[==========] Running 7 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 5 tests from LeaderRebalancerTest
[ RUN ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20250625 03:29:26.884001 426 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.106.190:40241
I20250625 03:29:26.885538 426 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20250625 03:29:26.886546 426 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250625 03:29:26.905552 435 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250625 03:29:26.905548 433 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250625 03:29:26.907487 426 server_base.cc:1048] running on GCE node
W20250625 03:29:26.905555 432 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250625 03:29:28.111917 426 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250625 03:29:28.112257 426 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250625 03:29:28.112468 426 hybrid_clock.cc:648] HybridClock initialized: now 1750822168112443 us; error 0 us; skew 500 ppm
I20250625 03:29:28.113314 426 server_base.cc:848] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250625 03:29:28.120946 426 webserver.cc:469] Webserver started at http://127.0.106.190:38835/ using document root <none> and password file <none>
I20250625 03:29:28.121882 426 fs_manager.cc:362] Metadata directory not provided
I20250625 03:29:28.122121 426 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250625 03:29:28.122584 426 server_base.cc:896] This appears to be a new deployment of Kudu; creating new FS layout
I20250625 03:29:28.128747 426 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1750822166717217-426-0/minicluster-data/master-0-root/instance:
uuid: "6d77fec2c20d4c8a8ab0a1c00980f333"
format_stamp: "Formatted at 2025-06-25 03:29:28 on dist-test-slave-lj23"
I20250625 03:29:28.137073 426 fs_manager.cc:696] Time spent creating directory manager: real 0.007s user 0.007s sys 0.001s
I20250625 03:29:28.143234 441 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250625 03:29:28.144532 426 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20250625 03:29:28.144976 426 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1750822166717217-426-0/minicluster-data/master-0-root
uuid: "6d77fec2c20d4c8a8ab0a1c00980f333"
format_stamp: "Formatted at 2025-06-25 03:29:28 on dist-test-slave-lj23"
I20250625 03:29:28.145328 426 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1750822166717217-426-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1750822166717217-426-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1750822166717217-426-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250625 03:29:28.205971 426 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250625 03:29:28.207522 426 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20250625 03:29:28.208036 426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250625 03:29:28.291342 426 rpc_server.cc:307] RPC server started. Bound to: 127.0.106.190:40241
I20250625 03:29:28.291417 492 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.106.190:40241 every 8 connection(s)
I20250625 03:29:28.299221 493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:29:28.323058 493 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6d77fec2c20d4c8a8ab0a1c00980f333: Bootstrap starting.
I20250625 03:29:28.329408 493 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6d77fec2c20d4c8a8ab0a1c00980f333: Neither blocks nor log segments found. Creating new log.
I20250625 03:29:28.331895 493 log.cc:826] T 00000000000000000000000000000000 P 6d77fec2c20d4c8a8ab0a1c00980f333: Log is configured to *not* fsync() on all Append() calls
I20250625 03:29:28.336555 493 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6d77fec2c20d4c8a8ab0a1c00980f333: No bootstrap required, opened a new log
I20250625 03:29:28.357676 493 raft_consensus.cc:357] T 00000000000000000000000000000000 P 6d77fec2c20d4c8a8ab0a1c00980f333 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d77fec2c20d4c8a8ab0a1c00980f333" member_type: VOTER }
I20250625 03:29:28.358232 493 raft_consensus.cc:383] T 00000000000000000000000000000000 P 6d77fec2c20d4c8a8ab0a1c00980f333 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:29:28.358498 493 raft_consensus.cc:738] T 00000000000000000000000000000000 P 6d77fec2c20d4c8a8ab0a1c00980f333 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d77fec2c20d4c8a8ab0a1c00980f333, State: Initialized, Role: FOLLOWER
I20250625 03:29:28.359298 493 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6d77fec2c20d4c8a8ab0a1c00980f333 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d77fec2c20d4c8a8ab0a1c00980f333" member_type: VOTER }
I20250625 03:29:28.360365 493 raft_consensus.cc:397] T 00000000000000000000000000000000 P 6d77fec2c20d4c8a8ab0a1c00980f333 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250625 03:29:28.360648 493 raft_consensus.cc:491] T 00000000000000000000000000000000 P 6d77fec2c20d4c8a8ab0a1c00980f333 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250625 03:29:28.360991 493 raft_consensus.cc:3058] T 00000000000000000000000000000000 P 6d77fec2c20d4c8a8ab0a1c00980f333 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:29:28.365201 493 raft_consensus.cc:513] T 00000000000000000000000000000000 P 6d77fec2c20d4c8a8ab0a1c00980f333 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d77fec2c20d4c8a8ab0a1c00980f333" member_type: VOTER }
I20250625 03:29:28.365975 493 leader_election.cc:304] T 00000000000000000000000000000000 P 6d77fec2c20d4c8a8ab0a1c00980f333 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6d77fec2c20d4c8a8ab0a1c00980f333; no voters:
I20250625 03:29:28.368189 493 leader_election.cc:290] T 00000000000000000000000000000000 P 6d77fec2c20d4c8a8ab0a1c00980f333 [CANDIDATE]: Term 1 election: Requested vote from peers
I20250625 03:29:28.368482 496 raft_consensus.cc:2802] T 00000000000000000000000000000000 P 6d77fec2c20d4c8a8ab0a1c00980f333 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:29:28.371912 496 raft_consensus.cc:695] T 00000000000000000000000000000000 P 6d77fec2c20d4c8a8ab0a1c00980f333 [term 1 LEADER]: Becoming Leader. State: Replica: 6d77fec2c20d4c8a8ab0a1c00980f333, State: Running, Role: LEADER
I20250625 03:29:28.372911 496 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6d77fec2c20d4c8a8ab0a1c00980f333 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d77fec2c20d4c8a8ab0a1c00980f333" member_type: VOTER }
I20250625 03:29:28.373948 493 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6d77fec2c20d4c8a8ab0a1c00980f333 [sys.catalog]: configured and running, proceeding with master startup.
I20250625 03:29:28.388597 497 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6d77fec2c20d4c8a8ab0a1c00980f333 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6d77fec2c20d4c8a8ab0a1c00980f333" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d77fec2c20d4c8a8ab0a1c00980f333" member_type: VOTER } }
I20250625 03:29:28.388784 498 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6d77fec2c20d4c8a8ab0a1c00980f333 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6d77fec2c20d4c8a8ab0a1c00980f333. Latest consensus state: current_term: 1 leader_uuid: "6d77fec2c20d4c8a8ab0a1c00980f333" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d77fec2c20d4c8a8ab0a1c00980f333" member_type: VOTER } }
I20250625 03:29:28.389725 497 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6d77fec2c20d4c8a8ab0a1c00980f333 [sys.catalog]: This master's current role is: LEADER
I20250625 03:29:28.390026 498 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6d77fec2c20d4c8a8ab0a1c00980f333 [sys.catalog]: This master's current role is: LEADER
I20250625 03:29:28.397526 505 catalog_manager.cc:1477] Loading table and tablet metadata into memory...
I20250625 03:29:28.411471 505 catalog_manager.cc:1486] Initializing Kudu cluster ID...
I20250625 03:29:28.414119 426 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20250625 03:29:28.431208 505 catalog_manager.cc:1349] Generated new cluster ID: a5ab042603144b13b8aa35292231765a
I20250625 03:29:28.431531 505 catalog_manager.cc:1497] Initializing Kudu internal certificate authority...
I20250625 03:29:28.465821 505 catalog_manager.cc:1372] Generated new certificate authority record
I20250625 03:29:28.467420 505 catalog_manager.cc:1506] Loading token signing keys...
I20250625 03:29:28.482975 505 catalog_manager.cc:5955] T 00000000000000000000000000000000 P 6d77fec2c20d4c8a8ab0a1c00980f333: Generated new TSK 0
I20250625 03:29:28.483901 505 catalog_manager.cc:1516] Initializing in-progress tserver states...
I20250625 03:29:28.546082 426 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250625 03:29:28.555763 515 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250625 03:29:28.558719 516 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250625 03:29:28.563184 426 server_base.cc:1048] running on GCE node
W20250625 03:29:28.563303 518 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250625 03:29:28.564312 426 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250625 03:29:28.564538 426 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250625 03:29:28.564708 426 hybrid_clock.cc:648] HybridClock initialized: now 1750822168564690 us; error 0 us; skew 500 ppm
I20250625 03:29:28.565291 426 server_base.cc:848] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250625 03:29:28.573786 426 webserver.cc:469] Webserver started at http://127.0.106.129:43921/ using document root <none> and password file <none>
I20250625 03:29:28.574357 426 fs_manager.cc:362] Metadata directory not provided
I20250625 03:29:28.574556 426 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250625 03:29:28.574843 426 server_base.cc:896] This appears to be a new deployment of Kudu; creating new FS layout
I20250625 03:29:28.575991 426 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1750822166717217-426-0/minicluster-data/ts-0-root/instance:
uuid: "4967ac6ac157453da1a6e7b4f1ed8d61"
format_stamp: "Formatted at 2025-06-25 03:29:28 on dist-test-slave-lj23"
I20250625 03:29:28.583038 426 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20250625 03:29:28.587613 523 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250625 03:29:28.588500 426 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20250625 03:29:28.588801 426 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1750822166717217-426-0/minicluster-data/ts-0-root
uuid: "4967ac6ac157453da1a6e7b4f1ed8d61"
format_stamp: "Formatted at 2025-06-25 03:29:28 on dist-test-slave-lj23"
I20250625 03:29:28.589082 426 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1750822166717217-426-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1750822166717217-426-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1750822166717217-426-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250625 03:29:28.618363 426 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250625 03:29:28.620397 426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250625 03:29:28.623397 426 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20250625 03:29:28.628938 426 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250625 03:29:28.629200 426 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250625 03:29:28.629498 426 ts_tablet_manager.cc:610] Registered 0 tablets
I20250625 03:29:28.629655 426 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250625 03:29:28.755944 426 rpc_server.cc:307] RPC server started. Bound to: 127.0.106.129:41137
I20250625 03:29:28.756057 585 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.106.129:41137 every 8 connection(s)
I20250625 03:29:28.764165 426 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250625 03:29:28.776984 590 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250625 03:29:28.778028 591 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250625 03:29:28.788718 593 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250625 03:29:28.789434 426 server_base.cc:1048] running on GCE node
I20250625 03:29:28.790494 426 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250625 03:29:28.790726 426 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250625 03:29:28.790930 426 hybrid_clock.cc:648] HybridClock initialized: now 1750822168790914 us; error 0 us; skew 500 ppm
I20250625 03:29:28.791720 426 server_base.cc:848] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250625 03:29:28.794581 586 heartbeater.cc:344] Connected to a master server at 127.0.106.190:40241
I20250625 03:29:28.795253 586 heartbeater.cc:461] Registering TS with master...
I20250625 03:29:28.796725 586 heartbeater.cc:507] Master 127.0.106.190:40241 requested a full tablet report, sending...
I20250625 03:29:28.800631 458 ts_manager.cc:194] Registered new tserver with Master: 4967ac6ac157453da1a6e7b4f1ed8d61 (127.0.106.129:41137)
I20250625 03:29:28.802300 426 webserver.cc:469] Webserver started at http://127.0.106.130:43953/ using document root <none> and password file <none>
I20250625 03:29:28.803021 426 fs_manager.cc:362] Metadata directory not provided
I20250625 03:29:28.803318 426 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250625 03:29:28.803653 426 server_base.cc:896] This appears to be a new deployment of Kudu; creating new FS layout
I20250625 03:29:28.804044 458 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47202
I20250625 03:29:28.805219 426 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1750822166717217-426-0/minicluster-data/ts-1-root/instance:
uuid: "7b40d12015744366a464f1be5675cfb9"
format_stamp: "Formatted at 2025-06-25 03:29:28 on dist-test-slave-lj23"
I20250625 03:29:28.812269 426 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20250625 03:29:28.818044 598 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250625 03:29:28.818919 426 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20250625 03:29:28.819264 426 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1750822166717217-426-0/minicluster-data/ts-1-root
uuid: "7b40d12015744366a464f1be5675cfb9"
format_stamp: "Formatted at 2025-06-25 03:29:28 on dist-test-slave-lj23"
I20250625 03:29:28.819633 426 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1750822166717217-426-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1750822166717217-426-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1750822166717217-426-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250625 03:29:28.845665 426 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250625 03:29:28.847352 426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250625 03:29:28.849002 426 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20250625 03:29:28.853168 426 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250625 03:29:28.853477 426 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250625 03:29:28.853765 426 ts_tablet_manager.cc:610] Registered 0 tablets
I20250625 03:29:28.853978 426 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250625 03:29:28.952896 426 rpc_server.cc:307] RPC server started. Bound to: 127.0.106.130:34581
I20250625 03:29:28.952971 660 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.106.130:34581 every 8 connection(s)
I20250625 03:29:28.963672 426 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20250625 03:29:28.975171 661 heartbeater.cc:344] Connected to a master server at 127.0.106.190:40241
I20250625 03:29:28.975657 661 heartbeater.cc:461] Registering TS with master...
W20250625 03:29:28.976143 665 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250625 03:29:28.976339 664 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250625 03:29:28.977391 661 heartbeater.cc:507] Master 127.0.106.190:40241 requested a full tablet report, sending...
I20250625 03:29:28.980737 458 ts_manager.cc:194] Registered new tserver with Master: 7b40d12015744366a464f1be5675cfb9 (127.0.106.130:34581)
I20250625 03:29:28.984493 458 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47206
W20250625 03:29:28.987103 667 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250625 03:29:28.989992 426 server_base.cc:1048] running on GCE node
I20250625 03:29:28.991079 426 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250625 03:29:28.991335 426 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250625 03:29:28.991531 426 hybrid_clock.cc:648] HybridClock initialized: now 1750822168991514 us; error 0 us; skew 500 ppm
I20250625 03:29:28.992092 426 server_base.cc:848] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250625 03:29:28.994717 426 webserver.cc:469] Webserver started at http://127.0.106.131:36011/ using document root <none> and password file <none>
I20250625 03:29:28.995214 426 fs_manager.cc:362] Metadata directory not provided
I20250625 03:29:28.995409 426 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250625 03:29:28.995679 426 server_base.cc:896] This appears to be a new deployment of Kudu; creating new FS layout
I20250625 03:29:28.996905 426 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1750822166717217-426-0/minicluster-data/ts-2-root/instance:
uuid: "57c574a183ee449ba3171ae11a734cc8"
format_stamp: "Formatted at 2025-06-25 03:29:28 on dist-test-slave-lj23"
I20250625 03:29:29.001533 426 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20250625 03:29:29.005004 672 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250625 03:29:29.005864 426 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20250625 03:29:29.006148 426 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1750822166717217-426-0/minicluster-data/ts-2-root
uuid: "57c574a183ee449ba3171ae11a734cc8"
format_stamp: "Formatted at 2025-06-25 03:29:28 on dist-test-slave-lj23"
I20250625 03:29:29.006407 426 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1750822166717217-426-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1750822166717217-426-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1750822166717217-426-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250625 03:29:29.037884 426 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250625 03:29:29.039161 426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250625 03:29:29.040994 426 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20250625 03:29:29.043522 426 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250625 03:29:29.043721 426 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250625 03:29:29.043978 426 ts_tablet_manager.cc:610] Registered 0 tablets
I20250625 03:29:29.044183 426 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20250625 03:29:29.159472 426 rpc_server.cc:307] RPC server started. Bound to: 127.0.106.131:35951
I20250625 03:29:29.159569 734 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.106.131:35951 every 8 connection(s)
I20250625 03:29:29.178355 735 heartbeater.cc:344] Connected to a master server at 127.0.106.190:40241
I20250625 03:29:29.178966 735 heartbeater.cc:461] Registering TS with master...
I20250625 03:29:29.180027 735 heartbeater.cc:507] Master 127.0.106.190:40241 requested a full tablet report, sending...
I20250625 03:29:29.182783 458 ts_manager.cc:194] Registered new tserver with Master: 57c574a183ee449ba3171ae11a734cc8 (127.0.106.131:35951)
I20250625 03:29:29.182960 426 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.018484754s
I20250625 03:29:29.184621 458 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47212
I20250625 03:29:29.187254 426 test_util.cc:276] Using random seed: 225809305
I20250625 03:29:29.247344 458 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47218:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 03:29:29.251123 458 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 03:29:29.384558 625 tablet_service.cc:1468] Processing CreateTablet for tablet 48a6f4f9f8cc41f48d562f310ec0b9d5 (DEFAULT_TABLE table=test-workload [id=ac76adfdb38e4178841a36b314be8202]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20250625 03:29:29.381088 700 tablet_service.cc:1468] Processing CreateTablet for tablet 4e9ead806c80443da83728a2f97fc310 (DEFAULT_TABLE table=test-workload [id=ac76adfdb38e4178841a36b314be8202]), partition=RANGE (key) PARTITION VALUES < 238609294
I20250625 03:29:29.384176 622 tablet_service.cc:1468] Processing CreateTablet for tablet 9dccb59457ba43efa6ba3f3290a028fd (DEFAULT_TABLE table=test-workload [id=ac76adfdb38e4178841a36b314be8202]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20250625 03:29:29.388305 626 tablet_service.cc:1468] Processing CreateTablet for tablet 4e9ead806c80443da83728a2f97fc310 (DEFAULT_TABLE table=test-workload [id=ac76adfdb38e4178841a36b314be8202]), partition=RANGE (key) PARTITION VALUES < 238609294
I20250625 03:29:29.384606 698 tablet_service.cc:1468] Processing CreateTablet for tablet 92d6dd32053d442ca03f15c290dc495e (DEFAULT_TABLE table=test-workload [id=ac76adfdb38e4178841a36b314be8202]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20250625 03:29:29.383026 623 tablet_service.cc:1468] Processing CreateTablet for tablet f9031be3db5846a194610fa6c83bc23c (DEFAULT_TABLE table=test-workload [id=ac76adfdb38e4178841a36b314be8202]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20250625 03:29:29.384892 699 tablet_service.cc:1468] Processing CreateTablet for tablet 48a6f4f9f8cc41f48d562f310ec0b9d5 (DEFAULT_TABLE table=test-workload [id=ac76adfdb38e4178841a36b314be8202]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20250625 03:29:29.390846 622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dccb59457ba43efa6ba3f3290a028fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:29:29.392335 621 tablet_service.cc:1468] Processing CreateTablet for tablet 777af158d52d4a9db024948c66182594 (DEFAULT_TABLE table=test-workload [id=ac76adfdb38e4178841a36b314be8202]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20250625 03:29:29.394050 699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48a6f4f9f8cc41f48d562f310ec0b9d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:29:29.384507 697 tablet_service.cc:1468] Processing CreateTablet for tablet f9031be3db5846a194610fa6c83bc23c (DEFAULT_TABLE table=test-workload [id=ac76adfdb38e4178841a36b314be8202]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20250625 03:29:29.384124 624 tablet_service.cc:1468] Processing CreateTablet for tablet 92d6dd32053d442ca03f15c290dc495e (DEFAULT_TABLE table=test-workload [id=ac76adfdb38e4178841a36b314be8202]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20250625 03:29:29.399281 625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48a6f4f9f8cc41f48d562f310ec0b9d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:29:29.398168 695 tablet_service.cc:1468] Processing CreateTablet for tablet 777af158d52d4a9db024948c66182594 (DEFAULT_TABLE table=test-workload [id=ac76adfdb38e4178841a36b314be8202]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20250625 03:29:29.395629 696 tablet_service.cc:1468] Processing CreateTablet for tablet 9dccb59457ba43efa6ba3f3290a028fd (DEFAULT_TABLE table=test-workload [id=ac76adfdb38e4178841a36b314be8202]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20250625 03:29:29.406314 698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92d6dd32053d442ca03f15c290dc495e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:29:29.409049 694 tablet_service.cc:1468] Processing CreateTablet for tablet 0d8ad140d73a4a80a1d2316ef129935d (DEFAULT_TABLE table=test-workload [id=ac76adfdb38e4178841a36b314be8202]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20250625 03:29:29.409300 621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 777af158d52d4a9db024948c66182594. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:29:29.409811 697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9031be3db5846a194610fa6c83bc23c. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 03:29:29.410892 506 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20250625 03:29:29.412429 618 tablet_service.cc:1468] Processing CreateTablet for tablet d2dd339d32874178b80ad608b5b7ea25 (DEFAULT_TABLE table=test-workload [id=ac76adfdb38e4178841a36b314be8202]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20250625 03:29:29.414952 695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 777af158d52d4a9db024948c66182594. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:29:29.405758 620 tablet_service.cc:1468] Processing CreateTablet for tablet 0d8ad140d73a4a80a1d2316ef129935d (DEFAULT_TABLE table=test-workload [id=ac76adfdb38e4178841a36b314be8202]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20250625 03:29:29.412372 619 tablet_service.cc:1468] Processing CreateTablet for tablet 6e85647348794694a1c45563583c5896 (DEFAULT_TABLE table=test-workload [id=ac76adfdb38e4178841a36b314be8202]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20250625 03:29:29.420979 624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92d6dd32053d442ca03f15c290dc495e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:29:29.422693 700 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e9ead806c80443da83728a2f97fc310. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:29:29.436432 692 tablet_service.cc:1468] Processing CreateTablet for tablet d2dd339d32874178b80ad608b5b7ea25 (DEFAULT_TABLE table=test-workload [id=ac76adfdb38e4178841a36b314be8202]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20250625 03:29:29.440668 618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2dd339d32874178b80ad608b5b7ea25. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:29:29.422545 693 tablet_service.cc:1468] Processing CreateTablet for tablet 6e85647348794694a1c45563583c5896 (DEFAULT_TABLE table=test-workload [id=ac76adfdb38e4178841a36b314be8202]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20250625 03:29:29.441509 696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dccb59457ba43efa6ba3f3290a028fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:29:29.445886 692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2dd339d32874178b80ad608b5b7ea25. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:29:29.447530 620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d8ad140d73a4a80a1d2316ef129935d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:29:29.449211 619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e85647348794694a1c45563583c5896. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:29:29.458119 694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d8ad140d73a4a80a1d2316ef129935d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:29:29.460333 693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e85647348794694a1c45563583c5896. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:29:29.463047 623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9031be3db5846a194610fa6c83bc23c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:29:29.481997 626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e9ead806c80443da83728a2f97fc310. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:29:29.541741 753 tablet_bootstrap.cc:492] T 92d6dd32053d442ca03f15c290dc495e P 7b40d12015744366a464f1be5675cfb9: Bootstrap starting.
I20250625 03:29:29.550356 549 tablet_service.cc:1468] Processing CreateTablet for tablet 92d6dd32053d442ca03f15c290dc495e (DEFAULT_TABLE table=test-workload [id=ac76adfdb38e4178841a36b314be8202]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20250625 03:29:29.552580 550 tablet_service.cc:1468] Processing CreateTablet for tablet 48a6f4f9f8cc41f48d562f310ec0b9d5 (DEFAULT_TABLE table=test-workload [id=ac76adfdb38e4178841a36b314be8202]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20250625 03:29:29.558346 543 tablet_service.cc:1468] Processing CreateTablet for tablet d2dd339d32874178b80ad608b5b7ea25 (DEFAULT_TABLE table=test-workload [id=ac76adfdb38e4178841a36b314be8202]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20250625 03:29:29.561693 546 tablet_service.cc:1468] Processing CreateTablet for tablet 777af158d52d4a9db024948c66182594 (DEFAULT_TABLE table=test-workload [id=ac76adfdb38e4178841a36b314be8202]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20250625 03:29:29.563488 545 tablet_service.cc:1468] Processing CreateTablet for tablet 0d8ad140d73a4a80a1d2316ef129935d (DEFAULT_TABLE table=test-workload [id=ac76adfdb38e4178841a36b314be8202]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20250625 03:29:29.561146 551 tablet_service.cc:1468] Processing CreateTablet for tablet 4e9ead806c80443da83728a2f97fc310 (DEFAULT_TABLE table=test-workload [id=ac76adfdb38e4178841a36b314be8202]), partition=RANGE (key) PARTITION VALUES < 238609294
I20250625 03:29:29.568491 754 tablet_bootstrap.cc:492] T f9031be3db5846a194610fa6c83bc23c P 57c574a183ee449ba3171ae11a734cc8: Bootstrap starting.
I20250625 03:29:29.566784 547 tablet_service.cc:1468] Processing CreateTablet for tablet 9dccb59457ba43efa6ba3f3290a028fd (DEFAULT_TABLE table=test-workload [id=ac76adfdb38e4178841a36b314be8202]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20250625 03:29:29.571736 549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92d6dd32053d442ca03f15c290dc495e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:29:29.573103 550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48a6f4f9f8cc41f48d562f310ec0b9d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:29:29.568560 544 tablet_service.cc:1468] Processing CreateTablet for tablet 6e85647348794694a1c45563583c5896 (DEFAULT_TABLE table=test-workload [id=ac76adfdb38e4178841a36b314be8202]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20250625 03:29:29.567155 548 tablet_service.cc:1468] Processing CreateTablet for tablet f9031be3db5846a194610fa6c83bc23c (DEFAULT_TABLE table=test-workload [id=ac76adfdb38e4178841a36b314be8202]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20250625 03:29:29.579264 543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2dd339d32874178b80ad608b5b7ea25. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:29:29.586241 545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d8ad140d73a4a80a1d2316ef129935d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:29:29.588889 546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 777af158d52d4a9db024948c66182594. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:29:29.592711 548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9031be3db5846a194610fa6c83bc23c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:29:29.597128 547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dccb59457ba43efa6ba3f3290a028fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:29:29.599926 544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e85647348794694a1c45563583c5896. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:29:29.612233 551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e9ead806c80443da83728a2f97fc310. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:29:29.688786 753 tablet_bootstrap.cc:654] T 92d6dd32053d442ca03f15c290dc495e P 7b40d12015744366a464f1be5675cfb9: Neither blocks nor log segments found. Creating new log.
I20250625 03:29:29.710726 754 tablet_bootstrap.cc:654] T f9031be3db5846a194610fa6c83bc23c P 57c574a183ee449ba3171ae11a734cc8: Neither blocks nor log segments found. Creating new log.
I20250625 03:29:29.725375 755 tablet_bootstrap.cc:492] T 777af158d52d4a9db024948c66182594 P 4967ac6ac157453da1a6e7b4f1ed8d61: Bootstrap starting.
I20250625 03:29:29.729566 753 tablet_bootstrap.cc:492] T 92d6dd32053d442ca03f15c290dc495e P 7b40d12015744366a464f1be5675cfb9: No bootstrap required, opened a new log
I20250625 03:29:29.730176 753 ts_tablet_manager.cc:1397] T 92d6dd32053d442ca03f15c290dc495e P 7b40d12015744366a464f1be5675cfb9: Time spent bootstrapping tablet: real 0.223s user 0.013s sys 0.007s
I20250625 03:29:29.735908 755 tablet_bootstrap.cc:654] T 777af158d52d4a9db024948c66182594 P 4967ac6ac157453da1a6e7b4f1ed8d61: Neither blocks nor log segments found. Creating new log.
I20250625 03:29:29.733834 753 raft_consensus.cc:357] T 92d6dd32053d442ca03f15c290dc495e P 7b40d12015744366a464f1be5675cfb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:29.736486 753 raft_consensus.cc:383] T 92d6dd32053d442ca03f15c290dc495e P 7b40d12015744366a464f1be5675cfb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:29:29.736897 753 raft_consensus.cc:738] T 92d6dd32053d442ca03f15c290dc495e P 7b40d12015744366a464f1be5675cfb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b40d12015744366a464f1be5675cfb9, State: Initialized, Role: FOLLOWER
I20250625 03:29:29.737874 753 consensus_queue.cc:260] T 92d6dd32053d442ca03f15c290dc495e P 7b40d12015744366a464f1be5675cfb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:29.744042 661 heartbeater.cc:499] Master 127.0.106.190:40241 was elected leader, sending a full tablet report...
I20250625 03:29:29.745357 753 ts_tablet_manager.cc:1428] T 92d6dd32053d442ca03f15c290dc495e P 7b40d12015744366a464f1be5675cfb9: Time spent starting tablet: real 0.015s user 0.008s sys 0.004s
I20250625 03:29:29.746428 753 tablet_bootstrap.cc:492] T 0d8ad140d73a4a80a1d2316ef129935d P 7b40d12015744366a464f1be5675cfb9: Bootstrap starting.
I20250625 03:29:29.751565 754 tablet_bootstrap.cc:492] T f9031be3db5846a194610fa6c83bc23c P 57c574a183ee449ba3171ae11a734cc8: No bootstrap required, opened a new log
I20250625 03:29:29.752100 754 ts_tablet_manager.cc:1397] T f9031be3db5846a194610fa6c83bc23c P 57c574a183ee449ba3171ae11a734cc8: Time spent bootstrapping tablet: real 0.193s user 0.021s sys 0.007s
I20250625 03:29:29.755308 754 raft_consensus.cc:357] T f9031be3db5846a194610fa6c83bc23c P 57c574a183ee449ba3171ae11a734cc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:29.756040 754 raft_consensus.cc:383] T f9031be3db5846a194610fa6c83bc23c P 57c574a183ee449ba3171ae11a734cc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:29:29.756343 754 raft_consensus.cc:738] T f9031be3db5846a194610fa6c83bc23c P 57c574a183ee449ba3171ae11a734cc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57c574a183ee449ba3171ae11a734cc8, State: Initialized, Role: FOLLOWER
I20250625 03:29:29.757036 754 consensus_queue.cc:260] T f9031be3db5846a194610fa6c83bc23c P 57c574a183ee449ba3171ae11a734cc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:29.765507 735 heartbeater.cc:499] Master 127.0.106.190:40241 was elected leader, sending a full tablet report...
I20250625 03:29:29.767205 754 ts_tablet_manager.cc:1428] T f9031be3db5846a194610fa6c83bc23c P 57c574a183ee449ba3171ae11a734cc8: Time spent starting tablet: real 0.015s user 0.009s sys 0.004s
I20250625 03:29:29.768267 754 tablet_bootstrap.cc:492] T 4e9ead806c80443da83728a2f97fc310 P 57c574a183ee449ba3171ae11a734cc8: Bootstrap starting.
I20250625 03:29:29.775265 754 tablet_bootstrap.cc:654] T 4e9ead806c80443da83728a2f97fc310 P 57c574a183ee449ba3171ae11a734cc8: Neither blocks nor log segments found. Creating new log.
I20250625 03:29:29.775578 755 tablet_bootstrap.cc:492] T 777af158d52d4a9db024948c66182594 P 4967ac6ac157453da1a6e7b4f1ed8d61: No bootstrap required, opened a new log
I20250625 03:29:29.776094 755 ts_tablet_manager.cc:1397] T 777af158d52d4a9db024948c66182594 P 4967ac6ac157453da1a6e7b4f1ed8d61: Time spent bootstrapping tablet: real 0.051s user 0.020s sys 0.022s
I20250625 03:29:29.778133 753 tablet_bootstrap.cc:654] T 0d8ad140d73a4a80a1d2316ef129935d P 7b40d12015744366a464f1be5675cfb9: Neither blocks nor log segments found. Creating new log.
I20250625 03:29:29.779757 755 raft_consensus.cc:357] T 777af158d52d4a9db024948c66182594 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:29.780670 755 raft_consensus.cc:383] T 777af158d52d4a9db024948c66182594 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:29:29.781095 755 raft_consensus.cc:738] T 777af158d52d4a9db024948c66182594 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4967ac6ac157453da1a6e7b4f1ed8d61, State: Initialized, Role: FOLLOWER
I20250625 03:29:29.781886 755 consensus_queue.cc:260] T 777af158d52d4a9db024948c66182594 P 4967ac6ac157453da1a6e7b4f1ed8d61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:29.790930 586 heartbeater.cc:499] Master 127.0.106.190:40241 was elected leader, sending a full tablet report...
I20250625 03:29:29.792269 755 ts_tablet_manager.cc:1428] T 777af158d52d4a9db024948c66182594 P 4967ac6ac157453da1a6e7b4f1ed8d61: Time spent starting tablet: real 0.016s user 0.007s sys 0.007s
I20250625 03:29:29.793541 755 tablet_bootstrap.cc:492] T 0d8ad140d73a4a80a1d2316ef129935d P 4967ac6ac157453da1a6e7b4f1ed8d61: Bootstrap starting.
I20250625 03:29:29.800927 755 tablet_bootstrap.cc:654] T 0d8ad140d73a4a80a1d2316ef129935d P 4967ac6ac157453da1a6e7b4f1ed8d61: Neither blocks nor log segments found. Creating new log.
I20250625 03:29:29.819063 753 tablet_bootstrap.cc:492] T 0d8ad140d73a4a80a1d2316ef129935d P 7b40d12015744366a464f1be5675cfb9: No bootstrap required, opened a new log
I20250625 03:29:29.820616 753 ts_tablet_manager.cc:1397] T 0d8ad140d73a4a80a1d2316ef129935d P 7b40d12015744366a464f1be5675cfb9: Time spent bootstrapping tablet: real 0.074s user 0.009s sys 0.011s
I20250625 03:29:29.822853 754 tablet_bootstrap.cc:492] T 4e9ead806c80443da83728a2f97fc310 P 57c574a183ee449ba3171ae11a734cc8: No bootstrap required, opened a new log
I20250625 03:29:29.823375 754 ts_tablet_manager.cc:1397] T 4e9ead806c80443da83728a2f97fc310 P 57c574a183ee449ba3171ae11a734cc8: Time spent bootstrapping tablet: real 0.055s user 0.030s sys 0.021s
I20250625 03:29:29.824410 753 raft_consensus.cc:357] T 0d8ad140d73a4a80a1d2316ef129935d P 7b40d12015744366a464f1be5675cfb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:29.825409 753 raft_consensus.cc:383] T 0d8ad140d73a4a80a1d2316ef129935d P 7b40d12015744366a464f1be5675cfb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:29:29.825801 753 raft_consensus.cc:738] T 0d8ad140d73a4a80a1d2316ef129935d P 7b40d12015744366a464f1be5675cfb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b40d12015744366a464f1be5675cfb9, State: Initialized, Role: FOLLOWER
I20250625 03:29:29.826241 754 raft_consensus.cc:357] T 4e9ead806c80443da83728a2f97fc310 P 57c574a183ee449ba3171ae11a734cc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } } peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } }
I20250625 03:29:29.827011 754 raft_consensus.cc:383] T 4e9ead806c80443da83728a2f97fc310 P 57c574a183ee449ba3171ae11a734cc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:29:29.827415 754 raft_consensus.cc:738] T 4e9ead806c80443da83728a2f97fc310 P 57c574a183ee449ba3171ae11a734cc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57c574a183ee449ba3171ae11a734cc8, State: Initialized, Role: FOLLOWER
I20250625 03:29:29.826855 753 consensus_queue.cc:260] T 0d8ad140d73a4a80a1d2316ef129935d P 7b40d12015744366a464f1be5675cfb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:29.828217 754 consensus_queue.cc:260] T 4e9ead806c80443da83728a2f97fc310 P 57c574a183ee449ba3171ae11a734cc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } } peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } }
I20250625 03:29:29.830732 754 ts_tablet_manager.cc:1428] T 4e9ead806c80443da83728a2f97fc310 P 57c574a183ee449ba3171ae11a734cc8: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20250625 03:29:29.831666 754 tablet_bootstrap.cc:492] T 92d6dd32053d442ca03f15c290dc495e P 57c574a183ee449ba3171ae11a734cc8: Bootstrap starting.
I20250625 03:29:29.835320 753 ts_tablet_manager.cc:1428] T 0d8ad140d73a4a80a1d2316ef129935d P 7b40d12015744366a464f1be5675cfb9: Time spent starting tablet: real 0.014s user 0.007s sys 0.002s
I20250625 03:29:29.836477 753 tablet_bootstrap.cc:492] T 777af158d52d4a9db024948c66182594 P 7b40d12015744366a464f1be5675cfb9: Bootstrap starting.
I20250625 03:29:29.838454 762 raft_consensus.cc:491] T 777af158d52d4a9db024948c66182594 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:29:29.839107 754 tablet_bootstrap.cc:654] T 92d6dd32053d442ca03f15c290dc495e P 57c574a183ee449ba3171ae11a734cc8: Neither blocks nor log segments found. Creating new log.
I20250625 03:29:29.838950 762 raft_consensus.cc:513] T 777af158d52d4a9db024948c66182594 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:29.846712 755 tablet_bootstrap.cc:492] T 0d8ad140d73a4a80a1d2316ef129935d P 4967ac6ac157453da1a6e7b4f1ed8d61: No bootstrap required, opened a new log
I20250625 03:29:29.847288 755 ts_tablet_manager.cc:1397] T 0d8ad140d73a4a80a1d2316ef129935d P 4967ac6ac157453da1a6e7b4f1ed8d61: Time spent bootstrapping tablet: real 0.054s user 0.029s sys 0.016s
I20250625 03:29:29.848179 759 raft_consensus.cc:491] T 0d8ad140d73a4a80a1d2316ef129935d P 7b40d12015744366a464f1be5675cfb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:29:29.848650 759 raft_consensus.cc:513] T 0d8ad140d73a4a80a1d2316ef129935d P 7b40d12015744366a464f1be5675cfb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:29.852650 759 leader_election.cc:290] T 0d8ad140d73a4a80a1d2316ef129935d P 7b40d12015744366a464f1be5675cfb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4967ac6ac157453da1a6e7b4f1ed8d61 (127.0.106.129:41137), 57c574a183ee449ba3171ae11a734cc8 (127.0.106.131:35951)
I20250625 03:29:29.853605 762 leader_election.cc:290] T 777af158d52d4a9db024948c66182594 P 4967ac6ac157453da1a6e7b4f1ed8d61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b40d12015744366a464f1be5675cfb9 (127.0.106.130:34581), 57c574a183ee449ba3171ae11a734cc8 (127.0.106.131:35951)
I20250625 03:29:29.855567 755 raft_consensus.cc:357] T 0d8ad140d73a4a80a1d2316ef129935d P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:29.858855 753 tablet_bootstrap.cc:654] T 777af158d52d4a9db024948c66182594 P 7b40d12015744366a464f1be5675cfb9: Neither blocks nor log segments found. Creating new log.
I20250625 03:29:29.859112 755 raft_consensus.cc:383] T 0d8ad140d73a4a80a1d2316ef129935d P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:29:29.861168 755 raft_consensus.cc:738] T 0d8ad140d73a4a80a1d2316ef129935d P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4967ac6ac157453da1a6e7b4f1ed8d61, State: Initialized, Role: FOLLOWER
I20250625 03:29:29.898962 755 consensus_queue.cc:260] T 0d8ad140d73a4a80a1d2316ef129935d P 4967ac6ac157453da1a6e7b4f1ed8d61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:29.904538 760 raft_consensus.cc:491] T f9031be3db5846a194610fa6c83bc23c P 57c574a183ee449ba3171ae11a734cc8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:29:29.905071 760 raft_consensus.cc:513] T f9031be3db5846a194610fa6c83bc23c P 57c574a183ee449ba3171ae11a734cc8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:29.906112 755 ts_tablet_manager.cc:1428] T 0d8ad140d73a4a80a1d2316ef129935d P 4967ac6ac157453da1a6e7b4f1ed8d61: Time spent starting tablet: real 0.058s user 0.004s sys 0.003s
I20250625 03:29:29.907608 760 leader_election.cc:290] T f9031be3db5846a194610fa6c83bc23c P 57c574a183ee449ba3171ae11a734cc8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4967ac6ac157453da1a6e7b4f1ed8d61 (127.0.106.129:41137), 7b40d12015744366a464f1be5675cfb9 (127.0.106.130:34581)
W20250625 03:29:29.921492 736 tablet.cc:2378] T 4e9ead806c80443da83728a2f97fc310 P 57c574a183ee449ba3171ae11a734cc8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20250625 03:29:29.922677 755 tablet_bootstrap.cc:492] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 4967ac6ac157453da1a6e7b4f1ed8d61: Bootstrap starting.
I20250625 03:29:29.925276 753 tablet_bootstrap.cc:492] T 777af158d52d4a9db024948c66182594 P 7b40d12015744366a464f1be5675cfb9: No bootstrap required, opened a new log
I20250625 03:29:29.925750 753 ts_tablet_manager.cc:1397] T 777af158d52d4a9db024948c66182594 P 7b40d12015744366a464f1be5675cfb9: Time spent bootstrapping tablet: real 0.089s user 0.015s sys 0.010s
I20250625 03:29:29.943936 755 tablet_bootstrap.cc:654] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 4967ac6ac157453da1a6e7b4f1ed8d61: Neither blocks nor log segments found. Creating new log.
I20250625 03:29:29.948318 753 raft_consensus.cc:357] T 777af158d52d4a9db024948c66182594 P 7b40d12015744366a464f1be5675cfb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:29.949566 753 raft_consensus.cc:383] T 777af158d52d4a9db024948c66182594 P 7b40d12015744366a464f1be5675cfb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:29:29.950407 754 tablet_bootstrap.cc:492] T 92d6dd32053d442ca03f15c290dc495e P 57c574a183ee449ba3171ae11a734cc8: No bootstrap required, opened a new log
I20250625 03:29:29.950961 754 ts_tablet_manager.cc:1397] T 92d6dd32053d442ca03f15c290dc495e P 57c574a183ee449ba3171ae11a734cc8: Time spent bootstrapping tablet: real 0.119s user 0.011s sys 0.026s
I20250625 03:29:29.952273 753 raft_consensus.cc:738] T 777af158d52d4a9db024948c66182594 P 7b40d12015744366a464f1be5675cfb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b40d12015744366a464f1be5675cfb9, State: Initialized, Role: FOLLOWER
I20250625 03:29:29.957993 754 raft_consensus.cc:357] T 92d6dd32053d442ca03f15c290dc495e P 57c574a183ee449ba3171ae11a734cc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:29.958830 754 raft_consensus.cc:383] T 92d6dd32053d442ca03f15c290dc495e P 57c574a183ee449ba3171ae11a734cc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:29:29.959122 754 raft_consensus.cc:738] T 92d6dd32053d442ca03f15c290dc495e P 57c574a183ee449ba3171ae11a734cc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57c574a183ee449ba3171ae11a734cc8, State: Initialized, Role: FOLLOWER
I20250625 03:29:29.960286 636 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "777af158d52d4a9db024948c66182594" candidate_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b40d12015744366a464f1be5675cfb9" is_pre_election: true
I20250625 03:29:29.960304 754 consensus_queue.cc:260] T 92d6dd32053d442ca03f15c290dc495e P 57c574a183ee449ba3171ae11a734cc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:29.962855 753 consensus_queue.cc:260] T 777af158d52d4a9db024948c66182594 P 7b40d12015744366a464f1be5675cfb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:29.969244 753 ts_tablet_manager.cc:1428] T 777af158d52d4a9db024948c66182594 P 7b40d12015744366a464f1be5675cfb9: Time spent starting tablet: real 0.043s user 0.008s sys 0.000s
I20250625 03:29:29.970319 753 tablet_bootstrap.cc:492] T 6e85647348794694a1c45563583c5896 P 7b40d12015744366a464f1be5675cfb9: Bootstrap starting.
I20250625 03:29:29.975306 760 raft_consensus.cc:491] T 4e9ead806c80443da83728a2f97fc310 P 57c574a183ee449ba3171ae11a734cc8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:29:29.975840 760 raft_consensus.cc:513] T 4e9ead806c80443da83728a2f97fc310 P 57c574a183ee449ba3171ae11a734cc8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } } peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } }
I20250625 03:29:29.976756 754 ts_tablet_manager.cc:1428] T 92d6dd32053d442ca03f15c290dc495e P 57c574a183ee449ba3171ae11a734cc8: Time spent starting tablet: real 0.025s user 0.007s sys 0.003s
I20250625 03:29:29.970891 636 raft_consensus.cc:2466] T 777af158d52d4a9db024948c66182594 P 7b40d12015744366a464f1be5675cfb9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4967ac6ac157453da1a6e7b4f1ed8d61 in term 0.
I20250625 03:29:29.977754 760 leader_election.cc:290] T 4e9ead806c80443da83728a2f97fc310 P 57c574a183ee449ba3171ae11a734cc8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4967ac6ac157453da1a6e7b4f1ed8d61 (127.0.106.129:41137), 7b40d12015744366a464f1be5675cfb9 (127.0.106.130:34581)
I20250625 03:29:29.991091 754 tablet_bootstrap.cc:492] T d2dd339d32874178b80ad608b5b7ea25 P 57c574a183ee449ba3171ae11a734cc8: Bootstrap starting.
I20250625 03:29:29.992764 527 leader_election.cc:304] T 777af158d52d4a9db024948c66182594 P 4967ac6ac157453da1a6e7b4f1ed8d61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4967ac6ac157453da1a6e7b4f1ed8d61, 7b40d12015744366a464f1be5675cfb9; no voters:
I20250625 03:29:29.993655 762 raft_consensus.cc:2802] T 777af158d52d4a9db024948c66182594 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:29:29.994062 762 raft_consensus.cc:491] T 777af158d52d4a9db024948c66182594 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:29:29.994411 762 raft_consensus.cc:3058] T 777af158d52d4a9db024948c66182594 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:29:29.998492 710 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0d8ad140d73a4a80a1d2316ef129935d" candidate_uuid: "7b40d12015744366a464f1be5675cfb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57c574a183ee449ba3171ae11a734cc8" is_pre_election: true
I20250625 03:29:29.995545 753 tablet_bootstrap.cc:654] T 6e85647348794694a1c45563583c5896 P 7b40d12015744366a464f1be5675cfb9: Neither blocks nor log segments found. Creating new log.
W20250625 03:29:30.002871 599 leader_election.cc:343] T 0d8ad140d73a4a80a1d2316ef129935d P 7b40d12015744366a464f1be5675cfb9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57c574a183ee449ba3171ae11a734cc8 (127.0.106.131:35951): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:29:30.005102 762 raft_consensus.cc:513] T 777af158d52d4a9db024948c66182594 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:30.034240 759 raft_consensus.cc:491] T 92d6dd32053d442ca03f15c290dc495e P 7b40d12015744366a464f1be5675cfb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:29:30.036964 762 leader_election.cc:290] T 777af158d52d4a9db024948c66182594 P 4967ac6ac157453da1a6e7b4f1ed8d61 [CANDIDATE]: Term 1 election: Requested vote from peers 7b40d12015744366a464f1be5675cfb9 (127.0.106.130:34581), 57c574a183ee449ba3171ae11a734cc8 (127.0.106.131:35951)
I20250625 03:29:30.037783 762 raft_consensus.cc:491] T 0d8ad140d73a4a80a1d2316ef129935d P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:29:30.038365 762 raft_consensus.cc:513] T 0d8ad140d73a4a80a1d2316ef129935d P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:30.040380 755 tablet_bootstrap.cc:492] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 4967ac6ac157453da1a6e7b4f1ed8d61: No bootstrap required, opened a new log
I20250625 03:29:30.040989 755 ts_tablet_manager.cc:1397] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 4967ac6ac157453da1a6e7b4f1ed8d61: Time spent bootstrapping tablet: real 0.119s user 0.012s sys 0.011s
I20250625 03:29:30.036749 759 raft_consensus.cc:513] T 92d6dd32053d442ca03f15c290dc495e P 7b40d12015744366a464f1be5675cfb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:30.048002 636 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "777af158d52d4a9db024948c66182594" candidate_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b40d12015744366a464f1be5675cfb9"
I20250625 03:29:30.048689 636 raft_consensus.cc:3058] T 777af158d52d4a9db024948c66182594 P 7b40d12015744366a464f1be5675cfb9 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:29:30.056723 759 leader_election.cc:290] T 92d6dd32053d442ca03f15c290dc495e P 7b40d12015744366a464f1be5675cfb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4967ac6ac157453da1a6e7b4f1ed8d61 (127.0.106.129:41137), 57c574a183ee449ba3171ae11a734cc8 (127.0.106.131:35951)
I20250625 03:29:30.054076 762 leader_election.cc:290] T 0d8ad140d73a4a80a1d2316ef129935d P 4967ac6ac157453da1a6e7b4f1ed8d61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b40d12015744366a464f1be5675cfb9 (127.0.106.130:34581), 57c574a183ee449ba3171ae11a734cc8 (127.0.106.131:35951)
I20250625 03:29:30.059577 710 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "92d6dd32053d442ca03f15c290dc495e" candidate_uuid: "7b40d12015744366a464f1be5675cfb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57c574a183ee449ba3171ae11a734cc8" is_pre_election: true
I20250625 03:29:30.060830 710 raft_consensus.cc:2466] T 92d6dd32053d442ca03f15c290dc495e P 57c574a183ee449ba3171ae11a734cc8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b40d12015744366a464f1be5675cfb9 in term 0.
I20250625 03:29:30.065303 753 tablet_bootstrap.cc:492] T 6e85647348794694a1c45563583c5896 P 7b40d12015744366a464f1be5675cfb9: No bootstrap required, opened a new log
I20250625 03:29:30.065536 599 leader_election.cc:304] T 92d6dd32053d442ca03f15c290dc495e P 7b40d12015744366a464f1be5675cfb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57c574a183ee449ba3171ae11a734cc8, 7b40d12015744366a464f1be5675cfb9; no voters:
I20250625 03:29:30.065786 753 ts_tablet_manager.cc:1397] T 6e85647348794694a1c45563583c5896 P 7b40d12015744366a464f1be5675cfb9: Time spent bootstrapping tablet: real 0.096s user 0.008s sys 0.008s
I20250625 03:29:30.066617 759 raft_consensus.cc:2802] T 92d6dd32053d442ca03f15c290dc495e P 7b40d12015744366a464f1be5675cfb9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:29:30.066970 759 raft_consensus.cc:491] T 92d6dd32053d442ca03f15c290dc495e P 7b40d12015744366a464f1be5675cfb9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:29:30.067297 759 raft_consensus.cc:3058] T 92d6dd32053d442ca03f15c290dc495e P 7b40d12015744366a464f1be5675cfb9 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:29:30.072959 561 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f9031be3db5846a194610fa6c83bc23c" candidate_uuid: "57c574a183ee449ba3171ae11a734cc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" is_pre_election: true
I20250625 03:29:30.077468 560 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4e9ead806c80443da83728a2f97fc310" candidate_uuid: "57c574a183ee449ba3171ae11a734cc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" is_pre_election: true
I20250625 03:29:30.082226 753 raft_consensus.cc:357] T 6e85647348794694a1c45563583c5896 P 7b40d12015744366a464f1be5675cfb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
W20250625 03:29:30.084546 675 leader_election.cc:343] T f9031be3db5846a194610fa6c83bc23c P 57c574a183ee449ba3171ae11a734cc8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4967ac6ac157453da1a6e7b4f1ed8d61 (127.0.106.129:41137): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:29:30.083583 636 raft_consensus.cc:2466] T 777af158d52d4a9db024948c66182594 P 7b40d12015744366a464f1be5675cfb9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4967ac6ac157453da1a6e7b4f1ed8d61 in term 1.
I20250625 03:29:30.081099 635 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0d8ad140d73a4a80a1d2316ef129935d" candidate_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b40d12015744366a464f1be5675cfb9" is_pre_election: true
I20250625 03:29:30.082959 753 raft_consensus.cc:383] T 6e85647348794694a1c45563583c5896 P 7b40d12015744366a464f1be5675cfb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20250625 03:29:30.085235 675 leader_election.cc:343] T 4e9ead806c80443da83728a2f97fc310 P 57c574a183ee449ba3171ae11a734cc8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4967ac6ac157453da1a6e7b4f1ed8d61 (127.0.106.129:41137): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:29:30.100521 635 raft_consensus.cc:2466] T 0d8ad140d73a4a80a1d2316ef129935d P 7b40d12015744366a464f1be5675cfb9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4967ac6ac157453da1a6e7b4f1ed8d61 in term 0.
I20250625 03:29:30.100800 754 tablet_bootstrap.cc:654] T d2dd339d32874178b80ad608b5b7ea25 P 57c574a183ee449ba3171ae11a734cc8: Neither blocks nor log segments found. Creating new log.
I20250625 03:29:30.087980 527 leader_election.cc:304] T 777af158d52d4a9db024948c66182594 P 4967ac6ac157453da1a6e7b4f1ed8d61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4967ac6ac157453da1a6e7b4f1ed8d61, 7b40d12015744366a464f1be5675cfb9; no voters:
I20250625 03:29:30.088133 759 raft_consensus.cc:513] T 92d6dd32053d442ca03f15c290dc495e P 7b40d12015744366a464f1be5675cfb9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:30.098675 753 raft_consensus.cc:738] T 6e85647348794694a1c45563583c5896 P 7b40d12015744366a464f1be5675cfb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b40d12015744366a464f1be5675cfb9, State: Initialized, Role: FOLLOWER
I20250625 03:29:30.102387 561 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "92d6dd32053d442ca03f15c290dc495e" candidate_uuid: "7b40d12015744366a464f1be5675cfb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" is_pre_election: true
I20250625 03:29:30.104068 527 leader_election.cc:304] T 0d8ad140d73a4a80a1d2316ef129935d P 4967ac6ac157453da1a6e7b4f1ed8d61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4967ac6ac157453da1a6e7b4f1ed8d61, 7b40d12015744366a464f1be5675cfb9; no voters:
I20250625 03:29:30.104188 777 raft_consensus.cc:2802] T 777af158d52d4a9db024948c66182594 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:29:30.104111 708 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0d8ad140d73a4a80a1d2316ef129935d" candidate_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57c574a183ee449ba3171ae11a734cc8" is_pre_election: true
I20250625 03:29:30.105041 762 raft_consensus.cc:2802] T 0d8ad140d73a4a80a1d2316ef129935d P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:29:30.104100 560 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0d8ad140d73a4a80a1d2316ef129935d" candidate_uuid: "7b40d12015744366a464f1be5675cfb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" is_pre_election: true
I20250625 03:29:30.104949 710 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "777af158d52d4a9db024948c66182594" candidate_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57c574a183ee449ba3171ae11a734cc8" is_pre_election: true
I20250625 03:29:30.107290 762 raft_consensus.cc:491] T 0d8ad140d73a4a80a1d2316ef129935d P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:29:30.104228 709 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "777af158d52d4a9db024948c66182594" candidate_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57c574a183ee449ba3171ae11a734cc8"
W20250625 03:29:30.107765 601 leader_election.cc:343] T 92d6dd32053d442ca03f15c290dc495e P 7b40d12015744366a464f1be5675cfb9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4967ac6ac157453da1a6e7b4f1ed8d61 (127.0.106.129:41137): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:29:30.112460 762 raft_consensus.cc:3058] T 0d8ad140d73a4a80a1d2316ef129935d P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 0 FOLLOWER]: Advancing to term 1
W20250625 03:29:30.114362 524 leader_election.cc:343] T 777af158d52d4a9db024948c66182594 P 4967ac6ac157453da1a6e7b4f1ed8d61 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 57c574a183ee449ba3171ae11a734cc8 (127.0.106.131:35951): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:29:30.106715 753 consensus_queue.cc:260] T 6e85647348794694a1c45563583c5896 P 7b40d12015744366a464f1be5675cfb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
W20250625 03:29:30.115731 524 leader_election.cc:343] T 0d8ad140d73a4a80a1d2316ef129935d P 4967ac6ac157453da1a6e7b4f1ed8d61 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57c574a183ee449ba3171ae11a734cc8 (127.0.106.131:35951): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:29:30.118094 755 raft_consensus.cc:357] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
W20250625 03:29:30.117762 524 leader_election.cc:343] T 777af158d52d4a9db024948c66182594 P 4967ac6ac157453da1a6e7b4f1ed8d61 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57c574a183ee449ba3171ae11a734cc8 (127.0.106.131:35951): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:29:30.119074 755 raft_consensus.cc:383] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:29:30.119349 759 leader_election.cc:290] T 92d6dd32053d442ca03f15c290dc495e P 7b40d12015744366a464f1be5675cfb9 [CANDIDATE]: Term 1 election: Requested vote from peers 4967ac6ac157453da1a6e7b4f1ed8d61 (127.0.106.129:41137), 57c574a183ee449ba3171ae11a734cc8 (127.0.106.131:35951)
I20250625 03:29:30.119459 755 raft_consensus.cc:738] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4967ac6ac157453da1a6e7b4f1ed8d61, State: Initialized, Role: FOLLOWER
I20250625 03:29:30.120249 561 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "92d6dd32053d442ca03f15c290dc495e" candidate_uuid: "7b40d12015744366a464f1be5675cfb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61"
I20250625 03:29:30.120306 755 consensus_queue.cc:260] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 4967ac6ac157453da1a6e7b4f1ed8d61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:30.121117 710 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "92d6dd32053d442ca03f15c290dc495e" candidate_uuid: "7b40d12015744366a464f1be5675cfb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57c574a183ee449ba3171ae11a734cc8"
I20250625 03:29:30.115546 777 raft_consensus.cc:695] T 777af158d52d4a9db024948c66182594 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 1 LEADER]: Becoming Leader. State: Replica: 4967ac6ac157453da1a6e7b4f1ed8d61, State: Running, Role: LEADER
I20250625 03:29:30.125315 710 raft_consensus.cc:3058] T 92d6dd32053d442ca03f15c290dc495e P 57c574a183ee449ba3171ae11a734cc8 [term 0 FOLLOWER]: Advancing to term 1
W20250625 03:29:30.125304 601 leader_election.cc:343] T 92d6dd32053d442ca03f15c290dc495e P 7b40d12015744366a464f1be5675cfb9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4967ac6ac157453da1a6e7b4f1ed8d61 (127.0.106.129:41137): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:29:30.131633 635 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f9031be3db5846a194610fa6c83bc23c" candidate_uuid: "57c574a183ee449ba3171ae11a734cc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b40d12015744366a464f1be5675cfb9" is_pre_election: true
I20250625 03:29:30.131597 762 raft_consensus.cc:513] T 0d8ad140d73a4a80a1d2316ef129935d P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:30.132970 755 ts_tablet_manager.cc:1428] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 4967ac6ac157453da1a6e7b4f1ed8d61: Time spent starting tablet: real 0.092s user 0.005s sys 0.015s
I20250625 03:29:30.133937 560 raft_consensus.cc:2391] T 0d8ad140d73a4a80a1d2316ef129935d P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7b40d12015744366a464f1be5675cfb9 in current term 1: Already voted for candidate 4967ac6ac157453da1a6e7b4f1ed8d61 in this term.
W20250625 03:29:30.134603 676 leader_election.cc:343] T f9031be3db5846a194610fa6c83bc23c P 57c574a183ee449ba3171ae11a734cc8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7b40d12015744366a464f1be5675cfb9 (127.0.106.130:34581): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:29:30.135257 755 tablet_bootstrap.cc:492] T d2dd339d32874178b80ad608b5b7ea25 P 4967ac6ac157453da1a6e7b4f1ed8d61: Bootstrap starting.
I20250625 03:29:30.135390 636 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4e9ead806c80443da83728a2f97fc310" candidate_uuid: "57c574a183ee449ba3171ae11a734cc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b40d12015744366a464f1be5675cfb9" is_pre_election: true
I20250625 03:29:30.135076 676 leader_election.cc:304] T f9031be3db5846a194610fa6c83bc23c P 57c574a183ee449ba3171ae11a734cc8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57c574a183ee449ba3171ae11a734cc8; no voters: 4967ac6ac157453da1a6e7b4f1ed8d61, 7b40d12015744366a464f1be5675cfb9
I20250625 03:29:30.137275 760 raft_consensus.cc:2747] T f9031be3db5846a194610fa6c83bc23c P 57c574a183ee449ba3171ae11a734cc8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:29:30.137923 635 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0d8ad140d73a4a80a1d2316ef129935d" candidate_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b40d12015744366a464f1be5675cfb9"
I20250625 03:29:30.138127 708 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0d8ad140d73a4a80a1d2316ef129935d" candidate_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57c574a183ee449ba3171ae11a734cc8"
I20250625 03:29:30.138504 635 raft_consensus.cc:3058] T 0d8ad140d73a4a80a1d2316ef129935d P 7b40d12015744366a464f1be5675cfb9 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:29:30.139263 762 leader_election.cc:290] T 0d8ad140d73a4a80a1d2316ef129935d P 4967ac6ac157453da1a6e7b4f1ed8d61 [CANDIDATE]: Term 1 election: Requested vote from peers 7b40d12015744366a464f1be5675cfb9 (127.0.106.130:34581), 57c574a183ee449ba3171ae11a734cc8 (127.0.106.131:35951)
W20250625 03:29:30.139523 524 leader_election.cc:343] T 0d8ad140d73a4a80a1d2316ef129935d P 4967ac6ac157453da1a6e7b4f1ed8d61 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 57c574a183ee449ba3171ae11a734cc8 (127.0.106.131:35951): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:29:30.135749 777 consensus_queue.cc:237] T 777af158d52d4a9db024948c66182594 P 4967ac6ac157453da1a6e7b4f1ed8d61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:30.141065 753 ts_tablet_manager.cc:1428] T 6e85647348794694a1c45563583c5896 P 7b40d12015744366a464f1be5675cfb9: Time spent starting tablet: real 0.075s user 0.016s sys 0.009s
I20250625 03:29:30.146576 753 tablet_bootstrap.cc:492] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 7b40d12015744366a464f1be5675cfb9: Bootstrap starting.
W20250625 03:29:30.140828 676 leader_election.cc:343] T 4e9ead806c80443da83728a2f97fc310 P 57c574a183ee449ba3171ae11a734cc8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7b40d12015744366a464f1be5675cfb9 (127.0.106.130:34581): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:29:30.147128 676 leader_election.cc:304] T 4e9ead806c80443da83728a2f97fc310 P 57c574a183ee449ba3171ae11a734cc8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57c574a183ee449ba3171ae11a734cc8; no voters: 4967ac6ac157453da1a6e7b4f1ed8d61, 7b40d12015744366a464f1be5675cfb9
I20250625 03:29:30.148089 760 raft_consensus.cc:2747] T 4e9ead806c80443da83728a2f97fc310 P 57c574a183ee449ba3171ae11a734cc8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:29:30.157930 710 raft_consensus.cc:2466] T 92d6dd32053d442ca03f15c290dc495e P 57c574a183ee449ba3171ae11a734cc8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b40d12015744366a464f1be5675cfb9 in term 1.
I20250625 03:29:30.162544 599 leader_election.cc:304] T 92d6dd32053d442ca03f15c290dc495e P 7b40d12015744366a464f1be5675cfb9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57c574a183ee449ba3171ae11a734cc8, 7b40d12015744366a464f1be5675cfb9; no voters: 4967ac6ac157453da1a6e7b4f1ed8d61
I20250625 03:29:30.163460 635 raft_consensus.cc:2466] T 0d8ad140d73a4a80a1d2316ef129935d P 7b40d12015744366a464f1be5675cfb9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4967ac6ac157453da1a6e7b4f1ed8d61 in term 1.
I20250625 03:29:30.166003 780 raft_consensus.cc:2802] T 92d6dd32053d442ca03f15c290dc495e P 7b40d12015744366a464f1be5675cfb9 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:29:30.166121 527 leader_election.cc:304] T 0d8ad140d73a4a80a1d2316ef129935d P 4967ac6ac157453da1a6e7b4f1ed8d61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4967ac6ac157453da1a6e7b4f1ed8d61, 7b40d12015744366a464f1be5675cfb9; no voters: 57c574a183ee449ba3171ae11a734cc8
I20250625 03:29:30.166924 754 tablet_bootstrap.cc:492] T d2dd339d32874178b80ad608b5b7ea25 P 57c574a183ee449ba3171ae11a734cc8: No bootstrap required, opened a new log
I20250625 03:29:30.167295 777 raft_consensus.cc:2802] T 0d8ad140d73a4a80a1d2316ef129935d P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:29:30.167383 754 ts_tablet_manager.cc:1397] T d2dd339d32874178b80ad608b5b7ea25 P 57c574a183ee449ba3171ae11a734cc8: Time spent bootstrapping tablet: real 0.177s user 0.009s sys 0.033s
I20250625 03:29:30.168071 777 raft_consensus.cc:695] T 0d8ad140d73a4a80a1d2316ef129935d P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 1 LEADER]: Becoming Leader. State: Replica: 4967ac6ac157453da1a6e7b4f1ed8d61, State: Running, Role: LEADER
I20250625 03:29:30.166730 780 raft_consensus.cc:695] T 92d6dd32053d442ca03f15c290dc495e P 7b40d12015744366a464f1be5675cfb9 [term 1 LEADER]: Becoming Leader. State: Replica: 7b40d12015744366a464f1be5675cfb9, State: Running, Role: LEADER
I20250625 03:29:30.169883 777 consensus_queue.cc:237] T 0d8ad140d73a4a80a1d2316ef129935d P 4967ac6ac157453da1a6e7b4f1ed8d61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:30.171383 753 tablet_bootstrap.cc:654] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 7b40d12015744366a464f1be5675cfb9: Neither blocks nor log segments found. Creating new log.
I20250625 03:29:30.171314 755 tablet_bootstrap.cc:654] T d2dd339d32874178b80ad608b5b7ea25 P 4967ac6ac157453da1a6e7b4f1ed8d61: Neither blocks nor log segments found. Creating new log.
I20250625 03:29:30.170490 780 consensus_queue.cc:237] T 92d6dd32053d442ca03f15c290dc495e P 7b40d12015744366a464f1be5675cfb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:30.173131 754 raft_consensus.cc:357] T d2dd339d32874178b80ad608b5b7ea25 P 57c574a183ee449ba3171ae11a734cc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:30.174865 754 raft_consensus.cc:383] T d2dd339d32874178b80ad608b5b7ea25 P 57c574a183ee449ba3171ae11a734cc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:29:30.175911 754 raft_consensus.cc:738] T d2dd339d32874178b80ad608b5b7ea25 P 57c574a183ee449ba3171ae11a734cc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57c574a183ee449ba3171ae11a734cc8, State: Initialized, Role: FOLLOWER
I20250625 03:29:30.176975 754 consensus_queue.cc:260] T d2dd339d32874178b80ad608b5b7ea25 P 57c574a183ee449ba3171ae11a734cc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:30.179479 601 leader_election.cc:304] T 0d8ad140d73a4a80a1d2316ef129935d P 7b40d12015744366a464f1be5675cfb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b40d12015744366a464f1be5675cfb9; no voters: 4967ac6ac157453da1a6e7b4f1ed8d61, 57c574a183ee449ba3171ae11a734cc8
I20250625 03:29:30.182602 759 raft_consensus.cc:2747] T 0d8ad140d73a4a80a1d2316ef129935d P 7b40d12015744366a464f1be5675cfb9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:29:30.188717 754 ts_tablet_manager.cc:1428] T d2dd339d32874178b80ad608b5b7ea25 P 57c574a183ee449ba3171ae11a734cc8: Time spent starting tablet: real 0.021s user 0.006s sys 0.002s
I20250625 03:29:30.190466 754 tablet_bootstrap.cc:492] T 0d8ad140d73a4a80a1d2316ef129935d P 57c574a183ee449ba3171ae11a734cc8: Bootstrap starting.
I20250625 03:29:30.189909 457 catalog_manager.cc:5582] T 777af158d52d4a9db024948c66182594 P 4967ac6ac157453da1a6e7b4f1ed8d61 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4967ac6ac157453da1a6e7b4f1ed8d61 (127.0.106.129). New cstate: current_term: 1 leader_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } health_report { overall_health: UNKNOWN } } }
I20250625 03:29:30.203939 754 tablet_bootstrap.cc:654] T 0d8ad140d73a4a80a1d2316ef129935d P 57c574a183ee449ba3171ae11a734cc8: Neither blocks nor log segments found. Creating new log.
I20250625 03:29:30.220320 458 catalog_manager.cc:5582] T 92d6dd32053d442ca03f15c290dc495e P 7b40d12015744366a464f1be5675cfb9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b40d12015744366a464f1be5675cfb9 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "7b40d12015744366a464f1be5675cfb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } health_report { overall_health: UNKNOWN } } }
I20250625 03:29:30.226819 753 tablet_bootstrap.cc:492] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 7b40d12015744366a464f1be5675cfb9: No bootstrap required, opened a new log
I20250625 03:29:30.227919 753 ts_tablet_manager.cc:1397] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 7b40d12015744366a464f1be5675cfb9: Time spent bootstrapping tablet: real 0.082s user 0.007s sys 0.033s
I20250625 03:29:30.233049 753 raft_consensus.cc:357] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 7b40d12015744366a464f1be5675cfb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:30.233515 754 tablet_bootstrap.cc:492] T 0d8ad140d73a4a80a1d2316ef129935d P 57c574a183ee449ba3171ae11a734cc8: No bootstrap required, opened a new log
I20250625 03:29:30.233820 753 raft_consensus.cc:383] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 7b40d12015744366a464f1be5675cfb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:29:30.234218 754 ts_tablet_manager.cc:1397] T 0d8ad140d73a4a80a1d2316ef129935d P 57c574a183ee449ba3171ae11a734cc8: Time spent bootstrapping tablet: real 0.044s user 0.018s sys 0.000s
I20250625 03:29:30.234153 753 raft_consensus.cc:738] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 7b40d12015744366a464f1be5675cfb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b40d12015744366a464f1be5675cfb9, State: Initialized, Role: FOLLOWER
I20250625 03:29:30.235306 753 consensus_queue.cc:260] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 7b40d12015744366a464f1be5675cfb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:30.236871 755 tablet_bootstrap.cc:492] T d2dd339d32874178b80ad608b5b7ea25 P 4967ac6ac157453da1a6e7b4f1ed8d61: No bootstrap required, opened a new log
I20250625 03:29:30.237342 755 ts_tablet_manager.cc:1397] T d2dd339d32874178b80ad608b5b7ea25 P 4967ac6ac157453da1a6e7b4f1ed8d61: Time spent bootstrapping tablet: real 0.102s user 0.025s sys 0.005s
I20250625 03:29:30.237922 753 ts_tablet_manager.cc:1428] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 7b40d12015744366a464f1be5675cfb9: Time spent starting tablet: real 0.009s user 0.006s sys 0.000s
I20250625 03:29:30.237635 754 raft_consensus.cc:357] T 0d8ad140d73a4a80a1d2316ef129935d P 57c574a183ee449ba3171ae11a734cc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:30.238510 754 raft_consensus.cc:383] T 0d8ad140d73a4a80a1d2316ef129935d P 57c574a183ee449ba3171ae11a734cc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:29:30.239403 753 tablet_bootstrap.cc:492] T d2dd339d32874178b80ad608b5b7ea25 P 7b40d12015744366a464f1be5675cfb9: Bootstrap starting.
I20250625 03:29:30.238854 754 raft_consensus.cc:738] T 0d8ad140d73a4a80a1d2316ef129935d P 57c574a183ee449ba3171ae11a734cc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57c574a183ee449ba3171ae11a734cc8, State: Initialized, Role: FOLLOWER
I20250625 03:29:30.240231 754 consensus_queue.cc:260] T 0d8ad140d73a4a80a1d2316ef129935d P 57c574a183ee449ba3171ae11a734cc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:30.242851 754 ts_tablet_manager.cc:1428] T 0d8ad140d73a4a80a1d2316ef129935d P 57c574a183ee449ba3171ae11a734cc8: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20250625 03:29:30.245582 754 tablet_bootstrap.cc:492] T 777af158d52d4a9db024948c66182594 P 57c574a183ee449ba3171ae11a734cc8: Bootstrap starting.
I20250625 03:29:30.249076 753 tablet_bootstrap.cc:654] T d2dd339d32874178b80ad608b5b7ea25 P 7b40d12015744366a464f1be5675cfb9: Neither blocks nor log segments found. Creating new log.
I20250625 03:29:30.253060 755 raft_consensus.cc:357] T d2dd339d32874178b80ad608b5b7ea25 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:30.253829 755 raft_consensus.cc:383] T d2dd339d32874178b80ad608b5b7ea25 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:29:30.254175 755 raft_consensus.cc:738] T d2dd339d32874178b80ad608b5b7ea25 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4967ac6ac157453da1a6e7b4f1ed8d61, State: Initialized, Role: FOLLOWER
I20250625 03:29:30.254853 755 consensus_queue.cc:260] T d2dd339d32874178b80ad608b5b7ea25 P 4967ac6ac157453da1a6e7b4f1ed8d61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:30.261150 755 ts_tablet_manager.cc:1428] T d2dd339d32874178b80ad608b5b7ea25 P 4967ac6ac157453da1a6e7b4f1ed8d61: Time spent starting tablet: real 0.023s user 0.004s sys 0.004s
I20250625 03:29:30.262310 755 tablet_bootstrap.cc:492] T 92d6dd32053d442ca03f15c290dc495e P 4967ac6ac157453da1a6e7b4f1ed8d61: Bootstrap starting.
I20250625 03:29:30.270435 754 tablet_bootstrap.cc:654] T 777af158d52d4a9db024948c66182594 P 57c574a183ee449ba3171ae11a734cc8: Neither blocks nor log segments found. Creating new log.
I20250625 03:29:30.271364 755 tablet_bootstrap.cc:654] T 92d6dd32053d442ca03f15c290dc495e P 4967ac6ac157453da1a6e7b4f1ed8d61: Neither blocks nor log segments found. Creating new log.
I20250625 03:29:30.276237 777 raft_consensus.cc:491] T d2dd339d32874178b80ad608b5b7ea25 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:29:30.276907 777 raft_consensus.cc:513] T d2dd339d32874178b80ad608b5b7ea25 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:30.278652 780 raft_consensus.cc:491] T 6e85647348794694a1c45563583c5896 P 7b40d12015744366a464f1be5675cfb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:29:30.279109 780 raft_consensus.cc:513] T 6e85647348794694a1c45563583c5896 P 7b40d12015744366a464f1be5675cfb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:30.280431 710 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d2dd339d32874178b80ad608b5b7ea25" candidate_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57c574a183ee449ba3171ae11a734cc8" is_pre_election: true
I20250625 03:29:30.281159 710 raft_consensus.cc:2466] T d2dd339d32874178b80ad608b5b7ea25 P 57c574a183ee449ba3171ae11a734cc8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4967ac6ac157453da1a6e7b4f1ed8d61 in term 0.
I20250625 03:29:30.281388 635 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d2dd339d32874178b80ad608b5b7ea25" candidate_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b40d12015744366a464f1be5675cfb9" is_pre_election: true
I20250625 03:29:30.282945 710 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6e85647348794694a1c45563583c5896" candidate_uuid: "7b40d12015744366a464f1be5675cfb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57c574a183ee449ba3171ae11a734cc8" is_pre_election: true
I20250625 03:29:30.282881 524 leader_election.cc:304] T d2dd339d32874178b80ad608b5b7ea25 P 4967ac6ac157453da1a6e7b4f1ed8d61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4967ac6ac157453da1a6e7b4f1ed8d61, 57c574a183ee449ba3171ae11a734cc8; no voters:
W20250625 03:29:30.284303 599 leader_election.cc:343] T 6e85647348794694a1c45563583c5896 P 7b40d12015744366a464f1be5675cfb9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57c574a183ee449ba3171ae11a734cc8 (127.0.106.131:35951): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:29:30.281200 780 leader_election.cc:290] T 6e85647348794694a1c45563583c5896 P 7b40d12015744366a464f1be5675cfb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4967ac6ac157453da1a6e7b4f1ed8d61 (127.0.106.129:41137), 57c574a183ee449ba3171ae11a734cc8 (127.0.106.131:35951)
I20250625 03:29:30.285519 560 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6e85647348794694a1c45563583c5896" candidate_uuid: "7b40d12015744366a464f1be5675cfb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" is_pre_election: true
I20250625 03:29:30.284842 762 raft_consensus.cc:2802] T d2dd339d32874178b80ad608b5b7ea25 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:29:30.286664 762 raft_consensus.cc:491] T d2dd339d32874178b80ad608b5b7ea25 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:29:30.287025 762 raft_consensus.cc:3058] T d2dd339d32874178b80ad608b5b7ea25 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:29:30.287910 755 tablet_bootstrap.cc:492] T 92d6dd32053d442ca03f15c290dc495e P 4967ac6ac157453da1a6e7b4f1ed8d61: No bootstrap required, opened a new log
I20250625 03:29:30.288241 753 tablet_bootstrap.cc:492] T d2dd339d32874178b80ad608b5b7ea25 P 7b40d12015744366a464f1be5675cfb9: No bootstrap required, opened a new log
I20250625 03:29:30.288406 755 ts_tablet_manager.cc:1397] T 92d6dd32053d442ca03f15c290dc495e P 4967ac6ac157453da1a6e7b4f1ed8d61: Time spent bootstrapping tablet: real 0.026s user 0.013s sys 0.001s
I20250625 03:29:30.288688 753 ts_tablet_manager.cc:1397] T d2dd339d32874178b80ad608b5b7ea25 P 7b40d12015744366a464f1be5675cfb9: Time spent bootstrapping tablet: real 0.050s user 0.024s sys 0.015s
I20250625 03:29:30.291688 753 raft_consensus.cc:357] T d2dd339d32874178b80ad608b5b7ea25 P 7b40d12015744366a464f1be5675cfb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:30.292626 753 raft_consensus.cc:383] T d2dd339d32874178b80ad608b5b7ea25 P 7b40d12015744366a464f1be5675cfb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:29:30.291919 755 raft_consensus.cc:357] T 92d6dd32053d442ca03f15c290dc495e P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
W20250625 03:29:30.292901 601 leader_election.cc:343] T 6e85647348794694a1c45563583c5896 P 7b40d12015744366a464f1be5675cfb9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4967ac6ac157453da1a6e7b4f1ed8d61 (127.0.106.129:41137): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:29:30.293015 753 raft_consensus.cc:738] T d2dd339d32874178b80ad608b5b7ea25 P 7b40d12015744366a464f1be5675cfb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b40d12015744366a464f1be5675cfb9, State: Initialized, Role: FOLLOWER
I20250625 03:29:30.293210 755 raft_consensus.cc:383] T 92d6dd32053d442ca03f15c290dc495e P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:29:30.293403 601 leader_election.cc:304] T 6e85647348794694a1c45563583c5896 P 7b40d12015744366a464f1be5675cfb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b40d12015744366a464f1be5675cfb9; no voters: 4967ac6ac157453da1a6e7b4f1ed8d61, 57c574a183ee449ba3171ae11a734cc8
I20250625 03:29:30.294164 780 raft_consensus.cc:2747] T 6e85647348794694a1c45563583c5896 P 7b40d12015744366a464f1be5675cfb9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:29:30.293892 753 consensus_queue.cc:260] T d2dd339d32874178b80ad608b5b7ea25 P 7b40d12015744366a464f1be5675cfb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:30.293567 755 raft_consensus.cc:738] T 92d6dd32053d442ca03f15c290dc495e P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4967ac6ac157453da1a6e7b4f1ed8d61, State: Initialized, Role: FOLLOWER
W20250625 03:29:30.291815 527 leader_election.cc:343] T d2dd339d32874178b80ad608b5b7ea25 P 4967ac6ac157453da1a6e7b4f1ed8d61 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7b40d12015744366a464f1be5675cfb9 (127.0.106.130:34581): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:29:30.295281 754 tablet_bootstrap.cc:492] T 777af158d52d4a9db024948c66182594 P 57c574a183ee449ba3171ae11a734cc8: No bootstrap required, opened a new log
I20250625 03:29:30.295748 754 ts_tablet_manager.cc:1397] T 777af158d52d4a9db024948c66182594 P 57c574a183ee449ba3171ae11a734cc8: Time spent bootstrapping tablet: real 0.050s user 0.011s sys 0.002s
I20250625 03:29:30.295497 755 consensus_queue.cc:260] T 92d6dd32053d442ca03f15c290dc495e P 4967ac6ac157453da1a6e7b4f1ed8d61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:30.297299 753 ts_tablet_manager.cc:1428] T d2dd339d32874178b80ad608b5b7ea25 P 7b40d12015744366a464f1be5675cfb9: Time spent starting tablet: real 0.008s user 0.005s sys 0.003s
I20250625 03:29:30.298103 755 ts_tablet_manager.cc:1428] T 92d6dd32053d442ca03f15c290dc495e P 4967ac6ac157453da1a6e7b4f1ed8d61: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
I20250625 03:29:30.294646 777 leader_election.cc:290] T d2dd339d32874178b80ad608b5b7ea25 P 4967ac6ac157453da1a6e7b4f1ed8d61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b40d12015744366a464f1be5675cfb9 (127.0.106.130:34581), 57c574a183ee449ba3171ae11a734cc8 (127.0.106.131:35951)
I20250625 03:29:30.298261 753 tablet_bootstrap.cc:492] T 4e9ead806c80443da83728a2f97fc310 P 7b40d12015744366a464f1be5675cfb9: Bootstrap starting.
I20250625 03:29:30.299055 755 tablet_bootstrap.cc:492] T 6e85647348794694a1c45563583c5896 P 4967ac6ac157453da1a6e7b4f1ed8d61: Bootstrap starting.
I20250625 03:29:30.298786 754 raft_consensus.cc:357] T 777af158d52d4a9db024948c66182594 P 57c574a183ee449ba3171ae11a734cc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:30.299497 754 raft_consensus.cc:383] T 777af158d52d4a9db024948c66182594 P 57c574a183ee449ba3171ae11a734cc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:29:30.302140 762 raft_consensus.cc:513] T d2dd339d32874178b80ad608b5b7ea25 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:30.305173 762 leader_election.cc:290] T d2dd339d32874178b80ad608b5b7ea25 P 4967ac6ac157453da1a6e7b4f1ed8d61 [CANDIDATE]: Term 1 election: Requested vote from peers 7b40d12015744366a464f1be5675cfb9 (127.0.106.130:34581), 57c574a183ee449ba3171ae11a734cc8 (127.0.106.131:35951)
I20250625 03:29:30.307662 710 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d2dd339d32874178b80ad608b5b7ea25" candidate_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57c574a183ee449ba3171ae11a734cc8"
I20250625 03:29:30.308300 710 raft_consensus.cc:3058] T d2dd339d32874178b80ad608b5b7ea25 P 57c574a183ee449ba3171ae11a734cc8 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:29:30.309736 753 tablet_bootstrap.cc:654] T 4e9ead806c80443da83728a2f97fc310 P 7b40d12015744366a464f1be5675cfb9: Neither blocks nor log segments found. Creating new log.
I20250625 03:29:30.311585 635 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d2dd339d32874178b80ad608b5b7ea25" candidate_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b40d12015744366a464f1be5675cfb9"
I20250625 03:29:30.312227 635 raft_consensus.cc:3058] T d2dd339d32874178b80ad608b5b7ea25 P 7b40d12015744366a464f1be5675cfb9 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:29:30.299798 754 raft_consensus.cc:738] T 777af158d52d4a9db024948c66182594 P 57c574a183ee449ba3171ae11a734cc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57c574a183ee449ba3171ae11a734cc8, State: Initialized, Role: FOLLOWER
I20250625 03:29:30.316413 710 raft_consensus.cc:2466] T d2dd339d32874178b80ad608b5b7ea25 P 57c574a183ee449ba3171ae11a734cc8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4967ac6ac157453da1a6e7b4f1ed8d61 in term 1.
I20250625 03:29:30.317370 755 tablet_bootstrap.cc:654] T 6e85647348794694a1c45563583c5896 P 4967ac6ac157453da1a6e7b4f1ed8d61: Neither blocks nor log segments found. Creating new log.
I20250625 03:29:30.317718 524 leader_election.cc:304] T d2dd339d32874178b80ad608b5b7ea25 P 4967ac6ac157453da1a6e7b4f1ed8d61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4967ac6ac157453da1a6e7b4f1ed8d61, 57c574a183ee449ba3171ae11a734cc8; no voters:
I20250625 03:29:30.318914 762 raft_consensus.cc:2802] T d2dd339d32874178b80ad608b5b7ea25 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:29:30.319448 762 raft_consensus.cc:695] T d2dd339d32874178b80ad608b5b7ea25 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 1 LEADER]: Becoming Leader. State: Replica: 4967ac6ac157453da1a6e7b4f1ed8d61, State: Running, Role: LEADER
I20250625 03:29:30.320351 762 consensus_queue.cc:237] T d2dd339d32874178b80ad608b5b7ea25 P 4967ac6ac157453da1a6e7b4f1ed8d61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:30.321503 754 consensus_queue.cc:260] T 777af158d52d4a9db024948c66182594 P 57c574a183ee449ba3171ae11a734cc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:30.325083 754 ts_tablet_manager.cc:1428] T 777af158d52d4a9db024948c66182594 P 57c574a183ee449ba3171ae11a734cc8: Time spent starting tablet: real 0.029s user 0.005s sys 0.002s
I20250625 03:29:30.327431 635 raft_consensus.cc:2466] T d2dd339d32874178b80ad608b5b7ea25 P 7b40d12015744366a464f1be5675cfb9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4967ac6ac157453da1a6e7b4f1ed8d61 in term 1.
I20250625 03:29:30.332458 754 tablet_bootstrap.cc:492] T 6e85647348794694a1c45563583c5896 P 57c574a183ee449ba3171ae11a734cc8: Bootstrap starting.
I20250625 03:29:30.342048 753 tablet_bootstrap.cc:492] T 4e9ead806c80443da83728a2f97fc310 P 7b40d12015744366a464f1be5675cfb9: No bootstrap required, opened a new log
I20250625 03:29:30.342729 753 ts_tablet_manager.cc:1397] T 4e9ead806c80443da83728a2f97fc310 P 7b40d12015744366a464f1be5675cfb9: Time spent bootstrapping tablet: real 0.045s user 0.003s sys 0.020s
I20250625 03:29:30.346819 753 raft_consensus.cc:357] T 4e9ead806c80443da83728a2f97fc310 P 7b40d12015744366a464f1be5675cfb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } } peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } }
I20250625 03:29:30.347368 753 raft_consensus.cc:383] T 4e9ead806c80443da83728a2f97fc310 P 7b40d12015744366a464f1be5675cfb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:29:30.347605 753 raft_consensus.cc:738] T 4e9ead806c80443da83728a2f97fc310 P 7b40d12015744366a464f1be5675cfb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b40d12015744366a464f1be5675cfb9, State: Initialized, Role: FOLLOWER
I20250625 03:29:30.349797 755 tablet_bootstrap.cc:492] T 6e85647348794694a1c45563583c5896 P 4967ac6ac157453da1a6e7b4f1ed8d61: No bootstrap required, opened a new log
I20250625 03:29:30.350273 755 ts_tablet_manager.cc:1397] T 6e85647348794694a1c45563583c5896 P 4967ac6ac157453da1a6e7b4f1ed8d61: Time spent bootstrapping tablet: real 0.051s user 0.020s sys 0.007s
I20250625 03:29:30.353325 755 raft_consensus.cc:357] T 6e85647348794694a1c45563583c5896 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:30.353847 755 raft_consensus.cc:383] T 6e85647348794694a1c45563583c5896 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:29:30.354084 755 raft_consensus.cc:738] T 6e85647348794694a1c45563583c5896 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4967ac6ac157453da1a6e7b4f1ed8d61, State: Initialized, Role: FOLLOWER
I20250625 03:29:30.354611 755 consensus_queue.cc:260] T 6e85647348794694a1c45563583c5896 P 4967ac6ac157453da1a6e7b4f1ed8d61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:30.356477 755 ts_tablet_manager.cc:1428] T 6e85647348794694a1c45563583c5896 P 4967ac6ac157453da1a6e7b4f1ed8d61: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20250625 03:29:30.356520 457 catalog_manager.cc:5582] T 0d8ad140d73a4a80a1d2316ef129935d P 4967ac6ac157453da1a6e7b4f1ed8d61 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4967ac6ac157453da1a6e7b4f1ed8d61 (127.0.106.129). New cstate: current_term: 1 leader_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } health_report { overall_health: UNKNOWN } } }
I20250625 03:29:30.357029 753 consensus_queue.cc:260] T 4e9ead806c80443da83728a2f97fc310 P 7b40d12015744366a464f1be5675cfb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } } peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } }
I20250625 03:29:30.359944 753 ts_tablet_manager.cc:1428] T 4e9ead806c80443da83728a2f97fc310 P 7b40d12015744366a464f1be5675cfb9: Time spent starting tablet: real 0.016s user 0.005s sys 0.000s
I20250625 03:29:30.360772 755 tablet_bootstrap.cc:492] T f9031be3db5846a194610fa6c83bc23c P 4967ac6ac157453da1a6e7b4f1ed8d61: Bootstrap starting.
I20250625 03:29:30.360808 753 tablet_bootstrap.cc:492] T f9031be3db5846a194610fa6c83bc23c P 7b40d12015744366a464f1be5675cfb9: Bootstrap starting.
I20250625 03:29:30.368499 753 tablet_bootstrap.cc:654] T f9031be3db5846a194610fa6c83bc23c P 7b40d12015744366a464f1be5675cfb9: Neither blocks nor log segments found. Creating new log.
I20250625 03:29:30.369877 755 tablet_bootstrap.cc:654] T f9031be3db5846a194610fa6c83bc23c P 4967ac6ac157453da1a6e7b4f1ed8d61: Neither blocks nor log segments found. Creating new log.
I20250625 03:29:30.377595 754 tablet_bootstrap.cc:654] T 6e85647348794694a1c45563583c5896 P 57c574a183ee449ba3171ae11a734cc8: Neither blocks nor log segments found. Creating new log.
I20250625 03:29:30.397099 457 catalog_manager.cc:5582] T d2dd339d32874178b80ad608b5b7ea25 P 4967ac6ac157453da1a6e7b4f1ed8d61 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4967ac6ac157453da1a6e7b4f1ed8d61 (127.0.106.129). New cstate: current_term: 1 leader_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } health_report { overall_health: UNKNOWN } } }
I20250625 03:29:30.405045 753 tablet_bootstrap.cc:492] T f9031be3db5846a194610fa6c83bc23c P 7b40d12015744366a464f1be5675cfb9: No bootstrap required, opened a new log
I20250625 03:29:30.405567 753 ts_tablet_manager.cc:1397] T f9031be3db5846a194610fa6c83bc23c P 7b40d12015744366a464f1be5675cfb9: Time spent bootstrapping tablet: real 0.045s user 0.022s sys 0.014s
I20250625 03:29:30.406703 755 tablet_bootstrap.cc:492] T f9031be3db5846a194610fa6c83bc23c P 4967ac6ac157453da1a6e7b4f1ed8d61: No bootstrap required, opened a new log
I20250625 03:29:30.410164 754 tablet_bootstrap.cc:492] T 6e85647348794694a1c45563583c5896 P 57c574a183ee449ba3171ae11a734cc8: No bootstrap required, opened a new log
I20250625 03:29:30.407964 753 raft_consensus.cc:357] T f9031be3db5846a194610fa6c83bc23c P 7b40d12015744366a464f1be5675cfb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:30.410826 754 ts_tablet_manager.cc:1397] T 6e85647348794694a1c45563583c5896 P 57c574a183ee449ba3171ae11a734cc8: Time spent bootstrapping tablet: real 0.081s user 0.013s sys 0.002s
I20250625 03:29:30.410964 753 raft_consensus.cc:383] T f9031be3db5846a194610fa6c83bc23c P 7b40d12015744366a464f1be5675cfb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:29:30.411293 753 raft_consensus.cc:738] T f9031be3db5846a194610fa6c83bc23c P 7b40d12015744366a464f1be5675cfb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b40d12015744366a464f1be5675cfb9, State: Initialized, Role: FOLLOWER
I20250625 03:29:30.408090 755 ts_tablet_manager.cc:1397] T f9031be3db5846a194610fa6c83bc23c P 4967ac6ac157453da1a6e7b4f1ed8d61: Time spent bootstrapping tablet: real 0.048s user 0.013s sys 0.014s
I20250625 03:29:30.411963 753 consensus_queue.cc:260] T f9031be3db5846a194610fa6c83bc23c P 7b40d12015744366a464f1be5675cfb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
W20250625 03:29:30.414355 506 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20250625 03:29:30.414461 753 ts_tablet_manager.cc:1428] T f9031be3db5846a194610fa6c83bc23c P 7b40d12015744366a464f1be5675cfb9: Time spent starting tablet: real 0.009s user 0.004s sys 0.002s
I20250625 03:29:30.415387 753 tablet_bootstrap.cc:492] T 9dccb59457ba43efa6ba3f3290a028fd P 7b40d12015744366a464f1be5675cfb9: Bootstrap starting.
I20250625 03:29:30.415899 754 raft_consensus.cc:357] T 6e85647348794694a1c45563583c5896 P 57c574a183ee449ba3171ae11a734cc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:30.416642 754 raft_consensus.cc:383] T 6e85647348794694a1c45563583c5896 P 57c574a183ee449ba3171ae11a734cc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:29:30.417052 754 raft_consensus.cc:738] T 6e85647348794694a1c45563583c5896 P 57c574a183ee449ba3171ae11a734cc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57c574a183ee449ba3171ae11a734cc8, State: Initialized, Role: FOLLOWER
I20250625 03:29:30.417836 754 consensus_queue.cc:260] T 6e85647348794694a1c45563583c5896 P 57c574a183ee449ba3171ae11a734cc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:30.420538 754 ts_tablet_manager.cc:1428] T 6e85647348794694a1c45563583c5896 P 57c574a183ee449ba3171ae11a734cc8: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
I20250625 03:29:30.421312 753 tablet_bootstrap.cc:654] T 9dccb59457ba43efa6ba3f3290a028fd P 7b40d12015744366a464f1be5675cfb9: Neither blocks nor log segments found. Creating new log.
I20250625 03:29:30.414943 755 raft_consensus.cc:357] T f9031be3db5846a194610fa6c83bc23c P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:30.423856 755 raft_consensus.cc:383] T f9031be3db5846a194610fa6c83bc23c P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:29:30.424232 755 raft_consensus.cc:738] T f9031be3db5846a194610fa6c83bc23c P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4967ac6ac157453da1a6e7b4f1ed8d61, State: Initialized, Role: FOLLOWER
I20250625 03:29:30.424908 755 consensus_queue.cc:260] T f9031be3db5846a194610fa6c83bc23c P 4967ac6ac157453da1a6e7b4f1ed8d61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:30.430018 755 ts_tablet_manager.cc:1428] T f9031be3db5846a194610fa6c83bc23c P 4967ac6ac157453da1a6e7b4f1ed8d61: Time spent starting tablet: real 0.018s user 0.006s sys 0.000s
I20250625 03:29:30.431646 755 tablet_bootstrap.cc:492] T 9dccb59457ba43efa6ba3f3290a028fd P 4967ac6ac157453da1a6e7b4f1ed8d61: Bootstrap starting.
I20250625 03:29:30.433140 753 tablet_bootstrap.cc:492] T 9dccb59457ba43efa6ba3f3290a028fd P 7b40d12015744366a464f1be5675cfb9: No bootstrap required, opened a new log
I20250625 03:29:30.433579 753 ts_tablet_manager.cc:1397] T 9dccb59457ba43efa6ba3f3290a028fd P 7b40d12015744366a464f1be5675cfb9: Time spent bootstrapping tablet: real 0.018s user 0.009s sys 0.000s
I20250625 03:29:30.436479 753 raft_consensus.cc:357] T 9dccb59457ba43efa6ba3f3290a028fd P 7b40d12015744366a464f1be5675cfb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:30.437150 753 raft_consensus.cc:383] T 9dccb59457ba43efa6ba3f3290a028fd P 7b40d12015744366a464f1be5675cfb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:29:30.437430 753 raft_consensus.cc:738] T 9dccb59457ba43efa6ba3f3290a028fd P 7b40d12015744366a464f1be5675cfb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b40d12015744366a464f1be5675cfb9, State: Initialized, Role: FOLLOWER
I20250625 03:29:30.439106 755 tablet_bootstrap.cc:654] T 9dccb59457ba43efa6ba3f3290a028fd P 4967ac6ac157453da1a6e7b4f1ed8d61: Neither blocks nor log segments found. Creating new log.
I20250625 03:29:30.440565 754 tablet_bootstrap.cc:492] T 9dccb59457ba43efa6ba3f3290a028fd P 57c574a183ee449ba3171ae11a734cc8: Bootstrap starting.
I20250625 03:29:30.438679 753 consensus_queue.cc:260] T 9dccb59457ba43efa6ba3f3290a028fd P 7b40d12015744366a464f1be5675cfb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:30.443964 753 ts_tablet_manager.cc:1428] T 9dccb59457ba43efa6ba3f3290a028fd P 7b40d12015744366a464f1be5675cfb9: Time spent starting tablet: real 0.010s user 0.004s sys 0.003s
I20250625 03:29:30.454161 754 tablet_bootstrap.cc:654] T 9dccb59457ba43efa6ba3f3290a028fd P 57c574a183ee449ba3171ae11a734cc8: Neither blocks nor log segments found. Creating new log.
I20250625 03:29:30.458333 755 tablet_bootstrap.cc:492] T 9dccb59457ba43efa6ba3f3290a028fd P 4967ac6ac157453da1a6e7b4f1ed8d61: No bootstrap required, opened a new log
I20250625 03:29:30.458779 754 tablet_bootstrap.cc:492] T 9dccb59457ba43efa6ba3f3290a028fd P 57c574a183ee449ba3171ae11a734cc8: No bootstrap required, opened a new log
I20250625 03:29:30.458839 755 ts_tablet_manager.cc:1397] T 9dccb59457ba43efa6ba3f3290a028fd P 4967ac6ac157453da1a6e7b4f1ed8d61: Time spent bootstrapping tablet: real 0.027s user 0.014s sys 0.011s
I20250625 03:29:30.459427 754 ts_tablet_manager.cc:1397] T 9dccb59457ba43efa6ba3f3290a028fd P 57c574a183ee449ba3171ae11a734cc8: Time spent bootstrapping tablet: real 0.019s user 0.010s sys 0.001s
I20250625 03:29:30.462267 755 raft_consensus.cc:357] T 9dccb59457ba43efa6ba3f3290a028fd P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:30.462580 754 raft_consensus.cc:357] T 9dccb59457ba43efa6ba3f3290a028fd P 57c574a183ee449ba3171ae11a734cc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:30.462971 755 raft_consensus.cc:383] T 9dccb59457ba43efa6ba3f3290a028fd P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:29:30.463160 754 raft_consensus.cc:383] T 9dccb59457ba43efa6ba3f3290a028fd P 57c574a183ee449ba3171ae11a734cc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:29:30.463261 755 raft_consensus.cc:738] T 9dccb59457ba43efa6ba3f3290a028fd P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4967ac6ac157453da1a6e7b4f1ed8d61, State: Initialized, Role: FOLLOWER
I20250625 03:29:30.463460 754 raft_consensus.cc:738] T 9dccb59457ba43efa6ba3f3290a028fd P 57c574a183ee449ba3171ae11a734cc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57c574a183ee449ba3171ae11a734cc8, State: Initialized, Role: FOLLOWER
I20250625 03:29:30.463920 755 consensus_queue.cc:260] T 9dccb59457ba43efa6ba3f3290a028fd P 4967ac6ac157453da1a6e7b4f1ed8d61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:30.464169 754 consensus_queue.cc:260] T 9dccb59457ba43efa6ba3f3290a028fd P 57c574a183ee449ba3171ae11a734cc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:30.469266 755 ts_tablet_manager.cc:1428] T 9dccb59457ba43efa6ba3f3290a028fd P 4967ac6ac157453da1a6e7b4f1ed8d61: Time spent starting tablet: real 0.010s user 0.004s sys 0.004s
I20250625 03:29:30.470227 755 tablet_bootstrap.cc:492] T 4e9ead806c80443da83728a2f97fc310 P 4967ac6ac157453da1a6e7b4f1ed8d61: Bootstrap starting.
I20250625 03:29:30.471798 754 ts_tablet_manager.cc:1428] T 9dccb59457ba43efa6ba3f3290a028fd P 57c574a183ee449ba3171ae11a734cc8: Time spent starting tablet: real 0.012s user 0.007s sys 0.001s
I20250625 03:29:30.472817 754 tablet_bootstrap.cc:492] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 57c574a183ee449ba3171ae11a734cc8: Bootstrap starting.
I20250625 03:29:30.480609 755 tablet_bootstrap.cc:654] T 4e9ead806c80443da83728a2f97fc310 P 4967ac6ac157453da1a6e7b4f1ed8d61: Neither blocks nor log segments found. Creating new log.
I20250625 03:29:30.482143 754 tablet_bootstrap.cc:654] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 57c574a183ee449ba3171ae11a734cc8: Neither blocks nor log segments found. Creating new log.
I20250625 03:29:30.486476 755 tablet_bootstrap.cc:492] T 4e9ead806c80443da83728a2f97fc310 P 4967ac6ac157453da1a6e7b4f1ed8d61: No bootstrap required, opened a new log
I20250625 03:29:30.487068 755 ts_tablet_manager.cc:1397] T 4e9ead806c80443da83728a2f97fc310 P 4967ac6ac157453da1a6e7b4f1ed8d61: Time spent bootstrapping tablet: real 0.017s user 0.007s sys 0.003s
I20250625 03:29:30.489540 755 raft_consensus.cc:357] T 4e9ead806c80443da83728a2f97fc310 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } } peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } }
I20250625 03:29:30.490203 755 raft_consensus.cc:383] T 4e9ead806c80443da83728a2f97fc310 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:29:30.490242 762 raft_consensus.cc:491] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:29:30.490533 755 raft_consensus.cc:738] T 4e9ead806c80443da83728a2f97fc310 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4967ac6ac157453da1a6e7b4f1ed8d61, State: Initialized, Role: FOLLOWER
I20250625 03:29:30.490782 762 raft_consensus.cc:513] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:30.491209 755 consensus_queue.cc:260] T 4e9ead806c80443da83728a2f97fc310 P 4967ac6ac157453da1a6e7b4f1ed8d61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } } peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } }
I20250625 03:29:30.492805 762 leader_election.cc:290] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 4967ac6ac157453da1a6e7b4f1ed8d61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b40d12015744366a464f1be5675cfb9 (127.0.106.130:34581), 57c574a183ee449ba3171ae11a734cc8 (127.0.106.131:35951)
I20250625 03:29:30.490763 754 tablet_bootstrap.cc:492] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 57c574a183ee449ba3171ae11a734cc8: No bootstrap required, opened a new log
I20250625 03:29:30.493566 754 ts_tablet_manager.cc:1397] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 57c574a183ee449ba3171ae11a734cc8: Time spent bootstrapping tablet: real 0.021s user 0.007s sys 0.007s
I20250625 03:29:30.494134 635 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "48a6f4f9f8cc41f48d562f310ec0b9d5" candidate_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b40d12015744366a464f1be5675cfb9" is_pre_election: true
I20250625 03:29:30.494740 635 raft_consensus.cc:2466] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 7b40d12015744366a464f1be5675cfb9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4967ac6ac157453da1a6e7b4f1ed8d61 in term 0.
I20250625 03:29:30.495394 710 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "48a6f4f9f8cc41f48d562f310ec0b9d5" candidate_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57c574a183ee449ba3171ae11a734cc8" is_pre_election: true
I20250625 03:29:30.496536 755 ts_tablet_manager.cc:1428] T 4e9ead806c80443da83728a2f97fc310 P 4967ac6ac157453da1a6e7b4f1ed8d61: Time spent starting tablet: real 0.009s user 0.008s sys 0.000s
I20250625 03:29:30.504317 754 raft_consensus.cc:357] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 57c574a183ee449ba3171ae11a734cc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:30.504810 754 raft_consensus.cc:383] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 57c574a183ee449ba3171ae11a734cc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20250625 03:29:30.497248 524 leader_election.cc:343] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 4967ac6ac157453da1a6e7b4f1ed8d61 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57c574a183ee449ba3171ae11a734cc8 (127.0.106.131:35951): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:29:30.505210 754 raft_consensus.cc:738] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 57c574a183ee449ba3171ae11a734cc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57c574a183ee449ba3171ae11a734cc8, State: Initialized, Role: FOLLOWER
I20250625 03:29:30.505928 527 leader_election.cc:304] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 4967ac6ac157453da1a6e7b4f1ed8d61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4967ac6ac157453da1a6e7b4f1ed8d61, 7b40d12015744366a464f1be5675cfb9; no voters: 57c574a183ee449ba3171ae11a734cc8
I20250625 03:29:30.505955 754 consensus_queue.cc:260] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 57c574a183ee449ba3171ae11a734cc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:30.506793 762 raft_consensus.cc:2802] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:29:30.507200 762 raft_consensus.cc:491] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:29:30.507516 762 raft_consensus.cc:3058] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:29:30.510885 754 ts_tablet_manager.cc:1428] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 57c574a183ee449ba3171ae11a734cc8: Time spent starting tablet: real 0.017s user 0.005s sys 0.000s
I20250625 03:29:30.515286 762 raft_consensus.cc:513] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:30.516438 777 raft_consensus.cc:491] T 6e85647348794694a1c45563583c5896 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:29:30.516906 777 raft_consensus.cc:513] T 6e85647348794694a1c45563583c5896 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:30.518438 635 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "48a6f4f9f8cc41f48d562f310ec0b9d5" candidate_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b40d12015744366a464f1be5675cfb9"
I20250625 03:29:30.518980 635 raft_consensus.cc:3058] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 7b40d12015744366a464f1be5675cfb9 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:29:30.519203 777 leader_election.cc:290] T 6e85647348794694a1c45563583c5896 P 4967ac6ac157453da1a6e7b4f1ed8d61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b40d12015744366a464f1be5675cfb9 (127.0.106.130:34581), 57c574a183ee449ba3171ae11a734cc8 (127.0.106.131:35951)
I20250625 03:29:30.520721 636 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6e85647348794694a1c45563583c5896" candidate_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b40d12015744366a464f1be5675cfb9" is_pre_election: true
I20250625 03:29:30.521323 636 raft_consensus.cc:2466] T 6e85647348794694a1c45563583c5896 P 7b40d12015744366a464f1be5675cfb9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4967ac6ac157453da1a6e7b4f1ed8d61 in term 0.
I20250625 03:29:30.522396 527 leader_election.cc:304] T 6e85647348794694a1c45563583c5896 P 4967ac6ac157453da1a6e7b4f1ed8d61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4967ac6ac157453da1a6e7b4f1ed8d61, 7b40d12015744366a464f1be5675cfb9; no voters:
I20250625 03:29:30.522975 777 raft_consensus.cc:2802] T 6e85647348794694a1c45563583c5896 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:29:30.523325 777 raft_consensus.cc:491] T 6e85647348794694a1c45563583c5896 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:29:30.523639 777 raft_consensus.cc:3058] T 6e85647348794694a1c45563583c5896 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:29:30.523975 710 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6e85647348794694a1c45563583c5896" candidate_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57c574a183ee449ba3171ae11a734cc8" is_pre_election: true
I20250625 03:29:30.524598 710 raft_consensus.cc:2466] T 6e85647348794694a1c45563583c5896 P 57c574a183ee449ba3171ae11a734cc8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4967ac6ac157453da1a6e7b4f1ed8d61 in term 0.
I20250625 03:29:30.527232 710 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "48a6f4f9f8cc41f48d562f310ec0b9d5" candidate_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57c574a183ee449ba3171ae11a734cc8"
I20250625 03:29:30.527772 710 raft_consensus.cc:3058] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 57c574a183ee449ba3171ae11a734cc8 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:29:30.530614 777 raft_consensus.cc:513] T 6e85647348794694a1c45563583c5896 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:30.532701 777 leader_election.cc:290] T 6e85647348794694a1c45563583c5896 P 4967ac6ac157453da1a6e7b4f1ed8d61 [CANDIDATE]: Term 1 election: Requested vote from peers 7b40d12015744366a464f1be5675cfb9 (127.0.106.130:34581), 57c574a183ee449ba3171ae11a734cc8 (127.0.106.131:35951)
I20250625 03:29:30.534530 635 raft_consensus.cc:2466] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 7b40d12015744366a464f1be5675cfb9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4967ac6ac157453da1a6e7b4f1ed8d61 in term 1.
I20250625 03:29:30.535013 708 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6e85647348794694a1c45563583c5896" candidate_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57c574a183ee449ba3171ae11a734cc8"
I20250625 03:29:30.535013 636 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6e85647348794694a1c45563583c5896" candidate_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b40d12015744366a464f1be5675cfb9"
I20250625 03:29:30.535924 708 raft_consensus.cc:3058] T 6e85647348794694a1c45563583c5896 P 57c574a183ee449ba3171ae11a734cc8 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:29:30.535925 636 raft_consensus.cc:3058] T 6e85647348794694a1c45563583c5896 P 7b40d12015744366a464f1be5675cfb9 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:29:30.538846 710 raft_consensus.cc:2466] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 57c574a183ee449ba3171ae11a734cc8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4967ac6ac157453da1a6e7b4f1ed8d61 in term 1.
I20250625 03:29:30.539994 524 leader_election.cc:304] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 4967ac6ac157453da1a6e7b4f1ed8d61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4967ac6ac157453da1a6e7b4f1ed8d61, 57c574a183ee449ba3171ae11a734cc8; no voters:
I20250625 03:29:30.540984 762 leader_election.cc:290] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 4967ac6ac157453da1a6e7b4f1ed8d61 [CANDIDATE]: Term 1 election: Requested vote from peers 7b40d12015744366a464f1be5675cfb9 (127.0.106.130:34581), 57c574a183ee449ba3171ae11a734cc8 (127.0.106.131:35951)
I20250625 03:29:30.541649 762 raft_consensus.cc:2802] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:29:30.543036 762 raft_consensus.cc:695] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 1 LEADER]: Becoming Leader. State: Replica: 4967ac6ac157453da1a6e7b4f1ed8d61, State: Running, Role: LEADER
I20250625 03:29:30.543838 762 consensus_queue.cc:237] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 4967ac6ac157453da1a6e7b4f1ed8d61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:30.544575 636 raft_consensus.cc:2466] T 6e85647348794694a1c45563583c5896 P 7b40d12015744366a464f1be5675cfb9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4967ac6ac157453da1a6e7b4f1ed8d61 in term 1.
I20250625 03:29:30.545678 527 leader_election.cc:304] T 6e85647348794694a1c45563583c5896 P 4967ac6ac157453da1a6e7b4f1ed8d61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4967ac6ac157453da1a6e7b4f1ed8d61, 7b40d12015744366a464f1be5675cfb9; no voters:
I20250625 03:29:30.546412 777 raft_consensus.cc:2802] T 6e85647348794694a1c45563583c5896 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:29:30.546873 777 raft_consensus.cc:695] T 6e85647348794694a1c45563583c5896 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 1 LEADER]: Becoming Leader. State: Replica: 4967ac6ac157453da1a6e7b4f1ed8d61, State: Running, Role: LEADER
I20250625 03:29:30.547245 760 raft_consensus.cc:491] T 9dccb59457ba43efa6ba3f3290a028fd P 57c574a183ee449ba3171ae11a734cc8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:29:30.547072 708 raft_consensus.cc:2466] T 6e85647348794694a1c45563583c5896 P 57c574a183ee449ba3171ae11a734cc8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4967ac6ac157453da1a6e7b4f1ed8d61 in term 1.
I20250625 03:29:30.547688 760 raft_consensus.cc:513] T 9dccb59457ba43efa6ba3f3290a028fd P 57c574a183ee449ba3171ae11a734cc8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:30.547966 777 consensus_queue.cc:237] T 6e85647348794694a1c45563583c5896 P 4967ac6ac157453da1a6e7b4f1ed8d61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:30.549579 760 leader_election.cc:290] T 9dccb59457ba43efa6ba3f3290a028fd P 57c574a183ee449ba3171ae11a734cc8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4967ac6ac157453da1a6e7b4f1ed8d61 (127.0.106.129:41137), 7b40d12015744366a464f1be5675cfb9 (127.0.106.130:34581)
I20250625 03:29:30.550395 560 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9dccb59457ba43efa6ba3f3290a028fd" candidate_uuid: "57c574a183ee449ba3171ae11a734cc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" is_pre_election: true
I20250625 03:29:30.551030 560 raft_consensus.cc:2466] T 9dccb59457ba43efa6ba3f3290a028fd P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57c574a183ee449ba3171ae11a734cc8 in term 0.
I20250625 03:29:30.551026 636 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9dccb59457ba43efa6ba3f3290a028fd" candidate_uuid: "57c574a183ee449ba3171ae11a734cc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b40d12015744366a464f1be5675cfb9" is_pre_election: true
I20250625 03:29:30.552294 675 leader_election.cc:304] T 9dccb59457ba43efa6ba3f3290a028fd P 57c574a183ee449ba3171ae11a734cc8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4967ac6ac157453da1a6e7b4f1ed8d61, 57c574a183ee449ba3171ae11a734cc8; no voters:
I20250625 03:29:30.553032 760 raft_consensus.cc:2802] T 9dccb59457ba43efa6ba3f3290a028fd P 57c574a183ee449ba3171ae11a734cc8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:29:30.553395 760 raft_consensus.cc:491] T 9dccb59457ba43efa6ba3f3290a028fd P 57c574a183ee449ba3171ae11a734cc8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:29:30.553726 760 raft_consensus.cc:3058] T 9dccb59457ba43efa6ba3f3290a028fd P 57c574a183ee449ba3171ae11a734cc8 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:29:30.554831 708 raft_consensus.cc:3058] T 0d8ad140d73a4a80a1d2316ef129935d P 57c574a183ee449ba3171ae11a734cc8 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:29:30.559572 779 consensus_queue.cc:1035] T 0d8ad140d73a4a80a1d2316ef129935d P 4967ac6ac157453da1a6e7b4f1ed8d61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:29:30.564777 779 consensus_queue.cc:1035] T 0d8ad140d73a4a80a1d2316ef129935d P 4967ac6ac157453da1a6e7b4f1ed8d61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:29:30.552740 636 raft_consensus.cc:2466] T 9dccb59457ba43efa6ba3f3290a028fd P 7b40d12015744366a464f1be5675cfb9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57c574a183ee449ba3171ae11a734cc8 in term 0.
I20250625 03:29:30.584802 760 raft_consensus.cc:513] T 9dccb59457ba43efa6ba3f3290a028fd P 57c574a183ee449ba3171ae11a734cc8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:30.588761 560 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9dccb59457ba43efa6ba3f3290a028fd" candidate_uuid: "57c574a183ee449ba3171ae11a734cc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61"
I20250625 03:29:30.588889 760 leader_election.cc:290] T 9dccb59457ba43efa6ba3f3290a028fd P 57c574a183ee449ba3171ae11a734cc8 [CANDIDATE]: Term 1 election: Requested vote from peers 4967ac6ac157453da1a6e7b4f1ed8d61 (127.0.106.129:41137), 7b40d12015744366a464f1be5675cfb9 (127.0.106.130:34581)
I20250625 03:29:30.589111 635 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9dccb59457ba43efa6ba3f3290a028fd" candidate_uuid: "57c574a183ee449ba3171ae11a734cc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b40d12015744366a464f1be5675cfb9"
I20250625 03:29:30.589382 560 raft_consensus.cc:3058] T 9dccb59457ba43efa6ba3f3290a028fd P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:29:30.589670 635 raft_consensus.cc:3058] T 9dccb59457ba43efa6ba3f3290a028fd P 7b40d12015744366a464f1be5675cfb9 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:29:30.605540 560 raft_consensus.cc:2466] T 9dccb59457ba43efa6ba3f3290a028fd P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57c574a183ee449ba3171ae11a734cc8 in term 1.
I20250625 03:29:30.610805 675 leader_election.cc:304] T 9dccb59457ba43efa6ba3f3290a028fd P 57c574a183ee449ba3171ae11a734cc8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4967ac6ac157453da1a6e7b4f1ed8d61, 57c574a183ee449ba3171ae11a734cc8; no voters:
I20250625 03:29:30.607237 635 raft_consensus.cc:2466] T 9dccb59457ba43efa6ba3f3290a028fd P 7b40d12015744366a464f1be5675cfb9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57c574a183ee449ba3171ae11a734cc8 in term 1.
I20250625 03:29:30.608193 780 consensus_queue.cc:1035] T 92d6dd32053d442ca03f15c290dc495e P 7b40d12015744366a464f1be5675cfb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:29:30.612463 810 raft_consensus.cc:2802] T 9dccb59457ba43efa6ba3f3290a028fd P 57c574a183ee449ba3171ae11a734cc8 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:29:30.613997 760 raft_consensus.cc:491] T 0d8ad140d73a4a80a1d2316ef129935d P 57c574a183ee449ba3171ae11a734cc8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4967ac6ac157453da1a6e7b4f1ed8d61)
I20250625 03:29:30.614626 760 raft_consensus.cc:513] T 0d8ad140d73a4a80a1d2316ef129935d P 57c574a183ee449ba3171ae11a734cc8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:30.621688 760 leader_election.cc:290] T 0d8ad140d73a4a80a1d2316ef129935d P 57c574a183ee449ba3171ae11a734cc8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4967ac6ac157453da1a6e7b4f1ed8d61 (127.0.106.129:41137), 7b40d12015744366a464f1be5675cfb9 (127.0.106.130:34581)
I20250625 03:29:30.622412 560 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0d8ad140d73a4a80a1d2316ef129935d" candidate_uuid: "57c574a183ee449ba3171ae11a734cc8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" is_pre_election: true
I20250625 03:29:30.627267 636 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0d8ad140d73a4a80a1d2316ef129935d" candidate_uuid: "57c574a183ee449ba3171ae11a734cc8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7b40d12015744366a464f1be5675cfb9" is_pre_election: true
I20250625 03:29:30.628965 676 leader_election.cc:304] T 0d8ad140d73a4a80a1d2316ef129935d P 57c574a183ee449ba3171ae11a734cc8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57c574a183ee449ba3171ae11a734cc8; no voters: 4967ac6ac157453da1a6e7b4f1ed8d61, 7b40d12015744366a464f1be5675cfb9
I20250625 03:29:30.631620 760 raft_consensus.cc:2747] T 0d8ad140d73a4a80a1d2316ef129935d P 57c574a183ee449ba3171ae11a734cc8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250625 03:29:30.634311 810 raft_consensus.cc:695] T 9dccb59457ba43efa6ba3f3290a028fd P 57c574a183ee449ba3171ae11a734cc8 [term 1 LEADER]: Becoming Leader. State: Replica: 57c574a183ee449ba3171ae11a734cc8, State: Running, Role: LEADER
I20250625 03:29:30.635203 810 consensus_queue.cc:237] T 9dccb59457ba43efa6ba3f3290a028fd P 57c574a183ee449ba3171ae11a734cc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:30.639170 762 raft_consensus.cc:491] T 92d6dd32053d442ca03f15c290dc495e P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:29:30.640048 762 raft_consensus.cc:513] T 92d6dd32053d442ca03f15c290dc495e P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:30.640676 458 catalog_manager.cc:5582] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 4967ac6ac157453da1a6e7b4f1ed8d61 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4967ac6ac157453da1a6e7b4f1ed8d61 (127.0.106.129). New cstate: current_term: 1 leader_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } health_report { overall_health: UNKNOWN } } }
I20250625 03:29:30.642653 762 leader_election.cc:290] T 92d6dd32053d442ca03f15c290dc495e P 4967ac6ac157453da1a6e7b4f1ed8d61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b40d12015744366a464f1be5675cfb9 (127.0.106.130:34581), 57c574a183ee449ba3171ae11a734cc8 (127.0.106.131:35951)
I20250625 03:29:30.644767 709 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "92d6dd32053d442ca03f15c290dc495e" candidate_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57c574a183ee449ba3171ae11a734cc8" is_pre_election: true
I20250625 03:29:30.648876 636 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "92d6dd32053d442ca03f15c290dc495e" candidate_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b40d12015744366a464f1be5675cfb9" is_pre_election: true
I20250625 03:29:30.651495 524 leader_election.cc:304] T 92d6dd32053d442ca03f15c290dc495e P 4967ac6ac157453da1a6e7b4f1ed8d61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4967ac6ac157453da1a6e7b4f1ed8d61; no voters: 57c574a183ee449ba3171ae11a734cc8, 7b40d12015744366a464f1be5675cfb9
I20250625 03:29:30.652623 762 raft_consensus.cc:2747] T 92d6dd32053d442ca03f15c290dc495e P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:29:30.661981 560 raft_consensus.cc:3058] T 92d6dd32053d442ca03f15c290dc495e P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:29:30.664911 457 catalog_manager.cc:5582] T 6e85647348794694a1c45563583c5896 P 4967ac6ac157453da1a6e7b4f1ed8d61 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4967ac6ac157453da1a6e7b4f1ed8d61 (127.0.106.129). New cstate: current_term: 1 leader_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } health_report { overall_health: UNKNOWN } } }
I20250625 03:29:30.669723 708 raft_consensus.cc:3058] T 777af158d52d4a9db024948c66182594 P 57c574a183ee449ba3171ae11a734cc8 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:29:30.669466 455 catalog_manager.cc:5582] T 9dccb59457ba43efa6ba3f3290a028fd P 57c574a183ee449ba3171ae11a734cc8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 57c574a183ee449ba3171ae11a734cc8 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "57c574a183ee449ba3171ae11a734cc8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } health_report { overall_health: HEALTHY } } }
I20250625 03:29:30.674607 780 consensus_queue.cc:1035] T 92d6dd32053d442ca03f15c290dc495e P 7b40d12015744366a464f1be5675cfb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:29:30.683195 762 consensus_queue.cc:1035] T 777af158d52d4a9db024948c66182594 P 4967ac6ac157453da1a6e7b4f1ed8d61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:29:30.685452 762 consensus_queue.cc:1035] T 777af158d52d4a9db024948c66182594 P 4967ac6ac157453da1a6e7b4f1ed8d61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:29:30.743518 780 raft_consensus.cc:491] T 4e9ead806c80443da83728a2f97fc310 P 7b40d12015744366a464f1be5675cfb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:29:30.743969 780 raft_consensus.cc:513] T 4e9ead806c80443da83728a2f97fc310 P 7b40d12015744366a464f1be5675cfb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } } peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } }
I20250625 03:29:30.745581 780 leader_election.cc:290] T 4e9ead806c80443da83728a2f97fc310 P 7b40d12015744366a464f1be5675cfb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57c574a183ee449ba3171ae11a734cc8 (127.0.106.131:35951), 4967ac6ac157453da1a6e7b4f1ed8d61 (127.0.106.129:41137)
I20250625 03:29:30.746384 708 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4e9ead806c80443da83728a2f97fc310" candidate_uuid: "7b40d12015744366a464f1be5675cfb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57c574a183ee449ba3171ae11a734cc8" is_pre_election: true
I20250625 03:29:30.746659 560 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4e9ead806c80443da83728a2f97fc310" candidate_uuid: "7b40d12015744366a464f1be5675cfb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" is_pre_election: true
I20250625 03:29:30.747036 708 raft_consensus.cc:2466] T 4e9ead806c80443da83728a2f97fc310 P 57c574a183ee449ba3171ae11a734cc8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b40d12015744366a464f1be5675cfb9 in term 0.
I20250625 03:29:30.747226 560 raft_consensus.cc:2466] T 4e9ead806c80443da83728a2f97fc310 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b40d12015744366a464f1be5675cfb9 in term 0.
I20250625 03:29:30.748132 599 leader_election.cc:304] T 4e9ead806c80443da83728a2f97fc310 P 7b40d12015744366a464f1be5675cfb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57c574a183ee449ba3171ae11a734cc8, 7b40d12015744366a464f1be5675cfb9; no voters:
I20250625 03:29:30.748759 780 raft_consensus.cc:2802] T 4e9ead806c80443da83728a2f97fc310 P 7b40d12015744366a464f1be5675cfb9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:29:30.749074 780 raft_consensus.cc:491] T 4e9ead806c80443da83728a2f97fc310 P 7b40d12015744366a464f1be5675cfb9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:29:30.749344 780 raft_consensus.cc:3058] T 4e9ead806c80443da83728a2f97fc310 P 7b40d12015744366a464f1be5675cfb9 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:29:30.754271 780 raft_consensus.cc:513] T 4e9ead806c80443da83728a2f97fc310 P 7b40d12015744366a464f1be5675cfb9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } } peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } }
I20250625 03:29:30.755765 780 leader_election.cc:290] T 4e9ead806c80443da83728a2f97fc310 P 7b40d12015744366a464f1be5675cfb9 [CANDIDATE]: Term 1 election: Requested vote from peers 57c574a183ee449ba3171ae11a734cc8 (127.0.106.131:35951), 4967ac6ac157453da1a6e7b4f1ed8d61 (127.0.106.129:41137)
I20250625 03:29:30.756600 708 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4e9ead806c80443da83728a2f97fc310" candidate_uuid: "7b40d12015744366a464f1be5675cfb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57c574a183ee449ba3171ae11a734cc8"
I20250625 03:29:30.756929 560 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4e9ead806c80443da83728a2f97fc310" candidate_uuid: "7b40d12015744366a464f1be5675cfb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61"
I20250625 03:29:30.757195 708 raft_consensus.cc:3058] T 4e9ead806c80443da83728a2f97fc310 P 57c574a183ee449ba3171ae11a734cc8 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:29:30.757486 560 raft_consensus.cc:3058] T 4e9ead806c80443da83728a2f97fc310 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:29:30.764240 708 raft_consensus.cc:2466] T 4e9ead806c80443da83728a2f97fc310 P 57c574a183ee449ba3171ae11a734cc8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b40d12015744366a464f1be5675cfb9 in term 1.
I20250625 03:29:30.763911 560 raft_consensus.cc:2466] T 4e9ead806c80443da83728a2f97fc310 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b40d12015744366a464f1be5675cfb9 in term 1.
I20250625 03:29:30.765336 599 leader_election.cc:304] T 4e9ead806c80443da83728a2f97fc310 P 7b40d12015744366a464f1be5675cfb9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57c574a183ee449ba3171ae11a734cc8, 7b40d12015744366a464f1be5675cfb9; no voters:
I20250625 03:29:30.766286 780 raft_consensus.cc:2802] T 4e9ead806c80443da83728a2f97fc310 P 7b40d12015744366a464f1be5675cfb9 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:29:30.766763 780 raft_consensus.cc:695] T 4e9ead806c80443da83728a2f97fc310 P 7b40d12015744366a464f1be5675cfb9 [term 1 LEADER]: Becoming Leader. State: Replica: 7b40d12015744366a464f1be5675cfb9, State: Running, Role: LEADER
I20250625 03:29:30.767017 779 consensus_queue.cc:1035] T d2dd339d32874178b80ad608b5b7ea25 P 4967ac6ac157453da1a6e7b4f1ed8d61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:29:30.767586 780 consensus_queue.cc:237] T 4e9ead806c80443da83728a2f97fc310 P 7b40d12015744366a464f1be5675cfb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } } peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } }
I20250625 03:29:30.776890 458 catalog_manager.cc:5582] T 4e9ead806c80443da83728a2f97fc310 P 7b40d12015744366a464f1be5675cfb9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b40d12015744366a464f1be5675cfb9 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "7b40d12015744366a464f1be5675cfb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } health_report { overall_health: HEALTHY } } }
I20250625 03:29:30.783099 777 consensus_queue.cc:1035] T d2dd339d32874178b80ad608b5b7ea25 P 4967ac6ac157453da1a6e7b4f1ed8d61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:29:30.834033 780 raft_consensus.cc:491] T f9031be3db5846a194610fa6c83bc23c P 7b40d12015744366a464f1be5675cfb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:29:30.834511 780 raft_consensus.cc:513] T f9031be3db5846a194610fa6c83bc23c P 7b40d12015744366a464f1be5675cfb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:30.836130 780 leader_election.cc:290] T f9031be3db5846a194610fa6c83bc23c P 7b40d12015744366a464f1be5675cfb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4967ac6ac157453da1a6e7b4f1ed8d61 (127.0.106.129:41137), 57c574a183ee449ba3171ae11a734cc8 (127.0.106.131:35951)
I20250625 03:29:30.836901 560 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f9031be3db5846a194610fa6c83bc23c" candidate_uuid: "7b40d12015744366a464f1be5675cfb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" is_pre_election: true
I20250625 03:29:30.837188 708 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f9031be3db5846a194610fa6c83bc23c" candidate_uuid: "7b40d12015744366a464f1be5675cfb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57c574a183ee449ba3171ae11a734cc8" is_pre_election: true
I20250625 03:29:30.837633 560 raft_consensus.cc:2466] T f9031be3db5846a194610fa6c83bc23c P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b40d12015744366a464f1be5675cfb9 in term 0.
I20250625 03:29:30.837788 708 raft_consensus.cc:2466] T f9031be3db5846a194610fa6c83bc23c P 57c574a183ee449ba3171ae11a734cc8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b40d12015744366a464f1be5675cfb9 in term 0.
I20250625 03:29:30.838716 601 leader_election.cc:304] T f9031be3db5846a194610fa6c83bc23c P 7b40d12015744366a464f1be5675cfb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4967ac6ac157453da1a6e7b4f1ed8d61, 7b40d12015744366a464f1be5675cfb9; no voters:
I20250625 03:29:30.839315 780 raft_consensus.cc:2802] T f9031be3db5846a194610fa6c83bc23c P 7b40d12015744366a464f1be5675cfb9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:29:30.839643 780 raft_consensus.cc:491] T f9031be3db5846a194610fa6c83bc23c P 7b40d12015744366a464f1be5675cfb9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:29:30.839903 780 raft_consensus.cc:3058] T f9031be3db5846a194610fa6c83bc23c P 7b40d12015744366a464f1be5675cfb9 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:29:30.844709 780 raft_consensus.cc:513] T f9031be3db5846a194610fa6c83bc23c P 7b40d12015744366a464f1be5675cfb9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:30.846429 780 leader_election.cc:290] T f9031be3db5846a194610fa6c83bc23c P 7b40d12015744366a464f1be5675cfb9 [CANDIDATE]: Term 1 election: Requested vote from peers 4967ac6ac157453da1a6e7b4f1ed8d61 (127.0.106.129:41137), 57c574a183ee449ba3171ae11a734cc8 (127.0.106.131:35951)
I20250625 03:29:30.847219 560 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f9031be3db5846a194610fa6c83bc23c" candidate_uuid: "7b40d12015744366a464f1be5675cfb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61"
I20250625 03:29:30.847452 708 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f9031be3db5846a194610fa6c83bc23c" candidate_uuid: "7b40d12015744366a464f1be5675cfb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57c574a183ee449ba3171ae11a734cc8"
I20250625 03:29:30.847802 560 raft_consensus.cc:3058] T f9031be3db5846a194610fa6c83bc23c P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:29:30.848098 708 raft_consensus.cc:3058] T f9031be3db5846a194610fa6c83bc23c P 57c574a183ee449ba3171ae11a734cc8 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:29:30.852471 708 raft_consensus.cc:2466] T f9031be3db5846a194610fa6c83bc23c P 57c574a183ee449ba3171ae11a734cc8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b40d12015744366a464f1be5675cfb9 in term 1.
I20250625 03:29:30.853384 599 leader_election.cc:304] T f9031be3db5846a194610fa6c83bc23c P 7b40d12015744366a464f1be5675cfb9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57c574a183ee449ba3171ae11a734cc8, 7b40d12015744366a464f1be5675cfb9; no voters:
I20250625 03:29:30.854005 780 raft_consensus.cc:2802] T f9031be3db5846a194610fa6c83bc23c P 7b40d12015744366a464f1be5675cfb9 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:29:30.854389 780 raft_consensus.cc:695] T f9031be3db5846a194610fa6c83bc23c P 7b40d12015744366a464f1be5675cfb9 [term 1 LEADER]: Becoming Leader. State: Replica: 7b40d12015744366a464f1be5675cfb9, State: Running, Role: LEADER
I20250625 03:29:30.854450 560 raft_consensus.cc:2466] T f9031be3db5846a194610fa6c83bc23c P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b40d12015744366a464f1be5675cfb9 in term 1.
I20250625 03:29:30.855239 780 consensus_queue.cc:237] T f9031be3db5846a194610fa6c83bc23c P 7b40d12015744366a464f1be5675cfb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:30.863400 457 catalog_manager.cc:5582] T f9031be3db5846a194610fa6c83bc23c P 7b40d12015744366a464f1be5675cfb9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b40d12015744366a464f1be5675cfb9 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "7b40d12015744366a464f1be5675cfb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } health_report { overall_health: UNKNOWN } } }
I20250625 03:29:30.897750 636 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "4e9ead806c80443da83728a2f97fc310"
dest_uuid: "7b40d12015744366a464f1be5675cfb9"
mode: GRACEFUL
new_leader_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61"
from {username='slave'} at 127.0.0.1:43504
I20250625 03:29:30.898341 636 raft_consensus.cc:604] T 4e9ead806c80443da83728a2f97fc310 P 7b40d12015744366a464f1be5675cfb9 [term 1 LEADER]: Received request to transfer leadership to TS 4967ac6ac157453da1a6e7b4f1ed8d61
I20250625 03:29:30.906445 636 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "92d6dd32053d442ca03f15c290dc495e"
dest_uuid: "7b40d12015744366a464f1be5675cfb9"
mode: GRACEFUL
new_leader_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61"
from {username='slave'} at 127.0.0.1:43504
I20250625 03:29:30.906924 636 raft_consensus.cc:604] T 92d6dd32053d442ca03f15c290dc495e P 7b40d12015744366a464f1be5675cfb9 [term 1 LEADER]: Received request to transfer leadership to TS 4967ac6ac157453da1a6e7b4f1ed8d61
I20250625 03:29:30.911921 636 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "f9031be3db5846a194610fa6c83bc23c"
dest_uuid: "7b40d12015744366a464f1be5675cfb9"
mode: GRACEFUL
new_leader_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61"
from {username='slave'} at 127.0.0.1:43504
I20250625 03:29:30.912461 636 raft_consensus.cc:604] T f9031be3db5846a194610fa6c83bc23c P 7b40d12015744366a464f1be5675cfb9 [term 1 LEADER]: Received request to transfer leadership to TS 4967ac6ac157453da1a6e7b4f1ed8d61
I20250625 03:29:30.926189 708 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "9dccb59457ba43efa6ba3f3290a028fd"
dest_uuid: "57c574a183ee449ba3171ae11a734cc8"
mode: GRACEFUL
new_leader_uuid: "7b40d12015744366a464f1be5675cfb9"
from {username='slave'} at 127.0.0.1:51286
I20250625 03:29:30.926805 708 raft_consensus.cc:604] T 9dccb59457ba43efa6ba3f3290a028fd P 57c574a183ee449ba3171ae11a734cc8 [term 1 LEADER]: Received request to transfer leadership to TS 7b40d12015744366a464f1be5675cfb9
I20250625 03:29:30.942600 560 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "777af158d52d4a9db024948c66182594"
dest_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61"
mode: GRACEFUL
new_leader_uuid: "7b40d12015744366a464f1be5675cfb9"
from {username='slave'} at 127.0.0.1:48680
I20250625 03:29:30.943249 560 raft_consensus.cc:604] T 777af158d52d4a9db024948c66182594 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 1 LEADER]: Received request to transfer leadership to TS 7b40d12015744366a464f1be5675cfb9
I20250625 03:29:30.948433 560 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "0d8ad140d73a4a80a1d2316ef129935d"
dest_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61"
mode: GRACEFUL
new_leader_uuid: "7b40d12015744366a464f1be5675cfb9"
from {username='slave'} at 127.0.0.1:48680
I20250625 03:29:30.949079 560 raft_consensus.cc:604] T 0d8ad140d73a4a80a1d2316ef129935d P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 1 LEADER]: Received request to transfer leadership to TS 7b40d12015744366a464f1be5675cfb9
I20250625 03:29:30.954017 560 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "6e85647348794694a1c45563583c5896"
dest_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61"
mode: GRACEFUL
new_leader_uuid: "7b40d12015744366a464f1be5675cfb9"
from {username='slave'} at 127.0.0.1:48680
I20250625 03:29:30.954617 560 raft_consensus.cc:604] T 6e85647348794694a1c45563583c5896 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 1 LEADER]: Received request to transfer leadership to TS 7b40d12015744366a464f1be5675cfb9
I20250625 03:29:30.960083 560 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "d2dd339d32874178b80ad608b5b7ea25"
dest_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61"
mode: GRACEFUL
new_leader_uuid: "57c574a183ee449ba3171ae11a734cc8"
from {username='slave'} at 127.0.0.1:48680
I20250625 03:29:30.960666 560 raft_consensus.cc:604] T d2dd339d32874178b80ad608b5b7ea25 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 1 LEADER]: Received request to transfer leadership to TS 57c574a183ee449ba3171ae11a734cc8
I20250625 03:29:30.962862 777 consensus_queue.cc:1035] T 6e85647348794694a1c45563583c5896 P 4967ac6ac157453da1a6e7b4f1ed8d61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:29:30.968763 762 raft_consensus.cc:991] T 6e85647348794694a1c45563583c5896 P 4967ac6ac157453da1a6e7b4f1ed8d61: : Instructing follower 7b40d12015744366a464f1be5675cfb9 to start an election
I20250625 03:29:30.969200 762 raft_consensus.cc:1079] T 6e85647348794694a1c45563583c5896 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 1 LEADER]: Signalling peer 7b40d12015744366a464f1be5675cfb9 to start an election
I20250625 03:29:30.971643 635 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "6e85647348794694a1c45563583c5896"
dest_uuid: "7b40d12015744366a464f1be5675cfb9"
from {username='slave'} at 127.0.0.1:43492
I20250625 03:29:30.972285 635 raft_consensus.cc:491] T 6e85647348794694a1c45563583c5896 P 7b40d12015744366a464f1be5675cfb9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:29:30.972646 635 raft_consensus.cc:3058] T 6e85647348794694a1c45563583c5896 P 7b40d12015744366a464f1be5675cfb9 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:29:30.973953 762 consensus_queue.cc:1035] T 6e85647348794694a1c45563583c5896 P 4967ac6ac157453da1a6e7b4f1ed8d61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:29:30.981567 635 raft_consensus.cc:513] T 6e85647348794694a1c45563583c5896 P 7b40d12015744366a464f1be5675cfb9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:30.982613 636 raft_consensus.cc:1238] T 6e85647348794694a1c45563583c5896 P 7b40d12015744366a464f1be5675cfb9 [term 2 FOLLOWER]: Rejecting Update request from peer 4967ac6ac157453da1a6e7b4f1ed8d61 for earlier term 1. Current term is 2. Ops: []
I20250625 03:29:30.985697 762 consensus_queue.cc:1035] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 4967ac6ac157453da1a6e7b4f1ed8d61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:29:30.990427 560 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6e85647348794694a1c45563583c5896" candidate_uuid: "7b40d12015744366a464f1be5675cfb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61"
I20250625 03:29:30.990716 777 consensus_queue.cc:1046] T 6e85647348794694a1c45563583c5896 P 4967ac6ac157453da1a6e7b4f1ed8d61 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:29:30.991822 560 raft_consensus.cc:3053] T 6e85647348794694a1c45563583c5896 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:29:30.992214 560 raft_consensus.cc:738] T 6e85647348794694a1c45563583c5896 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4967ac6ac157453da1a6e7b4f1ed8d61, State: Running, Role: LEADER
I20250625 03:29:30.993000 560 consensus_queue.cc:260] T 6e85647348794694a1c45563583c5896 P 4967ac6ac157453da1a6e7b4f1ed8d61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:30.994246 560 raft_consensus.cc:3058] T 6e85647348794694a1c45563583c5896 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:29:30.994352 635 leader_election.cc:290] T 6e85647348794694a1c45563583c5896 P 7b40d12015744366a464f1be5675cfb9 [CANDIDATE]: Term 2 election: Requested vote from peers 4967ac6ac157453da1a6e7b4f1ed8d61 (127.0.106.129:41137), 57c574a183ee449ba3171ae11a734cc8 (127.0.106.131:35951)
I20250625 03:29:30.994274 708 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6e85647348794694a1c45563583c5896" candidate_uuid: "7b40d12015744366a464f1be5675cfb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57c574a183ee449ba3171ae11a734cc8"
I20250625 03:29:30.996886 708 raft_consensus.cc:3058] T 6e85647348794694a1c45563583c5896 P 57c574a183ee449ba3171ae11a734cc8 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:29:31.001711 560 raft_consensus.cc:2466] T 6e85647348794694a1c45563583c5896 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b40d12015744366a464f1be5675cfb9 in term 2.
W20250625 03:29:31.002713 777 raft_consensus.cc:934] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20250625 03:29:31.003386 601 leader_election.cc:304] T 6e85647348794694a1c45563583c5896 P 7b40d12015744366a464f1be5675cfb9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4967ac6ac157453da1a6e7b4f1ed8d61, 7b40d12015744366a464f1be5675cfb9; no voters:
I20250625 03:29:31.004285 780 raft_consensus.cc:2802] T 6e85647348794694a1c45563583c5896 P 7b40d12015744366a464f1be5675cfb9 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:29:31.005080 780 raft_consensus.cc:695] T 6e85647348794694a1c45563583c5896 P 7b40d12015744366a464f1be5675cfb9 [term 2 LEADER]: Becoming Leader. State: Replica: 7b40d12015744366a464f1be5675cfb9, State: Running, Role: LEADER
I20250625 03:29:31.005970 780 consensus_queue.cc:237] T 6e85647348794694a1c45563583c5896 P 7b40d12015744366a464f1be5675cfb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:31.004094 708 raft_consensus.cc:2466] T 6e85647348794694a1c45563583c5896 P 57c574a183ee449ba3171ae11a734cc8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b40d12015744366a464f1be5675cfb9 in term 2.
I20250625 03:29:31.015568 777 consensus_queue.cc:1035] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 4967ac6ac157453da1a6e7b4f1ed8d61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:29:31.029361 457 catalog_manager.cc:5582] T 6e85647348794694a1c45563583c5896 P 7b40d12015744366a464f1be5675cfb9 reported cstate change: term changed from 1 to 2, leader changed from 4967ac6ac157453da1a6e7b4f1ed8d61 (127.0.106.129) to 7b40d12015744366a464f1be5675cfb9 (127.0.106.130). New cstate: current_term: 2 leader_uuid: "7b40d12015744366a464f1be5675cfb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } health_report { overall_health: UNKNOWN } } }
I20250625 03:29:31.067714 810 consensus_queue.cc:1035] T 9dccb59457ba43efa6ba3f3290a028fd P 57c574a183ee449ba3171ae11a734cc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:29:31.079191 810 consensus_queue.cc:1035] T 9dccb59457ba43efa6ba3f3290a028fd P 57c574a183ee449ba3171ae11a734cc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:29:31.088349 809 raft_consensus.cc:991] T 9dccb59457ba43efa6ba3f3290a028fd P 57c574a183ee449ba3171ae11a734cc8: : Instructing follower 7b40d12015744366a464f1be5675cfb9 to start an election
I20250625 03:29:31.088827 760 raft_consensus.cc:1079] T 9dccb59457ba43efa6ba3f3290a028fd P 57c574a183ee449ba3171ae11a734cc8 [term 1 LEADER]: Signalling peer 7b40d12015744366a464f1be5675cfb9 to start an election
I20250625 03:29:31.090472 634 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "9dccb59457ba43efa6ba3f3290a028fd"
dest_uuid: "7b40d12015744366a464f1be5675cfb9"
from {username='slave'} at 127.0.0.1:43494
I20250625 03:29:31.091030 634 raft_consensus.cc:491] T 9dccb59457ba43efa6ba3f3290a028fd P 7b40d12015744366a464f1be5675cfb9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:29:31.091391 634 raft_consensus.cc:3058] T 9dccb59457ba43efa6ba3f3290a028fd P 7b40d12015744366a464f1be5675cfb9 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:29:31.096577 634 raft_consensus.cc:513] T 9dccb59457ba43efa6ba3f3290a028fd P 7b40d12015744366a464f1be5675cfb9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:31.099009 708 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9dccb59457ba43efa6ba3f3290a028fd" candidate_uuid: "7b40d12015744366a464f1be5675cfb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57c574a183ee449ba3171ae11a734cc8"
I20250625 03:29:31.098930 560 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9dccb59457ba43efa6ba3f3290a028fd" candidate_uuid: "7b40d12015744366a464f1be5675cfb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61"
I20250625 03:29:31.099650 708 raft_consensus.cc:3053] T 9dccb59457ba43efa6ba3f3290a028fd P 57c574a183ee449ba3171ae11a734cc8 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:29:31.099699 560 raft_consensus.cc:3058] T 9dccb59457ba43efa6ba3f3290a028fd P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:29:31.100087 708 raft_consensus.cc:738] T 9dccb59457ba43efa6ba3f3290a028fd P 57c574a183ee449ba3171ae11a734cc8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 57c574a183ee449ba3171ae11a734cc8, State: Running, Role: LEADER
I20250625 03:29:31.101490 708 consensus_queue.cc:260] T 9dccb59457ba43efa6ba3f3290a028fd P 57c574a183ee449ba3171ae11a734cc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:31.102599 708 raft_consensus.cc:3058] T 9dccb59457ba43efa6ba3f3290a028fd P 57c574a183ee449ba3171ae11a734cc8 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:29:31.100045 634 leader_election.cc:290] T 9dccb59457ba43efa6ba3f3290a028fd P 7b40d12015744366a464f1be5675cfb9 [CANDIDATE]: Term 2 election: Requested vote from peers 4967ac6ac157453da1a6e7b4f1ed8d61 (127.0.106.129:41137), 57c574a183ee449ba3171ae11a734cc8 (127.0.106.131:35951)
I20250625 03:29:31.106956 560 raft_consensus.cc:2466] T 9dccb59457ba43efa6ba3f3290a028fd P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b40d12015744366a464f1be5675cfb9 in term 2.
I20250625 03:29:31.108315 601 leader_election.cc:304] T 9dccb59457ba43efa6ba3f3290a028fd P 7b40d12015744366a464f1be5675cfb9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4967ac6ac157453da1a6e7b4f1ed8d61, 7b40d12015744366a464f1be5675cfb9; no voters:
I20250625 03:29:31.109123 780 raft_consensus.cc:2802] T 9dccb59457ba43efa6ba3f3290a028fd P 7b40d12015744366a464f1be5675cfb9 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:29:31.109611 780 raft_consensus.cc:695] T 9dccb59457ba43efa6ba3f3290a028fd P 7b40d12015744366a464f1be5675cfb9 [term 2 LEADER]: Becoming Leader. State: Replica: 7b40d12015744366a464f1be5675cfb9, State: Running, Role: LEADER
I20250625 03:29:31.110363 708 raft_consensus.cc:2466] T 9dccb59457ba43efa6ba3f3290a028fd P 57c574a183ee449ba3171ae11a734cc8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b40d12015744366a464f1be5675cfb9 in term 2.
I20250625 03:29:31.110420 780 consensus_queue.cc:237] T 9dccb59457ba43efa6ba3f3290a028fd P 7b40d12015744366a464f1be5675cfb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:31.117054 458 catalog_manager.cc:5582] T 9dccb59457ba43efa6ba3f3290a028fd P 7b40d12015744366a464f1be5675cfb9 reported cstate change: term changed from 1 to 2, leader changed from 57c574a183ee449ba3171ae11a734cc8 (127.0.106.131) to 7b40d12015744366a464f1be5675cfb9 (127.0.106.130). New cstate: current_term: 2 leader_uuid: "7b40d12015744366a464f1be5675cfb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } health_report { overall_health: UNKNOWN } } }
I20250625 03:29:31.129846 777 raft_consensus.cc:991] T 0d8ad140d73a4a80a1d2316ef129935d P 4967ac6ac157453da1a6e7b4f1ed8d61: : Instructing follower 7b40d12015744366a464f1be5675cfb9 to start an election
I20250625 03:29:31.130333 779 raft_consensus.cc:1079] T 0d8ad140d73a4a80a1d2316ef129935d P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 1 LEADER]: Signalling peer 7b40d12015744366a464f1be5675cfb9 to start an election
I20250625 03:29:31.131647 634 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "0d8ad140d73a4a80a1d2316ef129935d"
dest_uuid: "7b40d12015744366a464f1be5675cfb9"
from {username='slave'} at 127.0.0.1:43492
I20250625 03:29:31.132165 634 raft_consensus.cc:491] T 0d8ad140d73a4a80a1d2316ef129935d P 7b40d12015744366a464f1be5675cfb9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:29:31.132442 634 raft_consensus.cc:3058] T 0d8ad140d73a4a80a1d2316ef129935d P 7b40d12015744366a464f1be5675cfb9 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:29:31.136809 634 raft_consensus.cc:513] T 0d8ad140d73a4a80a1d2316ef129935d P 7b40d12015744366a464f1be5675cfb9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:31.139583 634 leader_election.cc:290] T 0d8ad140d73a4a80a1d2316ef129935d P 7b40d12015744366a464f1be5675cfb9 [CANDIDATE]: Term 2 election: Requested vote from peers 4967ac6ac157453da1a6e7b4f1ed8d61 (127.0.106.129:41137), 57c574a183ee449ba3171ae11a734cc8 (127.0.106.131:35951)
I20250625 03:29:31.140254 708 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0d8ad140d73a4a80a1d2316ef129935d" candidate_uuid: "7b40d12015744366a464f1be5675cfb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57c574a183ee449ba3171ae11a734cc8"
I20250625 03:29:31.140506 560 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0d8ad140d73a4a80a1d2316ef129935d" candidate_uuid: "7b40d12015744366a464f1be5675cfb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61"
I20250625 03:29:31.140798 708 raft_consensus.cc:3058] T 0d8ad140d73a4a80a1d2316ef129935d P 57c574a183ee449ba3171ae11a734cc8 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:29:31.141096 560 raft_consensus.cc:3053] T 0d8ad140d73a4a80a1d2316ef129935d P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:29:31.141436 560 raft_consensus.cc:738] T 0d8ad140d73a4a80a1d2316ef129935d P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4967ac6ac157453da1a6e7b4f1ed8d61, State: Running, Role: LEADER
I20250625 03:29:31.142174 560 consensus_queue.cc:260] T 0d8ad140d73a4a80a1d2316ef129935d P 4967ac6ac157453da1a6e7b4f1ed8d61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:31.143373 560 raft_consensus.cc:3058] T 0d8ad140d73a4a80a1d2316ef129935d P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:29:31.145833 708 raft_consensus.cc:2466] T 0d8ad140d73a4a80a1d2316ef129935d P 57c574a183ee449ba3171ae11a734cc8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b40d12015744366a464f1be5675cfb9 in term 2.
I20250625 03:29:31.146833 599 leader_election.cc:304] T 0d8ad140d73a4a80a1d2316ef129935d P 7b40d12015744366a464f1be5675cfb9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57c574a183ee449ba3171ae11a734cc8, 7b40d12015744366a464f1be5675cfb9; no voters:
I20250625 03:29:31.147469 780 raft_consensus.cc:2802] T 0d8ad140d73a4a80a1d2316ef129935d P 7b40d12015744366a464f1be5675cfb9 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:29:31.147855 780 raft_consensus.cc:695] T 0d8ad140d73a4a80a1d2316ef129935d P 7b40d12015744366a464f1be5675cfb9 [term 2 LEADER]: Becoming Leader. State: Replica: 7b40d12015744366a464f1be5675cfb9, State: Running, Role: LEADER
I20250625 03:29:31.148742 780 consensus_queue.cc:237] T 0d8ad140d73a4a80a1d2316ef129935d P 7b40d12015744366a464f1be5675cfb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:31.149739 560 raft_consensus.cc:2466] T 0d8ad140d73a4a80a1d2316ef129935d P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b40d12015744366a464f1be5675cfb9 in term 2.
I20250625 03:29:31.155503 458 catalog_manager.cc:5582] T 0d8ad140d73a4a80a1d2316ef129935d P 7b40d12015744366a464f1be5675cfb9 reported cstate change: term changed from 1 to 2, leader changed from 4967ac6ac157453da1a6e7b4f1ed8d61 (127.0.106.129) to 7b40d12015744366a464f1be5675cfb9 (127.0.106.130). New cstate: current_term: 2 leader_uuid: "7b40d12015744366a464f1be5675cfb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } health_report { overall_health: UNKNOWN } } }
I20250625 03:29:31.199476 780 consensus_queue.cc:1035] T 4e9ead806c80443da83728a2f97fc310 P 7b40d12015744366a464f1be5675cfb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:29:31.211485 836 consensus_queue.cc:1035] T 4e9ead806c80443da83728a2f97fc310 P 7b40d12015744366a464f1be5675cfb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20250625 03:29:31.224510 759 raft_consensus.cc:991] T 4e9ead806c80443da83728a2f97fc310 P 7b40d12015744366a464f1be5675cfb9: : Instructing follower 4967ac6ac157453da1a6e7b4f1ed8d61 to start an election
I20250625 03:29:31.224949 836 raft_consensus.cc:1079] T 4e9ead806c80443da83728a2f97fc310 P 7b40d12015744366a464f1be5675cfb9 [term 1 LEADER]: Signalling peer 4967ac6ac157453da1a6e7b4f1ed8d61 to start an election
I20250625 03:29:31.226522 560 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "4e9ead806c80443da83728a2f97fc310"
dest_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61"
from {username='slave'} at 127.0.0.1:48660
I20250625 03:29:31.227082 560 raft_consensus.cc:491] T 4e9ead806c80443da83728a2f97fc310 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:29:31.227442 560 raft_consensus.cc:3058] T 4e9ead806c80443da83728a2f97fc310 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:29:31.233180 560 raft_consensus.cc:513] T 4e9ead806c80443da83728a2f97fc310 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } } peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } }
I20250625 03:29:31.235055 560 leader_election.cc:290] T 4e9ead806c80443da83728a2f97fc310 P 4967ac6ac157453da1a6e7b4f1ed8d61 [CANDIDATE]: Term 2 election: Requested vote from peers 57c574a183ee449ba3171ae11a734cc8 (127.0.106.131:35951), 7b40d12015744366a464f1be5675cfb9 (127.0.106.130:34581)
I20250625 03:29:31.236045 634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4e9ead806c80443da83728a2f97fc310" candidate_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7b40d12015744366a464f1be5675cfb9"
I20250625 03:29:31.236210 708 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4e9ead806c80443da83728a2f97fc310" candidate_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57c574a183ee449ba3171ae11a734cc8"
I20250625 03:29:31.236663 634 raft_consensus.cc:3053] T 4e9ead806c80443da83728a2f97fc310 P 7b40d12015744366a464f1be5675cfb9 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:29:31.237013 634 raft_consensus.cc:738] T 4e9ead806c80443da83728a2f97fc310 P 7b40d12015744366a464f1be5675cfb9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7b40d12015744366a464f1be5675cfb9, State: Running, Role: LEADER
I20250625 03:29:31.236979 708 raft_consensus.cc:3058] T 4e9ead806c80443da83728a2f97fc310 P 57c574a183ee449ba3171ae11a734cc8 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:29:31.238435 634 consensus_queue.cc:260] T 4e9ead806c80443da83728a2f97fc310 P 7b40d12015744366a464f1be5675cfb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } } peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } }
I20250625 03:29:31.239616 634 raft_consensus.cc:3058] T 4e9ead806c80443da83728a2f97fc310 P 7b40d12015744366a464f1be5675cfb9 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:29:31.244683 634 raft_consensus.cc:2466] T 4e9ead806c80443da83728a2f97fc310 P 7b40d12015744366a464f1be5675cfb9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4967ac6ac157453da1a6e7b4f1ed8d61 in term 2.
I20250625 03:29:31.245265 708 raft_consensus.cc:2466] T 4e9ead806c80443da83728a2f97fc310 P 57c574a183ee449ba3171ae11a734cc8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4967ac6ac157453da1a6e7b4f1ed8d61 in term 2.
I20250625 03:29:31.245693 527 leader_election.cc:304] T 4e9ead806c80443da83728a2f97fc310 P 4967ac6ac157453da1a6e7b4f1ed8d61 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4967ac6ac157453da1a6e7b4f1ed8d61, 7b40d12015744366a464f1be5675cfb9; no voters:
I20250625 03:29:31.246443 779 raft_consensus.cc:2802] T 4e9ead806c80443da83728a2f97fc310 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:29:31.246901 779 raft_consensus.cc:695] T 4e9ead806c80443da83728a2f97fc310 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 2 LEADER]: Becoming Leader. State: Replica: 4967ac6ac157453da1a6e7b4f1ed8d61, State: Running, Role: LEADER
I20250625 03:29:31.247660 779 consensus_queue.cc:237] T 4e9ead806c80443da83728a2f97fc310 P 4967ac6ac157453da1a6e7b4f1ed8d61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } } peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } }
I20250625 03:29:31.254099 457 catalog_manager.cc:5582] T 4e9ead806c80443da83728a2f97fc310 P 4967ac6ac157453da1a6e7b4f1ed8d61 reported cstate change: term changed from 1 to 2, leader changed from 7b40d12015744366a464f1be5675cfb9 (127.0.106.130) to 4967ac6ac157453da1a6e7b4f1ed8d61 (127.0.106.129). New cstate: current_term: 2 leader_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } health_report { overall_health: UNKNOWN } } }
I20250625 03:29:31.265580 777 raft_consensus.cc:991] T 777af158d52d4a9db024948c66182594 P 4967ac6ac157453da1a6e7b4f1ed8d61: : Instructing follower 7b40d12015744366a464f1be5675cfb9 to start an election
I20250625 03:29:31.265993 779 raft_consensus.cc:1079] T 777af158d52d4a9db024948c66182594 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 1 LEADER]: Signalling peer 7b40d12015744366a464f1be5675cfb9 to start an election
I20250625 03:29:31.267424 634 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "777af158d52d4a9db024948c66182594"
dest_uuid: "7b40d12015744366a464f1be5675cfb9"
from {username='slave'} at 127.0.0.1:43492
I20250625 03:29:31.267879 634 raft_consensus.cc:491] T 777af158d52d4a9db024948c66182594 P 7b40d12015744366a464f1be5675cfb9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:29:31.268231 634 raft_consensus.cc:3058] T 777af158d52d4a9db024948c66182594 P 7b40d12015744366a464f1be5675cfb9 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:29:31.272620 634 raft_consensus.cc:513] T 777af158d52d4a9db024948c66182594 P 7b40d12015744366a464f1be5675cfb9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:31.274626 634 leader_election.cc:290] T 777af158d52d4a9db024948c66182594 P 7b40d12015744366a464f1be5675cfb9 [CANDIDATE]: Term 2 election: Requested vote from peers 4967ac6ac157453da1a6e7b4f1ed8d61 (127.0.106.129:41137), 57c574a183ee449ba3171ae11a734cc8 (127.0.106.131:35951)
I20250625 03:29:31.275547 560 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "777af158d52d4a9db024948c66182594" candidate_uuid: "7b40d12015744366a464f1be5675cfb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61"
I20250625 03:29:31.276156 560 raft_consensus.cc:3053] T 777af158d52d4a9db024948c66182594 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:29:31.275959 708 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "777af158d52d4a9db024948c66182594" candidate_uuid: "7b40d12015744366a464f1be5675cfb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57c574a183ee449ba3171ae11a734cc8"
I20250625 03:29:31.276430 560 raft_consensus.cc:738] T 777af158d52d4a9db024948c66182594 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4967ac6ac157453da1a6e7b4f1ed8d61, State: Running, Role: LEADER
I20250625 03:29:31.276631 708 raft_consensus.cc:3058] T 777af158d52d4a9db024948c66182594 P 57c574a183ee449ba3171ae11a734cc8 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:29:31.277112 560 consensus_queue.cc:260] T 777af158d52d4a9db024948c66182594 P 4967ac6ac157453da1a6e7b4f1ed8d61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:31.278054 560 raft_consensus.cc:3058] T 777af158d52d4a9db024948c66182594 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:29:31.284430 560 raft_consensus.cc:2466] T 777af158d52d4a9db024948c66182594 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b40d12015744366a464f1be5675cfb9 in term 2.
I20250625 03:29:31.285405 601 leader_election.cc:304] T 777af158d52d4a9db024948c66182594 P 7b40d12015744366a464f1be5675cfb9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4967ac6ac157453da1a6e7b4f1ed8d61, 7b40d12015744366a464f1be5675cfb9; no voters:
I20250625 03:29:31.285455 708 raft_consensus.cc:2466] T 777af158d52d4a9db024948c66182594 P 57c574a183ee449ba3171ae11a734cc8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b40d12015744366a464f1be5675cfb9 in term 2.
I20250625 03:29:31.286157 836 raft_consensus.cc:2802] T 777af158d52d4a9db024948c66182594 P 7b40d12015744366a464f1be5675cfb9 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:29:31.286616 836 raft_consensus.cc:695] T 777af158d52d4a9db024948c66182594 P 7b40d12015744366a464f1be5675cfb9 [term 2 LEADER]: Becoming Leader. State: Replica: 7b40d12015744366a464f1be5675cfb9, State: Running, Role: LEADER
I20250625 03:29:31.287328 836 consensus_queue.cc:237] T 777af158d52d4a9db024948c66182594 P 7b40d12015744366a464f1be5675cfb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:31.291603 759 raft_consensus.cc:991] T 92d6dd32053d442ca03f15c290dc495e P 7b40d12015744366a464f1be5675cfb9: : Instructing follower 4967ac6ac157453da1a6e7b4f1ed8d61 to start an election
I20250625 03:29:31.292120 780 raft_consensus.cc:1079] T 92d6dd32053d442ca03f15c290dc495e P 7b40d12015744366a464f1be5675cfb9 [term 1 LEADER]: Signalling peer 4967ac6ac157453da1a6e7b4f1ed8d61 to start an election
I20250625 03:29:31.294651 560 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "92d6dd32053d442ca03f15c290dc495e"
dest_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61"
from {username='slave'} at 127.0.0.1:48660
I20250625 03:29:31.295090 560 raft_consensus.cc:491] T 92d6dd32053d442ca03f15c290dc495e P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:29:31.295372 560 raft_consensus.cc:3058] T 92d6dd32053d442ca03f15c290dc495e P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:29:31.297886 457 catalog_manager.cc:5582] T 777af158d52d4a9db024948c66182594 P 7b40d12015744366a464f1be5675cfb9 reported cstate change: term changed from 1 to 2, leader changed from 4967ac6ac157453da1a6e7b4f1ed8d61 (127.0.106.129) to 7b40d12015744366a464f1be5675cfb9 (127.0.106.130). New cstate: current_term: 2 leader_uuid: "7b40d12015744366a464f1be5675cfb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } health_report { overall_health: UNKNOWN } } }
I20250625 03:29:31.301934 560 raft_consensus.cc:513] T 92d6dd32053d442ca03f15c290dc495e P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:31.303707 560 leader_election.cc:290] T 92d6dd32053d442ca03f15c290dc495e P 4967ac6ac157453da1a6e7b4f1ed8d61 [CANDIDATE]: Term 2 election: Requested vote from peers 7b40d12015744366a464f1be5675cfb9 (127.0.106.130:34581), 57c574a183ee449ba3171ae11a734cc8 (127.0.106.131:35951)
I20250625 03:29:31.304564 634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "92d6dd32053d442ca03f15c290dc495e" candidate_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7b40d12015744366a464f1be5675cfb9"
I20250625 03:29:31.305269 634 raft_consensus.cc:3053] T 92d6dd32053d442ca03f15c290dc495e P 7b40d12015744366a464f1be5675cfb9 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:29:31.305588 634 raft_consensus.cc:738] T 92d6dd32053d442ca03f15c290dc495e P 7b40d12015744366a464f1be5675cfb9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7b40d12015744366a464f1be5675cfb9, State: Running, Role: LEADER
I20250625 03:29:31.306309 634 consensus_queue.cc:260] T 92d6dd32053d442ca03f15c290dc495e P 7b40d12015744366a464f1be5675cfb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:31.307384 634 raft_consensus.cc:3058] T 92d6dd32053d442ca03f15c290dc495e P 7b40d12015744366a464f1be5675cfb9 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:29:31.309473 708 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "92d6dd32053d442ca03f15c290dc495e" candidate_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57c574a183ee449ba3171ae11a734cc8"
I20250625 03:29:31.309937 708 raft_consensus.cc:3058] T 92d6dd32053d442ca03f15c290dc495e P 57c574a183ee449ba3171ae11a734cc8 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:29:31.314683 634 raft_consensus.cc:2466] T 92d6dd32053d442ca03f15c290dc495e P 7b40d12015744366a464f1be5675cfb9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4967ac6ac157453da1a6e7b4f1ed8d61 in term 2.
I20250625 03:29:31.315478 708 raft_consensus.cc:2466] T 92d6dd32053d442ca03f15c290dc495e P 57c574a183ee449ba3171ae11a734cc8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4967ac6ac157453da1a6e7b4f1ed8d61 in term 2.
I20250625 03:29:31.316478 527 leader_election.cc:304] T 92d6dd32053d442ca03f15c290dc495e P 4967ac6ac157453da1a6e7b4f1ed8d61 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4967ac6ac157453da1a6e7b4f1ed8d61, 7b40d12015744366a464f1be5675cfb9; no voters:
I20250625 03:29:31.317324 779 raft_consensus.cc:2802] T 92d6dd32053d442ca03f15c290dc495e P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:29:31.317749 779 raft_consensus.cc:695] T 92d6dd32053d442ca03f15c290dc495e P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 2 LEADER]: Becoming Leader. State: Replica: 4967ac6ac157453da1a6e7b4f1ed8d61, State: Running, Role: LEADER
I20250625 03:29:31.318543 779 consensus_queue.cc:237] T 92d6dd32053d442ca03f15c290dc495e P 4967ac6ac157453da1a6e7b4f1ed8d61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:31.325095 457 catalog_manager.cc:5582] T 92d6dd32053d442ca03f15c290dc495e P 4967ac6ac157453da1a6e7b4f1ed8d61 reported cstate change: term changed from 1 to 2, leader changed from 7b40d12015744366a464f1be5675cfb9 (127.0.106.130) to 4967ac6ac157453da1a6e7b4f1ed8d61 (127.0.106.129). New cstate: current_term: 2 leader_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } health_report { overall_health: UNKNOWN } } }
I20250625 03:29:31.384433 762 raft_consensus.cc:991] T d2dd339d32874178b80ad608b5b7ea25 P 4967ac6ac157453da1a6e7b4f1ed8d61: : Instructing follower 57c574a183ee449ba3171ae11a734cc8 to start an election
I20250625 03:29:31.384932 777 raft_consensus.cc:1079] T d2dd339d32874178b80ad608b5b7ea25 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 1 LEADER]: Signalling peer 57c574a183ee449ba3171ae11a734cc8 to start an election
I20250625 03:29:31.386544 708 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "d2dd339d32874178b80ad608b5b7ea25"
dest_uuid: "57c574a183ee449ba3171ae11a734cc8"
from {username='slave'} at 127.0.0.1:51274
I20250625 03:29:31.387130 708 raft_consensus.cc:491] T d2dd339d32874178b80ad608b5b7ea25 P 57c574a183ee449ba3171ae11a734cc8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:29:31.387518 708 raft_consensus.cc:3058] T d2dd339d32874178b80ad608b5b7ea25 P 57c574a183ee449ba3171ae11a734cc8 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:29:31.391937 836 consensus_queue.cc:1035] T f9031be3db5846a194610fa6c83bc23c P 7b40d12015744366a464f1be5675cfb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:29:31.394644 708 raft_consensus.cc:513] T d2dd339d32874178b80ad608b5b7ea25 P 57c574a183ee449ba3171ae11a734cc8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:31.397192 708 leader_election.cc:290] T d2dd339d32874178b80ad608b5b7ea25 P 57c574a183ee449ba3171ae11a734cc8 [CANDIDATE]: Term 2 election: Requested vote from peers 4967ac6ac157453da1a6e7b4f1ed8d61 (127.0.106.129:41137), 7b40d12015744366a464f1be5675cfb9 (127.0.106.130:34581)
I20250625 03:29:31.397897 561 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d2dd339d32874178b80ad608b5b7ea25" candidate_uuid: "57c574a183ee449ba3171ae11a734cc8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61"
I20250625 03:29:31.398480 561 raft_consensus.cc:3053] T d2dd339d32874178b80ad608b5b7ea25 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:29:31.398782 561 raft_consensus.cc:738] T d2dd339d32874178b80ad608b5b7ea25 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4967ac6ac157453da1a6e7b4f1ed8d61, State: Running, Role: LEADER
I20250625 03:29:31.399556 561 consensus_queue.cc:260] T d2dd339d32874178b80ad608b5b7ea25 P 4967ac6ac157453da1a6e7b4f1ed8d61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:31.400431 634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d2dd339d32874178b80ad608b5b7ea25" candidate_uuid: "57c574a183ee449ba3171ae11a734cc8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7b40d12015744366a464f1be5675cfb9"
I20250625 03:29:31.401808 561 raft_consensus.cc:3058] T d2dd339d32874178b80ad608b5b7ea25 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:29:31.401963 634 raft_consensus.cc:3058] T d2dd339d32874178b80ad608b5b7ea25 P 7b40d12015744366a464f1be5675cfb9 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:29:31.402743 836 consensus_queue.cc:1035] T f9031be3db5846a194610fa6c83bc23c P 7b40d12015744366a464f1be5675cfb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:29:31.409005 780 raft_consensus.cc:991] T f9031be3db5846a194610fa6c83bc23c P 7b40d12015744366a464f1be5675cfb9: : Instructing follower 4967ac6ac157453da1a6e7b4f1ed8d61 to start an election
I20250625 03:29:31.409560 780 raft_consensus.cc:1079] T f9031be3db5846a194610fa6c83bc23c P 7b40d12015744366a464f1be5675cfb9 [term 1 LEADER]: Signalling peer 4967ac6ac157453da1a6e7b4f1ed8d61 to start an election
I20250625 03:29:31.411583 559 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "f9031be3db5846a194610fa6c83bc23c"
dest_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61"
from {username='slave'} at 127.0.0.1:48660
I20250625 03:29:31.412920 561 raft_consensus.cc:2466] T d2dd339d32874178b80ad608b5b7ea25 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57c574a183ee449ba3171ae11a734cc8 in term 2.
I20250625 03:29:31.414064 675 leader_election.cc:304] T d2dd339d32874178b80ad608b5b7ea25 P 57c574a183ee449ba3171ae11a734cc8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4967ac6ac157453da1a6e7b4f1ed8d61, 57c574a183ee449ba3171ae11a734cc8; no voters:
I20250625 03:29:31.416817 559 raft_consensus.cc:491] T f9031be3db5846a194610fa6c83bc23c P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:29:31.417215 559 raft_consensus.cc:3058] T f9031be3db5846a194610fa6c83bc23c P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:29:31.420861 760 raft_consensus.cc:2802] T d2dd339d32874178b80ad608b5b7ea25 P 57c574a183ee449ba3171ae11a734cc8 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:29:31.421409 760 raft_consensus.cc:695] T d2dd339d32874178b80ad608b5b7ea25 P 57c574a183ee449ba3171ae11a734cc8 [term 2 LEADER]: Becoming Leader. State: Replica: 57c574a183ee449ba3171ae11a734cc8, State: Running, Role: LEADER
I20250625 03:29:31.422329 760 consensus_queue.cc:237] T d2dd339d32874178b80ad608b5b7ea25 P 57c574a183ee449ba3171ae11a734cc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:31.437108 559 raft_consensus.cc:513] T f9031be3db5846a194610fa6c83bc23c P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:31.438031 634 raft_consensus.cc:2466] T d2dd339d32874178b80ad608b5b7ea25 P 7b40d12015744366a464f1be5675cfb9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57c574a183ee449ba3171ae11a734cc8 in term 2.
I20250625 03:29:31.441812 561 raft_consensus.cc:1273] T 6e85647348794694a1c45563583c5896 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 2 FOLLOWER]: Refusing update from remote peer 7b40d12015744366a464f1be5675cfb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:29:31.443605 458 catalog_manager.cc:5582] T d2dd339d32874178b80ad608b5b7ea25 P 57c574a183ee449ba3171ae11a734cc8 reported cstate change: term changed from 1 to 2, leader changed from 4967ac6ac157453da1a6e7b4f1ed8d61 (127.0.106.129) to 57c574a183ee449ba3171ae11a734cc8 (127.0.106.131). New cstate: current_term: 2 leader_uuid: "57c574a183ee449ba3171ae11a734cc8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } health_report { overall_health: HEALTHY } } }
I20250625 03:29:31.444499 780 consensus_queue.cc:1035] T 6e85647348794694a1c45563583c5896 P 7b40d12015744366a464f1be5675cfb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:29:31.449105 559 leader_election.cc:290] T f9031be3db5846a194610fa6c83bc23c P 4967ac6ac157453da1a6e7b4f1ed8d61 [CANDIDATE]: Term 2 election: Requested vote from peers 7b40d12015744366a464f1be5675cfb9 (127.0.106.130:34581), 57c574a183ee449ba3171ae11a734cc8 (127.0.106.131:35951)
I20250625 03:29:31.450671 708 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f9031be3db5846a194610fa6c83bc23c" candidate_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57c574a183ee449ba3171ae11a734cc8"
I20250625 03:29:31.451349 708 raft_consensus.cc:3058] T f9031be3db5846a194610fa6c83bc23c P 57c574a183ee449ba3171ae11a734cc8 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:29:31.454996 709 raft_consensus.cc:1273] T 6e85647348794694a1c45563583c5896 P 57c574a183ee449ba3171ae11a734cc8 [term 2 FOLLOWER]: Refusing update from remote peer 7b40d12015744366a464f1be5675cfb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:29:31.455679 634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f9031be3db5846a194610fa6c83bc23c" candidate_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7b40d12015744366a464f1be5675cfb9"
I20250625 03:29:31.456269 634 raft_consensus.cc:3053] T f9031be3db5846a194610fa6c83bc23c P 7b40d12015744366a464f1be5675cfb9 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:29:31.456590 634 raft_consensus.cc:738] T f9031be3db5846a194610fa6c83bc23c P 7b40d12015744366a464f1be5675cfb9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7b40d12015744366a464f1be5675cfb9, State: Running, Role: LEADER
I20250625 03:29:31.457413 634 consensus_queue.cc:260] T f9031be3db5846a194610fa6c83bc23c P 7b40d12015744366a464f1be5675cfb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:31.457674 836 consensus_queue.cc:1035] T 6e85647348794694a1c45563583c5896 P 7b40d12015744366a464f1be5675cfb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:29:31.458278 708 raft_consensus.cc:2466] T f9031be3db5846a194610fa6c83bc23c P 57c574a183ee449ba3171ae11a734cc8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4967ac6ac157453da1a6e7b4f1ed8d61 in term 2.
I20250625 03:29:31.458640 634 raft_consensus.cc:3058] T f9031be3db5846a194610fa6c83bc23c P 7b40d12015744366a464f1be5675cfb9 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:29:31.459340 524 leader_election.cc:304] T f9031be3db5846a194610fa6c83bc23c P 4967ac6ac157453da1a6e7b4f1ed8d61 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4967ac6ac157453da1a6e7b4f1ed8d61, 57c574a183ee449ba3171ae11a734cc8; no voters:
I20250625 03:29:31.460247 777 raft_consensus.cc:2802] T f9031be3db5846a194610fa6c83bc23c P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:29:31.460680 777 raft_consensus.cc:695] T f9031be3db5846a194610fa6c83bc23c P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 2 LEADER]: Becoming Leader. State: Replica: 4967ac6ac157453da1a6e7b4f1ed8d61, State: Running, Role: LEADER
I20250625 03:29:31.461457 777 consensus_queue.cc:237] T f9031be3db5846a194610fa6c83bc23c P 4967ac6ac157453da1a6e7b4f1ed8d61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:31.469650 634 raft_consensus.cc:2466] T f9031be3db5846a194610fa6c83bc23c P 7b40d12015744366a464f1be5675cfb9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4967ac6ac157453da1a6e7b4f1ed8d61 in term 2.
I20250625 03:29:31.477996 458 catalog_manager.cc:5582] T f9031be3db5846a194610fa6c83bc23c P 4967ac6ac157453da1a6e7b4f1ed8d61 reported cstate change: term changed from 1 to 2, leader changed from 7b40d12015744366a464f1be5675cfb9 (127.0.106.130) to 4967ac6ac157453da1a6e7b4f1ed8d61 (127.0.106.129). New cstate: current_term: 2 leader_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } health_report { overall_health: UNKNOWN } } }
I20250625 03:29:31.661599 708 raft_consensus.cc:1273] T 0d8ad140d73a4a80a1d2316ef129935d P 57c574a183ee449ba3171ae11a734cc8 [term 2 FOLLOWER]: Refusing update from remote peer 7b40d12015744366a464f1be5675cfb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:29:31.662719 836 consensus_queue.cc:1035] T 0d8ad140d73a4a80a1d2316ef129935d P 7b40d12015744366a464f1be5675cfb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:29:31.665805 709 raft_consensus.cc:1273] T 9dccb59457ba43efa6ba3f3290a028fd P 57c574a183ee449ba3171ae11a734cc8 [term 2 FOLLOWER]: Refusing update from remote peer 7b40d12015744366a464f1be5675cfb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:29:31.667213 836 consensus_queue.cc:1035] T 9dccb59457ba43efa6ba3f3290a028fd P 7b40d12015744366a464f1be5675cfb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:29:31.672408 559 raft_consensus.cc:1273] T 0d8ad140d73a4a80a1d2316ef129935d P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 2 FOLLOWER]: Refusing update from remote peer 7b40d12015744366a464f1be5675cfb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:29:31.673820 780 consensus_queue.cc:1035] T 0d8ad140d73a4a80a1d2316ef129935d P 7b40d12015744366a464f1be5675cfb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:29:31.676582 559 raft_consensus.cc:1273] T 9dccb59457ba43efa6ba3f3290a028fd P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 2 FOLLOWER]: Refusing update from remote peer 7b40d12015744366a464f1be5675cfb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:29:31.678499 836 consensus_queue.cc:1035] T 9dccb59457ba43efa6ba3f3290a028fd P 7b40d12015744366a464f1be5675cfb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:29:31.690996 634 raft_consensus.cc:1273] T 4e9ead806c80443da83728a2f97fc310 P 7b40d12015744366a464f1be5675cfb9 [term 2 FOLLOWER]: Refusing update from remote peer 4967ac6ac157453da1a6e7b4f1ed8d61: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:29:31.692507 779 consensus_queue.cc:1035] T 4e9ead806c80443da83728a2f97fc310 P 4967ac6ac157453da1a6e7b4f1ed8d61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:29:31.701148 709 raft_consensus.cc:1273] T 4e9ead806c80443da83728a2f97fc310 P 57c574a183ee449ba3171ae11a734cc8 [term 2 FOLLOWER]: Refusing update from remote peer 4967ac6ac157453da1a6e7b4f1ed8d61: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:29:31.704313 777 consensus_queue.cc:1035] T 4e9ead806c80443da83728a2f97fc310 P 4967ac6ac157453da1a6e7b4f1ed8d61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:29:31.706321 634 raft_consensus.cc:1273] T 92d6dd32053d442ca03f15c290dc495e P 7b40d12015744366a464f1be5675cfb9 [term 2 FOLLOWER]: Refusing update from remote peer 4967ac6ac157453da1a6e7b4f1ed8d61: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:29:31.707865 777 consensus_queue.cc:1035] T 92d6dd32053d442ca03f15c290dc495e P 4967ac6ac157453da1a6e7b4f1ed8d61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:29:31.718936 709 raft_consensus.cc:1273] T 92d6dd32053d442ca03f15c290dc495e P 57c574a183ee449ba3171ae11a734cc8 [term 2 FOLLOWER]: Refusing update from remote peer 4967ac6ac157453da1a6e7b4f1ed8d61: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:29:31.723888 779 consensus_queue.cc:1035] T 92d6dd32053d442ca03f15c290dc495e P 4967ac6ac157453da1a6e7b4f1ed8d61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20250625 03:29:31.729617 560 raft_consensus.cc:1273] T 777af158d52d4a9db024948c66182594 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 2 FOLLOWER]: Refusing update from remote peer 7b40d12015744366a464f1be5675cfb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:29:31.730716 836 consensus_queue.cc:1035] T 777af158d52d4a9db024948c66182594 P 7b40d12015744366a464f1be5675cfb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:29:31.743418 709 raft_consensus.cc:1273] T 777af158d52d4a9db024948c66182594 P 57c574a183ee449ba3171ae11a734cc8 [term 2 FOLLOWER]: Refusing update from remote peer 7b40d12015744366a464f1be5675cfb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:29:31.744921 836 consensus_queue.cc:1035] T 777af158d52d4a9db024948c66182594 P 7b40d12015744366a464f1be5675cfb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:29:31.850176 634 raft_consensus.cc:1273] T d2dd339d32874178b80ad608b5b7ea25 P 7b40d12015744366a464f1be5675cfb9 [term 2 FOLLOWER]: Refusing update from remote peer 57c574a183ee449ba3171ae11a734cc8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:29:31.851367 760 consensus_queue.cc:1035] T d2dd339d32874178b80ad608b5b7ea25 P 57c574a183ee449ba3171ae11a734cc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:29:31.859300 560 raft_consensus.cc:1273] T d2dd339d32874178b80ad608b5b7ea25 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 2 FOLLOWER]: Refusing update from remote peer 57c574a183ee449ba3171ae11a734cc8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:29:31.860703 760 consensus_queue.cc:1035] T d2dd339d32874178b80ad608b5b7ea25 P 57c574a183ee449ba3171ae11a734cc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:29:32.001528 709 raft_consensus.cc:1273] T f9031be3db5846a194610fa6c83bc23c P 57c574a183ee449ba3171ae11a734cc8 [term 2 FOLLOWER]: Refusing update from remote peer 4967ac6ac157453da1a6e7b4f1ed8d61: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:29:32.002626 779 consensus_queue.cc:1035] T f9031be3db5846a194610fa6c83bc23c P 4967ac6ac157453da1a6e7b4f1ed8d61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:29:32.009691 634 raft_consensus.cc:1273] T f9031be3db5846a194610fa6c83bc23c P 7b40d12015744366a464f1be5675cfb9 [term 2 FOLLOWER]: Refusing update from remote peer 4967ac6ac157453da1a6e7b4f1ed8d61: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:29:32.011214 762 consensus_queue.cc:1035] T f9031be3db5846a194610fa6c83bc23c P 4967ac6ac157453da1a6e7b4f1ed8d61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:29:33.997460 426 auto_leader_rebalancer-test.cc:272] The leader distribution is
I20250625 03:29:33.998404 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:29:34.021610 560 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "4e9ead806c80443da83728a2f97fc310"
dest_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61"
mode: GRACEFUL
new_leader_uuid: "57c574a183ee449ba3171ae11a734cc8"
from {username='slave'} at 127.0.0.1:44156
I20250625 03:29:34.022130 560 raft_consensus.cc:604] T 4e9ead806c80443da83728a2f97fc310 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 2 LEADER]: Received request to transfer leadership to TS 57c574a183ee449ba3171ae11a734cc8
I20250625 03:29:34.031427 854 raft_consensus.cc:991] T 4e9ead806c80443da83728a2f97fc310 P 4967ac6ac157453da1a6e7b4f1ed8d61: : Instructing follower 57c574a183ee449ba3171ae11a734cc8 to start an election
I20250625 03:29:34.031862 854 raft_consensus.cc:1079] T 4e9ead806c80443da83728a2f97fc310 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 2 LEADER]: Signalling peer 57c574a183ee449ba3171ae11a734cc8 to start an election
I20250625 03:29:34.031939 634 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "6e85647348794694a1c45563583c5896"
dest_uuid: "7b40d12015744366a464f1be5675cfb9"
mode: GRACEFUL
new_leader_uuid: "57c574a183ee449ba3171ae11a734cc8"
from {username='slave'} at 127.0.0.1:44280
I20250625 03:29:34.032611 634 raft_consensus.cc:604] T 6e85647348794694a1c45563583c5896 P 7b40d12015744366a464f1be5675cfb9 [term 2 LEADER]: Received request to transfer leadership to TS 57c574a183ee449ba3171ae11a734cc8
I20250625 03:29:34.033589 709 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "4e9ead806c80443da83728a2f97fc310"
dest_uuid: "57c574a183ee449ba3171ae11a734cc8"
from {username='slave'} at 127.0.0.1:51274
I20250625 03:29:34.033797 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20250625 03:29:34.034300 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:29:34.034163 709 raft_consensus.cc:491] T 4e9ead806c80443da83728a2f97fc310 P 57c574a183ee449ba3171ae11a734cc8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:29:34.034610 709 raft_consensus.cc:3058] T 4e9ead806c80443da83728a2f97fc310 P 57c574a183ee449ba3171ae11a734cc8 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:29:34.039077 709 raft_consensus.cc:513] T 4e9ead806c80443da83728a2f97fc310 P 57c574a183ee449ba3171ae11a734cc8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } } peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } }
I20250625 03:29:34.040728 709 leader_election.cc:290] T 4e9ead806c80443da83728a2f97fc310 P 57c574a183ee449ba3171ae11a734cc8 [CANDIDATE]: Term 3 election: Requested vote from peers 4967ac6ac157453da1a6e7b4f1ed8d61 (127.0.106.129:41137), 7b40d12015744366a464f1be5675cfb9 (127.0.106.130:34581)
I20250625 03:29:34.041530 560 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4e9ead806c80443da83728a2f97fc310" candidate_uuid: "57c574a183ee449ba3171ae11a734cc8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61"
I20250625 03:29:34.041740 634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4e9ead806c80443da83728a2f97fc310" candidate_uuid: "57c574a183ee449ba3171ae11a734cc8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7b40d12015744366a464f1be5675cfb9"
I20250625 03:29:34.042018 560 raft_consensus.cc:3053] T 4e9ead806c80443da83728a2f97fc310 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 2 LEADER]: Stepping down as leader of term 2
I20250625 03:29:34.042194 634 raft_consensus.cc:3058] T 4e9ead806c80443da83728a2f97fc310 P 7b40d12015744366a464f1be5675cfb9 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:29:34.042310 560 raft_consensus.cc:738] T 4e9ead806c80443da83728a2f97fc310 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4967ac6ac157453da1a6e7b4f1ed8d61, State: Running, Role: LEADER
I20250625 03:29:34.043005 560 consensus_queue.cc:260] T 4e9ead806c80443da83728a2f97fc310 P 4967ac6ac157453da1a6e7b4f1ed8d61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } } peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } }
I20250625 03:29:34.043783 560 raft_consensus.cc:3058] T 4e9ead806c80443da83728a2f97fc310 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:29:34.046692 634 raft_consensus.cc:2466] T 4e9ead806c80443da83728a2f97fc310 P 7b40d12015744366a464f1be5675cfb9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57c574a183ee449ba3171ae11a734cc8 in term 3.
I20250625 03:29:34.047678 560 raft_consensus.cc:2466] T 4e9ead806c80443da83728a2f97fc310 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57c574a183ee449ba3171ae11a734cc8 in term 3.
I20250625 03:29:34.047710 676 leader_election.cc:304] T 4e9ead806c80443da83728a2f97fc310 P 57c574a183ee449ba3171ae11a734cc8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57c574a183ee449ba3171ae11a734cc8, 7b40d12015744366a464f1be5675cfb9; no voters:
I20250625 03:29:34.048543 760 raft_consensus.cc:2802] T 4e9ead806c80443da83728a2f97fc310 P 57c574a183ee449ba3171ae11a734cc8 [term 3 FOLLOWER]: Leader election won for term 3
I20250625 03:29:34.049512 760 raft_consensus.cc:695] T 4e9ead806c80443da83728a2f97fc310 P 57c574a183ee449ba3171ae11a734cc8 [term 3 LEADER]: Becoming Leader. State: Replica: 57c574a183ee449ba3171ae11a734cc8, State: Running, Role: LEADER
I20250625 03:29:34.050226 760 consensus_queue.cc:237] T 4e9ead806c80443da83728a2f97fc310 P 57c574a183ee449ba3171ae11a734cc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } } peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } }
I20250625 03:29:34.056842 456 catalog_manager.cc:5582] T 4e9ead806c80443da83728a2f97fc310 P 57c574a183ee449ba3171ae11a734cc8 reported cstate change: term changed from 2 to 3, leader changed from 4967ac6ac157453da1a6e7b4f1ed8d61 (127.0.106.129) to 57c574a183ee449ba3171ae11a734cc8 (127.0.106.131). New cstate: current_term: 3 leader_uuid: "57c574a183ee449ba3171ae11a734cc8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } health_report { overall_health: UNKNOWN } } }
I20250625 03:29:34.179484 845 raft_consensus.cc:991] T 6e85647348794694a1c45563583c5896 P 7b40d12015744366a464f1be5675cfb9: : Instructing follower 57c574a183ee449ba3171ae11a734cc8 to start an election
I20250625 03:29:34.179906 861 raft_consensus.cc:1079] T 6e85647348794694a1c45563583c5896 P 7b40d12015744366a464f1be5675cfb9 [term 2 LEADER]: Signalling peer 57c574a183ee449ba3171ae11a734cc8 to start an election
I20250625 03:29:34.181449 709 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "6e85647348794694a1c45563583c5896"
dest_uuid: "57c574a183ee449ba3171ae11a734cc8"
from {username='slave'} at 127.0.0.1:51264
I20250625 03:29:34.181954 709 raft_consensus.cc:491] T 6e85647348794694a1c45563583c5896 P 57c574a183ee449ba3171ae11a734cc8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:29:34.182199 709 raft_consensus.cc:3058] T 6e85647348794694a1c45563583c5896 P 57c574a183ee449ba3171ae11a734cc8 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:29:34.186839 709 raft_consensus.cc:513] T 6e85647348794694a1c45563583c5896 P 57c574a183ee449ba3171ae11a734cc8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:34.188313 709 leader_election.cc:290] T 6e85647348794694a1c45563583c5896 P 57c574a183ee449ba3171ae11a734cc8 [CANDIDATE]: Term 3 election: Requested vote from peers 4967ac6ac157453da1a6e7b4f1ed8d61 (127.0.106.129:41137), 7b40d12015744366a464f1be5675cfb9 (127.0.106.130:34581)
I20250625 03:29:34.189298 560 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6e85647348794694a1c45563583c5896" candidate_uuid: "57c574a183ee449ba3171ae11a734cc8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61"
I20250625 03:29:34.189334 634 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6e85647348794694a1c45563583c5896" candidate_uuid: "57c574a183ee449ba3171ae11a734cc8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7b40d12015744366a464f1be5675cfb9"
I20250625 03:29:34.189888 560 raft_consensus.cc:3058] T 6e85647348794694a1c45563583c5896 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:29:34.190045 634 raft_consensus.cc:3053] T 6e85647348794694a1c45563583c5896 P 7b40d12015744366a464f1be5675cfb9 [term 2 LEADER]: Stepping down as leader of term 2
I20250625 03:29:34.190429 634 raft_consensus.cc:738] T 6e85647348794694a1c45563583c5896 P 7b40d12015744366a464f1be5675cfb9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7b40d12015744366a464f1be5675cfb9, State: Running, Role: LEADER
I20250625 03:29:34.191174 634 consensus_queue.cc:260] T 6e85647348794694a1c45563583c5896 P 7b40d12015744366a464f1be5675cfb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:34.192305 634 raft_consensus.cc:3058] T 6e85647348794694a1c45563583c5896 P 7b40d12015744366a464f1be5675cfb9 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:29:34.195034 560 raft_consensus.cc:2466] T 6e85647348794694a1c45563583c5896 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57c574a183ee449ba3171ae11a734cc8 in term 3.
I20250625 03:29:34.196050 675 leader_election.cc:304] T 6e85647348794694a1c45563583c5896 P 57c574a183ee449ba3171ae11a734cc8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4967ac6ac157453da1a6e7b4f1ed8d61, 57c574a183ee449ba3171ae11a734cc8; no voters:
I20250625 03:29:34.196727 760 raft_consensus.cc:2802] T 6e85647348794694a1c45563583c5896 P 57c574a183ee449ba3171ae11a734cc8 [term 3 FOLLOWER]: Leader election won for term 3
I20250625 03:29:34.197093 760 raft_consensus.cc:695] T 6e85647348794694a1c45563583c5896 P 57c574a183ee449ba3171ae11a734cc8 [term 3 LEADER]: Becoming Leader. State: Replica: 57c574a183ee449ba3171ae11a734cc8, State: Running, Role: LEADER
I20250625 03:29:34.197882 634 raft_consensus.cc:2466] T 6e85647348794694a1c45563583c5896 P 7b40d12015744366a464f1be5675cfb9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57c574a183ee449ba3171ae11a734cc8 in term 3.
I20250625 03:29:34.197818 760 consensus_queue.cc:237] T 6e85647348794694a1c45563583c5896 P 57c574a183ee449ba3171ae11a734cc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:34.208799 458 catalog_manager.cc:5582] T 6e85647348794694a1c45563583c5896 P 57c574a183ee449ba3171ae11a734cc8 reported cstate change: term changed from 2 to 3, leader changed from 7b40d12015744366a464f1be5675cfb9 (127.0.106.130) to 57c574a183ee449ba3171ae11a734cc8 (127.0.106.131). New cstate: current_term: 3 leader_uuid: "57c574a183ee449ba3171ae11a734cc8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } health_report { overall_health: HEALTHY } } }
I20250625 03:29:34.542852 634 raft_consensus.cc:1273] T 4e9ead806c80443da83728a2f97fc310 P 7b40d12015744366a464f1be5675cfb9 [term 3 FOLLOWER]: Refusing update from remote peer 57c574a183ee449ba3171ae11a734cc8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250625 03:29:34.543974 760 consensus_queue.cc:1035] T 4e9ead806c80443da83728a2f97fc310 P 57c574a183ee449ba3171ae11a734cc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:29:34.552791 560 raft_consensus.cc:1273] T 4e9ead806c80443da83728a2f97fc310 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 3 FOLLOWER]: Refusing update from remote peer 57c574a183ee449ba3171ae11a734cc8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250625 03:29:34.554822 855 consensus_queue.cc:1035] T 4e9ead806c80443da83728a2f97fc310 P 57c574a183ee449ba3171ae11a734cc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:29:34.577095 560 raft_consensus.cc:1273] T 6e85647348794694a1c45563583c5896 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 3 FOLLOWER]: Refusing update from remote peer 57c574a183ee449ba3171ae11a734cc8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250625 03:29:34.578754 865 consensus_queue.cc:1035] T 6e85647348794694a1c45563583c5896 P 57c574a183ee449ba3171ae11a734cc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:29:34.589257 634 raft_consensus.cc:1273] T 6e85647348794694a1c45563583c5896 P 7b40d12015744366a464f1be5675cfb9 [term 3 FOLLOWER]: Refusing update from remote peer 57c574a183ee449ba3171ae11a734cc8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250625 03:29:34.591291 855 consensus_queue.cc:1035] T 6e85647348794694a1c45563583c5896 P 57c574a183ee449ba3171ae11a734cc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:29:35.035163 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:29:35.040045 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250625 03:29:35.040454 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:29:36.282655 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:29:36.288830 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250625 03:29:36.289289 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
W20250625 03:29:36.630713 582 debug-util.cc:398] Leaking SignalData structure 0x7b08000e4060 after lost signal to thread 429
W20250625 03:29:36.631412 582 debug-util.cc:398] Leaking SignalData structure 0x7b08000e4740 after lost signal to thread 492
W20250625 03:29:36.632157 582 debug-util.cc:398] Leaking SignalData structure 0x7b08000407e0 after lost signal to thread 585
W20250625 03:29:36.632808 582 debug-util.cc:398] Leaking SignalData structure 0x7b08001a2000 after lost signal to thread 660
W20250625 03:29:36.633908 582 debug-util.cc:398] Leaking SignalData structure 0x7b08001e0540 after lost signal to thread 734
I20250625 03:29:37.290697 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:29:37.299403 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250625 03:29:37.299860 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:29:38.301015 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:29:38.308984 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250625 03:29:38.309544 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:29:39.310390 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:29:39.315446 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250625 03:29:39.315821 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:29:40.316740 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:29:40.321485 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250625 03:29:40.321877 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:29:41.322749 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:29:41.327534 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250625 03:29:41.327919 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:29:42.328805 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:29:42.333935 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250625 03:29:42.334311 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:29:43.335172 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:29:43.340253 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250625 03:29:43.340632 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:29:44.367189 426 auto_leader_rebalancer-test.cc:291] The leader distribution is
I20250625 03:29:44.371907 708 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "4e9ead806c80443da83728a2f97fc310"
dest_uuid: "57c574a183ee449ba3171ae11a734cc8"
mode: GRACEFUL
new_leader_uuid: "7b40d12015744366a464f1be5675cfb9"
from {username='slave'} at 127.0.0.1:51286
I20250625 03:29:44.372614 708 raft_consensus.cc:604] T 4e9ead806c80443da83728a2f97fc310 P 57c574a183ee449ba3171ae11a734cc8 [term 3 LEADER]: Received request to transfer leadership to TS 7b40d12015744366a464f1be5675cfb9
I20250625 03:29:44.377312 560 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "48a6f4f9f8cc41f48d562f310ec0b9d5"
dest_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61"
mode: GRACEFUL
new_leader_uuid: "7b40d12015744366a464f1be5675cfb9"
from {username='slave'} at 127.0.0.1:48680
I20250625 03:29:44.377743 560 raft_consensus.cc:604] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 1 LEADER]: Received request to transfer leadership to TS 7b40d12015744366a464f1be5675cfb9
I20250625 03:29:44.381927 560 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "92d6dd32053d442ca03f15c290dc495e"
dest_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61"
mode: GRACEFUL
new_leader_uuid: "7b40d12015744366a464f1be5675cfb9"
from {username='slave'} at 127.0.0.1:48680
I20250625 03:29:44.382340 560 raft_consensus.cc:604] T 92d6dd32053d442ca03f15c290dc495e P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 2 LEADER]: Received request to transfer leadership to TS 7b40d12015744366a464f1be5675cfb9
I20250625 03:29:44.386471 560 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "f9031be3db5846a194610fa6c83bc23c"
dest_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61"
mode: GRACEFUL
new_leader_uuid: "7b40d12015744366a464f1be5675cfb9"
from {username='slave'} at 127.0.0.1:48680
I20250625 03:29:44.386924 560 raft_consensus.cc:604] T f9031be3db5846a194610fa6c83bc23c P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 2 LEADER]: Received request to transfer leadership to TS 7b40d12015744366a464f1be5675cfb9
I20250625 03:29:44.398186 708 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "6e85647348794694a1c45563583c5896"
dest_uuid: "57c574a183ee449ba3171ae11a734cc8"
mode: GRACEFUL
new_leader_uuid: "7b40d12015744366a464f1be5675cfb9"
from {username='slave'} at 127.0.0.1:51286
I20250625 03:29:44.398630 708 raft_consensus.cc:604] T 6e85647348794694a1c45563583c5896 P 57c574a183ee449ba3171ae11a734cc8 [term 3 LEADER]: Received request to transfer leadership to TS 7b40d12015744366a464f1be5675cfb9
I20250625 03:29:44.450089 854 raft_consensus.cc:991] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 4967ac6ac157453da1a6e7b4f1ed8d61: : Instructing follower 7b40d12015744366a464f1be5675cfb9 to start an election
I20250625 03:29:44.450670 878 raft_consensus.cc:1079] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 1 LEADER]: Signalling peer 7b40d12015744366a464f1be5675cfb9 to start an election
I20250625 03:29:44.452198 636 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "48a6f4f9f8cc41f48d562f310ec0b9d5"
dest_uuid: "7b40d12015744366a464f1be5675cfb9"
from {username='slave'} at 127.0.0.1:43492
I20250625 03:29:44.452739 636 raft_consensus.cc:491] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 7b40d12015744366a464f1be5675cfb9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:29:44.453080 636 raft_consensus.cc:3058] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 7b40d12015744366a464f1be5675cfb9 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:29:44.458431 636 raft_consensus.cc:513] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 7b40d12015744366a464f1be5675cfb9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:44.459900 636 leader_election.cc:290] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 7b40d12015744366a464f1be5675cfb9 [CANDIDATE]: Term 2 election: Requested vote from peers 4967ac6ac157453da1a6e7b4f1ed8d61 (127.0.106.129:41137), 57c574a183ee449ba3171ae11a734cc8 (127.0.106.131:35951)
I20250625 03:29:44.461021 708 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "48a6f4f9f8cc41f48d562f310ec0b9d5" candidate_uuid: "7b40d12015744366a464f1be5675cfb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57c574a183ee449ba3171ae11a734cc8"
I20250625 03:29:44.460922 560 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "48a6f4f9f8cc41f48d562f310ec0b9d5" candidate_uuid: "7b40d12015744366a464f1be5675cfb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61"
I20250625 03:29:44.461616 708 raft_consensus.cc:3058] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 57c574a183ee449ba3171ae11a734cc8 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:29:44.461764 560 raft_consensus.cc:3053] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:29:44.462076 560 raft_consensus.cc:738] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4967ac6ac157453da1a6e7b4f1ed8d61, State: Running, Role: LEADER
I20250625 03:29:44.462798 560 consensus_queue.cc:260] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 4967ac6ac157453da1a6e7b4f1ed8d61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:44.463729 560 raft_consensus.cc:3058] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:29:44.465946 708 raft_consensus.cc:2466] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 57c574a183ee449ba3171ae11a734cc8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b40d12015744366a464f1be5675cfb9 in term 2.
I20250625 03:29:44.466995 599 leader_election.cc:304] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 7b40d12015744366a464f1be5675cfb9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57c574a183ee449ba3171ae11a734cc8, 7b40d12015744366a464f1be5675cfb9; no voters:
I20250625 03:29:44.467770 875 raft_consensus.cc:2802] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 7b40d12015744366a464f1be5675cfb9 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:29:44.468174 560 raft_consensus.cc:2466] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b40d12015744366a464f1be5675cfb9 in term 2.
I20250625 03:29:44.468866 875 raft_consensus.cc:695] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 7b40d12015744366a464f1be5675cfb9 [term 2 LEADER]: Becoming Leader. State: Replica: 7b40d12015744366a464f1be5675cfb9, State: Running, Role: LEADER
I20250625 03:29:44.469861 875 consensus_queue.cc:237] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 7b40d12015744366a464f1be5675cfb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:44.479892 456 catalog_manager.cc:5582] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 7b40d12015744366a464f1be5675cfb9 reported cstate change: term changed from 1 to 2, leader changed from 4967ac6ac157453da1a6e7b4f1ed8d61 (127.0.106.129) to 7b40d12015744366a464f1be5675cfb9 (127.0.106.130). New cstate: current_term: 2 leader_uuid: "7b40d12015744366a464f1be5675cfb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } health_report { overall_health: UNKNOWN } } }
I20250625 03:29:44.537601 854 raft_consensus.cc:991] T 92d6dd32053d442ca03f15c290dc495e P 4967ac6ac157453da1a6e7b4f1ed8d61: : Instructing follower 7b40d12015744366a464f1be5675cfb9 to start an election
I20250625 03:29:44.537989 854 raft_consensus.cc:1079] T 92d6dd32053d442ca03f15c290dc495e P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 2 LEADER]: Signalling peer 7b40d12015744366a464f1be5675cfb9 to start an election
I20250625 03:29:44.539176 636 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "92d6dd32053d442ca03f15c290dc495e"
dest_uuid: "7b40d12015744366a464f1be5675cfb9"
from {username='slave'} at 127.0.0.1:43492
I20250625 03:29:44.539578 636 raft_consensus.cc:491] T 92d6dd32053d442ca03f15c290dc495e P 7b40d12015744366a464f1be5675cfb9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:29:44.539819 636 raft_consensus.cc:3058] T 92d6dd32053d442ca03f15c290dc495e P 7b40d12015744366a464f1be5675cfb9 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:29:44.543761 636 raft_consensus.cc:513] T 92d6dd32053d442ca03f15c290dc495e P 7b40d12015744366a464f1be5675cfb9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:44.545179 636 leader_election.cc:290] T 92d6dd32053d442ca03f15c290dc495e P 7b40d12015744366a464f1be5675cfb9 [CANDIDATE]: Term 3 election: Requested vote from peers 4967ac6ac157453da1a6e7b4f1ed8d61 (127.0.106.129:41137), 57c574a183ee449ba3171ae11a734cc8 (127.0.106.131:35951)
I20250625 03:29:44.545987 560 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "92d6dd32053d442ca03f15c290dc495e" candidate_uuid: "7b40d12015744366a464f1be5675cfb9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61"
I20250625 03:29:44.546175 708 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "92d6dd32053d442ca03f15c290dc495e" candidate_uuid: "7b40d12015744366a464f1be5675cfb9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "57c574a183ee449ba3171ae11a734cc8"
I20250625 03:29:44.546554 560 raft_consensus.cc:3053] T 92d6dd32053d442ca03f15c290dc495e P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 2 LEADER]: Stepping down as leader of term 2
I20250625 03:29:44.546617 708 raft_consensus.cc:3058] T 92d6dd32053d442ca03f15c290dc495e P 57c574a183ee449ba3171ae11a734cc8 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:29:44.546937 560 raft_consensus.cc:738] T 92d6dd32053d442ca03f15c290dc495e P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4967ac6ac157453da1a6e7b4f1ed8d61, State: Running, Role: LEADER
I20250625 03:29:44.547782 885 raft_consensus.cc:991] T 6e85647348794694a1c45563583c5896 P 57c574a183ee449ba3171ae11a734cc8: : Instructing follower 7b40d12015744366a464f1be5675cfb9 to start an election
I20250625 03:29:44.547614 560 consensus_queue.cc:260] T 92d6dd32053d442ca03f15c290dc495e P 4967ac6ac157453da1a6e7b4f1ed8d61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:44.548477 876 raft_consensus.cc:1079] T 6e85647348794694a1c45563583c5896 P 57c574a183ee449ba3171ae11a734cc8 [term 3 LEADER]: Signalling peer 7b40d12015744366a464f1be5675cfb9 to start an election
I20250625 03:29:44.548897 560 raft_consensus.cc:3058] T 92d6dd32053d442ca03f15c290dc495e P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:29:44.549825 636 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "6e85647348794694a1c45563583c5896"
dest_uuid: "7b40d12015744366a464f1be5675cfb9"
from {username='slave'} at 127.0.0.1:43494
I20250625 03:29:44.550299 636 raft_consensus.cc:491] T 6e85647348794694a1c45563583c5896 P 7b40d12015744366a464f1be5675cfb9 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:29:44.550637 636 raft_consensus.cc:3058] T 6e85647348794694a1c45563583c5896 P 7b40d12015744366a464f1be5675cfb9 [term 3 FOLLOWER]: Advancing to term 4
I20250625 03:29:44.553092 708 raft_consensus.cc:2466] T 92d6dd32053d442ca03f15c290dc495e P 57c574a183ee449ba3171ae11a734cc8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b40d12015744366a464f1be5675cfb9 in term 3.
I20250625 03:29:44.554126 599 leader_election.cc:304] T 92d6dd32053d442ca03f15c290dc495e P 7b40d12015744366a464f1be5675cfb9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57c574a183ee449ba3171ae11a734cc8, 7b40d12015744366a464f1be5675cfb9; no voters:
I20250625 03:29:44.554895 560 raft_consensus.cc:2466] T 92d6dd32053d442ca03f15c290dc495e P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b40d12015744366a464f1be5675cfb9 in term 3.
I20250625 03:29:44.554926 875 raft_consensus.cc:2802] T 92d6dd32053d442ca03f15c290dc495e P 7b40d12015744366a464f1be5675cfb9 [term 3 FOLLOWER]: Leader election won for term 3
I20250625 03:29:44.555744 875 raft_consensus.cc:695] T 92d6dd32053d442ca03f15c290dc495e P 7b40d12015744366a464f1be5675cfb9 [term 3 LEADER]: Becoming Leader. State: Replica: 7b40d12015744366a464f1be5675cfb9, State: Running, Role: LEADER
I20250625 03:29:44.555851 636 raft_consensus.cc:513] T 6e85647348794694a1c45563583c5896 P 7b40d12015744366a464f1be5675cfb9 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:44.556779 875 consensus_queue.cc:237] T 92d6dd32053d442ca03f15c290dc495e P 7b40d12015744366a464f1be5675cfb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:44.557690 636 leader_election.cc:290] T 6e85647348794694a1c45563583c5896 P 7b40d12015744366a464f1be5675cfb9 [CANDIDATE]: Term 4 election: Requested vote from peers 4967ac6ac157453da1a6e7b4f1ed8d61 (127.0.106.129:41137), 57c574a183ee449ba3171ae11a734cc8 (127.0.106.131:35951)
I20250625 03:29:44.558528 560 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6e85647348794694a1c45563583c5896" candidate_uuid: "7b40d12015744366a464f1be5675cfb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61"
I20250625 03:29:44.558676 708 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6e85647348794694a1c45563583c5896" candidate_uuid: "7b40d12015744366a464f1be5675cfb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "57c574a183ee449ba3171ae11a734cc8"
I20250625 03:29:44.559100 708 raft_consensus.cc:3053] T 6e85647348794694a1c45563583c5896 P 57c574a183ee449ba3171ae11a734cc8 [term 3 LEADER]: Stepping down as leader of term 3
I20250625 03:29:44.559099 560 raft_consensus.cc:3058] T 6e85647348794694a1c45563583c5896 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 3 FOLLOWER]: Advancing to term 4
I20250625 03:29:44.559551 708 raft_consensus.cc:738] T 6e85647348794694a1c45563583c5896 P 57c574a183ee449ba3171ae11a734cc8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 57c574a183ee449ba3171ae11a734cc8, State: Running, Role: LEADER
I20250625 03:29:44.560289 708 consensus_queue.cc:260] T 6e85647348794694a1c45563583c5896 P 57c574a183ee449ba3171ae11a734cc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:44.561568 708 raft_consensus.cc:3058] T 6e85647348794694a1c45563583c5896 P 57c574a183ee449ba3171ae11a734cc8 [term 3 FOLLOWER]: Advancing to term 4
I20250625 03:29:44.564909 456 catalog_manager.cc:5582] T 92d6dd32053d442ca03f15c290dc495e P 7b40d12015744366a464f1be5675cfb9 reported cstate change: term changed from 2 to 3, leader changed from 4967ac6ac157453da1a6e7b4f1ed8d61 (127.0.106.129) to 7b40d12015744366a464f1be5675cfb9 (127.0.106.130). New cstate: current_term: 3 leader_uuid: "7b40d12015744366a464f1be5675cfb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } health_report { overall_health: UNKNOWN } } }
I20250625 03:29:44.567322 560 raft_consensus.cc:2466] T 6e85647348794694a1c45563583c5896 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b40d12015744366a464f1be5675cfb9 in term 4.
I20250625 03:29:44.567322 708 raft_consensus.cc:2466] T 6e85647348794694a1c45563583c5896 P 57c574a183ee449ba3171ae11a734cc8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b40d12015744366a464f1be5675cfb9 in term 4.
I20250625 03:29:44.568658 601 leader_election.cc:304] T 6e85647348794694a1c45563583c5896 P 7b40d12015744366a464f1be5675cfb9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4967ac6ac157453da1a6e7b4f1ed8d61, 7b40d12015744366a464f1be5675cfb9; no voters:
I20250625 03:29:44.569443 875 raft_consensus.cc:2802] T 6e85647348794694a1c45563583c5896 P 7b40d12015744366a464f1be5675cfb9 [term 4 FOLLOWER]: Leader election won for term 4
I20250625 03:29:44.569898 875 raft_consensus.cc:695] T 6e85647348794694a1c45563583c5896 P 7b40d12015744366a464f1be5675cfb9 [term 4 LEADER]: Becoming Leader. State: Replica: 7b40d12015744366a464f1be5675cfb9, State: Running, Role: LEADER
I20250625 03:29:44.570848 875 consensus_queue.cc:237] T 6e85647348794694a1c45563583c5896 P 7b40d12015744366a464f1be5675cfb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:44.576517 885 raft_consensus.cc:991] T 4e9ead806c80443da83728a2f97fc310 P 57c574a183ee449ba3171ae11a734cc8: : Instructing follower 7b40d12015744366a464f1be5675cfb9 to start an election
I20250625 03:29:44.577049 876 raft_consensus.cc:1079] T 4e9ead806c80443da83728a2f97fc310 P 57c574a183ee449ba3171ae11a734cc8 [term 3 LEADER]: Signalling peer 7b40d12015744366a464f1be5675cfb9 to start an election
I20250625 03:29:44.578333 636 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "4e9ead806c80443da83728a2f97fc310"
dest_uuid: "7b40d12015744366a464f1be5675cfb9"
from {username='slave'} at 127.0.0.1:43494
I20250625 03:29:44.578774 636 raft_consensus.cc:491] T 4e9ead806c80443da83728a2f97fc310 P 7b40d12015744366a464f1be5675cfb9 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:29:44.579031 636 raft_consensus.cc:3058] T 4e9ead806c80443da83728a2f97fc310 P 7b40d12015744366a464f1be5675cfb9 [term 3 FOLLOWER]: Advancing to term 4
I20250625 03:29:44.579145 456 catalog_manager.cc:5582] T 6e85647348794694a1c45563583c5896 P 7b40d12015744366a464f1be5675cfb9 reported cstate change: term changed from 3 to 4, leader changed from 57c574a183ee449ba3171ae11a734cc8 (127.0.106.131) to 7b40d12015744366a464f1be5675cfb9 (127.0.106.130). New cstate: current_term: 4 leader_uuid: "7b40d12015744366a464f1be5675cfb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } health_report { overall_health: UNKNOWN } } }
I20250625 03:29:44.584091 636 raft_consensus.cc:513] T 4e9ead806c80443da83728a2f97fc310 P 7b40d12015744366a464f1be5675cfb9 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } } peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } }
I20250625 03:29:44.586078 636 leader_election.cc:290] T 4e9ead806c80443da83728a2f97fc310 P 7b40d12015744366a464f1be5675cfb9 [CANDIDATE]: Term 4 election: Requested vote from peers 57c574a183ee449ba3171ae11a734cc8 (127.0.106.131:35951), 4967ac6ac157453da1a6e7b4f1ed8d61 (127.0.106.129:41137)
I20250625 03:29:44.586673 708 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4e9ead806c80443da83728a2f97fc310" candidate_uuid: "7b40d12015744366a464f1be5675cfb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "57c574a183ee449ba3171ae11a734cc8"
I20250625 03:29:44.586668 560 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4e9ead806c80443da83728a2f97fc310" candidate_uuid: "7b40d12015744366a464f1be5675cfb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61"
I20250625 03:29:44.587371 708 raft_consensus.cc:3053] T 4e9ead806c80443da83728a2f97fc310 P 57c574a183ee449ba3171ae11a734cc8 [term 3 LEADER]: Stepping down as leader of term 3
I20250625 03:29:44.587756 708 raft_consensus.cc:738] T 4e9ead806c80443da83728a2f97fc310 P 57c574a183ee449ba3171ae11a734cc8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 57c574a183ee449ba3171ae11a734cc8, State: Running, Role: LEADER
I20250625 03:29:44.587496 560 raft_consensus.cc:3058] T 4e9ead806c80443da83728a2f97fc310 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 3 FOLLOWER]: Advancing to term 4
I20250625 03:29:44.588459 708 consensus_queue.cc:260] T 4e9ead806c80443da83728a2f97fc310 P 57c574a183ee449ba3171ae11a734cc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } } peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } }
I20250625 03:29:44.589526 708 raft_consensus.cc:3058] T 4e9ead806c80443da83728a2f97fc310 P 57c574a183ee449ba3171ae11a734cc8 [term 3 FOLLOWER]: Advancing to term 4
I20250625 03:29:44.593935 560 raft_consensus.cc:2466] T 4e9ead806c80443da83728a2f97fc310 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b40d12015744366a464f1be5675cfb9 in term 4.
I20250625 03:29:44.595036 601 leader_election.cc:304] T 4e9ead806c80443da83728a2f97fc310 P 7b40d12015744366a464f1be5675cfb9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4967ac6ac157453da1a6e7b4f1ed8d61, 7b40d12015744366a464f1be5675cfb9; no voters:
I20250625 03:29:44.595172 708 raft_consensus.cc:2466] T 4e9ead806c80443da83728a2f97fc310 P 57c574a183ee449ba3171ae11a734cc8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b40d12015744366a464f1be5675cfb9 in term 4.
I20250625 03:29:44.595734 875 raft_consensus.cc:2802] T 4e9ead806c80443da83728a2f97fc310 P 7b40d12015744366a464f1be5675cfb9 [term 4 FOLLOWER]: Leader election won for term 4
I20250625 03:29:44.596233 875 raft_consensus.cc:695] T 4e9ead806c80443da83728a2f97fc310 P 7b40d12015744366a464f1be5675cfb9 [term 4 LEADER]: Becoming Leader. State: Replica: 7b40d12015744366a464f1be5675cfb9, State: Running, Role: LEADER
I20250625 03:29:44.596948 875 consensus_queue.cc:237] T 4e9ead806c80443da83728a2f97fc310 P 7b40d12015744366a464f1be5675cfb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } } peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } }
I20250625 03:29:44.603557 456 catalog_manager.cc:5582] T 4e9ead806c80443da83728a2f97fc310 P 7b40d12015744366a464f1be5675cfb9 reported cstate change: term changed from 3 to 4, leader changed from 57c574a183ee449ba3171ae11a734cc8 (127.0.106.131) to 7b40d12015744366a464f1be5675cfb9 (127.0.106.130). New cstate: current_term: 4 leader_uuid: "7b40d12015744366a464f1be5675cfb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } health_report { overall_health: HEALTHY } } }
I20250625 03:29:44.884995 708 raft_consensus.cc:1273] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 57c574a183ee449ba3171ae11a734cc8 [term 2 FOLLOWER]: Refusing update from remote peer 7b40d12015744366a464f1be5675cfb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:29:44.886116 875 consensus_queue.cc:1035] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 7b40d12015744366a464f1be5675cfb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:29:44.895234 560 raft_consensus.cc:1273] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 2 FOLLOWER]: Refusing update from remote peer 7b40d12015744366a464f1be5675cfb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:29:44.897282 875 consensus_queue.cc:1035] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 7b40d12015744366a464f1be5675cfb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20250625 03:29:44.981247 878 raft_consensus.cc:991] T f9031be3db5846a194610fa6c83bc23c P 4967ac6ac157453da1a6e7b4f1ed8d61: : Instructing follower 7b40d12015744366a464f1be5675cfb9 to start an election
I20250625 03:29:44.981732 854 raft_consensus.cc:1079] T f9031be3db5846a194610fa6c83bc23c P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 2 LEADER]: Signalling peer 7b40d12015744366a464f1be5675cfb9 to start an election
I20250625 03:29:44.983018 636 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "f9031be3db5846a194610fa6c83bc23c"
dest_uuid: "7b40d12015744366a464f1be5675cfb9"
from {username='slave'} at 127.0.0.1:43492
I20250625 03:29:44.983407 636 raft_consensus.cc:491] T f9031be3db5846a194610fa6c83bc23c P 7b40d12015744366a464f1be5675cfb9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:29:44.983688 636 raft_consensus.cc:3058] T f9031be3db5846a194610fa6c83bc23c P 7b40d12015744366a464f1be5675cfb9 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:29:44.987515 636 raft_consensus.cc:513] T f9031be3db5846a194610fa6c83bc23c P 7b40d12015744366a464f1be5675cfb9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:44.989372 636 leader_election.cc:290] T f9031be3db5846a194610fa6c83bc23c P 7b40d12015744366a464f1be5675cfb9 [CANDIDATE]: Term 3 election: Requested vote from peers 4967ac6ac157453da1a6e7b4f1ed8d61 (127.0.106.129:41137), 57c574a183ee449ba3171ae11a734cc8 (127.0.106.131:35951)
I20250625 03:29:44.990134 560 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f9031be3db5846a194610fa6c83bc23c" candidate_uuid: "7b40d12015744366a464f1be5675cfb9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61"
I20250625 03:29:44.990396 708 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f9031be3db5846a194610fa6c83bc23c" candidate_uuid: "7b40d12015744366a464f1be5675cfb9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "57c574a183ee449ba3171ae11a734cc8"
I20250625 03:29:44.990612 560 raft_consensus.cc:3053] T f9031be3db5846a194610fa6c83bc23c P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 2 LEADER]: Stepping down as leader of term 2
I20250625 03:29:44.990833 708 raft_consensus.cc:3058] T f9031be3db5846a194610fa6c83bc23c P 57c574a183ee449ba3171ae11a734cc8 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:29:44.990934 560 raft_consensus.cc:738] T f9031be3db5846a194610fa6c83bc23c P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4967ac6ac157453da1a6e7b4f1ed8d61, State: Running, Role: LEADER
I20250625 03:29:44.991568 560 consensus_queue.cc:260] T f9031be3db5846a194610fa6c83bc23c P 4967ac6ac157453da1a6e7b4f1ed8d61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:44.992440 560 raft_consensus.cc:3058] T f9031be3db5846a194610fa6c83bc23c P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:29:44.994958 708 raft_consensus.cc:2466] T f9031be3db5846a194610fa6c83bc23c P 57c574a183ee449ba3171ae11a734cc8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b40d12015744366a464f1be5675cfb9 in term 3.
I20250625 03:29:44.995790 599 leader_election.cc:304] T f9031be3db5846a194610fa6c83bc23c P 7b40d12015744366a464f1be5675cfb9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57c574a183ee449ba3171ae11a734cc8, 7b40d12015744366a464f1be5675cfb9; no voters:
I20250625 03:29:44.996498 875 raft_consensus.cc:2802] T f9031be3db5846a194610fa6c83bc23c P 7b40d12015744366a464f1be5675cfb9 [term 3 FOLLOWER]: Leader election won for term 3
I20250625 03:29:44.996546 560 raft_consensus.cc:2466] T f9031be3db5846a194610fa6c83bc23c P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b40d12015744366a464f1be5675cfb9 in term 3.
I20250625 03:29:44.997108 875 raft_consensus.cc:695] T f9031be3db5846a194610fa6c83bc23c P 7b40d12015744366a464f1be5675cfb9 [term 3 LEADER]: Becoming Leader. State: Replica: 7b40d12015744366a464f1be5675cfb9, State: Running, Role: LEADER
I20250625 03:29:44.998118 875 consensus_queue.cc:237] T f9031be3db5846a194610fa6c83bc23c P 7b40d12015744366a464f1be5675cfb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:45.004940 560 raft_consensus.cc:1273] T 6e85647348794694a1c45563583c5896 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 4 FOLLOWER]: Refusing update from remote peer 7b40d12015744366a464f1be5675cfb9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20250625 03:29:45.004931 458 catalog_manager.cc:5582] T f9031be3db5846a194610fa6c83bc23c P 7b40d12015744366a464f1be5675cfb9 reported cstate change: term changed from 2 to 3, leader changed from 4967ac6ac157453da1a6e7b4f1ed8d61 (127.0.106.129) to 7b40d12015744366a464f1be5675cfb9 (127.0.106.130). New cstate: current_term: 3 leader_uuid: "7b40d12015744366a464f1be5675cfb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } health_report { overall_health: UNKNOWN } } }
I20250625 03:29:45.006032 875 consensus_queue.cc:1035] T 6e85647348794694a1c45563583c5896 P 7b40d12015744366a464f1be5675cfb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:29:45.015805 708 raft_consensus.cc:1273] T 6e85647348794694a1c45563583c5896 P 57c574a183ee449ba3171ae11a734cc8 [term 4 FOLLOWER]: Refusing update from remote peer 7b40d12015744366a464f1be5675cfb9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20250625 03:29:45.017027 875 consensus_queue.cc:1035] T 6e85647348794694a1c45563583c5896 P 7b40d12015744366a464f1be5675cfb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20250625 03:29:45.088335 708 raft_consensus.cc:1273] T 92d6dd32053d442ca03f15c290dc495e P 57c574a183ee449ba3171ae11a734cc8 [term 3 FOLLOWER]: Refusing update from remote peer 7b40d12015744366a464f1be5675cfb9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250625 03:29:45.089385 875 consensus_queue.cc:1035] T 92d6dd32053d442ca03f15c290dc495e P 7b40d12015744366a464f1be5675cfb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:29:45.098016 560 raft_consensus.cc:1273] T 92d6dd32053d442ca03f15c290dc495e P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 3 FOLLOWER]: Refusing update from remote peer 7b40d12015744366a464f1be5675cfb9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250625 03:29:45.100193 879 consensus_queue.cc:1035] T 92d6dd32053d442ca03f15c290dc495e P 7b40d12015744366a464f1be5675cfb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:29:45.113438 708 raft_consensus.cc:1273] T 4e9ead806c80443da83728a2f97fc310 P 57c574a183ee449ba3171ae11a734cc8 [term 4 FOLLOWER]: Refusing update from remote peer 7b40d12015744366a464f1be5675cfb9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20250625 03:29:45.115289 879 consensus_queue.cc:1035] T 4e9ead806c80443da83728a2f97fc310 P 7b40d12015744366a464f1be5675cfb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:29:45.117944 560 raft_consensus.cc:1273] T 4e9ead806c80443da83728a2f97fc310 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 4 FOLLOWER]: Refusing update from remote peer 7b40d12015744366a464f1be5675cfb9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20250625 03:29:45.118939 879 consensus_queue.cc:1035] T 4e9ead806c80443da83728a2f97fc310 P 7b40d12015744366a464f1be5675cfb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:29:45.449378 560 raft_consensus.cc:1273] T f9031be3db5846a194610fa6c83bc23c P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 3 FOLLOWER]: Refusing update from remote peer 7b40d12015744366a464f1be5675cfb9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250625 03:29:45.450547 875 consensus_queue.cc:1035] T f9031be3db5846a194610fa6c83bc23c P 7b40d12015744366a464f1be5675cfb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:29:45.458738 708 raft_consensus.cc:1273] T f9031be3db5846a194610fa6c83bc23c P 57c574a183ee449ba3171ae11a734cc8 [term 3 FOLLOWER]: Refusing update from remote peer 7b40d12015744366a464f1be5675cfb9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250625 03:29:45.460871 875 consensus_queue.cc:1035] T f9031be3db5846a194610fa6c83bc23c P 7b40d12015744366a464f1be5675cfb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:29:47.428077 426 auto_leader_rebalancer-test.cc:306] The leader distribution is
I20250625 03:29:47.428822 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:29:47.435393 636 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "0d8ad140d73a4a80a1d2316ef129935d"
dest_uuid: "7b40d12015744366a464f1be5675cfb9"
mode: GRACEFUL
new_leader_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61"
from {username='slave'} at 127.0.0.1:44280
I20250625 03:29:47.436235 636 raft_consensus.cc:604] T 0d8ad140d73a4a80a1d2316ef129935d P 7b40d12015744366a464f1be5675cfb9 [term 2 LEADER]: Received request to transfer leadership to TS 4967ac6ac157453da1a6e7b4f1ed8d61
I20250625 03:29:47.438866 636 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "48a6f4f9f8cc41f48d562f310ec0b9d5"
dest_uuid: "7b40d12015744366a464f1be5675cfb9"
mode: GRACEFUL
new_leader_uuid: "57c574a183ee449ba3171ae11a734cc8"
from {username='slave'} at 127.0.0.1:44280
I20250625 03:29:47.439257 636 raft_consensus.cc:604] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 7b40d12015744366a464f1be5675cfb9 [term 2 LEADER]: Received request to transfer leadership to TS 57c574a183ee449ba3171ae11a734cc8
I20250625 03:29:47.441265 636 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "6e85647348794694a1c45563583c5896"
dest_uuid: "7b40d12015744366a464f1be5675cfb9"
mode: GRACEFUL
new_leader_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61"
from {username='slave'} at 127.0.0.1:44280
I20250625 03:29:47.441628 636 raft_consensus.cc:604] T 6e85647348794694a1c45563583c5896 P 7b40d12015744366a464f1be5675cfb9 [term 4 LEADER]: Received request to transfer leadership to TS 4967ac6ac157453da1a6e7b4f1ed8d61
I20250625 03:29:47.443404 636 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "92d6dd32053d442ca03f15c290dc495e"
dest_uuid: "7b40d12015744366a464f1be5675cfb9"
mode: GRACEFUL
new_leader_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61"
from {username='slave'} at 127.0.0.1:44280
I20250625 03:29:47.443744 636 raft_consensus.cc:604] T 92d6dd32053d442ca03f15c290dc495e P 7b40d12015744366a464f1be5675cfb9 [term 3 LEADER]: Received request to transfer leadership to TS 4967ac6ac157453da1a6e7b4f1ed8d61
I20250625 03:29:47.445549 636 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "9dccb59457ba43efa6ba3f3290a028fd"
dest_uuid: "7b40d12015744366a464f1be5675cfb9"
mode: GRACEFUL
new_leader_uuid: "57c574a183ee449ba3171ae11a734cc8"
from {username='slave'} at 127.0.0.1:44280
I20250625 03:29:47.445902 636 raft_consensus.cc:604] T 9dccb59457ba43efa6ba3f3290a028fd P 7b40d12015744366a464f1be5675cfb9 [term 2 LEADER]: Received request to transfer leadership to TS 57c574a183ee449ba3171ae11a734cc8
I20250625 03:29:47.446707 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20250625 03:29:47.447094 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:29:47.490236 904 raft_consensus.cc:991] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 7b40d12015744366a464f1be5675cfb9: : Instructing follower 57c574a183ee449ba3171ae11a734cc8 to start an election
I20250625 03:29:47.490715 907 raft_consensus.cc:1079] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 7b40d12015744366a464f1be5675cfb9 [term 2 LEADER]: Signalling peer 57c574a183ee449ba3171ae11a734cc8 to start an election
I20250625 03:29:47.492065 709 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "48a6f4f9f8cc41f48d562f310ec0b9d5"
dest_uuid: "57c574a183ee449ba3171ae11a734cc8"
from {username='slave'} at 127.0.0.1:51264
I20250625 03:29:47.492457 709 raft_consensus.cc:491] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 57c574a183ee449ba3171ae11a734cc8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:29:47.492709 709 raft_consensus.cc:3058] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 57c574a183ee449ba3171ae11a734cc8 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:29:47.497466 709 raft_consensus.cc:513] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 57c574a183ee449ba3171ae11a734cc8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:47.499317 709 leader_election.cc:290] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 57c574a183ee449ba3171ae11a734cc8 [CANDIDATE]: Term 3 election: Requested vote from peers 4967ac6ac157453da1a6e7b4f1ed8d61 (127.0.106.129:41137), 7b40d12015744366a464f1be5675cfb9 (127.0.106.130:34581)
I20250625 03:29:47.500422 636 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "48a6f4f9f8cc41f48d562f310ec0b9d5" candidate_uuid: "57c574a183ee449ba3171ae11a734cc8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7b40d12015744366a464f1be5675cfb9"
I20250625 03:29:47.500326 560 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "48a6f4f9f8cc41f48d562f310ec0b9d5" candidate_uuid: "57c574a183ee449ba3171ae11a734cc8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61"
I20250625 03:29:47.501195 636 raft_consensus.cc:3053] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 7b40d12015744366a464f1be5675cfb9 [term 2 LEADER]: Stepping down as leader of term 2
I20250625 03:29:47.501255 560 raft_consensus.cc:3058] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:29:47.501528 636 raft_consensus.cc:738] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 7b40d12015744366a464f1be5675cfb9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7b40d12015744366a464f1be5675cfb9, State: Running, Role: LEADER
I20250625 03:29:47.502178 636 consensus_queue.cc:260] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 7b40d12015744366a464f1be5675cfb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:47.503094 636 raft_consensus.cc:3058] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 7b40d12015744366a464f1be5675cfb9 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:29:47.506394 560 raft_consensus.cc:2466] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57c574a183ee449ba3171ae11a734cc8 in term 3.
I20250625 03:29:47.507514 675 leader_election.cc:304] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 57c574a183ee449ba3171ae11a734cc8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4967ac6ac157453da1a6e7b4f1ed8d61, 57c574a183ee449ba3171ae11a734cc8; no voters:
I20250625 03:29:47.507983 636 raft_consensus.cc:2466] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 7b40d12015744366a464f1be5675cfb9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57c574a183ee449ba3171ae11a734cc8 in term 3.
I20250625 03:29:47.508289 876 raft_consensus.cc:2802] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 57c574a183ee449ba3171ae11a734cc8 [term 3 FOLLOWER]: Leader election won for term 3
I20250625 03:29:47.509249 876 raft_consensus.cc:695] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 57c574a183ee449ba3171ae11a734cc8 [term 3 LEADER]: Becoming Leader. State: Replica: 57c574a183ee449ba3171ae11a734cc8, State: Running, Role: LEADER
I20250625 03:29:47.510032 876 consensus_queue.cc:237] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 57c574a183ee449ba3171ae11a734cc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:47.516393 458 catalog_manager.cc:5582] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 57c574a183ee449ba3171ae11a734cc8 reported cstate change: term changed from 2 to 3, leader changed from 7b40d12015744366a464f1be5675cfb9 (127.0.106.130) to 57c574a183ee449ba3171ae11a734cc8 (127.0.106.131). New cstate: current_term: 3 leader_uuid: "57c574a183ee449ba3171ae11a734cc8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } health_report { overall_health: HEALTHY } } }
I20250625 03:29:47.581269 904 raft_consensus.cc:991] T 0d8ad140d73a4a80a1d2316ef129935d P 7b40d12015744366a464f1be5675cfb9: : Instructing follower 4967ac6ac157453da1a6e7b4f1ed8d61 to start an election
I20250625 03:29:47.581651 907 raft_consensus.cc:1079] T 0d8ad140d73a4a80a1d2316ef129935d P 7b40d12015744366a464f1be5675cfb9 [term 2 LEADER]: Signalling peer 4967ac6ac157453da1a6e7b4f1ed8d61 to start an election
I20250625 03:29:47.582906 560 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "0d8ad140d73a4a80a1d2316ef129935d"
dest_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61"
from {username='slave'} at 127.0.0.1:48660
I20250625 03:29:47.583340 560 raft_consensus.cc:491] T 0d8ad140d73a4a80a1d2316ef129935d P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:29:47.583596 560 raft_consensus.cc:3058] T 0d8ad140d73a4a80a1d2316ef129935d P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:29:47.587702 560 raft_consensus.cc:513] T 0d8ad140d73a4a80a1d2316ef129935d P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:47.589617 560 leader_election.cc:290] T 0d8ad140d73a4a80a1d2316ef129935d P 4967ac6ac157453da1a6e7b4f1ed8d61 [CANDIDATE]: Term 3 election: Requested vote from peers 7b40d12015744366a464f1be5675cfb9 (127.0.106.130:34581), 57c574a183ee449ba3171ae11a734cc8 (127.0.106.131:35951)
I20250625 03:29:47.590595 636 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0d8ad140d73a4a80a1d2316ef129935d" candidate_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7b40d12015744366a464f1be5675cfb9"
I20250625 03:29:47.590655 709 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0d8ad140d73a4a80a1d2316ef129935d" candidate_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "57c574a183ee449ba3171ae11a734cc8"
I20250625 03:29:47.591288 636 raft_consensus.cc:3053] T 0d8ad140d73a4a80a1d2316ef129935d P 7b40d12015744366a464f1be5675cfb9 [term 2 LEADER]: Stepping down as leader of term 2
I20250625 03:29:47.591418 709 raft_consensus.cc:3058] T 0d8ad140d73a4a80a1d2316ef129935d P 57c574a183ee449ba3171ae11a734cc8 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:29:47.591559 636 raft_consensus.cc:738] T 0d8ad140d73a4a80a1d2316ef129935d P 7b40d12015744366a464f1be5675cfb9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7b40d12015744366a464f1be5675cfb9, State: Running, Role: LEADER
I20250625 03:29:47.592319 636 consensus_queue.cc:260] T 0d8ad140d73a4a80a1d2316ef129935d P 7b40d12015744366a464f1be5675cfb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:47.593132 636 raft_consensus.cc:3058] T 0d8ad140d73a4a80a1d2316ef129935d P 7b40d12015744366a464f1be5675cfb9 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:29:47.595680 709 raft_consensus.cc:2466] T 0d8ad140d73a4a80a1d2316ef129935d P 57c574a183ee449ba3171ae11a734cc8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4967ac6ac157453da1a6e7b4f1ed8d61 in term 3.
I20250625 03:29:47.596829 524 leader_election.cc:304] T 0d8ad140d73a4a80a1d2316ef129935d P 4967ac6ac157453da1a6e7b4f1ed8d61 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4967ac6ac157453da1a6e7b4f1ed8d61, 57c574a183ee449ba3171ae11a734cc8; no voters:
I20250625 03:29:47.597070 636 raft_consensus.cc:2466] T 0d8ad140d73a4a80a1d2316ef129935d P 7b40d12015744366a464f1be5675cfb9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4967ac6ac157453da1a6e7b4f1ed8d61 in term 3.
I20250625 03:29:47.598600 914 raft_consensus.cc:2802] T 0d8ad140d73a4a80a1d2316ef129935d P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 3 FOLLOWER]: Leader election won for term 3
I20250625 03:29:47.599611 914 raft_consensus.cc:695] T 0d8ad140d73a4a80a1d2316ef129935d P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 3 LEADER]: Becoming Leader. State: Replica: 4967ac6ac157453da1a6e7b4f1ed8d61, State: Running, Role: LEADER
I20250625 03:29:47.600346 914 consensus_queue.cc:237] T 0d8ad140d73a4a80a1d2316ef129935d P 4967ac6ac157453da1a6e7b4f1ed8d61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:47.606665 458 catalog_manager.cc:5582] T 0d8ad140d73a4a80a1d2316ef129935d P 4967ac6ac157453da1a6e7b4f1ed8d61 reported cstate change: term changed from 2 to 3, leader changed from 7b40d12015744366a464f1be5675cfb9 (127.0.106.130) to 4967ac6ac157453da1a6e7b4f1ed8d61 (127.0.106.129). New cstate: current_term: 3 leader_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } health_report { overall_health: UNKNOWN } } }
I20250625 03:29:47.636611 904 raft_consensus.cc:991] T 6e85647348794694a1c45563583c5896 P 7b40d12015744366a464f1be5675cfb9: : Instructing follower 4967ac6ac157453da1a6e7b4f1ed8d61 to start an election
I20250625 03:29:47.637008 907 raft_consensus.cc:1079] T 6e85647348794694a1c45563583c5896 P 7b40d12015744366a464f1be5675cfb9 [term 4 LEADER]: Signalling peer 4967ac6ac157453da1a6e7b4f1ed8d61 to start an election
I20250625 03:29:47.638228 560 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "6e85647348794694a1c45563583c5896"
dest_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61"
from {username='slave'} at 127.0.0.1:48660
I20250625 03:29:47.638643 560 raft_consensus.cc:491] T 6e85647348794694a1c45563583c5896 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:29:47.638881 560 raft_consensus.cc:3058] T 6e85647348794694a1c45563583c5896 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 4 FOLLOWER]: Advancing to term 5
I20250625 03:29:47.643525 560 raft_consensus.cc:513] T 6e85647348794694a1c45563583c5896 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:47.644886 560 leader_election.cc:290] T 6e85647348794694a1c45563583c5896 P 4967ac6ac157453da1a6e7b4f1ed8d61 [CANDIDATE]: Term 5 election: Requested vote from peers 7b40d12015744366a464f1be5675cfb9 (127.0.106.130:34581), 57c574a183ee449ba3171ae11a734cc8 (127.0.106.131:35951)
I20250625 03:29:47.645787 636 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6e85647348794694a1c45563583c5896" candidate_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "7b40d12015744366a464f1be5675cfb9"
I20250625 03:29:47.645819 709 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6e85647348794694a1c45563583c5896" candidate_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "57c574a183ee449ba3171ae11a734cc8"
I20250625 03:29:47.646288 636 raft_consensus.cc:3053] T 6e85647348794694a1c45563583c5896 P 7b40d12015744366a464f1be5675cfb9 [term 4 LEADER]: Stepping down as leader of term 4
I20250625 03:29:47.646363 709 raft_consensus.cc:3058] T 6e85647348794694a1c45563583c5896 P 57c574a183ee449ba3171ae11a734cc8 [term 4 FOLLOWER]: Advancing to term 5
I20250625 03:29:47.646539 636 raft_consensus.cc:738] T 6e85647348794694a1c45563583c5896 P 7b40d12015744366a464f1be5675cfb9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7b40d12015744366a464f1be5675cfb9, State: Running, Role: LEADER
I20250625 03:29:47.647179 636 consensus_queue.cc:260] T 6e85647348794694a1c45563583c5896 P 7b40d12015744366a464f1be5675cfb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:47.647970 636 raft_consensus.cc:3058] T 6e85647348794694a1c45563583c5896 P 7b40d12015744366a464f1be5675cfb9 [term 4 FOLLOWER]: Advancing to term 5
I20250625 03:29:47.650527 709 raft_consensus.cc:2466] T 6e85647348794694a1c45563583c5896 P 57c574a183ee449ba3171ae11a734cc8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4967ac6ac157453da1a6e7b4f1ed8d61 in term 5.
I20250625 03:29:47.651342 524 leader_election.cc:304] T 6e85647348794694a1c45563583c5896 P 4967ac6ac157453da1a6e7b4f1ed8d61 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4967ac6ac157453da1a6e7b4f1ed8d61, 57c574a183ee449ba3171ae11a734cc8; no voters:
I20250625 03:29:47.651873 636 raft_consensus.cc:2466] T 6e85647348794694a1c45563583c5896 P 7b40d12015744366a464f1be5675cfb9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4967ac6ac157453da1a6e7b4f1ed8d61 in term 5.
I20250625 03:29:47.651928 914 raft_consensus.cc:2802] T 6e85647348794694a1c45563583c5896 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 5 FOLLOWER]: Leader election won for term 5
I20250625 03:29:47.652549 914 raft_consensus.cc:695] T 6e85647348794694a1c45563583c5896 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 5 LEADER]: Becoming Leader. State: Replica: 4967ac6ac157453da1a6e7b4f1ed8d61, State: Running, Role: LEADER
I20250625 03:29:47.653381 914 consensus_queue.cc:237] T 6e85647348794694a1c45563583c5896 P 4967ac6ac157453da1a6e7b4f1ed8d61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:47.660039 458 catalog_manager.cc:5582] T 6e85647348794694a1c45563583c5896 P 4967ac6ac157453da1a6e7b4f1ed8d61 reported cstate change: term changed from 4 to 5, leader changed from 7b40d12015744366a464f1be5675cfb9 (127.0.106.130) to 4967ac6ac157453da1a6e7b4f1ed8d61 (127.0.106.129). New cstate: current_term: 5 leader_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } health_report { overall_health: UNKNOWN } } }
I20250625 03:29:47.698671 904 raft_consensus.cc:991] T 92d6dd32053d442ca03f15c290dc495e P 7b40d12015744366a464f1be5675cfb9: : Instructing follower 4967ac6ac157453da1a6e7b4f1ed8d61 to start an election
I20250625 03:29:47.699081 907 raft_consensus.cc:1079] T 92d6dd32053d442ca03f15c290dc495e P 7b40d12015744366a464f1be5675cfb9 [term 3 LEADER]: Signalling peer 4967ac6ac157453da1a6e7b4f1ed8d61 to start an election
I20250625 03:29:47.700353 560 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "92d6dd32053d442ca03f15c290dc495e"
dest_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61"
from {username='slave'} at 127.0.0.1:48660
I20250625 03:29:47.700732 560 raft_consensus.cc:491] T 92d6dd32053d442ca03f15c290dc495e P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:29:47.700944 560 raft_consensus.cc:3058] T 92d6dd32053d442ca03f15c290dc495e P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 3 FOLLOWER]: Advancing to term 4
I20250625 03:29:47.704870 560 raft_consensus.cc:513] T 92d6dd32053d442ca03f15c290dc495e P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:47.706266 560 leader_election.cc:290] T 92d6dd32053d442ca03f15c290dc495e P 4967ac6ac157453da1a6e7b4f1ed8d61 [CANDIDATE]: Term 4 election: Requested vote from peers 7b40d12015744366a464f1be5675cfb9 (127.0.106.130:34581), 57c574a183ee449ba3171ae11a734cc8 (127.0.106.131:35951)
I20250625 03:29:47.707105 636 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "92d6dd32053d442ca03f15c290dc495e" candidate_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7b40d12015744366a464f1be5675cfb9"
I20250625 03:29:47.707105 709 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "92d6dd32053d442ca03f15c290dc495e" candidate_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "57c574a183ee449ba3171ae11a734cc8"
I20250625 03:29:47.707872 636 raft_consensus.cc:3053] T 92d6dd32053d442ca03f15c290dc495e P 7b40d12015744366a464f1be5675cfb9 [term 3 LEADER]: Stepping down as leader of term 3
I20250625 03:29:47.707937 709 raft_consensus.cc:3058] T 92d6dd32053d442ca03f15c290dc495e P 57c574a183ee449ba3171ae11a734cc8 [term 3 FOLLOWER]: Advancing to term 4
I20250625 03:29:47.708292 636 raft_consensus.cc:738] T 92d6dd32053d442ca03f15c290dc495e P 7b40d12015744366a464f1be5675cfb9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7b40d12015744366a464f1be5675cfb9, State: Running, Role: LEADER
I20250625 03:29:47.709036 636 consensus_queue.cc:260] T 92d6dd32053d442ca03f15c290dc495e P 7b40d12015744366a464f1be5675cfb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:47.710150 636 raft_consensus.cc:3058] T 92d6dd32053d442ca03f15c290dc495e P 7b40d12015744366a464f1be5675cfb9 [term 3 FOLLOWER]: Advancing to term 4
I20250625 03:29:47.714181 709 raft_consensus.cc:2466] T 92d6dd32053d442ca03f15c290dc495e P 57c574a183ee449ba3171ae11a734cc8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4967ac6ac157453da1a6e7b4f1ed8d61 in term 4.
I20250625 03:29:47.715179 524 leader_election.cc:304] T 92d6dd32053d442ca03f15c290dc495e P 4967ac6ac157453da1a6e7b4f1ed8d61 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4967ac6ac157453da1a6e7b4f1ed8d61, 57c574a183ee449ba3171ae11a734cc8; no voters:
I20250625 03:29:47.715723 636 raft_consensus.cc:2466] T 92d6dd32053d442ca03f15c290dc495e P 7b40d12015744366a464f1be5675cfb9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4967ac6ac157453da1a6e7b4f1ed8d61 in term 4.
I20250625 03:29:47.715793 914 raft_consensus.cc:2802] T 92d6dd32053d442ca03f15c290dc495e P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 4 FOLLOWER]: Leader election won for term 4
I20250625 03:29:47.716399 914 raft_consensus.cc:695] T 92d6dd32053d442ca03f15c290dc495e P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 4 LEADER]: Becoming Leader. State: Replica: 4967ac6ac157453da1a6e7b4f1ed8d61, State: Running, Role: LEADER
I20250625 03:29:47.717200 914 consensus_queue.cc:237] T 92d6dd32053d442ca03f15c290dc495e P 4967ac6ac157453da1a6e7b4f1ed8d61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:47.723812 458 catalog_manager.cc:5582] T 92d6dd32053d442ca03f15c290dc495e P 4967ac6ac157453da1a6e7b4f1ed8d61 reported cstate change: term changed from 3 to 4, leader changed from 7b40d12015744366a464f1be5675cfb9 (127.0.106.130) to 4967ac6ac157453da1a6e7b4f1ed8d61 (127.0.106.129). New cstate: current_term: 4 leader_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } health_report { overall_health: UNKNOWN } } }
I20250625 03:29:47.749487 904 raft_consensus.cc:991] T 9dccb59457ba43efa6ba3f3290a028fd P 7b40d12015744366a464f1be5675cfb9: : Instructing follower 57c574a183ee449ba3171ae11a734cc8 to start an election
I20250625 03:29:47.750001 907 raft_consensus.cc:1079] T 9dccb59457ba43efa6ba3f3290a028fd P 7b40d12015744366a464f1be5675cfb9 [term 2 LEADER]: Signalling peer 57c574a183ee449ba3171ae11a734cc8 to start an election
I20250625 03:29:47.751194 709 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "9dccb59457ba43efa6ba3f3290a028fd"
dest_uuid: "57c574a183ee449ba3171ae11a734cc8"
from {username='slave'} at 127.0.0.1:51264
I20250625 03:29:47.751621 709 raft_consensus.cc:491] T 9dccb59457ba43efa6ba3f3290a028fd P 57c574a183ee449ba3171ae11a734cc8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:29:47.751878 709 raft_consensus.cc:3058] T 9dccb59457ba43efa6ba3f3290a028fd P 57c574a183ee449ba3171ae11a734cc8 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:29:47.755911 709 raft_consensus.cc:513] T 9dccb59457ba43efa6ba3f3290a028fd P 57c574a183ee449ba3171ae11a734cc8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:47.757236 709 leader_election.cc:290] T 9dccb59457ba43efa6ba3f3290a028fd P 57c574a183ee449ba3171ae11a734cc8 [CANDIDATE]: Term 3 election: Requested vote from peers 4967ac6ac157453da1a6e7b4f1ed8d61 (127.0.106.129:41137), 7b40d12015744366a464f1be5675cfb9 (127.0.106.130:34581)
I20250625 03:29:47.758116 560 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9dccb59457ba43efa6ba3f3290a028fd" candidate_uuid: "57c574a183ee449ba3171ae11a734cc8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61"
I20250625 03:29:47.758226 636 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9dccb59457ba43efa6ba3f3290a028fd" candidate_uuid: "57c574a183ee449ba3171ae11a734cc8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7b40d12015744366a464f1be5675cfb9"
I20250625 03:29:47.758590 560 raft_consensus.cc:3058] T 9dccb59457ba43efa6ba3f3290a028fd P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:29:47.758666 636 raft_consensus.cc:3053] T 9dccb59457ba43efa6ba3f3290a028fd P 7b40d12015744366a464f1be5675cfb9 [term 2 LEADER]: Stepping down as leader of term 2
I20250625 03:29:47.758939 636 raft_consensus.cc:738] T 9dccb59457ba43efa6ba3f3290a028fd P 7b40d12015744366a464f1be5675cfb9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7b40d12015744366a464f1be5675cfb9, State: Running, Role: LEADER
I20250625 03:29:47.759497 636 consensus_queue.cc:260] T 9dccb59457ba43efa6ba3f3290a028fd P 7b40d12015744366a464f1be5675cfb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:47.760303 636 raft_consensus.cc:3058] T 9dccb59457ba43efa6ba3f3290a028fd P 7b40d12015744366a464f1be5675cfb9 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:29:47.762774 560 raft_consensus.cc:2466] T 9dccb59457ba43efa6ba3f3290a028fd P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57c574a183ee449ba3171ae11a734cc8 in term 3.
I20250625 03:29:47.763612 675 leader_election.cc:304] T 9dccb59457ba43efa6ba3f3290a028fd P 57c574a183ee449ba3171ae11a734cc8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4967ac6ac157453da1a6e7b4f1ed8d61, 57c574a183ee449ba3171ae11a734cc8; no voters:
I20250625 03:29:47.764222 876 raft_consensus.cc:2802] T 9dccb59457ba43efa6ba3f3290a028fd P 57c574a183ee449ba3171ae11a734cc8 [term 3 FOLLOWER]: Leader election won for term 3
I20250625 03:29:47.764246 636 raft_consensus.cc:2466] T 9dccb59457ba43efa6ba3f3290a028fd P 7b40d12015744366a464f1be5675cfb9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57c574a183ee449ba3171ae11a734cc8 in term 3.
I20250625 03:29:47.764710 876 raft_consensus.cc:695] T 9dccb59457ba43efa6ba3f3290a028fd P 57c574a183ee449ba3171ae11a734cc8 [term 3 LEADER]: Becoming Leader. State: Replica: 57c574a183ee449ba3171ae11a734cc8, State: Running, Role: LEADER
I20250625 03:29:47.765523 876 consensus_queue.cc:237] T 9dccb59457ba43efa6ba3f3290a028fd P 57c574a183ee449ba3171ae11a734cc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } }
I20250625 03:29:47.772390 458 catalog_manager.cc:5582] T 9dccb59457ba43efa6ba3f3290a028fd P 57c574a183ee449ba3171ae11a734cc8 reported cstate change: term changed from 2 to 3, leader changed from 7b40d12015744366a464f1be5675cfb9 (127.0.106.130) to 57c574a183ee449ba3171ae11a734cc8 (127.0.106.131). New cstate: current_term: 3 leader_uuid: "57c574a183ee449ba3171ae11a734cc8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 } health_report { overall_health: HEALTHY } } }
I20250625 03:29:47.909209 560 raft_consensus.cc:1273] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 3 FOLLOWER]: Refusing update from remote peer 57c574a183ee449ba3171ae11a734cc8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250625 03:29:47.910336 876 consensus_queue.cc:1035] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 57c574a183ee449ba3171ae11a734cc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:29:47.919215 636 raft_consensus.cc:1273] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 7b40d12015744366a464f1be5675cfb9 [term 3 FOLLOWER]: Refusing update from remote peer 57c574a183ee449ba3171ae11a734cc8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250625 03:29:47.921452 876 consensus_queue.cc:1035] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 57c574a183ee449ba3171ae11a734cc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:29:48.030712 709 raft_consensus.cc:1273] T 0d8ad140d73a4a80a1d2316ef129935d P 57c574a183ee449ba3171ae11a734cc8 [term 3 FOLLOWER]: Refusing update from remote peer 4967ac6ac157453da1a6e7b4f1ed8d61: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250625 03:29:48.031766 914 consensus_queue.cc:1035] T 0d8ad140d73a4a80a1d2316ef129935d P 4967ac6ac157453da1a6e7b4f1ed8d61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:29:48.040110 636 raft_consensus.cc:1273] T 0d8ad140d73a4a80a1d2316ef129935d P 7b40d12015744366a464f1be5675cfb9 [term 3 FOLLOWER]: Refusing update from remote peer 4967ac6ac157453da1a6e7b4f1ed8d61: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250625 03:29:48.042006 914 consensus_queue.cc:1035] T 0d8ad140d73a4a80a1d2316ef129935d P 4967ac6ac157453da1a6e7b4f1ed8d61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:29:48.119262 635 raft_consensus.cc:1273] T 6e85647348794694a1c45563583c5896 P 7b40d12015744366a464f1be5675cfb9 [term 5 FOLLOWER]: Refusing update from remote peer 4967ac6ac157453da1a6e7b4f1ed8d61: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20250625 03:29:48.120491 928 consensus_queue.cc:1035] T 6e85647348794694a1c45563583c5896 P 4967ac6ac157453da1a6e7b4f1ed8d61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250625 03:29:48.128701 709 raft_consensus.cc:1273] T 6e85647348794694a1c45563583c5896 P 57c574a183ee449ba3171ae11a734cc8 [term 5 FOLLOWER]: Refusing update from remote peer 4967ac6ac157453da1a6e7b4f1ed8d61: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20250625 03:29:48.130249 928 consensus_queue.cc:1035] T 6e85647348794694a1c45563583c5896 P 4967ac6ac157453da1a6e7b4f1ed8d61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250625 03:29:48.148967 709 raft_consensus.cc:1273] T 92d6dd32053d442ca03f15c290dc495e P 57c574a183ee449ba3171ae11a734cc8 [term 4 FOLLOWER]: Refusing update from remote peer 4967ac6ac157453da1a6e7b4f1ed8d61: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20250625 03:29:48.150007 928 consensus_queue.cc:1035] T 92d6dd32053d442ca03f15c290dc495e P 4967ac6ac157453da1a6e7b4f1ed8d61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57c574a183ee449ba3171ae11a734cc8" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:29:48.160477 635 raft_consensus.cc:1273] T 92d6dd32053d442ca03f15c290dc495e P 7b40d12015744366a464f1be5675cfb9 [term 4 FOLLOWER]: Refusing update from remote peer 4967ac6ac157453da1a6e7b4f1ed8d61: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20250625 03:29:48.161712 914 consensus_queue.cc:1035] T 92d6dd32053d442ca03f15c290dc495e P 4967ac6ac157453da1a6e7b4f1ed8d61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:29:48.241158 635 raft_consensus.cc:1273] T 9dccb59457ba43efa6ba3f3290a028fd P 7b40d12015744366a464f1be5675cfb9 [term 3 FOLLOWER]: Refusing update from remote peer 57c574a183ee449ba3171ae11a734cc8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250625 03:29:48.242339 922 consensus_queue.cc:1035] T 9dccb59457ba43efa6ba3f3290a028fd P 57c574a183ee449ba3171ae11a734cc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b40d12015744366a464f1be5675cfb9" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:29:48.250550 560 raft_consensus.cc:1273] T 9dccb59457ba43efa6ba3f3290a028fd P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 3 FOLLOWER]: Refusing update from remote peer 57c574a183ee449ba3171ae11a734cc8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250625 03:29:48.252153 908 consensus_queue.cc:1035] T 9dccb59457ba43efa6ba3f3290a028fd P 57c574a183ee449ba3171ae11a734cc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4967ac6ac157453da1a6e7b4f1ed8d61" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20250625 03:29:48.448132 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:29:48.452760 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250625 03:29:48.453110 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:29:49.453974 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:29:49.458803 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250625 03:29:49.459167 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:29:50.460230 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:29:50.465188 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250625 03:29:50.465590 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:29:51.466544 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:29:51.471283 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250625 03:29:51.471777 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:29:52.472747 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:29:52.477906 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250625 03:29:52.478262 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:29:53.479245 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:29:53.485038 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250625 03:29:53.485453 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:29:54.486426 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:29:54.491791 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250625 03:29:54.492231 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:29:55.493114 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:29:55.497749 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250625 03:29:55.498167 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:29:56.499159 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:29:56.504057 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250625 03:29:56.504472 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:29:57.532084 426 auto_leader_rebalancer-test.cc:318] The leader distribution is
I20250625 03:29:57.532837 426 tablet_server.cc:178] TabletServer@127.0.106.129:0 shutting down...
I20250625 03:29:57.560899 426 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250625 03:29:57.561663 426 tablet_replica.cc:331] T 9dccb59457ba43efa6ba3f3290a028fd P 4967ac6ac157453da1a6e7b4f1ed8d61: stopping tablet replica
I20250625 03:29:57.562676 426 raft_consensus.cc:2241] T 9dccb59457ba43efa6ba3f3290a028fd P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250625 03:29:57.563267 426 raft_consensus.cc:2270] T 9dccb59457ba43efa6ba3f3290a028fd P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:29:57.565644 426 tablet_replica.cc:331] T f9031be3db5846a194610fa6c83bc23c P 4967ac6ac157453da1a6e7b4f1ed8d61: stopping tablet replica
I20250625 03:29:57.566102 426 raft_consensus.cc:2241] T f9031be3db5846a194610fa6c83bc23c P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250625 03:29:57.566463 426 raft_consensus.cc:2270] T f9031be3db5846a194610fa6c83bc23c P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:29:57.568153 426 tablet_replica.cc:331] T 6e85647348794694a1c45563583c5896 P 4967ac6ac157453da1a6e7b4f1ed8d61: stopping tablet replica
I20250625 03:29:57.568615 426 raft_consensus.cc:2241] T 6e85647348794694a1c45563583c5896 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 5 LEADER]: Raft consensus shutting down.
I20250625 03:29:57.569380 426 raft_consensus.cc:2270] T 6e85647348794694a1c45563583c5896 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 5 FOLLOWER]: Raft consensus is shut down!
I20250625 03:29:57.570901 426 tablet_replica.cc:331] T 92d6dd32053d442ca03f15c290dc495e P 4967ac6ac157453da1a6e7b4f1ed8d61: stopping tablet replica
I20250625 03:29:57.571348 426 raft_consensus.cc:2241] T 92d6dd32053d442ca03f15c290dc495e P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 4 LEADER]: Raft consensus shutting down.
I20250625 03:29:57.572113 426 raft_consensus.cc:2270] T 92d6dd32053d442ca03f15c290dc495e P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 4 FOLLOWER]: Raft consensus is shut down!
I20250625 03:29:57.573643 426 tablet_replica.cc:331] T d2dd339d32874178b80ad608b5b7ea25 P 4967ac6ac157453da1a6e7b4f1ed8d61: stopping tablet replica
I20250625 03:29:57.574050 426 raft_consensus.cc:2241] T d2dd339d32874178b80ad608b5b7ea25 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:29:57.574412 426 raft_consensus.cc:2270] T d2dd339d32874178b80ad608b5b7ea25 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:29:57.575906 426 tablet_replica.cc:331] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 4967ac6ac157453da1a6e7b4f1ed8d61: stopping tablet replica
I20250625 03:29:57.576385 426 raft_consensus.cc:2241] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250625 03:29:57.576781 426 raft_consensus.cc:2270] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:29:57.578426 426 tablet_replica.cc:331] T 4e9ead806c80443da83728a2f97fc310 P 4967ac6ac157453da1a6e7b4f1ed8d61: stopping tablet replica
I20250625 03:29:57.579082 426 raft_consensus.cc:2241] T 4e9ead806c80443da83728a2f97fc310 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 4 FOLLOWER]: Raft consensus shutting down.
I20250625 03:29:57.579540 426 raft_consensus.cc:2270] T 4e9ead806c80443da83728a2f97fc310 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 4 FOLLOWER]: Raft consensus is shut down!
I20250625 03:29:57.581359 426 tablet_replica.cc:331] T 0d8ad140d73a4a80a1d2316ef129935d P 4967ac6ac157453da1a6e7b4f1ed8d61: stopping tablet replica
I20250625 03:29:57.581789 426 raft_consensus.cc:2241] T 0d8ad140d73a4a80a1d2316ef129935d P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 3 LEADER]: Raft consensus shutting down.
I20250625 03:29:57.582528 426 raft_consensus.cc:2270] T 0d8ad140d73a4a80a1d2316ef129935d P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:29:57.584288 426 tablet_replica.cc:331] T 777af158d52d4a9db024948c66182594 P 4967ac6ac157453da1a6e7b4f1ed8d61: stopping tablet replica
I20250625 03:29:57.584692 426 raft_consensus.cc:2241] T 777af158d52d4a9db024948c66182594 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:29:57.585073 426 raft_consensus.cc:2270] T 777af158d52d4a9db024948c66182594 P 4967ac6ac157453da1a6e7b4f1ed8d61 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:29:57.686390 426 tablet_server.cc:195] TabletServer@127.0.106.129:0 shutdown complete.
I20250625 03:29:57.704998 426 tablet_server.cc:178] TabletServer@127.0.106.130:0 shutting down...
W20250625 03:29:57.720621 675 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.106.129:41137: connect: Connection refused (error 111)
W20250625 03:29:57.726306 675 consensus_peers.cc:487] T 9dccb59457ba43efa6ba3f3290a028fd P 57c574a183ee449ba3171ae11a734cc8 -> Peer 4967ac6ac157453da1a6e7b4f1ed8d61 (127.0.106.129:41137): Couldn't send request to peer 4967ac6ac157453da1a6e7b4f1ed8d61. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:41137: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250625 03:29:57.730700 601 consensus_peers.cc:487] T 4e9ead806c80443da83728a2f97fc310 P 7b40d12015744366a464f1be5675cfb9 -> Peer 4967ac6ac157453da1a6e7b4f1ed8d61 (127.0.106.129:41137): Couldn't send request to peer 4967ac6ac157453da1a6e7b4f1ed8d61. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:41137: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250625 03:29:57.737440 675 consensus_peers.cc:487] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 57c574a183ee449ba3171ae11a734cc8 -> Peer 4967ac6ac157453da1a6e7b4f1ed8d61 (127.0.106.129:41137): Couldn't send request to peer 4967ac6ac157453da1a6e7b4f1ed8d61. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:41137: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250625 03:29:57.739378 426 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250625 03:29:57.740209 426 tablet_replica.cc:331] T 9dccb59457ba43efa6ba3f3290a028fd P 7b40d12015744366a464f1be5675cfb9: stopping tablet replica
I20250625 03:29:57.741321 426 raft_consensus.cc:2241] T 9dccb59457ba43efa6ba3f3290a028fd P 7b40d12015744366a464f1be5675cfb9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250625 03:29:57.741955 426 raft_consensus.cc:2270] T 9dccb59457ba43efa6ba3f3290a028fd P 7b40d12015744366a464f1be5675cfb9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:29:57.743662 426 tablet_replica.cc:331] T f9031be3db5846a194610fa6c83bc23c P 7b40d12015744366a464f1be5675cfb9: stopping tablet replica
I20250625 03:29:57.744172 426 raft_consensus.cc:2241] T f9031be3db5846a194610fa6c83bc23c P 7b40d12015744366a464f1be5675cfb9 [term 3 LEADER]: Raft consensus shutting down.
I20250625 03:29:57.744920 426 raft_consensus.cc:2270] T f9031be3db5846a194610fa6c83bc23c P 7b40d12015744366a464f1be5675cfb9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:29:57.746456 426 tablet_replica.cc:331] T d2dd339d32874178b80ad608b5b7ea25 P 7b40d12015744366a464f1be5675cfb9: stopping tablet replica
I20250625 03:29:57.746915 426 raft_consensus.cc:2241] T d2dd339d32874178b80ad608b5b7ea25 P 7b40d12015744366a464f1be5675cfb9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:29:57.747273 426 raft_consensus.cc:2270] T d2dd339d32874178b80ad608b5b7ea25 P 7b40d12015744366a464f1be5675cfb9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:29:57.748870 426 tablet_replica.cc:331] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 7b40d12015744366a464f1be5675cfb9: stopping tablet replica
I20250625 03:29:57.749318 426 raft_consensus.cc:2241] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 7b40d12015744366a464f1be5675cfb9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250625 03:29:57.749653 426 raft_consensus.cc:2270] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 7b40d12015744366a464f1be5675cfb9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:29:57.751190 426 tablet_replica.cc:331] T 6e85647348794694a1c45563583c5896 P 7b40d12015744366a464f1be5675cfb9: stopping tablet replica
I20250625 03:29:57.751619 426 raft_consensus.cc:2241] T 6e85647348794694a1c45563583c5896 P 7b40d12015744366a464f1be5675cfb9 [term 5 FOLLOWER]: Raft consensus shutting down.
I20250625 03:29:57.751950 426 raft_consensus.cc:2270] T 6e85647348794694a1c45563583c5896 P 7b40d12015744366a464f1be5675cfb9 [term 5 FOLLOWER]: Raft consensus is shut down!
I20250625 03:29:57.753700 426 tablet_replica.cc:331] T 4e9ead806c80443da83728a2f97fc310 P 7b40d12015744366a464f1be5675cfb9: stopping tablet replica
I20250625 03:29:57.754125 426 raft_consensus.cc:2241] T 4e9ead806c80443da83728a2f97fc310 P 7b40d12015744366a464f1be5675cfb9 [term 4 LEADER]: Raft consensus shutting down.
I20250625 03:29:57.754925 426 raft_consensus.cc:2270] T 4e9ead806c80443da83728a2f97fc310 P 7b40d12015744366a464f1be5675cfb9 [term 4 FOLLOWER]: Raft consensus is shut down!
I20250625 03:29:57.756532 426 tablet_replica.cc:331] T 777af158d52d4a9db024948c66182594 P 7b40d12015744366a464f1be5675cfb9: stopping tablet replica
I20250625 03:29:57.756927 426 raft_consensus.cc:2241] T 777af158d52d4a9db024948c66182594 P 7b40d12015744366a464f1be5675cfb9 [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:29:57.757608 426 raft_consensus.cc:2270] T 777af158d52d4a9db024948c66182594 P 7b40d12015744366a464f1be5675cfb9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:29:57.759148 426 tablet_replica.cc:331] T 0d8ad140d73a4a80a1d2316ef129935d P 7b40d12015744366a464f1be5675cfb9: stopping tablet replica
I20250625 03:29:57.759539 426 raft_consensus.cc:2241] T 0d8ad140d73a4a80a1d2316ef129935d P 7b40d12015744366a464f1be5675cfb9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250625 03:29:57.759862 426 raft_consensus.cc:2270] T 0d8ad140d73a4a80a1d2316ef129935d P 7b40d12015744366a464f1be5675cfb9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:29:57.761471 426 tablet_replica.cc:331] T 92d6dd32053d442ca03f15c290dc495e P 7b40d12015744366a464f1be5675cfb9: stopping tablet replica
I20250625 03:29:57.761834 426 raft_consensus.cc:2241] T 92d6dd32053d442ca03f15c290dc495e P 7b40d12015744366a464f1be5675cfb9 [term 4 FOLLOWER]: Raft consensus shutting down.
I20250625 03:29:57.762157 426 raft_consensus.cc:2270] T 92d6dd32053d442ca03f15c290dc495e P 7b40d12015744366a464f1be5675cfb9 [term 4 FOLLOWER]: Raft consensus is shut down!
I20250625 03:29:57.789731 426 tablet_server.cc:195] TabletServer@127.0.106.130:0 shutdown complete.
I20250625 03:29:57.811610 426 tablet_server.cc:178] TabletServer@127.0.106.131:0 shutting down...
I20250625 03:29:57.837491 426 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250625 03:29:57.838116 426 tablet_replica.cc:331] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 57c574a183ee449ba3171ae11a734cc8: stopping tablet replica
I20250625 03:29:57.838765 426 raft_consensus.cc:2241] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 57c574a183ee449ba3171ae11a734cc8 [term 3 LEADER]: Raft consensus shutting down.
I20250625 03:29:57.839565 426 raft_consensus.cc:2270] T 48a6f4f9f8cc41f48d562f310ec0b9d5 P 57c574a183ee449ba3171ae11a734cc8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:29:57.841356 426 tablet_replica.cc:331] T 9dccb59457ba43efa6ba3f3290a028fd P 57c574a183ee449ba3171ae11a734cc8: stopping tablet replica
I20250625 03:29:57.841845 426 raft_consensus.cc:2241] T 9dccb59457ba43efa6ba3f3290a028fd P 57c574a183ee449ba3171ae11a734cc8 [term 3 LEADER]: Raft consensus shutting down.
I20250625 03:29:57.842569 426 raft_consensus.cc:2270] T 9dccb59457ba43efa6ba3f3290a028fd P 57c574a183ee449ba3171ae11a734cc8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:29:57.844202 426 tablet_replica.cc:331] T 6e85647348794694a1c45563583c5896 P 57c574a183ee449ba3171ae11a734cc8: stopping tablet replica
I20250625 03:29:57.844688 426 raft_consensus.cc:2241] T 6e85647348794694a1c45563583c5896 P 57c574a183ee449ba3171ae11a734cc8 [term 5 FOLLOWER]: Raft consensus shutting down.
I20250625 03:29:57.845088 426 raft_consensus.cc:2270] T 6e85647348794694a1c45563583c5896 P 57c574a183ee449ba3171ae11a734cc8 [term 5 FOLLOWER]: Raft consensus is shut down!
I20250625 03:29:57.846628 426 tablet_replica.cc:331] T 777af158d52d4a9db024948c66182594 P 57c574a183ee449ba3171ae11a734cc8: stopping tablet replica
I20250625 03:29:57.847091 426 raft_consensus.cc:2241] T 777af158d52d4a9db024948c66182594 P 57c574a183ee449ba3171ae11a734cc8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:29:57.847483 426 raft_consensus.cc:2270] T 777af158d52d4a9db024948c66182594 P 57c574a183ee449ba3171ae11a734cc8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:29:57.849045 426 tablet_replica.cc:331] T 4e9ead806c80443da83728a2f97fc310 P 57c574a183ee449ba3171ae11a734cc8: stopping tablet replica
I20250625 03:29:57.849488 426 raft_consensus.cc:2241] T 4e9ead806c80443da83728a2f97fc310 P 57c574a183ee449ba3171ae11a734cc8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20250625 03:29:57.849877 426 raft_consensus.cc:2270] T 4e9ead806c80443da83728a2f97fc310 P 57c574a183ee449ba3171ae11a734cc8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20250625 03:29:57.851434 426 tablet_replica.cc:331] T 0d8ad140d73a4a80a1d2316ef129935d P 57c574a183ee449ba3171ae11a734cc8: stopping tablet replica
I20250625 03:29:57.851859 426 raft_consensus.cc:2241] T 0d8ad140d73a4a80a1d2316ef129935d P 57c574a183ee449ba3171ae11a734cc8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250625 03:29:57.852288 426 raft_consensus.cc:2270] T 0d8ad140d73a4a80a1d2316ef129935d P 57c574a183ee449ba3171ae11a734cc8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:29:57.853730 426 tablet_replica.cc:331] T d2dd339d32874178b80ad608b5b7ea25 P 57c574a183ee449ba3171ae11a734cc8: stopping tablet replica
I20250625 03:29:57.854163 426 raft_consensus.cc:2241] T d2dd339d32874178b80ad608b5b7ea25 P 57c574a183ee449ba3171ae11a734cc8 [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:29:57.854861 426 raft_consensus.cc:2270] T d2dd339d32874178b80ad608b5b7ea25 P 57c574a183ee449ba3171ae11a734cc8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:29:57.856477 426 tablet_replica.cc:331] T 92d6dd32053d442ca03f15c290dc495e P 57c574a183ee449ba3171ae11a734cc8: stopping tablet replica
I20250625 03:29:57.856905 426 raft_consensus.cc:2241] T 92d6dd32053d442ca03f15c290dc495e P 57c574a183ee449ba3171ae11a734cc8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20250625 03:29:57.857304 426 raft_consensus.cc:2270] T 92d6dd32053d442ca03f15c290dc495e P 57c574a183ee449ba3171ae11a734cc8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20250625 03:29:57.858844 426 tablet_replica.cc:331] T f9031be3db5846a194610fa6c83bc23c P 57c574a183ee449ba3171ae11a734cc8: stopping tablet replica
I20250625 03:29:57.859261 426 raft_consensus.cc:2241] T f9031be3db5846a194610fa6c83bc23c P 57c574a183ee449ba3171ae11a734cc8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250625 03:29:57.859645 426 raft_consensus.cc:2270] T f9031be3db5846a194610fa6c83bc23c P 57c574a183ee449ba3171ae11a734cc8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:29:57.886029 426 tablet_server.cc:195] TabletServer@127.0.106.131:0 shutdown complete.
I20250625 03:29:57.903445 426 master.cc:561] Master@127.0.106.190:40241 shutting down...
I20250625 03:29:58.096973 426 raft_consensus.cc:2241] T 00000000000000000000000000000000 P 6d77fec2c20d4c8a8ab0a1c00980f333 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:29:58.097589 426 raft_consensus.cc:2270] T 00000000000000000000000000000000 P 6d77fec2c20d4c8a8ab0a1c00980f333 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:29:58.097899 426 tablet_replica.cc:331] T 00000000000000000000000000000000 P 6d77fec2c20d4c8a8ab0a1c00980f333: stopping tablet replica
I20250625 03:29:58.117671 426 master.cc:583] Master@127.0.106.190:40241 shutdown complete.
4967ac6ac157453da1a6e7b4f1ed8d61 4
57c574a183ee449ba3171ae11a734cc8 1
7b40d12015744366a464f1be5675cfb9 4
4967ac6ac157453da1a6e7b4f1ed8d61 3
57c574a183ee449ba3171ae11a734cc8 3
7b40d12015744366a464f1be5675cfb9 3
4967ac6ac157453da1a6e7b4f1ed8d61 0
57c574a183ee449ba3171ae11a734cc8 1
7b40d12015744366a464f1be5675cfb9 8
4967ac6ac157453da1a6e7b4f1ed8d61 3
57c574a183ee449ba3171ae11a734cc8 3
7b40d12015744366a464f1be5675cfb9 3
[ OK ] LeaderRebalancerTest.FunctionalTestForDivided (31280 ms)
[ RUN ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20250625 03:29:58.161870 426 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.106.190:34593
I20250625 03:29:58.162931 426 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250625 03:29:58.168083 948 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250625 03:29:58.169095 949 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250625 03:29:58.170648 426 server_base.cc:1048] running on GCE node
W20250625 03:29:58.170982 951 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250625 03:29:58.172071 426 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250625 03:29:58.172315 426 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250625 03:29:58.172459 426 hybrid_clock.cc:648] HybridClock initialized: now 1750822198172443 us; error 0 us; skew 500 ppm
I20250625 03:29:58.172971 426 server_base.cc:848] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250625 03:29:58.175518 426 webserver.cc:469] Webserver started at http://127.0.106.190:45449/ using document root <none> and password file <none>
I20250625 03:29:58.175998 426 fs_manager.cc:362] Metadata directory not provided
I20250625 03:29:58.176471 426 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250625 03:29:58.176738 426 server_base.cc:896] This appears to be a new deployment of Kudu; creating new FS layout
I20250625 03:29:58.177872 426 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1750822166717217-426-0/minicluster-data/master-0-root/instance:
uuid: "0e50f47b0e5c4dec9dd35afe9044df8b"
format_stamp: "Formatted at 2025-06-25 03:29:58 on dist-test-slave-lj23"
I20250625 03:29:58.182401 426 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20250625 03:29:58.186004 956 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250625 03:29:58.186805 426 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20250625 03:29:58.187062 426 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1750822166717217-426-0/minicluster-data/master-0-root
uuid: "0e50f47b0e5c4dec9dd35afe9044df8b"
format_stamp: "Formatted at 2025-06-25 03:29:58 on dist-test-slave-lj23"
I20250625 03:29:58.187299 426 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1750822166717217-426-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1750822166717217-426-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1750822166717217-426-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250625 03:29:58.198422 426 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250625 03:29:58.199573 426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250625 03:29:58.237494 426 rpc_server.cc:307] RPC server started. Bound to: 127.0.106.190:34593
I20250625 03:29:58.237598 1007 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.106.190:34593 every 8 connection(s)
I20250625 03:29:58.241333 1008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:29:58.250633 1008 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e50f47b0e5c4dec9dd35afe9044df8b: Bootstrap starting.
I20250625 03:29:58.255190 1008 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0e50f47b0e5c4dec9dd35afe9044df8b: Neither blocks nor log segments found. Creating new log.
I20250625 03:29:58.259413 1008 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e50f47b0e5c4dec9dd35afe9044df8b: No bootstrap required, opened a new log
I20250625 03:29:58.261482 1008 raft_consensus.cc:357] T 00000000000000000000000000000000 P 0e50f47b0e5c4dec9dd35afe9044df8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e50f47b0e5c4dec9dd35afe9044df8b" member_type: VOTER }
I20250625 03:29:58.261904 1008 raft_consensus.cc:383] T 00000000000000000000000000000000 P 0e50f47b0e5c4dec9dd35afe9044df8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:29:58.262077 1008 raft_consensus.cc:738] T 00000000000000000000000000000000 P 0e50f47b0e5c4dec9dd35afe9044df8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e50f47b0e5c4dec9dd35afe9044df8b, State: Initialized, Role: FOLLOWER
I20250625 03:29:58.262526 1008 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0e50f47b0e5c4dec9dd35afe9044df8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e50f47b0e5c4dec9dd35afe9044df8b" member_type: VOTER }
I20250625 03:29:58.262928 1008 raft_consensus.cc:397] T 00000000000000000000000000000000 P 0e50f47b0e5c4dec9dd35afe9044df8b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250625 03:29:58.263108 1008 raft_consensus.cc:491] T 00000000000000000000000000000000 P 0e50f47b0e5c4dec9dd35afe9044df8b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250625 03:29:58.263332 1008 raft_consensus.cc:3058] T 00000000000000000000000000000000 P 0e50f47b0e5c4dec9dd35afe9044df8b [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:29:58.267248 1008 raft_consensus.cc:513] T 00000000000000000000000000000000 P 0e50f47b0e5c4dec9dd35afe9044df8b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e50f47b0e5c4dec9dd35afe9044df8b" member_type: VOTER }
I20250625 03:29:58.267755 1008 leader_election.cc:304] T 00000000000000000000000000000000 P 0e50f47b0e5c4dec9dd35afe9044df8b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0e50f47b0e5c4dec9dd35afe9044df8b; no voters:
I20250625 03:29:58.268779 1008 leader_election.cc:290] T 00000000000000000000000000000000 P 0e50f47b0e5c4dec9dd35afe9044df8b [CANDIDATE]: Term 1 election: Requested vote from peers
I20250625 03:29:58.269152 1011 raft_consensus.cc:2802] T 00000000000000000000000000000000 P 0e50f47b0e5c4dec9dd35afe9044df8b [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:29:58.270419 1011 raft_consensus.cc:695] T 00000000000000000000000000000000 P 0e50f47b0e5c4dec9dd35afe9044df8b [term 1 LEADER]: Becoming Leader. State: Replica: 0e50f47b0e5c4dec9dd35afe9044df8b, State: Running, Role: LEADER
I20250625 03:29:58.271114 1011 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0e50f47b0e5c4dec9dd35afe9044df8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e50f47b0e5c4dec9dd35afe9044df8b" member_type: VOTER }
I20250625 03:29:58.271636 1008 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0e50f47b0e5c4dec9dd35afe9044df8b [sys.catalog]: configured and running, proceeding with master startup.
I20250625 03:29:58.276391 1013 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e50f47b0e5c4dec9dd35afe9044df8b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0e50f47b0e5c4dec9dd35afe9044df8b. Latest consensus state: current_term: 1 leader_uuid: "0e50f47b0e5c4dec9dd35afe9044df8b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e50f47b0e5c4dec9dd35afe9044df8b" member_type: VOTER } }
I20250625 03:29:58.277117 1012 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e50f47b0e5c4dec9dd35afe9044df8b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0e50f47b0e5c4dec9dd35afe9044df8b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e50f47b0e5c4dec9dd35afe9044df8b" member_type: VOTER } }
I20250625 03:29:58.277374 1013 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e50f47b0e5c4dec9dd35afe9044df8b [sys.catalog]: This master's current role is: LEADER
I20250625 03:29:58.277702 1012 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e50f47b0e5c4dec9dd35afe9044df8b [sys.catalog]: This master's current role is: LEADER
I20250625 03:29:58.279479 1020 catalog_manager.cc:1477] Loading table and tablet metadata into memory...
I20250625 03:29:58.284269 1020 catalog_manager.cc:1486] Initializing Kudu cluster ID...
I20250625 03:29:58.286409 426 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20250625 03:29:58.296573 1020 catalog_manager.cc:1349] Generated new cluster ID: f92ed4282d824560a9d9bcf313b97607
I20250625 03:29:58.296849 1020 catalog_manager.cc:1497] Initializing Kudu internal certificate authority...
I20250625 03:29:58.323665 1020 catalog_manager.cc:1372] Generated new certificate authority record
I20250625 03:29:58.324910 1020 catalog_manager.cc:1506] Loading token signing keys...
I20250625 03:29:58.335906 1020 catalog_manager.cc:5955] T 00000000000000000000000000000000 P 0e50f47b0e5c4dec9dd35afe9044df8b: Generated new TSK 0
I20250625 03:29:58.336524 1020 catalog_manager.cc:1516] Initializing in-progress tserver states...
I20250625 03:29:58.352730 426 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250625 03:29:58.358229 1029 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250625 03:29:58.359387 1030 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250625 03:29:58.361635 426 server_base.cc:1048] running on GCE node
W20250625 03:29:58.361595 1032 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250625 03:29:58.362828 426 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250625 03:29:58.363013 426 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250625 03:29:58.363181 426 hybrid_clock.cc:648] HybridClock initialized: now 1750822198363160 us; error 0 us; skew 500 ppm
I20250625 03:29:58.363723 426 server_base.cc:848] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250625 03:29:58.366204 426 webserver.cc:469] Webserver started at http://127.0.106.129:36563/ using document root <none> and password file <none>
I20250625 03:29:58.366711 426 fs_manager.cc:362] Metadata directory not provided
I20250625 03:29:58.366889 426 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250625 03:29:58.367138 426 server_base.cc:896] This appears to be a new deployment of Kudu; creating new FS layout
I20250625 03:29:58.368227 426 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1750822166717217-426-0/minicluster-data/ts-0-root/instance:
uuid: "89a9444e93674a9d9e3d988af9c95a3e"
format_stamp: "Formatted at 2025-06-25 03:29:58 on dist-test-slave-lj23"
I20250625 03:29:58.372638 426 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20250625 03:29:58.375983 1037 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250625 03:29:58.376690 426 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20250625 03:29:58.376967 426 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1750822166717217-426-0/minicluster-data/ts-0-root
uuid: "89a9444e93674a9d9e3d988af9c95a3e"
format_stamp: "Formatted at 2025-06-25 03:29:58 on dist-test-slave-lj23"
I20250625 03:29:58.377224 426 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1750822166717217-426-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1750822166717217-426-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1750822166717217-426-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250625 03:29:58.390072 426 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250625 03:29:58.391261 426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250625 03:29:58.392709 426 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20250625 03:29:58.394786 426 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250625 03:29:58.394964 426 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250625 03:29:58.395231 426 ts_tablet_manager.cc:610] Registered 0 tablets
I20250625 03:29:58.395380 426 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250625 03:29:58.434052 426 rpc_server.cc:307] RPC server started. Bound to: 127.0.106.129:44675
I20250625 03:29:58.434132 1099 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.106.129:44675 every 8 connection(s)
I20250625 03:29:58.438447 426 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250625 03:29:58.445216 1104 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250625 03:29:58.446336 1105 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250625 03:29:58.449365 426 server_base.cc:1048] running on GCE node
W20250625 03:29:58.450337 1107 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250625 03:29:58.451297 426 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250625 03:29:58.451494 426 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250625 03:29:58.451673 426 hybrid_clock.cc:648] HybridClock initialized: now 1750822198451656 us; error 0 us; skew 500 ppm
I20250625 03:29:58.452399 426 server_base.cc:848] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250625 03:29:58.452414 1100 heartbeater.cc:344] Connected to a master server at 127.0.106.190:34593
I20250625 03:29:58.452913 1100 heartbeater.cc:461] Registering TS with master...
I20250625 03:29:58.453802 1100 heartbeater.cc:507] Master 127.0.106.190:34593 requested a full tablet report, sending...
I20250625 03:29:58.455057 426 webserver.cc:469] Webserver started at http://127.0.106.130:38737/ using document root <none> and password file <none>
I20250625 03:29:58.455591 426 fs_manager.cc:362] Metadata directory not provided
I20250625 03:29:58.455786 426 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250625 03:29:58.456094 426 server_base.cc:896] This appears to be a new deployment of Kudu; creating new FS layout
I20250625 03:29:58.456080 973 ts_manager.cc:194] Registered new tserver with Master: 89a9444e93674a9d9e3d988af9c95a3e (127.0.106.129:44675)
I20250625 03:29:58.457386 426 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1750822166717217-426-0/minicluster-data/ts-1-root/instance:
uuid: "5f009baf8a094da7a58d2a36ea888442"
format_stamp: "Formatted at 2025-06-25 03:29:58 on dist-test-slave-lj23"
I20250625 03:29:58.457921 973 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46886
I20250625 03:29:58.461946 426 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20250625 03:29:58.465389 1112 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250625 03:29:58.466315 426 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20250625 03:29:58.466602 426 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1750822166717217-426-0/minicluster-data/ts-1-root
uuid: "5f009baf8a094da7a58d2a36ea888442"
format_stamp: "Formatted at 2025-06-25 03:29:58 on dist-test-slave-lj23"
I20250625 03:29:58.466876 426 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1750822166717217-426-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1750822166717217-426-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1750822166717217-426-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250625 03:29:58.501914 426 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250625 03:29:58.503072 426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250625 03:29:58.504511 426 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20250625 03:29:58.506768 426 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250625 03:29:58.506965 426 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250625 03:29:58.507190 426 ts_tablet_manager.cc:610] Registered 0 tablets
I20250625 03:29:58.507452 426 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250625 03:29:58.546228 426 rpc_server.cc:307] RPC server started. Bound to: 127.0.106.130:37441
I20250625 03:29:58.546314 1174 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.106.130:37441 every 8 connection(s)
I20250625 03:29:58.550886 426 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250625 03:29:58.557085 1178 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250625 03:29:58.558912 1179 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250625 03:29:58.560921 1181 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250625 03:29:58.561677 426 server_base.cc:1048] running on GCE node
I20250625 03:29:58.562701 426 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250625 03:29:58.562953 426 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250625 03:29:58.563117 426 hybrid_clock.cc:648] HybridClock initialized: now 1750822198563100 us; error 0 us; skew 500 ppm
I20250625 03:29:58.563506 1175 heartbeater.cc:344] Connected to a master server at 127.0.106.190:34593
I20250625 03:29:58.563776 426 server_base.cc:848] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250625 03:29:58.563895 1175 heartbeater.cc:461] Registering TS with master...
I20250625 03:29:58.564797 1175 heartbeater.cc:507] Master 127.0.106.190:34593 requested a full tablet report, sending...
I20250625 03:29:58.566589 426 webserver.cc:469] Webserver started at http://127.0.106.131:32889/ using document root <none> and password file <none>
I20250625 03:29:58.566941 973 ts_manager.cc:194] Registered new tserver with Master: 5f009baf8a094da7a58d2a36ea888442 (127.0.106.130:37441)
I20250625 03:29:58.567080 426 fs_manager.cc:362] Metadata directory not provided
I20250625 03:29:58.567348 426 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250625 03:29:58.567595 426 server_base.cc:896] This appears to be a new deployment of Kudu; creating new FS layout
I20250625 03:29:58.568326 973 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46894
I20250625 03:29:58.568771 426 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1750822166717217-426-0/minicluster-data/ts-2-root/instance:
uuid: "90c988d9adde44879ef11b8aa6ef4da3"
format_stamp: "Formatted at 2025-06-25 03:29:58 on dist-test-slave-lj23"
I20250625 03:29:58.573376 426 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.004s sys 0.001s
I20250625 03:29:58.576612 1186 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250625 03:29:58.577466 426 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20250625 03:29:58.577733 426 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1750822166717217-426-0/minicluster-data/ts-2-root
uuid: "90c988d9adde44879ef11b8aa6ef4da3"
format_stamp: "Formatted at 2025-06-25 03:29:58 on dist-test-slave-lj23"
I20250625 03:29:58.577981 426 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1750822166717217-426-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1750822166717217-426-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1750822166717217-426-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250625 03:29:58.600448 426 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250625 03:29:58.601637 426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250625 03:29:58.603071 426 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20250625 03:29:58.605217 426 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250625 03:29:58.605403 426 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250625 03:29:58.605584 426 ts_tablet_manager.cc:610] Registered 0 tablets
I20250625 03:29:58.605703 426 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250625 03:29:58.645349 426 rpc_server.cc:307] RPC server started. Bound to: 127.0.106.131:42281
I20250625 03:29:58.645431 1248 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.106.131:42281 every 8 connection(s)
I20250625 03:29:58.658707 1249 heartbeater.cc:344] Connected to a master server at 127.0.106.190:34593
I20250625 03:29:58.659056 1249 heartbeater.cc:461] Registering TS with master...
I20250625 03:29:58.659760 1249 heartbeater.cc:507] Master 127.0.106.190:34593 requested a full tablet report, sending...
I20250625 03:29:58.661590 973 ts_manager.cc:194] Registered new tserver with Master: 90c988d9adde44879ef11b8aa6ef4da3 (127.0.106.131:42281)
I20250625 03:29:58.661926 426 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013459477s
I20250625 03:29:58.662859 973 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46904
I20250625 03:29:58.664175 426 test_util.cc:276] Using random seed: 255286232
I20250625 03:29:58.687783 973 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46906:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 03:29:58.690640 973 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 03:29:58.766671 1214 tablet_service.cc:1468] Processing CreateTablet for tablet b6138e286d7448baa149c4952eb2fd0c (DEFAULT_TABLE table=test-workload [id=191ef7828c9946839f77bc83471951f2]), partition=RANGE (key) PARTITION VALUES < 214748364
I20250625 03:29:58.769255 1213 tablet_service.cc:1468] Processing CreateTablet for tablet bc9758463ec04a4b93042f29add1a1fd (DEFAULT_TABLE table=test-workload [id=191ef7828c9946839f77bc83471951f2]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20250625 03:29:58.771620 1212 tablet_service.cc:1468] Processing CreateTablet for tablet 86ab18af04f544ef8316b4caeaf781d2 (DEFAULT_TABLE table=test-workload [id=191ef7828c9946839f77bc83471951f2]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20250625 03:29:58.773813 1211 tablet_service.cc:1468] Processing CreateTablet for tablet 0ee874019a27479a94caf3275d914259 (DEFAULT_TABLE table=test-workload [id=191ef7828c9946839f77bc83471951f2]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20250625 03:29:58.774860 1206 tablet_service.cc:1468] Processing CreateTablet for tablet 90089cf7177a4f67a5cc1bdfb9f179bd (DEFAULT_TABLE table=test-workload [id=191ef7828c9946839f77bc83471951f2]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20250625 03:29:58.776165 1210 tablet_service.cc:1468] Processing CreateTablet for tablet 27e1943c0c154ec68f7e0a75b39b1105 (DEFAULT_TABLE table=test-workload [id=191ef7828c9946839f77bc83471951f2]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20250625 03:29:58.777573 1207 tablet_service.cc:1468] Processing CreateTablet for tablet 93d7b80866e64a77b925f730e300fe88 (DEFAULT_TABLE table=test-workload [id=191ef7828c9946839f77bc83471951f2]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20250625 03:29:58.778270 1205 tablet_service.cc:1468] Processing CreateTablet for tablet 513e577d0f2f4faea26726a7e8670a8d (DEFAULT_TABLE table=test-workload [id=191ef7828c9946839f77bc83471951f2]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20250625 03:29:58.779767 1208 tablet_service.cc:1468] Processing CreateTablet for tablet 1d26f90c72ff4068ad7d0b002f4546cc (DEFAULT_TABLE table=test-workload [id=191ef7828c9946839f77bc83471951f2]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20250625 03:29:58.782024 1209 tablet_service.cc:1468] Processing CreateTablet for tablet 6b62b2927d214886b92f502546868ca0 (DEFAULT_TABLE table=test-workload [id=191ef7828c9946839f77bc83471951f2]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20250625 03:29:58.786047 1214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6138e286d7448baa149c4952eb2fd0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:29:58.786827 1209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b62b2927d214886b92f502546868ca0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:29:58.787472 1212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86ab18af04f544ef8316b4caeaf781d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:29:58.788102 1208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d26f90c72ff4068ad7d0b002f4546cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:29:58.788687 1213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc9758463ec04a4b93042f29add1a1fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:29:58.789475 1140 tablet_service.cc:1468] Processing CreateTablet for tablet b6138e286d7448baa149c4952eb2fd0c (DEFAULT_TABLE table=test-workload [id=191ef7828c9946839f77bc83471951f2]), partition=RANGE (key) PARTITION VALUES < 214748364
I20250625 03:29:58.789834 1207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93d7b80866e64a77b925f730e300fe88. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:29:58.790221 1139 tablet_service.cc:1468] Processing CreateTablet for tablet bc9758463ec04a4b93042f29add1a1fd (DEFAULT_TABLE table=test-workload [id=191ef7828c9946839f77bc83471951f2]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20250625 03:29:58.790771 1140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6138e286d7448baa149c4952eb2fd0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:29:58.791574 1139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc9758463ec04a4b93042f29add1a1fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:29:58.792347 1211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ee874019a27479a94caf3275d914259. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:29:58.795406 1138 tablet_service.cc:1468] Processing CreateTablet for tablet 86ab18af04f544ef8316b4caeaf781d2 (DEFAULT_TABLE table=test-workload [id=191ef7828c9946839f77bc83471951f2]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20250625 03:29:58.796375 1205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 513e577d0f2f4faea26726a7e8670a8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:29:58.796883 1138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86ab18af04f544ef8316b4caeaf781d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:29:58.797348 1137 tablet_service.cc:1468] Processing CreateTablet for tablet 0ee874019a27479a94caf3275d914259 (DEFAULT_TABLE table=test-workload [id=191ef7828c9946839f77bc83471951f2]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20250625 03:29:58.798727 1137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ee874019a27479a94caf3275d914259. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:29:58.804397 1210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27e1943c0c154ec68f7e0a75b39b1105. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:29:58.805702 1206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90089cf7177a4f67a5cc1bdfb9f179bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:29:58.813287 1136 tablet_service.cc:1468] Processing CreateTablet for tablet 27e1943c0c154ec68f7e0a75b39b1105 (DEFAULT_TABLE table=test-workload [id=191ef7828c9946839f77bc83471951f2]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20250625 03:29:58.814688 1136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27e1943c0c154ec68f7e0a75b39b1105. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:29:58.819804 1135 tablet_service.cc:1468] Processing CreateTablet for tablet 6b62b2927d214886b92f502546868ca0 (DEFAULT_TABLE table=test-workload [id=191ef7828c9946839f77bc83471951f2]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20250625 03:29:58.821370 1135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b62b2927d214886b92f502546868ca0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:29:58.821907 1065 tablet_service.cc:1468] Processing CreateTablet for tablet b6138e286d7448baa149c4952eb2fd0c (DEFAULT_TABLE table=test-workload [id=191ef7828c9946839f77bc83471951f2]), partition=RANGE (key) PARTITION VALUES < 214748364
I20250625 03:29:58.823218 1065 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6138e286d7448baa149c4952eb2fd0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:29:58.825301 1134 tablet_service.cc:1468] Processing CreateTablet for tablet 1d26f90c72ff4068ad7d0b002f4546cc (DEFAULT_TABLE table=test-workload [id=191ef7828c9946839f77bc83471951f2]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20250625 03:29:58.826743 1134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d26f90c72ff4068ad7d0b002f4546cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:29:58.829267 1133 tablet_service.cc:1468] Processing CreateTablet for tablet 93d7b80866e64a77b925f730e300fe88 (DEFAULT_TABLE table=test-workload [id=191ef7828c9946839f77bc83471951f2]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20250625 03:29:58.829653 1064 tablet_service.cc:1468] Processing CreateTablet for tablet bc9758463ec04a4b93042f29add1a1fd (DEFAULT_TABLE table=test-workload [id=191ef7828c9946839f77bc83471951f2]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20250625 03:29:58.830631 1133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93d7b80866e64a77b925f730e300fe88. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:29:58.830834 1064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc9758463ec04a4b93042f29add1a1fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:29:58.833209 1132 tablet_service.cc:1468] Processing CreateTablet for tablet 90089cf7177a4f67a5cc1bdfb9f179bd (DEFAULT_TABLE table=test-workload [id=191ef7828c9946839f77bc83471951f2]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20250625 03:29:58.834532 1132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90089cf7177a4f67a5cc1bdfb9f179bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:29:58.837229 1131 tablet_service.cc:1468] Processing CreateTablet for tablet 513e577d0f2f4faea26726a7e8670a8d (DEFAULT_TABLE table=test-workload [id=191ef7828c9946839f77bc83471951f2]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20250625 03:29:58.837685 1063 tablet_service.cc:1468] Processing CreateTablet for tablet 86ab18af04f544ef8316b4caeaf781d2 (DEFAULT_TABLE table=test-workload [id=191ef7828c9946839f77bc83471951f2]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20250625 03:29:58.838559 1131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 513e577d0f2f4faea26726a7e8670a8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:29:58.838979 1063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86ab18af04f544ef8316b4caeaf781d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:29:58.842643 1062 tablet_service.cc:1468] Processing CreateTablet for tablet 0ee874019a27479a94caf3275d914259 (DEFAULT_TABLE table=test-workload [id=191ef7828c9946839f77bc83471951f2]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20250625 03:29:58.844308 1062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ee874019a27479a94caf3275d914259. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:29:58.846823 1061 tablet_service.cc:1468] Processing CreateTablet for tablet 27e1943c0c154ec68f7e0a75b39b1105 (DEFAULT_TABLE table=test-workload [id=191ef7828c9946839f77bc83471951f2]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20250625 03:29:58.848634 1061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27e1943c0c154ec68f7e0a75b39b1105. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:29:58.877334 1060 tablet_service.cc:1468] Processing CreateTablet for tablet 6b62b2927d214886b92f502546868ca0 (DEFAULT_TABLE table=test-workload [id=191ef7828c9946839f77bc83471951f2]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20250625 03:29:58.878912 1056 tablet_service.cc:1468] Processing CreateTablet for tablet 513e577d0f2f4faea26726a7e8670a8d (DEFAULT_TABLE table=test-workload [id=191ef7828c9946839f77bc83471951f2]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20250625 03:29:58.879725 1059 tablet_service.cc:1468] Processing CreateTablet for tablet 1d26f90c72ff4068ad7d0b002f4546cc (DEFAULT_TABLE table=test-workload [id=191ef7828c9946839f77bc83471951f2]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20250625 03:29:58.882468 1057 tablet_service.cc:1468] Processing CreateTablet for tablet 90089cf7177a4f67a5cc1bdfb9f179bd (DEFAULT_TABLE table=test-workload [id=191ef7828c9946839f77bc83471951f2]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20250625 03:29:58.884402 1058 tablet_service.cc:1468] Processing CreateTablet for tablet 93d7b80866e64a77b925f730e300fe88 (DEFAULT_TABLE table=test-workload [id=191ef7828c9946839f77bc83471951f2]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20250625 03:29:58.892333 1060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b62b2927d214886b92f502546868ca0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:29:58.893103 1056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 513e577d0f2f4faea26726a7e8670a8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:29:58.896376 1059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d26f90c72ff4068ad7d0b002f4546cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:29:58.912364 1057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90089cf7177a4f67a5cc1bdfb9f179bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:29:58.920492 1058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93d7b80866e64a77b925f730e300fe88. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:29:58.963024 1265 tablet_bootstrap.cc:492] T 90089cf7177a4f67a5cc1bdfb9f179bd P 5f009baf8a094da7a58d2a36ea888442: Bootstrap starting.
I20250625 03:29:58.963464 1266 tablet_bootstrap.cc:492] T b6138e286d7448baa149c4952eb2fd0c P 89a9444e93674a9d9e3d988af9c95a3e: Bootstrap starting.
I20250625 03:29:58.972556 1265 tablet_bootstrap.cc:654] T 90089cf7177a4f67a5cc1bdfb9f179bd P 5f009baf8a094da7a58d2a36ea888442: Neither blocks nor log segments found. Creating new log.
I20250625 03:29:58.973547 1264 tablet_bootstrap.cc:492] T b6138e286d7448baa149c4952eb2fd0c P 90c988d9adde44879ef11b8aa6ef4da3: Bootstrap starting.
I20250625 03:29:58.993593 1264 tablet_bootstrap.cc:654] T b6138e286d7448baa149c4952eb2fd0c P 90c988d9adde44879ef11b8aa6ef4da3: Neither blocks nor log segments found. Creating new log.
I20250625 03:29:58.997689 1266 tablet_bootstrap.cc:654] T b6138e286d7448baa149c4952eb2fd0c P 89a9444e93674a9d9e3d988af9c95a3e: Neither blocks nor log segments found. Creating new log.
I20250625 03:29:59.008848 1265 tablet_bootstrap.cc:492] T 90089cf7177a4f67a5cc1bdfb9f179bd P 5f009baf8a094da7a58d2a36ea888442: No bootstrap required, opened a new log
I20250625 03:29:59.009333 1265 ts_tablet_manager.cc:1397] T 90089cf7177a4f67a5cc1bdfb9f179bd P 5f009baf8a094da7a58d2a36ea888442: Time spent bootstrapping tablet: real 0.047s user 0.028s sys 0.011s
I20250625 03:29:59.011741 1265 raft_consensus.cc:357] T 90089cf7177a4f67a5cc1bdfb9f179bd P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.013067 1265 raft_consensus.cc:383] T 90089cf7177a4f67a5cc1bdfb9f179bd P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:29:59.013393 1265 raft_consensus.cc:738] T 90089cf7177a4f67a5cc1bdfb9f179bd P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f009baf8a094da7a58d2a36ea888442, State: Initialized, Role: FOLLOWER
I20250625 03:29:59.013999 1265 consensus_queue.cc:260] T 90089cf7177a4f67a5cc1bdfb9f179bd P 5f009baf8a094da7a58d2a36ea888442 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.014946 1266 tablet_bootstrap.cc:492] T b6138e286d7448baa149c4952eb2fd0c P 89a9444e93674a9d9e3d988af9c95a3e: No bootstrap required, opened a new log
I20250625 03:29:59.015479 1266 ts_tablet_manager.cc:1397] T b6138e286d7448baa149c4952eb2fd0c P 89a9444e93674a9d9e3d988af9c95a3e: Time spent bootstrapping tablet: real 0.053s user 0.004s sys 0.013s
I20250625 03:29:59.015937 1175 heartbeater.cc:499] Master 127.0.106.190:34593 was elected leader, sending a full tablet report...
I20250625 03:29:59.016623 1265 ts_tablet_manager.cc:1428] T 90089cf7177a4f67a5cc1bdfb9f179bd P 5f009baf8a094da7a58d2a36ea888442: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20250625 03:29:59.017553 1265 tablet_bootstrap.cc:492] T 6b62b2927d214886b92f502546868ca0 P 5f009baf8a094da7a58d2a36ea888442: Bootstrap starting.
I20250625 03:29:59.017612 1264 tablet_bootstrap.cc:492] T b6138e286d7448baa149c4952eb2fd0c P 90c988d9adde44879ef11b8aa6ef4da3: No bootstrap required, opened a new log
I20250625 03:29:59.018249 1264 ts_tablet_manager.cc:1397] T b6138e286d7448baa149c4952eb2fd0c P 90c988d9adde44879ef11b8aa6ef4da3: Time spent bootstrapping tablet: real 0.045s user 0.015s sys 0.007s
I20250625 03:29:59.018370 1266 raft_consensus.cc:357] T b6138e286d7448baa149c4952eb2fd0c P 89a9444e93674a9d9e3d988af9c95a3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } } peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } }
I20250625 03:29:59.019116 1266 raft_consensus.cc:383] T b6138e286d7448baa149c4952eb2fd0c P 89a9444e93674a9d9e3d988af9c95a3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:29:59.019424 1266 raft_consensus.cc:738] T b6138e286d7448baa149c4952eb2fd0c P 89a9444e93674a9d9e3d988af9c95a3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89a9444e93674a9d9e3d988af9c95a3e, State: Initialized, Role: FOLLOWER
I20250625 03:29:59.020150 1266 consensus_queue.cc:260] T b6138e286d7448baa149c4952eb2fd0c P 89a9444e93674a9d9e3d988af9c95a3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } } peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } }
I20250625 03:29:59.022640 1100 heartbeater.cc:499] Master 127.0.106.190:34593 was elected leader, sending a full tablet report...
I20250625 03:29:59.023102 1265 tablet_bootstrap.cc:654] T 6b62b2927d214886b92f502546868ca0 P 5f009baf8a094da7a58d2a36ea888442: Neither blocks nor log segments found. Creating new log.
I20250625 03:29:59.023306 1266 ts_tablet_manager.cc:1428] T b6138e286d7448baa149c4952eb2fd0c P 89a9444e93674a9d9e3d988af9c95a3e: Time spent starting tablet: real 0.008s user 0.003s sys 0.005s
I20250625 03:29:59.024318 1266 tablet_bootstrap.cc:492] T 513e577d0f2f4faea26726a7e8670a8d P 89a9444e93674a9d9e3d988af9c95a3e: Bootstrap starting.
I20250625 03:29:59.029567 1265 tablet_bootstrap.cc:492] T 6b62b2927d214886b92f502546868ca0 P 5f009baf8a094da7a58d2a36ea888442: No bootstrap required, opened a new log
I20250625 03:29:59.030084 1265 ts_tablet_manager.cc:1397] T 6b62b2927d214886b92f502546868ca0 P 5f009baf8a094da7a58d2a36ea888442: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.004s
I20250625 03:29:59.030848 1266 tablet_bootstrap.cc:654] T 513e577d0f2f4faea26726a7e8670a8d P 89a9444e93674a9d9e3d988af9c95a3e: Neither blocks nor log segments found. Creating new log.
I20250625 03:29:59.032511 1264 raft_consensus.cc:357] T b6138e286d7448baa149c4952eb2fd0c P 90c988d9adde44879ef11b8aa6ef4da3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } } peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } }
I20250625 03:29:59.032822 1265 raft_consensus.cc:357] T 6b62b2927d214886b92f502546868ca0 P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.033703 1264 raft_consensus.cc:383] T b6138e286d7448baa149c4952eb2fd0c P 90c988d9adde44879ef11b8aa6ef4da3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:29:59.034379 1264 raft_consensus.cc:738] T b6138e286d7448baa149c4952eb2fd0c P 90c988d9adde44879ef11b8aa6ef4da3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90c988d9adde44879ef11b8aa6ef4da3, State: Initialized, Role: FOLLOWER
I20250625 03:29:59.033955 1265 raft_consensus.cc:383] T 6b62b2927d214886b92f502546868ca0 P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:29:59.035588 1264 consensus_queue.cc:260] T b6138e286d7448baa149c4952eb2fd0c P 90c988d9adde44879ef11b8aa6ef4da3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } } peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } }
I20250625 03:29:59.036393 1265 raft_consensus.cc:738] T 6b62b2927d214886b92f502546868ca0 P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f009baf8a094da7a58d2a36ea888442, State: Initialized, Role: FOLLOWER
I20250625 03:29:59.037384 1265 consensus_queue.cc:260] T 6b62b2927d214886b92f502546868ca0 P 5f009baf8a094da7a58d2a36ea888442 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.040077 1265 ts_tablet_manager.cc:1428] T 6b62b2927d214886b92f502546868ca0 P 5f009baf8a094da7a58d2a36ea888442: Time spent starting tablet: real 0.010s user 0.009s sys 0.000s
I20250625 03:29:59.040977 1265 tablet_bootstrap.cc:492] T 86ab18af04f544ef8316b4caeaf781d2 P 5f009baf8a094da7a58d2a36ea888442: Bootstrap starting.
I20250625 03:29:59.047797 1265 tablet_bootstrap.cc:654] T 86ab18af04f544ef8316b4caeaf781d2 P 5f009baf8a094da7a58d2a36ea888442: Neither blocks nor log segments found. Creating new log.
I20250625 03:29:59.054813 1266 tablet_bootstrap.cc:492] T 513e577d0f2f4faea26726a7e8670a8d P 89a9444e93674a9d9e3d988af9c95a3e: No bootstrap required, opened a new log
I20250625 03:29:59.055492 1266 ts_tablet_manager.cc:1397] T 513e577d0f2f4faea26726a7e8670a8d P 89a9444e93674a9d9e3d988af9c95a3e: Time spent bootstrapping tablet: real 0.031s user 0.003s sys 0.025s
I20250625 03:29:59.057289 1264 ts_tablet_manager.cc:1428] T b6138e286d7448baa149c4952eb2fd0c P 90c988d9adde44879ef11b8aa6ef4da3: Time spent starting tablet: real 0.039s user 0.010s sys 0.000s
I20250625 03:29:59.058233 1249 heartbeater.cc:499] Master 127.0.106.190:34593 was elected leader, sending a full tablet report...
I20250625 03:29:59.058990 1264 tablet_bootstrap.cc:492] T 1d26f90c72ff4068ad7d0b002f4546cc P 90c988d9adde44879ef11b8aa6ef4da3: Bootstrap starting.
I20250625 03:29:59.058740 1266 raft_consensus.cc:357] T 513e577d0f2f4faea26726a7e8670a8d P 89a9444e93674a9d9e3d988af9c95a3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.059469 1265 tablet_bootstrap.cc:492] T 86ab18af04f544ef8316b4caeaf781d2 P 5f009baf8a094da7a58d2a36ea888442: No bootstrap required, opened a new log
I20250625 03:29:59.059549 1266 raft_consensus.cc:383] T 513e577d0f2f4faea26726a7e8670a8d P 89a9444e93674a9d9e3d988af9c95a3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:29:59.059937 1266 raft_consensus.cc:738] T 513e577d0f2f4faea26726a7e8670a8d P 89a9444e93674a9d9e3d988af9c95a3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89a9444e93674a9d9e3d988af9c95a3e, State: Initialized, Role: FOLLOWER
I20250625 03:29:59.060087 1265 ts_tablet_manager.cc:1397] T 86ab18af04f544ef8316b4caeaf781d2 P 5f009baf8a094da7a58d2a36ea888442: Time spent bootstrapping tablet: real 0.019s user 0.014s sys 0.003s
I20250625 03:29:59.060722 1266 consensus_queue.cc:260] T 513e577d0f2f4faea26726a7e8670a8d P 89a9444e93674a9d9e3d988af9c95a3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.063308 1266 ts_tablet_manager.cc:1428] T 513e577d0f2f4faea26726a7e8670a8d P 89a9444e93674a9d9e3d988af9c95a3e: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20250625 03:29:59.062851 1265 raft_consensus.cc:357] T 86ab18af04f544ef8316b4caeaf781d2 P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.063684 1265 raft_consensus.cc:383] T 86ab18af04f544ef8316b4caeaf781d2 P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:29:59.063975 1265 raft_consensus.cc:738] T 86ab18af04f544ef8316b4caeaf781d2 P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f009baf8a094da7a58d2a36ea888442, State: Initialized, Role: FOLLOWER
I20250625 03:29:59.064260 1266 tablet_bootstrap.cc:492] T 86ab18af04f544ef8316b4caeaf781d2 P 89a9444e93674a9d9e3d988af9c95a3e: Bootstrap starting.
I20250625 03:29:59.064852 1265 consensus_queue.cc:260] T 86ab18af04f544ef8316b4caeaf781d2 P 5f009baf8a094da7a58d2a36ea888442 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.068104 1264 tablet_bootstrap.cc:654] T 1d26f90c72ff4068ad7d0b002f4546cc P 90c988d9adde44879ef11b8aa6ef4da3: Neither blocks nor log segments found. Creating new log.
I20250625 03:29:59.070958 1266 tablet_bootstrap.cc:654] T 86ab18af04f544ef8316b4caeaf781d2 P 89a9444e93674a9d9e3d988af9c95a3e: Neither blocks nor log segments found. Creating new log.
I20250625 03:29:59.071468 1265 ts_tablet_manager.cc:1428] T 86ab18af04f544ef8316b4caeaf781d2 P 5f009baf8a094da7a58d2a36ea888442: Time spent starting tablet: real 0.011s user 0.005s sys 0.000s
I20250625 03:29:59.072510 1265 tablet_bootstrap.cc:492] T bc9758463ec04a4b93042f29add1a1fd P 5f009baf8a094da7a58d2a36ea888442: Bootstrap starting.
I20250625 03:29:59.080533 1265 tablet_bootstrap.cc:654] T bc9758463ec04a4b93042f29add1a1fd P 5f009baf8a094da7a58d2a36ea888442: Neither blocks nor log segments found. Creating new log.
I20250625 03:29:59.093312 1265 tablet_bootstrap.cc:492] T bc9758463ec04a4b93042f29add1a1fd P 5f009baf8a094da7a58d2a36ea888442: No bootstrap required, opened a new log
I20250625 03:29:59.093992 1265 ts_tablet_manager.cc:1397] T bc9758463ec04a4b93042f29add1a1fd P 5f009baf8a094da7a58d2a36ea888442: Time spent bootstrapping tablet: real 0.022s user 0.011s sys 0.008s
I20250625 03:29:59.097522 1265 raft_consensus.cc:357] T bc9758463ec04a4b93042f29add1a1fd P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.098505 1265 raft_consensus.cc:383] T bc9758463ec04a4b93042f29add1a1fd P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:29:59.098881 1265 raft_consensus.cc:738] T bc9758463ec04a4b93042f29add1a1fd P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f009baf8a094da7a58d2a36ea888442, State: Initialized, Role: FOLLOWER
I20250625 03:29:59.100100 1265 consensus_queue.cc:260] T bc9758463ec04a4b93042f29add1a1fd P 5f009baf8a094da7a58d2a36ea888442 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.106846 1265 ts_tablet_manager.cc:1428] T bc9758463ec04a4b93042f29add1a1fd P 5f009baf8a094da7a58d2a36ea888442: Time spent starting tablet: real 0.012s user 0.006s sys 0.003s
I20250625 03:29:59.108255 1265 tablet_bootstrap.cc:492] T 0ee874019a27479a94caf3275d914259 P 5f009baf8a094da7a58d2a36ea888442: Bootstrap starting.
I20250625 03:29:59.116852 1265 tablet_bootstrap.cc:654] T 0ee874019a27479a94caf3275d914259 P 5f009baf8a094da7a58d2a36ea888442: Neither blocks nor log segments found. Creating new log.
I20250625 03:29:59.130537 1265 tablet_bootstrap.cc:492] T 0ee874019a27479a94caf3275d914259 P 5f009baf8a094da7a58d2a36ea888442: No bootstrap required, opened a new log
I20250625 03:29:59.131203 1265 ts_tablet_manager.cc:1397] T 0ee874019a27479a94caf3275d914259 P 5f009baf8a094da7a58d2a36ea888442: Time spent bootstrapping tablet: real 0.023s user 0.012s sys 0.008s
I20250625 03:29:59.132671 1264 tablet_bootstrap.cc:492] T 1d26f90c72ff4068ad7d0b002f4546cc P 90c988d9adde44879ef11b8aa6ef4da3: No bootstrap required, opened a new log
I20250625 03:29:59.133080 1264 ts_tablet_manager.cc:1397] T 1d26f90c72ff4068ad7d0b002f4546cc P 90c988d9adde44879ef11b8aa6ef4da3: Time spent bootstrapping tablet: real 0.074s user 0.029s sys 0.040s
I20250625 03:29:59.133641 1266 tablet_bootstrap.cc:492] T 86ab18af04f544ef8316b4caeaf781d2 P 89a9444e93674a9d9e3d988af9c95a3e: No bootstrap required, opened a new log
I20250625 03:29:59.133735 1265 raft_consensus.cc:357] T 0ee874019a27479a94caf3275d914259 P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.134230 1266 ts_tablet_manager.cc:1397] T 86ab18af04f544ef8316b4caeaf781d2 P 89a9444e93674a9d9e3d988af9c95a3e: Time spent bootstrapping tablet: real 0.070s user 0.024s sys 0.043s
I20250625 03:29:59.134544 1265 raft_consensus.cc:383] T 0ee874019a27479a94caf3275d914259 P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:29:59.134868 1265 raft_consensus.cc:738] T 0ee874019a27479a94caf3275d914259 P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f009baf8a094da7a58d2a36ea888442, State: Initialized, Role: FOLLOWER
I20250625 03:29:59.135423 1264 raft_consensus.cc:357] T 1d26f90c72ff4068ad7d0b002f4546cc P 90c988d9adde44879ef11b8aa6ef4da3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.135977 1264 raft_consensus.cc:383] T 1d26f90c72ff4068ad7d0b002f4546cc P 90c988d9adde44879ef11b8aa6ef4da3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:29:59.135608 1265 consensus_queue.cc:260] T 0ee874019a27479a94caf3275d914259 P 5f009baf8a094da7a58d2a36ea888442 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.136265 1264 raft_consensus.cc:738] T 1d26f90c72ff4068ad7d0b002f4546cc P 90c988d9adde44879ef11b8aa6ef4da3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90c988d9adde44879ef11b8aa6ef4da3, State: Initialized, Role: FOLLOWER
I20250625 03:29:59.137136 1266 raft_consensus.cc:357] T 86ab18af04f544ef8316b4caeaf781d2 P 89a9444e93674a9d9e3d988af9c95a3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.137167 1264 consensus_queue.cc:260] T 1d26f90c72ff4068ad7d0b002f4546cc P 90c988d9adde44879ef11b8aa6ef4da3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.137915 1266 raft_consensus.cc:383] T 86ab18af04f544ef8316b4caeaf781d2 P 89a9444e93674a9d9e3d988af9c95a3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:29:59.138033 1265 ts_tablet_manager.cc:1428] T 0ee874019a27479a94caf3275d914259 P 5f009baf8a094da7a58d2a36ea888442: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20250625 03:29:59.138252 1266 raft_consensus.cc:738] T 86ab18af04f544ef8316b4caeaf781d2 P 89a9444e93674a9d9e3d988af9c95a3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89a9444e93674a9d9e3d988af9c95a3e, State: Initialized, Role: FOLLOWER
I20250625 03:29:59.138998 1265 tablet_bootstrap.cc:492] T b6138e286d7448baa149c4952eb2fd0c P 5f009baf8a094da7a58d2a36ea888442: Bootstrap starting.
I20250625 03:29:59.138998 1266 consensus_queue.cc:260] T 86ab18af04f544ef8316b4caeaf781d2 P 89a9444e93674a9d9e3d988af9c95a3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.143281 1264 ts_tablet_manager.cc:1428] T 1d26f90c72ff4068ad7d0b002f4546cc P 90c988d9adde44879ef11b8aa6ef4da3: Time spent starting tablet: real 0.010s user 0.003s sys 0.003s
I20250625 03:29:59.144232 1264 tablet_bootstrap.cc:492] T 93d7b80866e64a77b925f730e300fe88 P 90c988d9adde44879ef11b8aa6ef4da3: Bootstrap starting.
I20250625 03:29:59.145761 1265 tablet_bootstrap.cc:654] T b6138e286d7448baa149c4952eb2fd0c P 5f009baf8a094da7a58d2a36ea888442: Neither blocks nor log segments found. Creating new log.
I20250625 03:29:59.147886 1266 ts_tablet_manager.cc:1428] T 86ab18af04f544ef8316b4caeaf781d2 P 89a9444e93674a9d9e3d988af9c95a3e: Time spent starting tablet: real 0.013s user 0.003s sys 0.002s
I20250625 03:29:59.150622 1264 tablet_bootstrap.cc:654] T 93d7b80866e64a77b925f730e300fe88 P 90c988d9adde44879ef11b8aa6ef4da3: Neither blocks nor log segments found. Creating new log.
I20250625 03:29:59.153226 1266 tablet_bootstrap.cc:492] T 93d7b80866e64a77b925f730e300fe88 P 89a9444e93674a9d9e3d988af9c95a3e: Bootstrap starting.
I20250625 03:29:59.157341 1265 tablet_bootstrap.cc:492] T b6138e286d7448baa149c4952eb2fd0c P 5f009baf8a094da7a58d2a36ea888442: No bootstrap required, opened a new log
I20250625 03:29:59.158159 1265 ts_tablet_manager.cc:1397] T b6138e286d7448baa149c4952eb2fd0c P 5f009baf8a094da7a58d2a36ea888442: Time spent bootstrapping tablet: real 0.019s user 0.014s sys 0.004s
I20250625 03:29:59.160027 1266 tablet_bootstrap.cc:654] T 93d7b80866e64a77b925f730e300fe88 P 89a9444e93674a9d9e3d988af9c95a3e: Neither blocks nor log segments found. Creating new log.
I20250625 03:29:59.160327 1265 raft_consensus.cc:357] T b6138e286d7448baa149c4952eb2fd0c P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } } peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } }
I20250625 03:29:59.161048 1265 raft_consensus.cc:383] T b6138e286d7448baa149c4952eb2fd0c P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:29:59.161391 1265 raft_consensus.cc:738] T b6138e286d7448baa149c4952eb2fd0c P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f009baf8a094da7a58d2a36ea888442, State: Initialized, Role: FOLLOWER
I20250625 03:29:59.162112 1265 consensus_queue.cc:260] T b6138e286d7448baa149c4952eb2fd0c P 5f009baf8a094da7a58d2a36ea888442 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } } peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } }
I20250625 03:29:59.163730 1264 tablet_bootstrap.cc:492] T 93d7b80866e64a77b925f730e300fe88 P 90c988d9adde44879ef11b8aa6ef4da3: No bootstrap required, opened a new log
I20250625 03:29:59.164321 1265 ts_tablet_manager.cc:1428] T b6138e286d7448baa149c4952eb2fd0c P 5f009baf8a094da7a58d2a36ea888442: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20250625 03:29:59.164461 1264 ts_tablet_manager.cc:1397] T 93d7b80866e64a77b925f730e300fe88 P 90c988d9adde44879ef11b8aa6ef4da3: Time spent bootstrapping tablet: real 0.020s user 0.011s sys 0.001s
I20250625 03:29:59.165311 1265 tablet_bootstrap.cc:492] T 27e1943c0c154ec68f7e0a75b39b1105 P 5f009baf8a094da7a58d2a36ea888442: Bootstrap starting.
I20250625 03:29:59.168378 1266 tablet_bootstrap.cc:492] T 93d7b80866e64a77b925f730e300fe88 P 89a9444e93674a9d9e3d988af9c95a3e: No bootstrap required, opened a new log
I20250625 03:29:59.168889 1266 ts_tablet_manager.cc:1397] T 93d7b80866e64a77b925f730e300fe88 P 89a9444e93674a9d9e3d988af9c95a3e: Time spent bootstrapping tablet: real 0.016s user 0.007s sys 0.007s
I20250625 03:29:59.171491 1265 tablet_bootstrap.cc:654] T 27e1943c0c154ec68f7e0a75b39b1105 P 5f009baf8a094da7a58d2a36ea888442: Neither blocks nor log segments found. Creating new log.
I20250625 03:29:59.171267 1264 raft_consensus.cc:357] T 93d7b80866e64a77b925f730e300fe88 P 90c988d9adde44879ef11b8aa6ef4da3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.171710 1266 raft_consensus.cc:357] T 93d7b80866e64a77b925f730e300fe88 P 89a9444e93674a9d9e3d988af9c95a3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.172401 1266 raft_consensus.cc:383] T 93d7b80866e64a77b925f730e300fe88 P 89a9444e93674a9d9e3d988af9c95a3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:29:59.172717 1266 raft_consensus.cc:738] T 93d7b80866e64a77b925f730e300fe88 P 89a9444e93674a9d9e3d988af9c95a3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89a9444e93674a9d9e3d988af9c95a3e, State: Initialized, Role: FOLLOWER
I20250625 03:29:59.173429 1266 consensus_queue.cc:260] T 93d7b80866e64a77b925f730e300fe88 P 89a9444e93674a9d9e3d988af9c95a3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.172222 1264 raft_consensus.cc:383] T 93d7b80866e64a77b925f730e300fe88 P 90c988d9adde44879ef11b8aa6ef4da3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:29:59.175868 1264 raft_consensus.cc:738] T 93d7b80866e64a77b925f730e300fe88 P 90c988d9adde44879ef11b8aa6ef4da3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90c988d9adde44879ef11b8aa6ef4da3, State: Initialized, Role: FOLLOWER
I20250625 03:29:59.176786 1265 tablet_bootstrap.cc:492] T 27e1943c0c154ec68f7e0a75b39b1105 P 5f009baf8a094da7a58d2a36ea888442: No bootstrap required, opened a new log
I20250625 03:29:59.177317 1265 ts_tablet_manager.cc:1397] T 27e1943c0c154ec68f7e0a75b39b1105 P 5f009baf8a094da7a58d2a36ea888442: Time spent bootstrapping tablet: real 0.012s user 0.010s sys 0.000s
I20250625 03:29:59.178241 1266 ts_tablet_manager.cc:1428] T 93d7b80866e64a77b925f730e300fe88 P 89a9444e93674a9d9e3d988af9c95a3e: Time spent starting tablet: real 0.009s user 0.003s sys 0.004s
I20250625 03:29:59.179288 1266 tablet_bootstrap.cc:492] T 6b62b2927d214886b92f502546868ca0 P 89a9444e93674a9d9e3d988af9c95a3e: Bootstrap starting.
I20250625 03:29:59.179322 1265 raft_consensus.cc:357] T 27e1943c0c154ec68f7e0a75b39b1105 P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.180372 1265 raft_consensus.cc:383] T 27e1943c0c154ec68f7e0a75b39b1105 P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:29:59.180677 1265 raft_consensus.cc:738] T 27e1943c0c154ec68f7e0a75b39b1105 P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f009baf8a094da7a58d2a36ea888442, State: Initialized, Role: FOLLOWER
I20250625 03:29:59.176753 1264 consensus_queue.cc:260] T 93d7b80866e64a77b925f730e300fe88 P 90c988d9adde44879ef11b8aa6ef4da3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.181499 1265 consensus_queue.cc:260] T 27e1943c0c154ec68f7e0a75b39b1105 P 5f009baf8a094da7a58d2a36ea888442 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.185070 1264 ts_tablet_manager.cc:1428] T 93d7b80866e64a77b925f730e300fe88 P 90c988d9adde44879ef11b8aa6ef4da3: Time spent starting tablet: real 0.020s user 0.006s sys 0.000s
I20250625 03:29:59.186082 1264 tablet_bootstrap.cc:492] T 6b62b2927d214886b92f502546868ca0 P 90c988d9adde44879ef11b8aa6ef4da3: Bootstrap starting.
I20250625 03:29:59.186589 1266 tablet_bootstrap.cc:654] T 6b62b2927d214886b92f502546868ca0 P 89a9444e93674a9d9e3d988af9c95a3e: Neither blocks nor log segments found. Creating new log.
I20250625 03:29:59.186699 1265 ts_tablet_manager.cc:1428] T 27e1943c0c154ec68f7e0a75b39b1105 P 5f009baf8a094da7a58d2a36ea888442: Time spent starting tablet: real 0.009s user 0.006s sys 0.000s
I20250625 03:29:59.187705 1265 tablet_bootstrap.cc:492] T 93d7b80866e64a77b925f730e300fe88 P 5f009baf8a094da7a58d2a36ea888442: Bootstrap starting.
I20250625 03:29:59.194377 1264 tablet_bootstrap.cc:654] T 6b62b2927d214886b92f502546868ca0 P 90c988d9adde44879ef11b8aa6ef4da3: Neither blocks nor log segments found. Creating new log.
I20250625 03:29:59.195410 1265 tablet_bootstrap.cc:654] T 93d7b80866e64a77b925f730e300fe88 P 5f009baf8a094da7a58d2a36ea888442: Neither blocks nor log segments found. Creating new log.
I20250625 03:29:59.210933 1266 tablet_bootstrap.cc:492] T 6b62b2927d214886b92f502546868ca0 P 89a9444e93674a9d9e3d988af9c95a3e: No bootstrap required, opened a new log
I20250625 03:29:59.211282 1264 tablet_bootstrap.cc:492] T 6b62b2927d214886b92f502546868ca0 P 90c988d9adde44879ef11b8aa6ef4da3: No bootstrap required, opened a new log
I20250625 03:29:59.211683 1264 ts_tablet_manager.cc:1397] T 6b62b2927d214886b92f502546868ca0 P 90c988d9adde44879ef11b8aa6ef4da3: Time spent bootstrapping tablet: real 0.026s user 0.011s sys 0.004s
I20250625 03:29:59.211776 1266 ts_tablet_manager.cc:1397] T 6b62b2927d214886b92f502546868ca0 P 89a9444e93674a9d9e3d988af9c95a3e: Time spent bootstrapping tablet: real 0.033s user 0.015s sys 0.015s
I20250625 03:29:59.214143 1264 raft_consensus.cc:357] T 6b62b2927d214886b92f502546868ca0 P 90c988d9adde44879ef11b8aa6ef4da3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.214638 1265 tablet_bootstrap.cc:492] T 93d7b80866e64a77b925f730e300fe88 P 5f009baf8a094da7a58d2a36ea888442: No bootstrap required, opened a new log
I20250625 03:29:59.214677 1264 raft_consensus.cc:383] T 6b62b2927d214886b92f502546868ca0 P 90c988d9adde44879ef11b8aa6ef4da3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:29:59.215065 1264 raft_consensus.cc:738] T 6b62b2927d214886b92f502546868ca0 P 90c988d9adde44879ef11b8aa6ef4da3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90c988d9adde44879ef11b8aa6ef4da3, State: Initialized, Role: FOLLOWER
I20250625 03:29:59.215212 1265 ts_tablet_manager.cc:1397] T 93d7b80866e64a77b925f730e300fe88 P 5f009baf8a094da7a58d2a36ea888442: Time spent bootstrapping tablet: real 0.028s user 0.018s sys 0.007s
I20250625 03:29:59.214533 1266 raft_consensus.cc:357] T 6b62b2927d214886b92f502546868ca0 P 89a9444e93674a9d9e3d988af9c95a3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.215812 1266 raft_consensus.cc:383] T 6b62b2927d214886b92f502546868ca0 P 89a9444e93674a9d9e3d988af9c95a3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:29:59.215667 1264 consensus_queue.cc:260] T 6b62b2927d214886b92f502546868ca0 P 90c988d9adde44879ef11b8aa6ef4da3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.216256 1266 raft_consensus.cc:738] T 6b62b2927d214886b92f502546868ca0 P 89a9444e93674a9d9e3d988af9c95a3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89a9444e93674a9d9e3d988af9c95a3e, State: Initialized, Role: FOLLOWER
I20250625 03:29:59.217114 1266 consensus_queue.cc:260] T 6b62b2927d214886b92f502546868ca0 P 89a9444e93674a9d9e3d988af9c95a3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.218000 1264 ts_tablet_manager.cc:1428] T 6b62b2927d214886b92f502546868ca0 P 90c988d9adde44879ef11b8aa6ef4da3: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20250625 03:29:59.217711 1265 raft_consensus.cc:357] T 93d7b80866e64a77b925f730e300fe88 P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.218420 1265 raft_consensus.cc:383] T 93d7b80866e64a77b925f730e300fe88 P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:29:59.218972 1264 tablet_bootstrap.cc:492] T 86ab18af04f544ef8316b4caeaf781d2 P 90c988d9adde44879ef11b8aa6ef4da3: Bootstrap starting.
I20250625 03:29:59.219051 1270 raft_consensus.cc:491] T 86ab18af04f544ef8316b4caeaf781d2 P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:29:59.219578 1270 raft_consensus.cc:513] T 86ab18af04f544ef8316b4caeaf781d2 P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.220103 1266 ts_tablet_manager.cc:1428] T 6b62b2927d214886b92f502546868ca0 P 89a9444e93674a9d9e3d988af9c95a3e: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20250625 03:29:59.221216 1266 tablet_bootstrap.cc:492] T 27e1943c0c154ec68f7e0a75b39b1105 P 89a9444e93674a9d9e3d988af9c95a3e: Bootstrap starting.
I20250625 03:29:59.218705 1265 raft_consensus.cc:738] T 93d7b80866e64a77b925f730e300fe88 P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f009baf8a094da7a58d2a36ea888442, State: Initialized, Role: FOLLOWER
I20250625 03:29:59.222208 1265 consensus_queue.cc:260] T 93d7b80866e64a77b925f730e300fe88 P 5f009baf8a094da7a58d2a36ea888442 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.224706 1271 raft_consensus.cc:491] T 6b62b2927d214886b92f502546868ca0 P 89a9444e93674a9d9e3d988af9c95a3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:29:59.225119 1271 raft_consensus.cc:513] T 6b62b2927d214886b92f502546868ca0 P 89a9444e93674a9d9e3d988af9c95a3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.226985 1271 leader_election.cc:290] T 6b62b2927d214886b92f502546868ca0 P 89a9444e93674a9d9e3d988af9c95a3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f009baf8a094da7a58d2a36ea888442 (127.0.106.130:37441), 90c988d9adde44879ef11b8aa6ef4da3 (127.0.106.131:42281)
I20250625 03:29:59.230326 1270 leader_election.cc:290] T 86ab18af04f544ef8316b4caeaf781d2 P 5f009baf8a094da7a58d2a36ea888442 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89a9444e93674a9d9e3d988af9c95a3e (127.0.106.129:44675), 90c988d9adde44879ef11b8aa6ef4da3 (127.0.106.131:42281)
I20250625 03:29:59.245942 1270 raft_consensus.cc:491] T b6138e286d7448baa149c4952eb2fd0c P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:29:59.246734 1270 raft_consensus.cc:513] T b6138e286d7448baa149c4952eb2fd0c P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } } peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } }
I20250625 03:29:59.249426 1270 leader_election.cc:290] T b6138e286d7448baa149c4952eb2fd0c P 5f009baf8a094da7a58d2a36ea888442 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 90c988d9adde44879ef11b8aa6ef4da3 (127.0.106.131:42281), 89a9444e93674a9d9e3d988af9c95a3e (127.0.106.129:44675)
I20250625 03:29:59.250839 1266 tablet_bootstrap.cc:654] T 27e1943c0c154ec68f7e0a75b39b1105 P 89a9444e93674a9d9e3d988af9c95a3e: Neither blocks nor log segments found. Creating new log.
I20250625 03:29:59.259446 1264 tablet_bootstrap.cc:654] T 86ab18af04f544ef8316b4caeaf781d2 P 90c988d9adde44879ef11b8aa6ef4da3: Neither blocks nor log segments found. Creating new log.
W20250625 03:29:59.281800 1021 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20250625 03:29:59.295102 1289 raft_consensus.cc:491] T bc9758463ec04a4b93042f29add1a1fd P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:29:59.299399 1292 raft_consensus.cc:491] T 90089cf7177a4f67a5cc1bdfb9f179bd P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:29:59.298985 1289 raft_consensus.cc:513] T bc9758463ec04a4b93042f29add1a1fd P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.299860 1292 raft_consensus.cc:513] T 90089cf7177a4f67a5cc1bdfb9f179bd P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.301530 1289 leader_election.cc:290] T bc9758463ec04a4b93042f29add1a1fd P 5f009baf8a094da7a58d2a36ea888442 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89a9444e93674a9d9e3d988af9c95a3e (127.0.106.129:44675), 90c988d9adde44879ef11b8aa6ef4da3 (127.0.106.131:42281)
I20250625 03:29:59.298082 1265 ts_tablet_manager.cc:1428] T 93d7b80866e64a77b925f730e300fe88 P 5f009baf8a094da7a58d2a36ea888442: Time spent starting tablet: real 0.083s user 0.009s sys 0.001s
I20250625 03:29:59.303501 1265 tablet_bootstrap.cc:492] T 1d26f90c72ff4068ad7d0b002f4546cc P 5f009baf8a094da7a58d2a36ea888442: Bootstrap starting.
I20250625 03:29:59.306617 1073 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bc9758463ec04a4b93042f29add1a1fd" candidate_uuid: "5f009baf8a094da7a58d2a36ea888442" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89a9444e93674a9d9e3d988af9c95a3e" is_pre_election: true
I20250625 03:29:59.304759 1075 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "86ab18af04f544ef8316b4caeaf781d2" candidate_uuid: "5f009baf8a094da7a58d2a36ea888442" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89a9444e93674a9d9e3d988af9c95a3e" is_pre_election: true
I20250625 03:29:59.307863 1075 raft_consensus.cc:2466] T 86ab18af04f544ef8316b4caeaf781d2 P 89a9444e93674a9d9e3d988af9c95a3e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f009baf8a094da7a58d2a36ea888442 in term 0.
I20250625 03:29:59.305760 1074 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b6138e286d7448baa149c4952eb2fd0c" candidate_uuid: "5f009baf8a094da7a58d2a36ea888442" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89a9444e93674a9d9e3d988af9c95a3e" is_pre_election: true
I20250625 03:29:59.308881 1074 raft_consensus.cc:2466] T b6138e286d7448baa149c4952eb2fd0c P 89a9444e93674a9d9e3d988af9c95a3e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f009baf8a094da7a58d2a36ea888442 in term 0.
I20250625 03:29:59.310746 1266 tablet_bootstrap.cc:492] T 27e1943c0c154ec68f7e0a75b39b1105 P 89a9444e93674a9d9e3d988af9c95a3e: No bootstrap required, opened a new log
I20250625 03:29:59.311225 1266 ts_tablet_manager.cc:1397] T 27e1943c0c154ec68f7e0a75b39b1105 P 89a9444e93674a9d9e3d988af9c95a3e: Time spent bootstrapping tablet: real 0.090s user 0.012s sys 0.005s
I20250625 03:29:59.312072 1265 tablet_bootstrap.cc:654] T 1d26f90c72ff4068ad7d0b002f4546cc P 5f009baf8a094da7a58d2a36ea888442: Neither blocks nor log segments found. Creating new log.
W20250625 03:29:59.315488 1114 leader_election.cc:343] T bc9758463ec04a4b93042f29add1a1fd P 5f009baf8a094da7a58d2a36ea888442 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89a9444e93674a9d9e3d988af9c95a3e (127.0.106.129:44675): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:29:59.316804 1292 leader_election.cc:290] T 90089cf7177a4f67a5cc1bdfb9f179bd P 5f009baf8a094da7a58d2a36ea888442 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89a9444e93674a9d9e3d988af9c95a3e (127.0.106.129:44675), 90c988d9adde44879ef11b8aa6ef4da3 (127.0.106.131:42281)
I20250625 03:29:59.318593 1114 leader_election.cc:304] T 86ab18af04f544ef8316b4caeaf781d2 P 5f009baf8a094da7a58d2a36ea888442 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f009baf8a094da7a58d2a36ea888442, 89a9444e93674a9d9e3d988af9c95a3e; no voters:
I20250625 03:29:59.319525 1114 leader_election.cc:304] T b6138e286d7448baa149c4952eb2fd0c P 5f009baf8a094da7a58d2a36ea888442 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f009baf8a094da7a58d2a36ea888442, 89a9444e93674a9d9e3d988af9c95a3e; no voters:
I20250625 03:29:59.320389 1289 raft_consensus.cc:2802] T b6138e286d7448baa149c4952eb2fd0c P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:29:59.320755 1289 raft_consensus.cc:491] T b6138e286d7448baa149c4952eb2fd0c P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:29:59.321061 1289 raft_consensus.cc:3058] T b6138e286d7448baa149c4952eb2fd0c P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:29:59.319696 1292 raft_consensus.cc:2802] T 86ab18af04f544ef8316b4caeaf781d2 P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:29:59.321363 1074 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "90089cf7177a4f67a5cc1bdfb9f179bd" candidate_uuid: "5f009baf8a094da7a58d2a36ea888442" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89a9444e93674a9d9e3d988af9c95a3e" is_pre_election: true
I20250625 03:29:59.321620 1292 raft_consensus.cc:491] T 86ab18af04f544ef8316b4caeaf781d2 P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:29:59.321981 1292 raft_consensus.cc:3058] T 86ab18af04f544ef8316b4caeaf781d2 P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:29:59.324704 1224 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "86ab18af04f544ef8316b4caeaf781d2" candidate_uuid: "5f009baf8a094da7a58d2a36ea888442" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90c988d9adde44879ef11b8aa6ef4da3" is_pre_election: true
I20250625 03:29:59.325858 1221 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "90089cf7177a4f67a5cc1bdfb9f179bd" candidate_uuid: "5f009baf8a094da7a58d2a36ea888442" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90c988d9adde44879ef11b8aa6ef4da3" is_pre_election: true
I20250625 03:29:59.326187 1223 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b6138e286d7448baa149c4952eb2fd0c" candidate_uuid: "5f009baf8a094da7a58d2a36ea888442" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90c988d9adde44879ef11b8aa6ef4da3" is_pre_election: true
I20250625 03:29:59.326802 1223 raft_consensus.cc:2466] T b6138e286d7448baa149c4952eb2fd0c P 90c988d9adde44879ef11b8aa6ef4da3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f009baf8a094da7a58d2a36ea888442 in term 0.
I20250625 03:29:59.327843 1222 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bc9758463ec04a4b93042f29add1a1fd" candidate_uuid: "5f009baf8a094da7a58d2a36ea888442" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90c988d9adde44879ef11b8aa6ef4da3" is_pre_election: true
I20250625 03:29:59.329705 1274 raft_consensus.cc:491] T 1d26f90c72ff4068ad7d0b002f4546cc P 90c988d9adde44879ef11b8aa6ef4da3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20250625 03:29:59.329803 1116 leader_election.cc:343] T 86ab18af04f544ef8316b4caeaf781d2 P 5f009baf8a094da7a58d2a36ea888442 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 90c988d9adde44879ef11b8aa6ef4da3 (127.0.106.131:42281): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:29:59.330271 1274 raft_consensus.cc:513] T 1d26f90c72ff4068ad7d0b002f4546cc P 90c988d9adde44879ef11b8aa6ef4da3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.332938 1266 raft_consensus.cc:357] T 27e1943c0c154ec68f7e0a75b39b1105 P 89a9444e93674a9d9e3d988af9c95a3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.333698 1266 raft_consensus.cc:383] T 27e1943c0c154ec68f7e0a75b39b1105 P 89a9444e93674a9d9e3d988af9c95a3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:29:59.333705 1274 leader_election.cc:290] T 1d26f90c72ff4068ad7d0b002f4546cc P 90c988d9adde44879ef11b8aa6ef4da3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89a9444e93674a9d9e3d988af9c95a3e (127.0.106.129:44675), 5f009baf8a094da7a58d2a36ea888442 (127.0.106.130:37441)
I20250625 03:29:59.332428 1289 raft_consensus.cc:513] T b6138e286d7448baa149c4952eb2fd0c P 5f009baf8a094da7a58d2a36ea888442 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } } peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } }
I20250625 03:29:59.334107 1266 raft_consensus.cc:738] T 27e1943c0c154ec68f7e0a75b39b1105 P 89a9444e93674a9d9e3d988af9c95a3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89a9444e93674a9d9e3d988af9c95a3e, State: Initialized, Role: FOLLOWER
I20250625 03:29:59.335023 1266 consensus_queue.cc:260] T 27e1943c0c154ec68f7e0a75b39b1105 P 89a9444e93674a9d9e3d988af9c95a3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.338685 1265 tablet_bootstrap.cc:492] T 1d26f90c72ff4068ad7d0b002f4546cc P 5f009baf8a094da7a58d2a36ea888442: No bootstrap required, opened a new log
I20250625 03:29:59.339231 1265 ts_tablet_manager.cc:1397] T 1d26f90c72ff4068ad7d0b002f4546cc P 5f009baf8a094da7a58d2a36ea888442: Time spent bootstrapping tablet: real 0.036s user 0.009s sys 0.000s
W20250625 03:29:59.325865 1114 leader_election.cc:343] T 90089cf7177a4f67a5cc1bdfb9f179bd P 5f009baf8a094da7a58d2a36ea888442 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89a9444e93674a9d9e3d988af9c95a3e (127.0.106.129:44675): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:29:59.340616 1266 ts_tablet_manager.cc:1428] T 27e1943c0c154ec68f7e0a75b39b1105 P 89a9444e93674a9d9e3d988af9c95a3e: Time spent starting tablet: real 0.029s user 0.008s sys 0.000s
I20250625 03:29:59.340934 1074 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b6138e286d7448baa149c4952eb2fd0c" candidate_uuid: "5f009baf8a094da7a58d2a36ea888442" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89a9444e93674a9d9e3d988af9c95a3e"
I20250625 03:29:59.341475 1074 raft_consensus.cc:3058] T b6138e286d7448baa149c4952eb2fd0c P 89a9444e93674a9d9e3d988af9c95a3e [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:29:59.341647 1266 tablet_bootstrap.cc:492] T 90089cf7177a4f67a5cc1bdfb9f179bd P 89a9444e93674a9d9e3d988af9c95a3e: Bootstrap starting.
I20250625 03:29:59.341886 1265 raft_consensus.cc:357] T 1d26f90c72ff4068ad7d0b002f4546cc P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.342543 1265 raft_consensus.cc:383] T 1d26f90c72ff4068ad7d0b002f4546cc P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:29:59.342861 1265 raft_consensus.cc:738] T 1d26f90c72ff4068ad7d0b002f4546cc P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f009baf8a094da7a58d2a36ea888442, State: Initialized, Role: FOLLOWER
I20250625 03:29:59.335963 1289 leader_election.cc:290] T b6138e286d7448baa149c4952eb2fd0c P 5f009baf8a094da7a58d2a36ea888442 [CANDIDATE]: Term 1 election: Requested vote from peers 90c988d9adde44879ef11b8aa6ef4da3 (127.0.106.131:42281), 89a9444e93674a9d9e3d988af9c95a3e (127.0.106.129:44675)
I20250625 03:29:59.343533 1265 consensus_queue.cc:260] T 1d26f90c72ff4068ad7d0b002f4546cc P 5f009baf8a094da7a58d2a36ea888442 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.350638 1292 raft_consensus.cc:513] T 86ab18af04f544ef8316b4caeaf781d2 P 5f009baf8a094da7a58d2a36ea888442 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.350987 1222 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6b62b2927d214886b92f502546868ca0" candidate_uuid: "89a9444e93674a9d9e3d988af9c95a3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90c988d9adde44879ef11b8aa6ef4da3" is_pre_election: true
I20250625 03:29:59.351673 1222 raft_consensus.cc:2466] T 6b62b2927d214886b92f502546868ca0 P 90c988d9adde44879ef11b8aa6ef4da3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89a9444e93674a9d9e3d988af9c95a3e in term 0.
I20250625 03:29:59.352993 1265 ts_tablet_manager.cc:1428] T 1d26f90c72ff4068ad7d0b002f4546cc P 5f009baf8a094da7a58d2a36ea888442: Time spent starting tablet: real 0.013s user 0.008s sys 0.000s
I20250625 03:29:59.353111 1041 leader_election.cc:304] T 6b62b2927d214886b92f502546868ca0 P 89a9444e93674a9d9e3d988af9c95a3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89a9444e93674a9d9e3d988af9c95a3e, 90c988d9adde44879ef11b8aa6ef4da3; no voters:
W20250625 03:29:59.348253 1116 leader_election.cc:343] T 90089cf7177a4f67a5cc1bdfb9f179bd P 5f009baf8a094da7a58d2a36ea888442 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 90c988d9adde44879ef11b8aa6ef4da3 (127.0.106.131:42281): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:29:59.354086 1271 raft_consensus.cc:2802] T 6b62b2927d214886b92f502546868ca0 P 89a9444e93674a9d9e3d988af9c95a3e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:29:59.353258 1074 raft_consensus.cc:2466] T b6138e286d7448baa149c4952eb2fd0c P 89a9444e93674a9d9e3d988af9c95a3e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f009baf8a094da7a58d2a36ea888442 in term 1.
I20250625 03:29:59.354653 1271 raft_consensus.cc:491] T 6b62b2927d214886b92f502546868ca0 P 89a9444e93674a9d9e3d988af9c95a3e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:29:59.356242 1271 raft_consensus.cc:3058] T 6b62b2927d214886b92f502546868ca0 P 89a9444e93674a9d9e3d988af9c95a3e [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:29:59.356894 1114 leader_election.cc:304] T b6138e286d7448baa149c4952eb2fd0c P 5f009baf8a094da7a58d2a36ea888442 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f009baf8a094da7a58d2a36ea888442, 89a9444e93674a9d9e3d988af9c95a3e; no voters:
I20250625 03:29:59.357786 1292 leader_election.cc:290] T 86ab18af04f544ef8316b4caeaf781d2 P 5f009baf8a094da7a58d2a36ea888442 [CANDIDATE]: Term 1 election: Requested vote from peers 89a9444e93674a9d9e3d988af9c95a3e (127.0.106.129:44675), 90c988d9adde44879ef11b8aa6ef4da3 (127.0.106.131:42281)
I20250625 03:29:59.358230 1266 tablet_bootstrap.cc:654] T 90089cf7177a4f67a5cc1bdfb9f179bd P 89a9444e93674a9d9e3d988af9c95a3e: Neither blocks nor log segments found. Creating new log.
I20250625 03:29:59.358754 1289 raft_consensus.cc:2802] T b6138e286d7448baa149c4952eb2fd0c P 5f009baf8a094da7a58d2a36ea888442 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:29:59.359239 1289 raft_consensus.cc:695] T b6138e286d7448baa149c4952eb2fd0c P 5f009baf8a094da7a58d2a36ea888442 [term 1 LEADER]: Becoming Leader. State: Replica: 5f009baf8a094da7a58d2a36ea888442, State: Running, Role: LEADER
I20250625 03:29:59.355564 1264 tablet_bootstrap.cc:492] T 86ab18af04f544ef8316b4caeaf781d2 P 90c988d9adde44879ef11b8aa6ef4da3: No bootstrap required, opened a new log
I20250625 03:29:59.360381 1264 ts_tablet_manager.cc:1397] T 86ab18af04f544ef8316b4caeaf781d2 P 90c988d9adde44879ef11b8aa6ef4da3: Time spent bootstrapping tablet: real 0.142s user 0.009s sys 0.008s
I20250625 03:29:59.360106 1289 consensus_queue.cc:237] T b6138e286d7448baa149c4952eb2fd0c P 5f009baf8a094da7a58d2a36ea888442 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } } peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } }
I20250625 03:29:59.361174 1074 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1d26f90c72ff4068ad7d0b002f4546cc" candidate_uuid: "90c988d9adde44879ef11b8aa6ef4da3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89a9444e93674a9d9e3d988af9c95a3e" is_pre_election: true
W20250625 03:29:59.362741 1188 leader_election.cc:343] T 1d26f90c72ff4068ad7d0b002f4546cc P 90c988d9adde44879ef11b8aa6ef4da3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89a9444e93674a9d9e3d988af9c95a3e (127.0.106.129:44675): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:29:59.363814 1264 raft_consensus.cc:357] T 86ab18af04f544ef8316b4caeaf781d2 P 90c988d9adde44879ef11b8aa6ef4da3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.364604 1264 raft_consensus.cc:383] T 86ab18af04f544ef8316b4caeaf781d2 P 90c988d9adde44879ef11b8aa6ef4da3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:29:59.364974 1264 raft_consensus.cc:738] T 86ab18af04f544ef8316b4caeaf781d2 P 90c988d9adde44879ef11b8aa6ef4da3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90c988d9adde44879ef11b8aa6ef4da3, State: Initialized, Role: FOLLOWER
I20250625 03:29:59.355830 1265 tablet_bootstrap.cc:492] T 513e577d0f2f4faea26726a7e8670a8d P 5f009baf8a094da7a58d2a36ea888442: Bootstrap starting.
I20250625 03:29:59.365939 1289 raft_consensus.cc:491] T 1d26f90c72ff4068ad7d0b002f4546cc P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:29:59.366338 1074 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "86ab18af04f544ef8316b4caeaf781d2" candidate_uuid: "5f009baf8a094da7a58d2a36ea888442" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89a9444e93674a9d9e3d988af9c95a3e"
I20250625 03:29:59.366477 1289 raft_consensus.cc:513] T 1d26f90c72ff4068ad7d0b002f4546cc P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.366904 1074 raft_consensus.cc:3058] T 86ab18af04f544ef8316b4caeaf781d2 P 89a9444e93674a9d9e3d988af9c95a3e [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:29:59.368643 1289 leader_election.cc:290] T 1d26f90c72ff4068ad7d0b002f4546cc P 5f009baf8a094da7a58d2a36ea888442 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89a9444e93674a9d9e3d988af9c95a3e (127.0.106.129:44675), 90c988d9adde44879ef11b8aa6ef4da3 (127.0.106.131:42281)
I20250625 03:29:59.370189 1075 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1d26f90c72ff4068ad7d0b002f4546cc" candidate_uuid: "5f009baf8a094da7a58d2a36ea888442" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89a9444e93674a9d9e3d988af9c95a3e" is_pre_election: true
W20250625 03:29:59.371937 1114 leader_election.cc:343] T 1d26f90c72ff4068ad7d0b002f4546cc P 5f009baf8a094da7a58d2a36ea888442 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89a9444e93674a9d9e3d988af9c95a3e (127.0.106.129:44675): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:29:59.374280 1074 raft_consensus.cc:2466] T 86ab18af04f544ef8316b4caeaf781d2 P 89a9444e93674a9d9e3d988af9c95a3e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f009baf8a094da7a58d2a36ea888442 in term 1.
I20250625 03:29:59.375324 1114 leader_election.cc:304] T 86ab18af04f544ef8316b4caeaf781d2 P 5f009baf8a094da7a58d2a36ea888442 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f009baf8a094da7a58d2a36ea888442, 89a9444e93674a9d9e3d988af9c95a3e; no voters:
I20250625 03:29:59.365687 1264 consensus_queue.cc:260] T 86ab18af04f544ef8316b4caeaf781d2 P 90c988d9adde44879ef11b8aa6ef4da3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.376200 1289 raft_consensus.cc:2802] T 86ab18af04f544ef8316b4caeaf781d2 P 5f009baf8a094da7a58d2a36ea888442 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:29:59.376808 1289 raft_consensus.cc:695] T 86ab18af04f544ef8316b4caeaf781d2 P 5f009baf8a094da7a58d2a36ea888442 [term 1 LEADER]: Becoming Leader. State: Replica: 5f009baf8a094da7a58d2a36ea888442, State: Running, Role: LEADER
I20250625 03:29:59.377650 1271 raft_consensus.cc:513] T 6b62b2927d214886b92f502546868ca0 P 89a9444e93674a9d9e3d988af9c95a3e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.377931 1289 consensus_queue.cc:237] T 86ab18af04f544ef8316b4caeaf781d2 P 5f009baf8a094da7a58d2a36ea888442 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.387339 1116 leader_election.cc:304] T 90089cf7177a4f67a5cc1bdfb9f179bd P 5f009baf8a094da7a58d2a36ea888442 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f009baf8a094da7a58d2a36ea888442; no voters: 89a9444e93674a9d9e3d988af9c95a3e, 90c988d9adde44879ef11b8aa6ef4da3
I20250625 03:29:59.387511 1150 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1d26f90c72ff4068ad7d0b002f4546cc" candidate_uuid: "90c988d9adde44879ef11b8aa6ef4da3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f009baf8a094da7a58d2a36ea888442" is_pre_election: true
I20250625 03:29:59.388293 1150 raft_consensus.cc:2466] T 1d26f90c72ff4068ad7d0b002f4546cc P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90c988d9adde44879ef11b8aa6ef4da3 in term 0.
W20250625 03:29:59.388432 1116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.131:42281, user_credentials={real_user=slave}} blocked reactor thread for 57642.2us
I20250625 03:29:59.389349 1289 raft_consensus.cc:2747] T 90089cf7177a4f67a5cc1bdfb9f179bd P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:29:59.389938 1190 leader_election.cc:304] T 1d26f90c72ff4068ad7d0b002f4546cc P 90c988d9adde44879ef11b8aa6ef4da3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f009baf8a094da7a58d2a36ea888442, 90c988d9adde44879ef11b8aa6ef4da3; no voters: 89a9444e93674a9d9e3d988af9c95a3e
I20250625 03:29:59.390203 1266 tablet_bootstrap.cc:492] T 90089cf7177a4f67a5cc1bdfb9f179bd P 89a9444e93674a9d9e3d988af9c95a3e: No bootstrap required, opened a new log
I20250625 03:29:59.390615 1264 ts_tablet_manager.cc:1428] T 86ab18af04f544ef8316b4caeaf781d2 P 90c988d9adde44879ef11b8aa6ef4da3: Time spent starting tablet: real 0.030s user 0.007s sys 0.000s
I20250625 03:29:59.390738 1266 ts_tablet_manager.cc:1397] T 90089cf7177a4f67a5cc1bdfb9f179bd P 89a9444e93674a9d9e3d988af9c95a3e: Time spent bootstrapping tablet: real 0.049s user 0.015s sys 0.018s
W20250625 03:29:59.390846 1116 leader_election.cc:343] T bc9758463ec04a4b93042f29add1a1fd P 5f009baf8a094da7a58d2a36ea888442 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 90c988d9adde44879ef11b8aa6ef4da3 (127.0.106.131:42281): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:29:59.391997 1274 raft_consensus.cc:2802] T 1d26f90c72ff4068ad7d0b002f4546cc P 90c988d9adde44879ef11b8aa6ef4da3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:29:59.393965 1274 raft_consensus.cc:491] T 1d26f90c72ff4068ad7d0b002f4546cc P 90c988d9adde44879ef11b8aa6ef4da3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:29:59.394402 1274 raft_consensus.cc:3058] T 1d26f90c72ff4068ad7d0b002f4546cc P 90c988d9adde44879ef11b8aa6ef4da3 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:29:59.395514 1222 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6b62b2927d214886b92f502546868ca0" candidate_uuid: "89a9444e93674a9d9e3d988af9c95a3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90c988d9adde44879ef11b8aa6ef4da3"
I20250625 03:29:59.396106 1222 raft_consensus.cc:3058] T 6b62b2927d214886b92f502546868ca0 P 90c988d9adde44879ef11b8aa6ef4da3 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:29:59.396219 1266 raft_consensus.cc:357] T 90089cf7177a4f67a5cc1bdfb9f179bd P 89a9444e93674a9d9e3d988af9c95a3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.396999 1266 raft_consensus.cc:383] T 90089cf7177a4f67a5cc1bdfb9f179bd P 89a9444e93674a9d9e3d988af9c95a3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:29:59.397300 1266 raft_consensus.cc:738] T 90089cf7177a4f67a5cc1bdfb9f179bd P 89a9444e93674a9d9e3d988af9c95a3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89a9444e93674a9d9e3d988af9c95a3e, State: Initialized, Role: FOLLOWER
I20250625 03:29:59.397991 1266 consensus_queue.cc:260] T 90089cf7177a4f67a5cc1bdfb9f179bd P 89a9444e93674a9d9e3d988af9c95a3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.404127 1222 raft_consensus.cc:2466] T 6b62b2927d214886b92f502546868ca0 P 90c988d9adde44879ef11b8aa6ef4da3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89a9444e93674a9d9e3d988af9c95a3e in term 1.
I20250625 03:29:59.405833 1041 leader_election.cc:304] T 6b62b2927d214886b92f502546868ca0 P 89a9444e93674a9d9e3d988af9c95a3e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89a9444e93674a9d9e3d988af9c95a3e, 90c988d9adde44879ef11b8aa6ef4da3; no voters:
I20250625 03:29:59.409485 1274 raft_consensus.cc:513] T 1d26f90c72ff4068ad7d0b002f4546cc P 90c988d9adde44879ef11b8aa6ef4da3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.392843 1265 tablet_bootstrap.cc:654] T 513e577d0f2f4faea26726a7e8670a8d P 5f009baf8a094da7a58d2a36ea888442: Neither blocks nor log segments found. Creating new log.
I20250625 03:29:59.391633 1264 tablet_bootstrap.cc:492] T 27e1943c0c154ec68f7e0a75b39b1105 P 90c988d9adde44879ef11b8aa6ef4da3: Bootstrap starting.
I20250625 03:29:59.393886 1116 leader_election.cc:304] T bc9758463ec04a4b93042f29add1a1fd P 5f009baf8a094da7a58d2a36ea888442 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f009baf8a094da7a58d2a36ea888442; no voters: 89a9444e93674a9d9e3d988af9c95a3e, 90c988d9adde44879ef11b8aa6ef4da3
I20250625 03:29:59.416679 1271 leader_election.cc:290] T 6b62b2927d214886b92f502546868ca0 P 89a9444e93674a9d9e3d988af9c95a3e [CANDIDATE]: Term 1 election: Requested vote from peers 5f009baf8a094da7a58d2a36ea888442 (127.0.106.130:37441), 90c988d9adde44879ef11b8aa6ef4da3 (127.0.106.131:42281)
I20250625 03:29:59.417239 1289 raft_consensus.cc:2747] T bc9758463ec04a4b93042f29add1a1fd P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:29:59.417739 1271 raft_consensus.cc:2802] T 6b62b2927d214886b92f502546868ca0 P 89a9444e93674a9d9e3d988af9c95a3e [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:29:59.418175 1271 raft_consensus.cc:695] T 6b62b2927d214886b92f502546868ca0 P 89a9444e93674a9d9e3d988af9c95a3e [term 1 LEADER]: Becoming Leader. State: Replica: 89a9444e93674a9d9e3d988af9c95a3e, State: Running, Role: LEADER
I20250625 03:29:59.441349 1074 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1d26f90c72ff4068ad7d0b002f4546cc" candidate_uuid: "90c988d9adde44879ef11b8aa6ef4da3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89a9444e93674a9d9e3d988af9c95a3e"
I20250625 03:29:59.420600 1221 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1d26f90c72ff4068ad7d0b002f4546cc" candidate_uuid: "5f009baf8a094da7a58d2a36ea888442" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90c988d9adde44879ef11b8aa6ef4da3" is_pre_election: true
I20250625 03:29:59.441421 1148 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1d26f90c72ff4068ad7d0b002f4546cc" candidate_uuid: "90c988d9adde44879ef11b8aa6ef4da3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f009baf8a094da7a58d2a36ea888442"
I20250625 03:29:59.443346 1221 raft_consensus.cc:2391] T 1d26f90c72ff4068ad7d0b002f4546cc P 90c988d9adde44879ef11b8aa6ef4da3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f009baf8a094da7a58d2a36ea888442 in current term 1: Already voted for candidate 90c988d9adde44879ef11b8aa6ef4da3 in this term.
I20250625 03:29:59.443421 1148 raft_consensus.cc:3058] T 1d26f90c72ff4068ad7d0b002f4546cc P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Advancing to term 1
W20250625 03:29:59.444190 1188 leader_election.cc:343] T 1d26f90c72ff4068ad7d0b002f4546cc P 90c988d9adde44879ef11b8aa6ef4da3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89a9444e93674a9d9e3d988af9c95a3e (127.0.106.129:44675): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:29:59.440311 1274 leader_election.cc:290] T 1d26f90c72ff4068ad7d0b002f4546cc P 90c988d9adde44879ef11b8aa6ef4da3 [CANDIDATE]: Term 1 election: Requested vote from peers 89a9444e93674a9d9e3d988af9c95a3e (127.0.106.129:44675), 5f009baf8a094da7a58d2a36ea888442 (127.0.106.130:37441)
I20250625 03:29:59.420404 1223 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "86ab18af04f544ef8316b4caeaf781d2" candidate_uuid: "5f009baf8a094da7a58d2a36ea888442" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90c988d9adde44879ef11b8aa6ef4da3"
I20250625 03:29:59.417465 1303 raft_consensus.cc:491] T 86ab18af04f544ef8316b4caeaf781d2 P 90c988d9adde44879ef11b8aa6ef4da3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:29:59.450919 1306 raft_consensus.cc:491] T 513e577d0f2f4faea26726a7e8670a8d P 89a9444e93674a9d9e3d988af9c95a3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:29:59.451145 1303 raft_consensus.cc:513] T 86ab18af04f544ef8316b4caeaf781d2 P 90c988d9adde44879ef11b8aa6ef4da3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.452378 1223 raft_consensus.cc:3058] T 86ab18af04f544ef8316b4caeaf781d2 P 90c988d9adde44879ef11b8aa6ef4da3 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:29:59.418994 1271 consensus_queue.cc:237] T 6b62b2927d214886b92f502546868ca0 P 89a9444e93674a9d9e3d988af9c95a3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.453528 1266 ts_tablet_manager.cc:1428] T 90089cf7177a4f67a5cc1bdfb9f179bd P 89a9444e93674a9d9e3d988af9c95a3e: Time spent starting tablet: real 0.060s user 0.019s sys 0.037s
I20250625 03:29:59.453420 1148 raft_consensus.cc:2466] T 1d26f90c72ff4068ad7d0b002f4546cc P 5f009baf8a094da7a58d2a36ea888442 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90c988d9adde44879ef11b8aa6ef4da3 in term 1.
I20250625 03:29:59.454710 1266 tablet_bootstrap.cc:492] T bc9758463ec04a4b93042f29add1a1fd P 89a9444e93674a9d9e3d988af9c95a3e: Bootstrap starting.
I20250625 03:29:59.454846 1190 leader_election.cc:304] T 1d26f90c72ff4068ad7d0b002f4546cc P 90c988d9adde44879ef11b8aa6ef4da3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f009baf8a094da7a58d2a36ea888442, 90c988d9adde44879ef11b8aa6ef4da3; no voters: 89a9444e93674a9d9e3d988af9c95a3e
I20250625 03:29:59.455997 1274 raft_consensus.cc:2802] T 1d26f90c72ff4068ad7d0b002f4546cc P 90c988d9adde44879ef11b8aa6ef4da3 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:29:59.427389 1149 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6b62b2927d214886b92f502546868ca0" candidate_uuid: "89a9444e93674a9d9e3d988af9c95a3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f009baf8a094da7a58d2a36ea888442"
I20250625 03:29:59.459095 1149 raft_consensus.cc:3058] T 6b62b2927d214886b92f502546868ca0 P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:29:59.449929 1265 tablet_bootstrap.cc:492] T 513e577d0f2f4faea26726a7e8670a8d P 5f009baf8a094da7a58d2a36ea888442: No bootstrap required, opened a new log
I20250625 03:29:59.459951 1265 ts_tablet_manager.cc:1397] T 513e577d0f2f4faea26726a7e8670a8d P 5f009baf8a094da7a58d2a36ea888442: Time spent bootstrapping tablet: real 0.106s user 0.013s sys 0.000s
I20250625 03:29:59.461248 1074 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "86ab18af04f544ef8316b4caeaf781d2" candidate_uuid: "90c988d9adde44879ef11b8aa6ef4da3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89a9444e93674a9d9e3d988af9c95a3e" is_pre_election: true
I20250625 03:29:59.462031 1074 raft_consensus.cc:2391] T 86ab18af04f544ef8316b4caeaf781d2 P 89a9444e93674a9d9e3d988af9c95a3e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 90c988d9adde44879ef11b8aa6ef4da3 in current term 1: Already voted for candidate 5f009baf8a094da7a58d2a36ea888442 in this term.
I20250625 03:29:59.462260 1266 tablet_bootstrap.cc:654] T bc9758463ec04a4b93042f29add1a1fd P 89a9444e93674a9d9e3d988af9c95a3e: Neither blocks nor log segments found. Creating new log.
I20250625 03:29:59.462458 1289 raft_consensus.cc:491] T 0ee874019a27479a94caf3275d914259 P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:29:59.462952 1289 raft_consensus.cc:513] T 0ee874019a27479a94caf3275d914259 P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.464356 1303 leader_election.cc:290] T 86ab18af04f544ef8316b4caeaf781d2 P 90c988d9adde44879ef11b8aa6ef4da3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89a9444e93674a9d9e3d988af9c95a3e (127.0.106.129:44675), 5f009baf8a094da7a58d2a36ea888442 (127.0.106.130:37441)
I20250625 03:29:59.463627 972 catalog_manager.cc:5582] T b6138e286d7448baa149c4952eb2fd0c P 5f009baf8a094da7a58d2a36ea888442 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f009baf8a094da7a58d2a36ea888442 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "5f009baf8a094da7a58d2a36ea888442" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } health_report { overall_health: HEALTHY } } }
I20250625 03:29:59.465018 1289 leader_election.cc:290] T 0ee874019a27479a94caf3275d914259 P 5f009baf8a094da7a58d2a36ea888442 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89a9444e93674a9d9e3d988af9c95a3e (127.0.106.129:44675), 90c988d9adde44879ef11b8aa6ef4da3 (127.0.106.131:42281)
I20250625 03:29:59.467041 1147 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "86ab18af04f544ef8316b4caeaf781d2" candidate_uuid: "90c988d9adde44879ef11b8aa6ef4da3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f009baf8a094da7a58d2a36ea888442" is_pre_election: true
I20250625 03:29:59.469169 1190 leader_election.cc:304] T 86ab18af04f544ef8316b4caeaf781d2 P 90c988d9adde44879ef11b8aa6ef4da3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 90c988d9adde44879ef11b8aa6ef4da3; no voters: 5f009baf8a094da7a58d2a36ea888442, 89a9444e93674a9d9e3d988af9c95a3e
I20250625 03:29:59.465567 972 catalog_manager.cc:5582] T 86ab18af04f544ef8316b4caeaf781d2 P 5f009baf8a094da7a58d2a36ea888442 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f009baf8a094da7a58d2a36ea888442 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "5f009baf8a094da7a58d2a36ea888442" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } health_report { overall_health: UNKNOWN } } }
I20250625 03:29:59.470208 1289 raft_consensus.cc:491] T 27e1943c0c154ec68f7e0a75b39b1105 P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:29:59.470680 1074 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0ee874019a27479a94caf3275d914259" candidate_uuid: "5f009baf8a094da7a58d2a36ea888442" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89a9444e93674a9d9e3d988af9c95a3e" is_pre_election: true
I20250625 03:29:59.470850 1289 raft_consensus.cc:513] T 27e1943c0c154ec68f7e0a75b39b1105 P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
W20250625 03:29:59.472352 1114 leader_election.cc:343] T 0ee874019a27479a94caf3275d914259 P 5f009baf8a094da7a58d2a36ea888442 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89a9444e93674a9d9e3d988af9c95a3e (127.0.106.129:44675): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:29:59.473434 1289 leader_election.cc:290] T 27e1943c0c154ec68f7e0a75b39b1105 P 5f009baf8a094da7a58d2a36ea888442 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89a9444e93674a9d9e3d988af9c95a3e (127.0.106.129:44675), 90c988d9adde44879ef11b8aa6ef4da3 (127.0.106.131:42281)
I20250625 03:29:59.462424 1265 raft_consensus.cc:357] T 513e577d0f2f4faea26726a7e8670a8d P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.474876 1265 raft_consensus.cc:383] T 513e577d0f2f4faea26726a7e8670a8d P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:29:59.451360 1306 raft_consensus.cc:513] T 513e577d0f2f4faea26726a7e8670a8d P 89a9444e93674a9d9e3d988af9c95a3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.446151 1304 raft_consensus.cc:491] T 27e1943c0c154ec68f7e0a75b39b1105 P 89a9444e93674a9d9e3d988af9c95a3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:29:59.475361 1265 raft_consensus.cc:738] T 513e577d0f2f4faea26726a7e8670a8d P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f009baf8a094da7a58d2a36ea888442, State: Initialized, Role: FOLLOWER
I20250625 03:29:59.475649 1304 raft_consensus.cc:513] T 27e1943c0c154ec68f7e0a75b39b1105 P 89a9444e93674a9d9e3d988af9c95a3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.477908 1304 leader_election.cc:290] T 27e1943c0c154ec68f7e0a75b39b1105 P 89a9444e93674a9d9e3d988af9c95a3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f009baf8a094da7a58d2a36ea888442 (127.0.106.130:37441), 90c988d9adde44879ef11b8aa6ef4da3 (127.0.106.131:42281)
I20250625 03:29:59.450713 1264 tablet_bootstrap.cc:654] T 27e1943c0c154ec68f7e0a75b39b1105 P 90c988d9adde44879ef11b8aa6ef4da3: Neither blocks nor log segments found. Creating new log.
I20250625 03:29:59.474761 1074 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "27e1943c0c154ec68f7e0a75b39b1105" candidate_uuid: "5f009baf8a094da7a58d2a36ea888442" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89a9444e93674a9d9e3d988af9c95a3e" is_pre_election: true
I20250625 03:29:59.478598 1224 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "513e577d0f2f4faea26726a7e8670a8d" candidate_uuid: "89a9444e93674a9d9e3d988af9c95a3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90c988d9adde44879ef11b8aa6ef4da3" is_pre_election: true
I20250625 03:29:59.479136 1074 raft_consensus.cc:2466] T 27e1943c0c154ec68f7e0a75b39b1105 P 89a9444e93674a9d9e3d988af9c95a3e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f009baf8a094da7a58d2a36ea888442 in term 0.
I20250625 03:29:59.480414 1220 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "27e1943c0c154ec68f7e0a75b39b1105" candidate_uuid: "89a9444e93674a9d9e3d988af9c95a3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90c988d9adde44879ef11b8aa6ef4da3" is_pre_election: true
I20250625 03:29:59.480655 1114 leader_election.cc:304] T 27e1943c0c154ec68f7e0a75b39b1105 P 5f009baf8a094da7a58d2a36ea888442 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f009baf8a094da7a58d2a36ea888442, 89a9444e93674a9d9e3d988af9c95a3e; no voters:
W20250625 03:29:59.481585 1041 leader_election.cc:343] T 513e577d0f2f4faea26726a7e8670a8d P 89a9444e93674a9d9e3d988af9c95a3e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 90c988d9adde44879ef11b8aa6ef4da3 (127.0.106.131:42281): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:29:59.478781 1221 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0ee874019a27479a94caf3275d914259" candidate_uuid: "5f009baf8a094da7a58d2a36ea888442" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90c988d9adde44879ef11b8aa6ef4da3" is_pre_election: true
I20250625 03:29:59.481935 1289 raft_consensus.cc:2802] T 27e1943c0c154ec68f7e0a75b39b1105 P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:29:59.482436 1289 raft_consensus.cc:491] T 27e1943c0c154ec68f7e0a75b39b1105 P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:29:59.481698 1223 raft_consensus.cc:2466] T 86ab18af04f544ef8316b4caeaf781d2 P 90c988d9adde44879ef11b8aa6ef4da3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f009baf8a094da7a58d2a36ea888442 in term 1.
I20250625 03:29:59.482910 1289 raft_consensus.cc:3058] T 27e1943c0c154ec68f7e0a75b39b1105 P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Advancing to term 1
W20250625 03:29:59.483292 1041 leader_election.cc:343] T 27e1943c0c154ec68f7e0a75b39b1105 P 89a9444e93674a9d9e3d988af9c95a3e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 90c988d9adde44879ef11b8aa6ef4da3 (127.0.106.131:42281): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:29:59.430282 1222 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b6138e286d7448baa149c4952eb2fd0c" candidate_uuid: "5f009baf8a094da7a58d2a36ea888442" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90c988d9adde44879ef11b8aa6ef4da3"
I20250625 03:29:59.484298 1222 raft_consensus.cc:3058] T b6138e286d7448baa149c4952eb2fd0c P 90c988d9adde44879ef11b8aa6ef4da3 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:29:59.483192 1303 raft_consensus.cc:2747] T 86ab18af04f544ef8316b4caeaf781d2 P 90c988d9adde44879ef11b8aa6ef4da3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:29:59.483969 1265 consensus_queue.cc:260] T 513e577d0f2f4faea26726a7e8670a8d P 5f009baf8a094da7a58d2a36ea888442 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.485239 1221 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "27e1943c0c154ec68f7e0a75b39b1105" candidate_uuid: "5f009baf8a094da7a58d2a36ea888442" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90c988d9adde44879ef11b8aa6ef4da3" is_pre_election: true
I20250625 03:29:59.492861 1265 ts_tablet_manager.cc:1428] T 513e577d0f2f4faea26726a7e8670a8d P 5f009baf8a094da7a58d2a36ea888442: Time spent starting tablet: real 0.033s user 0.005s sys 0.003s
I20250625 03:29:59.484042 1306 leader_election.cc:290] T 513e577d0f2f4faea26726a7e8670a8d P 89a9444e93674a9d9e3d988af9c95a3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f009baf8a094da7a58d2a36ea888442 (127.0.106.130:37441), 90c988d9adde44879ef11b8aa6ef4da3 (127.0.106.131:42281)
I20250625 03:29:59.420747 1150 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6b62b2927d214886b92f502546868ca0" candidate_uuid: "89a9444e93674a9d9e3d988af9c95a3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f009baf8a094da7a58d2a36ea888442" is_pre_election: true
I20250625 03:29:59.484910 1116 leader_election.cc:304] T 1d26f90c72ff4068ad7d0b002f4546cc P 5f009baf8a094da7a58d2a36ea888442 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f009baf8a094da7a58d2a36ea888442; no voters: 89a9444e93674a9d9e3d988af9c95a3e, 90c988d9adde44879ef11b8aa6ef4da3
I20250625 03:29:59.494412 1264 tablet_bootstrap.cc:492] T 27e1943c0c154ec68f7e0a75b39b1105 P 90c988d9adde44879ef11b8aa6ef4da3: No bootstrap required, opened a new log
I20250625 03:29:59.494829 1292 raft_consensus.cc:2747] T 1d26f90c72ff4068ad7d0b002f4546cc P 5f009baf8a094da7a58d2a36ea888442 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:29:59.495043 1264 ts_tablet_manager.cc:1397] T 27e1943c0c154ec68f7e0a75b39b1105 P 90c988d9adde44879ef11b8aa6ef4da3: Time spent bootstrapping tablet: real 0.104s user 0.007s sys 0.006s
W20250625 03:29:59.496212 1116 leader_election.cc:343] T 0ee874019a27479a94caf3275d914259 P 5f009baf8a094da7a58d2a36ea888442 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 90c988d9adde44879ef11b8aa6ef4da3 (127.0.106.131:42281): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:29:59.496685 1116 leader_election.cc:304] T 0ee874019a27479a94caf3275d914259 P 5f009baf8a094da7a58d2a36ea888442 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f009baf8a094da7a58d2a36ea888442; no voters: 89a9444e93674a9d9e3d988af9c95a3e, 90c988d9adde44879ef11b8aa6ef4da3
I20250625 03:29:59.496807 1274 raft_consensus.cc:695] T 1d26f90c72ff4068ad7d0b002f4546cc P 90c988d9adde44879ef11b8aa6ef4da3 [term 1 LEADER]: Becoming Leader. State: Replica: 90c988d9adde44879ef11b8aa6ef4da3, State: Running, Role: LEADER
I20250625 03:29:59.498463 1264 raft_consensus.cc:357] T 27e1943c0c154ec68f7e0a75b39b1105 P 90c988d9adde44879ef11b8aa6ef4da3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.499279 1264 raft_consensus.cc:383] T 27e1943c0c154ec68f7e0a75b39b1105 P 90c988d9adde44879ef11b8aa6ef4da3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:29:59.499646 1264 raft_consensus.cc:738] T 27e1943c0c154ec68f7e0a75b39b1105 P 90c988d9adde44879ef11b8aa6ef4da3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90c988d9adde44879ef11b8aa6ef4da3, State: Initialized, Role: FOLLOWER
I20250625 03:29:59.500538 1264 consensus_queue.cc:260] T 27e1943c0c154ec68f7e0a75b39b1105 P 90c988d9adde44879ef11b8aa6ef4da3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.498080 1274 consensus_queue.cc:237] T 1d26f90c72ff4068ad7d0b002f4546cc P 90c988d9adde44879ef11b8aa6ef4da3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.503321 1264 ts_tablet_manager.cc:1428] T 27e1943c0c154ec68f7e0a75b39b1105 P 90c988d9adde44879ef11b8aa6ef4da3: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20250625 03:29:59.504385 1264 tablet_bootstrap.cc:492] T 0ee874019a27479a94caf3275d914259 P 90c988d9adde44879ef11b8aa6ef4da3: Bootstrap starting.
I20250625 03:29:59.511116 1264 tablet_bootstrap.cc:654] T 0ee874019a27479a94caf3275d914259 P 90c988d9adde44879ef11b8aa6ef4da3: Neither blocks nor log segments found. Creating new log.
I20250625 03:29:59.511215 971 catalog_manager.cc:5582] T 6b62b2927d214886b92f502546868ca0 P 89a9444e93674a9d9e3d988af9c95a3e reported cstate change: term changed from 0 to 1, leader changed from <none> to 89a9444e93674a9d9e3d988af9c95a3e (127.0.106.129). New cstate: current_term: 1 leader_uuid: "89a9444e93674a9d9e3d988af9c95a3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } health_report { overall_health: UNKNOWN } } }
I20250625 03:29:59.517546 1292 raft_consensus.cc:2747] T 0ee874019a27479a94caf3275d914259 P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250625 03:29:59.519583 1116 leader_election.cc:343] T 27e1943c0c154ec68f7e0a75b39b1105 P 5f009baf8a094da7a58d2a36ea888442 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 90c988d9adde44879ef11b8aa6ef4da3 (127.0.106.131:42281): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:29:59.517343 1222 raft_consensus.cc:2466] T b6138e286d7448baa149c4952eb2fd0c P 90c988d9adde44879ef11b8aa6ef4da3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f009baf8a094da7a58d2a36ea888442 in term 1.
I20250625 03:29:59.521409 1149 raft_consensus.cc:2466] T 6b62b2927d214886b92f502546868ca0 P 5f009baf8a094da7a58d2a36ea888442 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89a9444e93674a9d9e3d988af9c95a3e in term 1.
I20250625 03:29:59.517351 1289 raft_consensus.cc:513] T 27e1943c0c154ec68f7e0a75b39b1105 P 5f009baf8a094da7a58d2a36ea888442 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.523561 1149 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "513e577d0f2f4faea26726a7e8670a8d" candidate_uuid: "89a9444e93674a9d9e3d988af9c95a3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f009baf8a094da7a58d2a36ea888442" is_pre_election: true
I20250625 03:29:59.524231 1149 raft_consensus.cc:2466] T 513e577d0f2f4faea26726a7e8670a8d P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89a9444e93674a9d9e3d988af9c95a3e in term 0.
I20250625 03:29:59.524993 1266 tablet_bootstrap.cc:492] T bc9758463ec04a4b93042f29add1a1fd P 89a9444e93674a9d9e3d988af9c95a3e: No bootstrap required, opened a new log
I20250625 03:29:59.525491 1266 ts_tablet_manager.cc:1397] T bc9758463ec04a4b93042f29add1a1fd P 89a9444e93674a9d9e3d988af9c95a3e: Time spent bootstrapping tablet: real 0.071s user 0.025s sys 0.041s
I20250625 03:29:59.525911 1074 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "27e1943c0c154ec68f7e0a75b39b1105" candidate_uuid: "5f009baf8a094da7a58d2a36ea888442" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89a9444e93674a9d9e3d988af9c95a3e"
I20250625 03:29:59.526059 1041 leader_election.cc:304] T 513e577d0f2f4faea26726a7e8670a8d P 89a9444e93674a9d9e3d988af9c95a3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f009baf8a094da7a58d2a36ea888442, 89a9444e93674a9d9e3d988af9c95a3e; no voters: 90c988d9adde44879ef11b8aa6ef4da3
I20250625 03:29:59.526481 1074 raft_consensus.cc:3058] T 27e1943c0c154ec68f7e0a75b39b1105 P 89a9444e93674a9d9e3d988af9c95a3e [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:29:59.526633 1149 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "27e1943c0c154ec68f7e0a75b39b1105" candidate_uuid: "89a9444e93674a9d9e3d988af9c95a3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f009baf8a094da7a58d2a36ea888442" is_pre_election: true
I20250625 03:29:59.527179 1271 raft_consensus.cc:2802] T 513e577d0f2f4faea26726a7e8670a8d P 89a9444e93674a9d9e3d988af9c95a3e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:29:59.527407 1149 raft_consensus.cc:2391] T 27e1943c0c154ec68f7e0a75b39b1105 P 5f009baf8a094da7a58d2a36ea888442 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89a9444e93674a9d9e3d988af9c95a3e in current term 1: Already voted for candidate 5f009baf8a094da7a58d2a36ea888442 in this term.
I20250625 03:29:59.527555 1271 raft_consensus.cc:491] T 513e577d0f2f4faea26726a7e8670a8d P 89a9444e93674a9d9e3d988af9c95a3e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:29:59.527951 1271 raft_consensus.cc:3058] T 513e577d0f2f4faea26726a7e8670a8d P 89a9444e93674a9d9e3d988af9c95a3e [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:29:59.528119 1266 raft_consensus.cc:357] T bc9758463ec04a4b93042f29add1a1fd P 89a9444e93674a9d9e3d988af9c95a3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.528554 1041 leader_election.cc:304] T 27e1943c0c154ec68f7e0a75b39b1105 P 89a9444e93674a9d9e3d988af9c95a3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89a9444e93674a9d9e3d988af9c95a3e; no voters: 5f009baf8a094da7a58d2a36ea888442, 90c988d9adde44879ef11b8aa6ef4da3
I20250625 03:29:59.528797 1266 raft_consensus.cc:383] T bc9758463ec04a4b93042f29add1a1fd P 89a9444e93674a9d9e3d988af9c95a3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:29:59.529166 1266 raft_consensus.cc:738] T bc9758463ec04a4b93042f29add1a1fd P 89a9444e93674a9d9e3d988af9c95a3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89a9444e93674a9d9e3d988af9c95a3e, State: Initialized, Role: FOLLOWER
I20250625 03:29:59.529862 1266 consensus_queue.cc:260] T bc9758463ec04a4b93042f29add1a1fd P 89a9444e93674a9d9e3d988af9c95a3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.531556 1222 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "27e1943c0c154ec68f7e0a75b39b1105" candidate_uuid: "5f009baf8a094da7a58d2a36ea888442" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90c988d9adde44879ef11b8aa6ef4da3"
I20250625 03:29:59.531939 1266 ts_tablet_manager.cc:1428] T bc9758463ec04a4b93042f29add1a1fd P 89a9444e93674a9d9e3d988af9c95a3e: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20250625 03:29:59.532233 1222 raft_consensus.cc:3058] T 27e1943c0c154ec68f7e0a75b39b1105 P 90c988d9adde44879ef11b8aa6ef4da3 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:29:59.532882 1266 tablet_bootstrap.cc:492] T 0ee874019a27479a94caf3275d914259 P 89a9444e93674a9d9e3d988af9c95a3e: Bootstrap starting.
I20250625 03:29:59.534473 1074 raft_consensus.cc:2466] T 27e1943c0c154ec68f7e0a75b39b1105 P 89a9444e93674a9d9e3d988af9c95a3e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f009baf8a094da7a58d2a36ea888442 in term 1.
I20250625 03:29:59.535017 1306 raft_consensus.cc:2747] T 27e1943c0c154ec68f7e0a75b39b1105 P 89a9444e93674a9d9e3d988af9c95a3e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:29:59.524909 1289 leader_election.cc:290] T 27e1943c0c154ec68f7e0a75b39b1105 P 5f009baf8a094da7a58d2a36ea888442 [CANDIDATE]: Term 1 election: Requested vote from peers 89a9444e93674a9d9e3d988af9c95a3e (127.0.106.129:44675), 90c988d9adde44879ef11b8aa6ef4da3 (127.0.106.131:42281)
I20250625 03:29:59.536597 1271 raft_consensus.cc:513] T 513e577d0f2f4faea26726a7e8670a8d P 89a9444e93674a9d9e3d988af9c95a3e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.537555 1114 leader_election.cc:304] T 27e1943c0c154ec68f7e0a75b39b1105 P 5f009baf8a094da7a58d2a36ea888442 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f009baf8a094da7a58d2a36ea888442, 89a9444e93674a9d9e3d988af9c95a3e; no voters:
I20250625 03:29:59.538482 1289 raft_consensus.cc:2802] T 27e1943c0c154ec68f7e0a75b39b1105 P 5f009baf8a094da7a58d2a36ea888442 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:29:59.538946 1266 tablet_bootstrap.cc:654] T 0ee874019a27479a94caf3275d914259 P 89a9444e93674a9d9e3d988af9c95a3e: Neither blocks nor log segments found. Creating new log.
I20250625 03:29:59.539371 1149 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "513e577d0f2f4faea26726a7e8670a8d" candidate_uuid: "89a9444e93674a9d9e3d988af9c95a3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f009baf8a094da7a58d2a36ea888442"
I20250625 03:29:59.539974 1149 raft_consensus.cc:3058] T 513e577d0f2f4faea26726a7e8670a8d P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:29:59.546361 1266 tablet_bootstrap.cc:492] T 0ee874019a27479a94caf3275d914259 P 89a9444e93674a9d9e3d988af9c95a3e: No bootstrap required, opened a new log
I20250625 03:29:59.539451 1289 raft_consensus.cc:695] T 27e1943c0c154ec68f7e0a75b39b1105 P 5f009baf8a094da7a58d2a36ea888442 [term 1 LEADER]: Becoming Leader. State: Replica: 5f009baf8a094da7a58d2a36ea888442, State: Running, Role: LEADER
I20250625 03:29:59.546837 1266 ts_tablet_manager.cc:1397] T 0ee874019a27479a94caf3275d914259 P 89a9444e93674a9d9e3d988af9c95a3e: Time spent bootstrapping tablet: real 0.014s user 0.009s sys 0.003s
I20250625 03:29:59.541523 1221 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "513e577d0f2f4faea26726a7e8670a8d" candidate_uuid: "89a9444e93674a9d9e3d988af9c95a3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90c988d9adde44879ef11b8aa6ef4da3"
I20250625 03:29:59.547744 1289 consensus_queue.cc:237] T 27e1943c0c154ec68f7e0a75b39b1105 P 5f009baf8a094da7a58d2a36ea888442 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
W20250625 03:29:59.549506 1041 leader_election.cc:343] T 513e577d0f2f4faea26726a7e8670a8d P 89a9444e93674a9d9e3d988af9c95a3e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 90c988d9adde44879ef11b8aa6ef4da3 (127.0.106.131:42281): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:29:59.549574 1266 raft_consensus.cc:357] T 0ee874019a27479a94caf3275d914259 P 89a9444e93674a9d9e3d988af9c95a3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.550020 1264 tablet_bootstrap.cc:492] T 0ee874019a27479a94caf3275d914259 P 90c988d9adde44879ef11b8aa6ef4da3: No bootstrap required, opened a new log
I20250625 03:29:59.550290 1266 raft_consensus.cc:383] T 0ee874019a27479a94caf3275d914259 P 89a9444e93674a9d9e3d988af9c95a3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:29:59.550612 1266 raft_consensus.cc:738] T 0ee874019a27479a94caf3275d914259 P 89a9444e93674a9d9e3d988af9c95a3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89a9444e93674a9d9e3d988af9c95a3e, State: Initialized, Role: FOLLOWER
I20250625 03:29:59.550690 1264 ts_tablet_manager.cc:1397] T 0ee874019a27479a94caf3275d914259 P 90c988d9adde44879ef11b8aa6ef4da3: Time spent bootstrapping tablet: real 0.047s user 0.008s sys 0.011s
I20250625 03:29:59.551328 1266 consensus_queue.cc:260] T 0ee874019a27479a94caf3275d914259 P 89a9444e93674a9d9e3d988af9c95a3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.553858 1266 ts_tablet_manager.cc:1428] T 0ee874019a27479a94caf3275d914259 P 89a9444e93674a9d9e3d988af9c95a3e: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20250625 03:29:59.553978 1264 raft_consensus.cc:357] T 0ee874019a27479a94caf3275d914259 P 90c988d9adde44879ef11b8aa6ef4da3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.554919 1264 raft_consensus.cc:383] T 0ee874019a27479a94caf3275d914259 P 90c988d9adde44879ef11b8aa6ef4da3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:29:59.555337 1264 raft_consensus.cc:738] T 0ee874019a27479a94caf3275d914259 P 90c988d9adde44879ef11b8aa6ef4da3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90c988d9adde44879ef11b8aa6ef4da3, State: Initialized, Role: FOLLOWER
I20250625 03:29:59.556576 1274 raft_consensus.cc:491] T 93d7b80866e64a77b925f730e300fe88 P 90c988d9adde44879ef11b8aa6ef4da3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:29:59.556317 1264 consensus_queue.cc:260] T 0ee874019a27479a94caf3275d914259 P 90c988d9adde44879ef11b8aa6ef4da3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.557070 1274 raft_consensus.cc:513] T 93d7b80866e64a77b925f730e300fe88 P 90c988d9adde44879ef11b8aa6ef4da3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.541723 1271 leader_election.cc:290] T 513e577d0f2f4faea26726a7e8670a8d P 89a9444e93674a9d9e3d988af9c95a3e [CANDIDATE]: Term 1 election: Requested vote from peers 5f009baf8a094da7a58d2a36ea888442 (127.0.106.130:37441), 90c988d9adde44879ef11b8aa6ef4da3 (127.0.106.131:42281)
I20250625 03:29:59.541527 1222 raft_consensus.cc:2466] T 27e1943c0c154ec68f7e0a75b39b1105 P 90c988d9adde44879ef11b8aa6ef4da3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f009baf8a094da7a58d2a36ea888442 in term 1.
I20250625 03:29:59.559100 1274 leader_election.cc:290] T 93d7b80866e64a77b925f730e300fe88 P 90c988d9adde44879ef11b8aa6ef4da3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89a9444e93674a9d9e3d988af9c95a3e (127.0.106.129:44675), 5f009baf8a094da7a58d2a36ea888442 (127.0.106.130:37441)
I20250625 03:29:59.559517 1264 ts_tablet_manager.cc:1428] T 0ee874019a27479a94caf3275d914259 P 90c988d9adde44879ef11b8aa6ef4da3: Time spent starting tablet: real 0.008s user 0.005s sys 0.002s
I20250625 03:29:59.559716 1266 tablet_bootstrap.cc:492] T 1d26f90c72ff4068ad7d0b002f4546cc P 89a9444e93674a9d9e3d988af9c95a3e: Bootstrap starting.
I20250625 03:29:59.560707 1148 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "93d7b80866e64a77b925f730e300fe88" candidate_uuid: "90c988d9adde44879ef11b8aa6ef4da3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f009baf8a094da7a58d2a36ea888442" is_pre_election: true
I20250625 03:29:59.561017 1264 tablet_bootstrap.cc:492] T bc9758463ec04a4b93042f29add1a1fd P 90c988d9adde44879ef11b8aa6ef4da3: Bootstrap starting.
I20250625 03:29:59.561355 1148 raft_consensus.cc:2466] T 93d7b80866e64a77b925f730e300fe88 P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90c988d9adde44879ef11b8aa6ef4da3 in term 0.
I20250625 03:29:59.561794 1149 raft_consensus.cc:2466] T 513e577d0f2f4faea26726a7e8670a8d P 5f009baf8a094da7a58d2a36ea888442 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89a9444e93674a9d9e3d988af9c95a3e in term 1.
I20250625 03:29:59.562549 1190 leader_election.cc:304] T 93d7b80866e64a77b925f730e300fe88 P 90c988d9adde44879ef11b8aa6ef4da3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f009baf8a094da7a58d2a36ea888442, 90c988d9adde44879ef11b8aa6ef4da3; no voters:
I20250625 03:29:59.562913 1041 leader_election.cc:304] T 513e577d0f2f4faea26726a7e8670a8d P 89a9444e93674a9d9e3d988af9c95a3e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f009baf8a094da7a58d2a36ea888442, 89a9444e93674a9d9e3d988af9c95a3e; no voters: 90c988d9adde44879ef11b8aa6ef4da3
I20250625 03:29:59.563398 1274 raft_consensus.cc:2802] T 93d7b80866e64a77b925f730e300fe88 P 90c988d9adde44879ef11b8aa6ef4da3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:29:59.563773 1274 raft_consensus.cc:491] T 93d7b80866e64a77b925f730e300fe88 P 90c988d9adde44879ef11b8aa6ef4da3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:29:59.564121 1271 raft_consensus.cc:2802] T 513e577d0f2f4faea26726a7e8670a8d P 89a9444e93674a9d9e3d988af9c95a3e [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:29:59.564612 1271 raft_consensus.cc:695] T 513e577d0f2f4faea26726a7e8670a8d P 89a9444e93674a9d9e3d988af9c95a3e [term 1 LEADER]: Becoming Leader. State: Replica: 89a9444e93674a9d9e3d988af9c95a3e, State: Running, Role: LEADER
I20250625 03:29:59.565927 1266 tablet_bootstrap.cc:654] T 1d26f90c72ff4068ad7d0b002f4546cc P 89a9444e93674a9d9e3d988af9c95a3e: Neither blocks nor log segments found. Creating new log.
I20250625 03:29:59.565483 1271 consensus_queue.cc:237] T 513e577d0f2f4faea26726a7e8670a8d P 89a9444e93674a9d9e3d988af9c95a3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.564136 1274 raft_consensus.cc:3058] T 93d7b80866e64a77b925f730e300fe88 P 90c988d9adde44879ef11b8aa6ef4da3 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:29:59.569195 1264 tablet_bootstrap.cc:654] T bc9758463ec04a4b93042f29add1a1fd P 90c988d9adde44879ef11b8aa6ef4da3: Neither blocks nor log segments found. Creating new log.
I20250625 03:29:59.564499 1074 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "93d7b80866e64a77b925f730e300fe88" candidate_uuid: "90c988d9adde44879ef11b8aa6ef4da3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89a9444e93674a9d9e3d988af9c95a3e" is_pre_election: true
I20250625 03:29:59.575853 1074 raft_consensus.cc:2466] T 93d7b80866e64a77b925f730e300fe88 P 89a9444e93674a9d9e3d988af9c95a3e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90c988d9adde44879ef11b8aa6ef4da3 in term 0.
I20250625 03:29:59.577385 973 catalog_manager.cc:5582] T 1d26f90c72ff4068ad7d0b002f4546cc P 90c988d9adde44879ef11b8aa6ef4da3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 90c988d9adde44879ef11b8aa6ef4da3 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "90c988d9adde44879ef11b8aa6ef4da3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } health_report { overall_health: HEALTHY } } }
I20250625 03:29:59.583393 1274 raft_consensus.cc:513] T 93d7b80866e64a77b925f730e300fe88 P 90c988d9adde44879ef11b8aa6ef4da3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.593375 1149 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "93d7b80866e64a77b925f730e300fe88" candidate_uuid: "90c988d9adde44879ef11b8aa6ef4da3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f009baf8a094da7a58d2a36ea888442"
I20250625 03:29:59.594271 1149 raft_consensus.cc:3058] T 93d7b80866e64a77b925f730e300fe88 P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:29:59.596376 1074 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "93d7b80866e64a77b925f730e300fe88" candidate_uuid: "90c988d9adde44879ef11b8aa6ef4da3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89a9444e93674a9d9e3d988af9c95a3e"
I20250625 03:29:59.597358 1074 raft_consensus.cc:3058] T 93d7b80866e64a77b925f730e300fe88 P 89a9444e93674a9d9e3d988af9c95a3e [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:29:59.602500 1274 leader_election.cc:290] T 93d7b80866e64a77b925f730e300fe88 P 90c988d9adde44879ef11b8aa6ef4da3 [CANDIDATE]: Term 1 election: Requested vote from peers 89a9444e93674a9d9e3d988af9c95a3e (127.0.106.129:44675), 5f009baf8a094da7a58d2a36ea888442 (127.0.106.130:37441)
I20250625 03:29:59.607448 1149 raft_consensus.cc:2466] T 93d7b80866e64a77b925f730e300fe88 P 5f009baf8a094da7a58d2a36ea888442 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90c988d9adde44879ef11b8aa6ef4da3 in term 1.
I20250625 03:29:59.607295 971 catalog_manager.cc:5582] T 27e1943c0c154ec68f7e0a75b39b1105 P 5f009baf8a094da7a58d2a36ea888442 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f009baf8a094da7a58d2a36ea888442 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "5f009baf8a094da7a58d2a36ea888442" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } health_report { overall_health: UNKNOWN } } }
I20250625 03:29:59.612438 1190 leader_election.cc:304] T 93d7b80866e64a77b925f730e300fe88 P 90c988d9adde44879ef11b8aa6ef4da3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f009baf8a094da7a58d2a36ea888442, 90c988d9adde44879ef11b8aa6ef4da3; no voters:
I20250625 03:29:59.614138 1274 raft_consensus.cc:2802] T 93d7b80866e64a77b925f730e300fe88 P 90c988d9adde44879ef11b8aa6ef4da3 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:29:59.614203 1074 raft_consensus.cc:2466] T 93d7b80866e64a77b925f730e300fe88 P 89a9444e93674a9d9e3d988af9c95a3e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90c988d9adde44879ef11b8aa6ef4da3 in term 1.
I20250625 03:29:59.614686 1274 raft_consensus.cc:695] T 93d7b80866e64a77b925f730e300fe88 P 90c988d9adde44879ef11b8aa6ef4da3 [term 1 LEADER]: Becoming Leader. State: Replica: 90c988d9adde44879ef11b8aa6ef4da3, State: Running, Role: LEADER
I20250625 03:29:59.615728 1274 consensus_queue.cc:237] T 93d7b80866e64a77b925f730e300fe88 P 90c988d9adde44879ef11b8aa6ef4da3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.625900 1266 tablet_bootstrap.cc:492] T 1d26f90c72ff4068ad7d0b002f4546cc P 89a9444e93674a9d9e3d988af9c95a3e: No bootstrap required, opened a new log
I20250625 03:29:59.626319 1266 ts_tablet_manager.cc:1397] T 1d26f90c72ff4068ad7d0b002f4546cc P 89a9444e93674a9d9e3d988af9c95a3e: Time spent bootstrapping tablet: real 0.067s user 0.023s sys 0.026s
I20250625 03:29:59.632131 972 catalog_manager.cc:5582] T 513e577d0f2f4faea26726a7e8670a8d P 89a9444e93674a9d9e3d988af9c95a3e reported cstate change: term changed from 0 to 1, leader changed from <none> to 89a9444e93674a9d9e3d988af9c95a3e (127.0.106.129). New cstate: current_term: 1 leader_uuid: "89a9444e93674a9d9e3d988af9c95a3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } health_report { overall_health: UNKNOWN } } }
I20250625 03:29:59.633852 1266 raft_consensus.cc:357] T 1d26f90c72ff4068ad7d0b002f4546cc P 89a9444e93674a9d9e3d988af9c95a3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.634336 1266 raft_consensus.cc:383] T 1d26f90c72ff4068ad7d0b002f4546cc P 89a9444e93674a9d9e3d988af9c95a3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:29:59.634534 1266 raft_consensus.cc:738] T 1d26f90c72ff4068ad7d0b002f4546cc P 89a9444e93674a9d9e3d988af9c95a3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89a9444e93674a9d9e3d988af9c95a3e, State: Initialized, Role: FOLLOWER
I20250625 03:29:59.635097 1266 consensus_queue.cc:260] T 1d26f90c72ff4068ad7d0b002f4546cc P 89a9444e93674a9d9e3d988af9c95a3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.637037 1266 ts_tablet_manager.cc:1428] T 1d26f90c72ff4068ad7d0b002f4546cc P 89a9444e93674a9d9e3d988af9c95a3e: Time spent starting tablet: real 0.010s user 0.006s sys 0.001s
I20250625 03:29:59.637317 1264 tablet_bootstrap.cc:492] T bc9758463ec04a4b93042f29add1a1fd P 90c988d9adde44879ef11b8aa6ef4da3: No bootstrap required, opened a new log
I20250625 03:29:59.637713 1264 ts_tablet_manager.cc:1397] T bc9758463ec04a4b93042f29add1a1fd P 90c988d9adde44879ef11b8aa6ef4da3: Time spent bootstrapping tablet: real 0.077s user 0.018s sys 0.013s
I20250625 03:29:59.640157 1264 raft_consensus.cc:357] T bc9758463ec04a4b93042f29add1a1fd P 90c988d9adde44879ef11b8aa6ef4da3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.640821 1264 raft_consensus.cc:383] T bc9758463ec04a4b93042f29add1a1fd P 90c988d9adde44879ef11b8aa6ef4da3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:29:59.641088 1264 raft_consensus.cc:738] T bc9758463ec04a4b93042f29add1a1fd P 90c988d9adde44879ef11b8aa6ef4da3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90c988d9adde44879ef11b8aa6ef4da3, State: Initialized, Role: FOLLOWER
I20250625 03:29:59.641666 1264 consensus_queue.cc:260] T bc9758463ec04a4b93042f29add1a1fd P 90c988d9adde44879ef11b8aa6ef4da3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.642999 1264 ts_tablet_manager.cc:1428] T bc9758463ec04a4b93042f29add1a1fd P 90c988d9adde44879ef11b8aa6ef4da3: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20250625 03:29:59.643746 1264 tablet_bootstrap.cc:492] T 513e577d0f2f4faea26726a7e8670a8d P 90c988d9adde44879ef11b8aa6ef4da3: Bootstrap starting.
I20250625 03:29:59.645550 971 catalog_manager.cc:5582] T 93d7b80866e64a77b925f730e300fe88 P 90c988d9adde44879ef11b8aa6ef4da3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 90c988d9adde44879ef11b8aa6ef4da3 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "90c988d9adde44879ef11b8aa6ef4da3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } health_report { overall_health: HEALTHY } } }
I20250625 03:29:59.648289 1264 tablet_bootstrap.cc:654] T 513e577d0f2f4faea26726a7e8670a8d P 90c988d9adde44879ef11b8aa6ef4da3: Neither blocks nor log segments found. Creating new log.
I20250625 03:29:59.653250 1264 tablet_bootstrap.cc:492] T 513e577d0f2f4faea26726a7e8670a8d P 90c988d9adde44879ef11b8aa6ef4da3: No bootstrap required, opened a new log
I20250625 03:29:59.653613 1264 ts_tablet_manager.cc:1397] T 513e577d0f2f4faea26726a7e8670a8d P 90c988d9adde44879ef11b8aa6ef4da3: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.004s
I20250625 03:29:59.655954 1264 raft_consensus.cc:357] T 513e577d0f2f4faea26726a7e8670a8d P 90c988d9adde44879ef11b8aa6ef4da3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.656623 1264 raft_consensus.cc:383] T 513e577d0f2f4faea26726a7e8670a8d P 90c988d9adde44879ef11b8aa6ef4da3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:29:59.656855 1264 raft_consensus.cc:738] T 513e577d0f2f4faea26726a7e8670a8d P 90c988d9adde44879ef11b8aa6ef4da3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90c988d9adde44879ef11b8aa6ef4da3, State: Initialized, Role: FOLLOWER
I20250625 03:29:59.657375 1264 consensus_queue.cc:260] T 513e577d0f2f4faea26726a7e8670a8d P 90c988d9adde44879ef11b8aa6ef4da3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.658852 1264 ts_tablet_manager.cc:1428] T 513e577d0f2f4faea26726a7e8670a8d P 90c988d9adde44879ef11b8aa6ef4da3: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20250625 03:29:59.659608 1264 tablet_bootstrap.cc:492] T 90089cf7177a4f67a5cc1bdfb9f179bd P 90c988d9adde44879ef11b8aa6ef4da3: Bootstrap starting.
I20250625 03:29:59.663957 1264 tablet_bootstrap.cc:654] T 90089cf7177a4f67a5cc1bdfb9f179bd P 90c988d9adde44879ef11b8aa6ef4da3: Neither blocks nor log segments found. Creating new log.
I20250625 03:29:59.667866 1264 tablet_bootstrap.cc:492] T 90089cf7177a4f67a5cc1bdfb9f179bd P 90c988d9adde44879ef11b8aa6ef4da3: No bootstrap required, opened a new log
I20250625 03:29:59.668282 1264 ts_tablet_manager.cc:1397] T 90089cf7177a4f67a5cc1bdfb9f179bd P 90c988d9adde44879ef11b8aa6ef4da3: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20250625 03:29:59.670107 1264 raft_consensus.cc:357] T 90089cf7177a4f67a5cc1bdfb9f179bd P 90c988d9adde44879ef11b8aa6ef4da3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.670867 1264 raft_consensus.cc:383] T 90089cf7177a4f67a5cc1bdfb9f179bd P 90c988d9adde44879ef11b8aa6ef4da3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:29:59.671159 1264 raft_consensus.cc:738] T 90089cf7177a4f67a5cc1bdfb9f179bd P 90c988d9adde44879ef11b8aa6ef4da3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90c988d9adde44879ef11b8aa6ef4da3, State: Initialized, Role: FOLLOWER
I20250625 03:29:59.671795 1264 consensus_queue.cc:260] T 90089cf7177a4f67a5cc1bdfb9f179bd P 90c988d9adde44879ef11b8aa6ef4da3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.673740 1264 ts_tablet_manager.cc:1428] T 90089cf7177a4f67a5cc1bdfb9f179bd P 90c988d9adde44879ef11b8aa6ef4da3: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20250625 03:29:59.757542 1289 consensus_queue.cc:1035] T b6138e286d7448baa149c4952eb2fd0c P 5f009baf8a094da7a58d2a36ea888442 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:29:59.768558 1292 consensus_queue.cc:1035] T b6138e286d7448baa149c4952eb2fd0c P 5f009baf8a094da7a58d2a36ea888442 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:29:59.787887 1292 consensus_queue.cc:1035] T 86ab18af04f544ef8316b4caeaf781d2 P 5f009baf8a094da7a58d2a36ea888442 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:29:59.797835 1270 consensus_queue.cc:1035] T 86ab18af04f544ef8316b4caeaf781d2 P 5f009baf8a094da7a58d2a36ea888442 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:29:59.811766 1271 raft_consensus.cc:491] T 1d26f90c72ff4068ad7d0b002f4546cc P 89a9444e93674a9d9e3d988af9c95a3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:29:59.812242 1271 raft_consensus.cc:513] T 1d26f90c72ff4068ad7d0b002f4546cc P 89a9444e93674a9d9e3d988af9c95a3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.813788 1271 leader_election.cc:290] T 1d26f90c72ff4068ad7d0b002f4546cc P 89a9444e93674a9d9e3d988af9c95a3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f009baf8a094da7a58d2a36ea888442 (127.0.106.130:37441), 90c988d9adde44879ef11b8aa6ef4da3 (127.0.106.131:42281)
I20250625 03:29:59.814329 1149 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1d26f90c72ff4068ad7d0b002f4546cc" candidate_uuid: "89a9444e93674a9d9e3d988af9c95a3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f009baf8a094da7a58d2a36ea888442" is_pre_election: true
I20250625 03:29:59.814759 1222 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1d26f90c72ff4068ad7d0b002f4546cc" candidate_uuid: "89a9444e93674a9d9e3d988af9c95a3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90c988d9adde44879ef11b8aa6ef4da3" is_pre_election: true
I20250625 03:29:59.815078 1149 raft_consensus.cc:2391] T 1d26f90c72ff4068ad7d0b002f4546cc P 5f009baf8a094da7a58d2a36ea888442 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89a9444e93674a9d9e3d988af9c95a3e in current term 1: Already voted for candidate 90c988d9adde44879ef11b8aa6ef4da3 in this term.
I20250625 03:29:59.816183 1041 leader_election.cc:304] T 1d26f90c72ff4068ad7d0b002f4546cc P 89a9444e93674a9d9e3d988af9c95a3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89a9444e93674a9d9e3d988af9c95a3e; no voters: 5f009baf8a094da7a58d2a36ea888442, 90c988d9adde44879ef11b8aa6ef4da3
I20250625 03:29:59.816776 1271 raft_consensus.cc:3058] T 1d26f90c72ff4068ad7d0b002f4546cc P 89a9444e93674a9d9e3d988af9c95a3e [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:29:59.821202 1271 raft_consensus.cc:2747] T 1d26f90c72ff4068ad7d0b002f4546cc P 89a9444e93674a9d9e3d988af9c95a3e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:29:59.855569 1271 raft_consensus.cc:491] T 90089cf7177a4f67a5cc1bdfb9f179bd P 89a9444e93674a9d9e3d988af9c95a3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:29:59.856076 1271 raft_consensus.cc:513] T 90089cf7177a4f67a5cc1bdfb9f179bd P 89a9444e93674a9d9e3d988af9c95a3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.857558 1271 leader_election.cc:290] T 90089cf7177a4f67a5cc1bdfb9f179bd P 89a9444e93674a9d9e3d988af9c95a3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f009baf8a094da7a58d2a36ea888442 (127.0.106.130:37441), 90c988d9adde44879ef11b8aa6ef4da3 (127.0.106.131:42281)
I20250625 03:29:59.858402 1149 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "90089cf7177a4f67a5cc1bdfb9f179bd" candidate_uuid: "89a9444e93674a9d9e3d988af9c95a3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f009baf8a094da7a58d2a36ea888442" is_pre_election: true
I20250625 03:29:59.858753 1222 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "90089cf7177a4f67a5cc1bdfb9f179bd" candidate_uuid: "89a9444e93674a9d9e3d988af9c95a3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90c988d9adde44879ef11b8aa6ef4da3" is_pre_election: true
I20250625 03:29:59.859021 1149 raft_consensus.cc:2466] T 90089cf7177a4f67a5cc1bdfb9f179bd P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89a9444e93674a9d9e3d988af9c95a3e in term 0.
I20250625 03:29:59.859333 1222 raft_consensus.cc:2466] T 90089cf7177a4f67a5cc1bdfb9f179bd P 90c988d9adde44879ef11b8aa6ef4da3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89a9444e93674a9d9e3d988af9c95a3e in term 0.
I20250625 03:29:59.860117 1041 leader_election.cc:304] T 90089cf7177a4f67a5cc1bdfb9f179bd P 89a9444e93674a9d9e3d988af9c95a3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f009baf8a094da7a58d2a36ea888442, 89a9444e93674a9d9e3d988af9c95a3e; no voters:
I20250625 03:29:59.860706 1271 raft_consensus.cc:2802] T 90089cf7177a4f67a5cc1bdfb9f179bd P 89a9444e93674a9d9e3d988af9c95a3e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:29:59.860985 1271 raft_consensus.cc:491] T 90089cf7177a4f67a5cc1bdfb9f179bd P 89a9444e93674a9d9e3d988af9c95a3e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:29:59.861234 1271 raft_consensus.cc:3058] T 90089cf7177a4f67a5cc1bdfb9f179bd P 89a9444e93674a9d9e3d988af9c95a3e [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:29:59.865657 1271 raft_consensus.cc:513] T 90089cf7177a4f67a5cc1bdfb9f179bd P 89a9444e93674a9d9e3d988af9c95a3e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.867094 1271 leader_election.cc:290] T 90089cf7177a4f67a5cc1bdfb9f179bd P 89a9444e93674a9d9e3d988af9c95a3e [CANDIDATE]: Term 1 election: Requested vote from peers 5f009baf8a094da7a58d2a36ea888442 (127.0.106.130:37441), 90c988d9adde44879ef11b8aa6ef4da3 (127.0.106.131:42281)
I20250625 03:29:59.867933 1149 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "90089cf7177a4f67a5cc1bdfb9f179bd" candidate_uuid: "89a9444e93674a9d9e3d988af9c95a3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f009baf8a094da7a58d2a36ea888442"
I20250625 03:29:59.868152 1222 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "90089cf7177a4f67a5cc1bdfb9f179bd" candidate_uuid: "89a9444e93674a9d9e3d988af9c95a3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90c988d9adde44879ef11b8aa6ef4da3"
I20250625 03:29:59.868409 1149 raft_consensus.cc:3058] T 90089cf7177a4f67a5cc1bdfb9f179bd P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:29:59.868800 1222 raft_consensus.cc:3058] T 90089cf7177a4f67a5cc1bdfb9f179bd P 90c988d9adde44879ef11b8aa6ef4da3 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:29:59.872922 1149 raft_consensus.cc:2466] T 90089cf7177a4f67a5cc1bdfb9f179bd P 5f009baf8a094da7a58d2a36ea888442 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89a9444e93674a9d9e3d988af9c95a3e in term 1.
I20250625 03:29:59.873065 1222 raft_consensus.cc:2466] T 90089cf7177a4f67a5cc1bdfb9f179bd P 90c988d9adde44879ef11b8aa6ef4da3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89a9444e93674a9d9e3d988af9c95a3e in term 1.
I20250625 03:29:59.873919 1041 leader_election.cc:304] T 90089cf7177a4f67a5cc1bdfb9f179bd P 89a9444e93674a9d9e3d988af9c95a3e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f009baf8a094da7a58d2a36ea888442, 89a9444e93674a9d9e3d988af9c95a3e; no voters:
I20250625 03:29:59.874492 1271 raft_consensus.cc:2802] T 90089cf7177a4f67a5cc1bdfb9f179bd P 89a9444e93674a9d9e3d988af9c95a3e [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:29:59.874867 1271 raft_consensus.cc:695] T 90089cf7177a4f67a5cc1bdfb9f179bd P 89a9444e93674a9d9e3d988af9c95a3e [term 1 LEADER]: Becoming Leader. State: Replica: 89a9444e93674a9d9e3d988af9c95a3e, State: Running, Role: LEADER
I20250625 03:29:59.875540 1271 consensus_queue.cc:237] T 90089cf7177a4f67a5cc1bdfb9f179bd P 89a9444e93674a9d9e3d988af9c95a3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.882944 972 catalog_manager.cc:5582] T 90089cf7177a4f67a5cc1bdfb9f179bd P 89a9444e93674a9d9e3d988af9c95a3e reported cstate change: term changed from 0 to 1, leader changed from <none> to 89a9444e93674a9d9e3d988af9c95a3e (127.0.106.129). New cstate: current_term: 1 leader_uuid: "89a9444e93674a9d9e3d988af9c95a3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } health_report { overall_health: UNKNOWN } } }
I20250625 03:29:59.888293 1274 raft_consensus.cc:491] T 513e577d0f2f4faea26726a7e8670a8d P 90c988d9adde44879ef11b8aa6ef4da3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:29:59.888883 1274 raft_consensus.cc:513] T 513e577d0f2f4faea26726a7e8670a8d P 90c988d9adde44879ef11b8aa6ef4da3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.890694 1274 leader_election.cc:290] T 513e577d0f2f4faea26726a7e8670a8d P 90c988d9adde44879ef11b8aa6ef4da3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89a9444e93674a9d9e3d988af9c95a3e (127.0.106.129:44675), 5f009baf8a094da7a58d2a36ea888442 (127.0.106.130:37441)
I20250625 03:29:59.891724 1074 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "513e577d0f2f4faea26726a7e8670a8d" candidate_uuid: "90c988d9adde44879ef11b8aa6ef4da3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89a9444e93674a9d9e3d988af9c95a3e" is_pre_election: true
I20250625 03:29:59.891723 1149 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "513e577d0f2f4faea26726a7e8670a8d" candidate_uuid: "90c988d9adde44879ef11b8aa6ef4da3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f009baf8a094da7a58d2a36ea888442" is_pre_election: true
I20250625 03:29:59.892678 1149 raft_consensus.cc:2391] T 513e577d0f2f4faea26726a7e8670a8d P 5f009baf8a094da7a58d2a36ea888442 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 90c988d9adde44879ef11b8aa6ef4da3 in current term 1: Already voted for candidate 89a9444e93674a9d9e3d988af9c95a3e in this term.
I20250625 03:29:59.893481 1190 leader_election.cc:304] T 513e577d0f2f4faea26726a7e8670a8d P 90c988d9adde44879ef11b8aa6ef4da3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 90c988d9adde44879ef11b8aa6ef4da3; no voters: 5f009baf8a094da7a58d2a36ea888442, 89a9444e93674a9d9e3d988af9c95a3e
I20250625 03:29:59.894109 1274 raft_consensus.cc:3058] T 513e577d0f2f4faea26726a7e8670a8d P 90c988d9adde44879ef11b8aa6ef4da3 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:29:59.898600 1274 raft_consensus.cc:2747] T 513e577d0f2f4faea26726a7e8670a8d P 90c988d9adde44879ef11b8aa6ef4da3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:29:59.909977 1274 raft_consensus.cc:491] T 0ee874019a27479a94caf3275d914259 P 90c988d9adde44879ef11b8aa6ef4da3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:29:59.910403 1274 raft_consensus.cc:513] T 0ee874019a27479a94caf3275d914259 P 90c988d9adde44879ef11b8aa6ef4da3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.911887 1274 leader_election.cc:290] T 0ee874019a27479a94caf3275d914259 P 90c988d9adde44879ef11b8aa6ef4da3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89a9444e93674a9d9e3d988af9c95a3e (127.0.106.129:44675), 5f009baf8a094da7a58d2a36ea888442 (127.0.106.130:37441)
I20250625 03:29:59.912810 1074 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0ee874019a27479a94caf3275d914259" candidate_uuid: "90c988d9adde44879ef11b8aa6ef4da3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89a9444e93674a9d9e3d988af9c95a3e" is_pre_election: true
I20250625 03:29:59.913026 1149 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0ee874019a27479a94caf3275d914259" candidate_uuid: "90c988d9adde44879ef11b8aa6ef4da3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f009baf8a094da7a58d2a36ea888442" is_pre_election: true
I20250625 03:29:59.913326 1074 raft_consensus.cc:2466] T 0ee874019a27479a94caf3275d914259 P 89a9444e93674a9d9e3d988af9c95a3e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90c988d9adde44879ef11b8aa6ef4da3 in term 0.
I20250625 03:29:59.913573 1149 raft_consensus.cc:2466] T 0ee874019a27479a94caf3275d914259 P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90c988d9adde44879ef11b8aa6ef4da3 in term 0.
I20250625 03:29:59.914243 1188 leader_election.cc:304] T 0ee874019a27479a94caf3275d914259 P 90c988d9adde44879ef11b8aa6ef4da3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89a9444e93674a9d9e3d988af9c95a3e, 90c988d9adde44879ef11b8aa6ef4da3; no voters:
I20250625 03:29:59.914978 1274 raft_consensus.cc:2802] T 0ee874019a27479a94caf3275d914259 P 90c988d9adde44879ef11b8aa6ef4da3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:29:59.915247 1274 raft_consensus.cc:491] T 0ee874019a27479a94caf3275d914259 P 90c988d9adde44879ef11b8aa6ef4da3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:29:59.915510 1274 raft_consensus.cc:3058] T 0ee874019a27479a94caf3275d914259 P 90c988d9adde44879ef11b8aa6ef4da3 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:29:59.920042 1274 raft_consensus.cc:513] T 0ee874019a27479a94caf3275d914259 P 90c988d9adde44879ef11b8aa6ef4da3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.921511 1274 leader_election.cc:290] T 0ee874019a27479a94caf3275d914259 P 90c988d9adde44879ef11b8aa6ef4da3 [CANDIDATE]: Term 1 election: Requested vote from peers 89a9444e93674a9d9e3d988af9c95a3e (127.0.106.129:44675), 5f009baf8a094da7a58d2a36ea888442 (127.0.106.130:37441)
I20250625 03:29:59.922479 1074 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0ee874019a27479a94caf3275d914259" candidate_uuid: "90c988d9adde44879ef11b8aa6ef4da3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89a9444e93674a9d9e3d988af9c95a3e"
I20250625 03:29:59.922479 1149 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0ee874019a27479a94caf3275d914259" candidate_uuid: "90c988d9adde44879ef11b8aa6ef4da3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f009baf8a094da7a58d2a36ea888442"
I20250625 03:29:59.923218 1074 raft_consensus.cc:3058] T 0ee874019a27479a94caf3275d914259 P 89a9444e93674a9d9e3d988af9c95a3e [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:29:59.923269 1149 raft_consensus.cc:3058] T 0ee874019a27479a94caf3275d914259 P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:29:59.928812 1271 consensus_queue.cc:1035] T 6b62b2927d214886b92f502546868ca0 P 89a9444e93674a9d9e3d988af9c95a3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:29:59.930162 1074 raft_consensus.cc:2466] T 0ee874019a27479a94caf3275d914259 P 89a9444e93674a9d9e3d988af9c95a3e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90c988d9adde44879ef11b8aa6ef4da3 in term 1.
I20250625 03:29:59.930162 1149 raft_consensus.cc:2466] T 0ee874019a27479a94caf3275d914259 P 5f009baf8a094da7a58d2a36ea888442 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90c988d9adde44879ef11b8aa6ef4da3 in term 1.
I20250625 03:29:59.931404 1188 leader_election.cc:304] T 0ee874019a27479a94caf3275d914259 P 90c988d9adde44879ef11b8aa6ef4da3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 5f009baf8a094da7a58d2a36ea888442, 89a9444e93674a9d9e3d988af9c95a3e, 90c988d9adde44879ef11b8aa6ef4da3; no voters:
I20250625 03:29:59.932256 1274 raft_consensus.cc:2802] T 0ee874019a27479a94caf3275d914259 P 90c988d9adde44879ef11b8aa6ef4da3 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:29:59.932868 1274 raft_consensus.cc:695] T 0ee874019a27479a94caf3275d914259 P 90c988d9adde44879ef11b8aa6ef4da3 [term 1 LEADER]: Becoming Leader. State: Replica: 90c988d9adde44879ef11b8aa6ef4da3, State: Running, Role: LEADER
I20250625 03:29:59.933606 1274 consensus_queue.cc:237] T 0ee874019a27479a94caf3275d914259 P 90c988d9adde44879ef11b8aa6ef4da3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.934368 1307 raft_consensus.cc:491] T bc9758463ec04a4b93042f29add1a1fd P 90c988d9adde44879ef11b8aa6ef4da3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:29:59.934811 1307 raft_consensus.cc:513] T bc9758463ec04a4b93042f29add1a1fd P 90c988d9adde44879ef11b8aa6ef4da3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.937484 1307 leader_election.cc:290] T bc9758463ec04a4b93042f29add1a1fd P 90c988d9adde44879ef11b8aa6ef4da3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89a9444e93674a9d9e3d988af9c95a3e (127.0.106.129:44675), 5f009baf8a094da7a58d2a36ea888442 (127.0.106.130:37441)
I20250625 03:29:59.938040 1149 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bc9758463ec04a4b93042f29add1a1fd" candidate_uuid: "90c988d9adde44879ef11b8aa6ef4da3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f009baf8a094da7a58d2a36ea888442" is_pre_election: true
I20250625 03:29:59.938674 1149 raft_consensus.cc:2466] T bc9758463ec04a4b93042f29add1a1fd P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90c988d9adde44879ef11b8aa6ef4da3 in term 0.
I20250625 03:29:59.938975 1074 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bc9758463ec04a4b93042f29add1a1fd" candidate_uuid: "90c988d9adde44879ef11b8aa6ef4da3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89a9444e93674a9d9e3d988af9c95a3e" is_pre_election: true
I20250625 03:29:59.939568 1074 raft_consensus.cc:2466] T bc9758463ec04a4b93042f29add1a1fd P 89a9444e93674a9d9e3d988af9c95a3e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90c988d9adde44879ef11b8aa6ef4da3 in term 0.
I20250625 03:29:59.939630 1190 leader_election.cc:304] T bc9758463ec04a4b93042f29add1a1fd P 90c988d9adde44879ef11b8aa6ef4da3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f009baf8a094da7a58d2a36ea888442, 90c988d9adde44879ef11b8aa6ef4da3; no voters:
I20250625 03:29:59.940687 1307 raft_consensus.cc:2802] T bc9758463ec04a4b93042f29add1a1fd P 90c988d9adde44879ef11b8aa6ef4da3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:29:59.940970 1307 raft_consensus.cc:491] T bc9758463ec04a4b93042f29add1a1fd P 90c988d9adde44879ef11b8aa6ef4da3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:29:59.941215 1307 raft_consensus.cc:3058] T bc9758463ec04a4b93042f29add1a1fd P 90c988d9adde44879ef11b8aa6ef4da3 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:29:59.945869 972 catalog_manager.cc:5582] T 0ee874019a27479a94caf3275d914259 P 90c988d9adde44879ef11b8aa6ef4da3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 90c988d9adde44879ef11b8aa6ef4da3 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "90c988d9adde44879ef11b8aa6ef4da3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } health_report { overall_health: HEALTHY } } }
I20250625 03:29:59.947726 1307 raft_consensus.cc:513] T bc9758463ec04a4b93042f29add1a1fd P 90c988d9adde44879ef11b8aa6ef4da3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.949477 1307 leader_election.cc:290] T bc9758463ec04a4b93042f29add1a1fd P 90c988d9adde44879ef11b8aa6ef4da3 [CANDIDATE]: Term 1 election: Requested vote from peers 89a9444e93674a9d9e3d988af9c95a3e (127.0.106.129:44675), 5f009baf8a094da7a58d2a36ea888442 (127.0.106.130:37441)
I20250625 03:29:59.950289 1074 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bc9758463ec04a4b93042f29add1a1fd" candidate_uuid: "90c988d9adde44879ef11b8aa6ef4da3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89a9444e93674a9d9e3d988af9c95a3e"
I20250625 03:29:59.950549 1149 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bc9758463ec04a4b93042f29add1a1fd" candidate_uuid: "90c988d9adde44879ef11b8aa6ef4da3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f009baf8a094da7a58d2a36ea888442"
I20250625 03:29:59.950781 1074 raft_consensus.cc:3058] T bc9758463ec04a4b93042f29add1a1fd P 89a9444e93674a9d9e3d988af9c95a3e [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:29:59.951112 1149 raft_consensus.cc:3058] T bc9758463ec04a4b93042f29add1a1fd P 5f009baf8a094da7a58d2a36ea888442 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:29:59.958068 1074 raft_consensus.cc:2466] T bc9758463ec04a4b93042f29add1a1fd P 89a9444e93674a9d9e3d988af9c95a3e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90c988d9adde44879ef11b8aa6ef4da3 in term 1.
I20250625 03:29:59.959345 1188 leader_election.cc:304] T bc9758463ec04a4b93042f29add1a1fd P 90c988d9adde44879ef11b8aa6ef4da3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89a9444e93674a9d9e3d988af9c95a3e, 90c988d9adde44879ef11b8aa6ef4da3; no voters:
I20250625 03:29:59.959914 1302 consensus_queue.cc:1035] T 6b62b2927d214886b92f502546868ca0 P 89a9444e93674a9d9e3d988af9c95a3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:29:59.960304 1307 raft_consensus.cc:2802] T bc9758463ec04a4b93042f29add1a1fd P 90c988d9adde44879ef11b8aa6ef4da3 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:29:59.961365 1307 raft_consensus.cc:695] T bc9758463ec04a4b93042f29add1a1fd P 90c988d9adde44879ef11b8aa6ef4da3 [term 1 LEADER]: Becoming Leader. State: Replica: 90c988d9adde44879ef11b8aa6ef4da3, State: Running, Role: LEADER
I20250625 03:29:59.962132 1307 consensus_queue.cc:237] T bc9758463ec04a4b93042f29add1a1fd P 90c988d9adde44879ef11b8aa6ef4da3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:29:59.964779 1302 consensus_queue.cc:1035] T 513e577d0f2f4faea26726a7e8670a8d P 89a9444e93674a9d9e3d988af9c95a3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:29:59.958068 1149 raft_consensus.cc:2466] T bc9758463ec04a4b93042f29add1a1fd P 5f009baf8a094da7a58d2a36ea888442 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90c988d9adde44879ef11b8aa6ef4da3 in term 1.
I20250625 03:29:59.979399 971 catalog_manager.cc:5582] T bc9758463ec04a4b93042f29add1a1fd P 90c988d9adde44879ef11b8aa6ef4da3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 90c988d9adde44879ef11b8aa6ef4da3 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "90c988d9adde44879ef11b8aa6ef4da3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } health_report { overall_health: HEALTHY } } }
I20250625 03:29:59.981302 1306 consensus_queue.cc:1035] T 513e577d0f2f4faea26726a7e8670a8d P 89a9444e93674a9d9e3d988af9c95a3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:30:00.012487 1307 consensus_queue.cc:1035] T 1d26f90c72ff4068ad7d0b002f4546cc P 90c988d9adde44879ef11b8aa6ef4da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:30:00.022858 1340 consensus_queue.cc:1035] T 1d26f90c72ff4068ad7d0b002f4546cc P 90c988d9adde44879ef11b8aa6ef4da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:30:00.108423 1270 consensus_queue.cc:1035] T 27e1943c0c154ec68f7e0a75b39b1105 P 5f009baf8a094da7a58d2a36ea888442 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:30:00.118188 1270 consensus_queue.cc:1035] T 27e1943c0c154ec68f7e0a75b39b1105 P 5f009baf8a094da7a58d2a36ea888442 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:30:00.118458 1340 consensus_queue.cc:1035] T 93d7b80866e64a77b925f730e300fe88 P 90c988d9adde44879ef11b8aa6ef4da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:30:00.132383 1307 consensus_queue.cc:1035] T 93d7b80866e64a77b925f730e300fe88 P 90c988d9adde44879ef11b8aa6ef4da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:30:00.224822 1150 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "b6138e286d7448baa149c4952eb2fd0c"
dest_uuid: "5f009baf8a094da7a58d2a36ea888442"
mode: GRACEFUL
new_leader_uuid: "89a9444e93674a9d9e3d988af9c95a3e"
from {username='slave'} at 127.0.0.1:32960
I20250625 03:30:00.225363 1150 raft_consensus.cc:604] T b6138e286d7448baa149c4952eb2fd0c P 5f009baf8a094da7a58d2a36ea888442 [term 1 LEADER]: Received request to transfer leadership to TS 89a9444e93674a9d9e3d988af9c95a3e
I20250625 03:30:00.238341 1222 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "bc9758463ec04a4b93042f29add1a1fd"
dest_uuid: "90c988d9adde44879ef11b8aa6ef4da3"
mode: GRACEFUL
new_leader_uuid: "89a9444e93674a9d9e3d988af9c95a3e"
from {username='slave'} at 127.0.0.1:50114
I20250625 03:30:00.238824 1222 raft_consensus.cc:604] T bc9758463ec04a4b93042f29add1a1fd P 90c988d9adde44879ef11b8aa6ef4da3 [term 1 LEADER]: Received request to transfer leadership to TS 89a9444e93674a9d9e3d988af9c95a3e
I20250625 03:30:00.243075 1150 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "86ab18af04f544ef8316b4caeaf781d2"
dest_uuid: "5f009baf8a094da7a58d2a36ea888442"
mode: GRACEFUL
new_leader_uuid: "89a9444e93674a9d9e3d988af9c95a3e"
from {username='slave'} at 127.0.0.1:32960
I20250625 03:30:00.243557 1150 raft_consensus.cc:604] T 86ab18af04f544ef8316b4caeaf781d2 P 5f009baf8a094da7a58d2a36ea888442 [term 1 LEADER]: Received request to transfer leadership to TS 89a9444e93674a9d9e3d988af9c95a3e
I20250625 03:30:00.247646 1222 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "0ee874019a27479a94caf3275d914259"
dest_uuid: "90c988d9adde44879ef11b8aa6ef4da3"
mode: GRACEFUL
new_leader_uuid: "89a9444e93674a9d9e3d988af9c95a3e"
from {username='slave'} at 127.0.0.1:50114
I20250625 03:30:00.248149 1222 raft_consensus.cc:604] T 0ee874019a27479a94caf3275d914259 P 90c988d9adde44879ef11b8aa6ef4da3 [term 1 LEADER]: Received request to transfer leadership to TS 89a9444e93674a9d9e3d988af9c95a3e
I20250625 03:30:00.252427 1150 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "27e1943c0c154ec68f7e0a75b39b1105"
dest_uuid: "5f009baf8a094da7a58d2a36ea888442"
mode: GRACEFUL
new_leader_uuid: "89a9444e93674a9d9e3d988af9c95a3e"
from {username='slave'} at 127.0.0.1:32960
I20250625 03:30:00.252867 1150 raft_consensus.cc:604] T 27e1943c0c154ec68f7e0a75b39b1105 P 5f009baf8a094da7a58d2a36ea888442 [term 1 LEADER]: Received request to transfer leadership to TS 89a9444e93674a9d9e3d988af9c95a3e
I20250625 03:30:00.265100 1074 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "6b62b2927d214886b92f502546868ca0"
dest_uuid: "89a9444e93674a9d9e3d988af9c95a3e"
mode: GRACEFUL
new_leader_uuid: "5f009baf8a094da7a58d2a36ea888442"
from {username='slave'} at 127.0.0.1:60924
I20250625 03:30:00.265621 1074 raft_consensus.cc:604] T 6b62b2927d214886b92f502546868ca0 P 89a9444e93674a9d9e3d988af9c95a3e [term 1 LEADER]: Received request to transfer leadership to TS 5f009baf8a094da7a58d2a36ea888442
I20250625 03:30:00.267187 1304 consensus_queue.cc:1035] T 90089cf7177a4f67a5cc1bdfb9f179bd P 89a9444e93674a9d9e3d988af9c95a3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:30:00.270555 1221 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "1d26f90c72ff4068ad7d0b002f4546cc"
dest_uuid: "90c988d9adde44879ef11b8aa6ef4da3"
mode: GRACEFUL
new_leader_uuid: "5f009baf8a094da7a58d2a36ea888442"
from {username='slave'} at 127.0.0.1:50114
I20250625 03:30:00.271044 1221 raft_consensus.cc:604] T 1d26f90c72ff4068ad7d0b002f4546cc P 90c988d9adde44879ef11b8aa6ef4da3 [term 1 LEADER]: Received request to transfer leadership to TS 5f009baf8a094da7a58d2a36ea888442
I20250625 03:30:00.277527 1222 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "93d7b80866e64a77b925f730e300fe88"
dest_uuid: "90c988d9adde44879ef11b8aa6ef4da3"
mode: GRACEFUL
new_leader_uuid: "5f009baf8a094da7a58d2a36ea888442"
from {username='slave'} at 127.0.0.1:50114
I20250625 03:30:00.278084 1222 raft_consensus.cc:604] T 93d7b80866e64a77b925f730e300fe88 P 90c988d9adde44879ef11b8aa6ef4da3 [term 1 LEADER]: Received request to transfer leadership to TS 5f009baf8a094da7a58d2a36ea888442
I20250625 03:30:00.281957 1306 consensus_queue.cc:1035] T 90089cf7177a4f67a5cc1bdfb9f179bd P 89a9444e93674a9d9e3d988af9c95a3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:30:00.287672 1074 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "90089cf7177a4f67a5cc1bdfb9f179bd"
dest_uuid: "89a9444e93674a9d9e3d988af9c95a3e"
mode: GRACEFUL
new_leader_uuid: "5f009baf8a094da7a58d2a36ea888442"
from {username='slave'} at 127.0.0.1:60924
I20250625 03:30:00.288343 1074 raft_consensus.cc:604] T 90089cf7177a4f67a5cc1bdfb9f179bd P 89a9444e93674a9d9e3d988af9c95a3e [term 1 LEADER]: Received request to transfer leadership to TS 5f009baf8a094da7a58d2a36ea888442
I20250625 03:30:00.291839 1306 raft_consensus.cc:991] T 90089cf7177a4f67a5cc1bdfb9f179bd P 89a9444e93674a9d9e3d988af9c95a3e: : Instructing follower 5f009baf8a094da7a58d2a36ea888442 to start an election
I20250625 03:30:00.292285 1302 raft_consensus.cc:1079] T 90089cf7177a4f67a5cc1bdfb9f179bd P 89a9444e93674a9d9e3d988af9c95a3e [term 1 LEADER]: Signalling peer 5f009baf8a094da7a58d2a36ea888442 to start an election
I20250625 03:30:00.293785 1150 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "90089cf7177a4f67a5cc1bdfb9f179bd"
dest_uuid: "5f009baf8a094da7a58d2a36ea888442"
from {username='slave'} at 127.0.0.1:32946
I20250625 03:30:00.294100 1074 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "513e577d0f2f4faea26726a7e8670a8d"
dest_uuid: "89a9444e93674a9d9e3d988af9c95a3e"
mode: GRACEFUL
new_leader_uuid: "90c988d9adde44879ef11b8aa6ef4da3"
from {username='slave'} at 127.0.0.1:60924
I20250625 03:30:00.294324 1150 raft_consensus.cc:491] T 90089cf7177a4f67a5cc1bdfb9f179bd P 5f009baf8a094da7a58d2a36ea888442 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:30:00.294685 1074 raft_consensus.cc:604] T 513e577d0f2f4faea26726a7e8670a8d P 89a9444e93674a9d9e3d988af9c95a3e [term 1 LEADER]: Received request to transfer leadership to TS 90c988d9adde44879ef11b8aa6ef4da3
I20250625 03:30:00.294705 1150 raft_consensus.cc:3058] T 90089cf7177a4f67a5cc1bdfb9f179bd P 5f009baf8a094da7a58d2a36ea888442 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:30:00.300626 1150 raft_consensus.cc:513] T 90089cf7177a4f67a5cc1bdfb9f179bd P 5f009baf8a094da7a58d2a36ea888442 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:30:00.302599 1150 leader_election.cc:290] T 90089cf7177a4f67a5cc1bdfb9f179bd P 5f009baf8a094da7a58d2a36ea888442 [CANDIDATE]: Term 2 election: Requested vote from peers 89a9444e93674a9d9e3d988af9c95a3e (127.0.106.129:44675), 90c988d9adde44879ef11b8aa6ef4da3 (127.0.106.131:42281)
I20250625 03:30:00.303102 1074 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "90089cf7177a4f67a5cc1bdfb9f179bd" candidate_uuid: "5f009baf8a094da7a58d2a36ea888442" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89a9444e93674a9d9e3d988af9c95a3e"
I20250625 03:30:00.303412 1222 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "90089cf7177a4f67a5cc1bdfb9f179bd" candidate_uuid: "5f009baf8a094da7a58d2a36ea888442" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "90c988d9adde44879ef11b8aa6ef4da3"
I20250625 03:30:00.303716 1074 raft_consensus.cc:3053] T 90089cf7177a4f67a5cc1bdfb9f179bd P 89a9444e93674a9d9e3d988af9c95a3e [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:30:00.303884 1222 raft_consensus.cc:3058] T 90089cf7177a4f67a5cc1bdfb9f179bd P 90c988d9adde44879ef11b8aa6ef4da3 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:30:00.304163 1074 raft_consensus.cc:738] T 90089cf7177a4f67a5cc1bdfb9f179bd P 89a9444e93674a9d9e3d988af9c95a3e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89a9444e93674a9d9e3d988af9c95a3e, State: Running, Role: LEADER
I20250625 03:30:00.304975 1074 consensus_queue.cc:260] T 90089cf7177a4f67a5cc1bdfb9f179bd P 89a9444e93674a9d9e3d988af9c95a3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:30:00.306262 1074 raft_consensus.cc:3058] T 90089cf7177a4f67a5cc1bdfb9f179bd P 89a9444e93674a9d9e3d988af9c95a3e [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:30:00.309026 1222 raft_consensus.cc:2466] T 90089cf7177a4f67a5cc1bdfb9f179bd P 90c988d9adde44879ef11b8aa6ef4da3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f009baf8a094da7a58d2a36ea888442 in term 2.
I20250625 03:30:00.310082 1116 leader_election.cc:304] T 90089cf7177a4f67a5cc1bdfb9f179bd P 5f009baf8a094da7a58d2a36ea888442 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f009baf8a094da7a58d2a36ea888442, 90c988d9adde44879ef11b8aa6ef4da3; no voters:
I20250625 03:30:00.310842 1289 raft_consensus.cc:2802] T 90089cf7177a4f67a5cc1bdfb9f179bd P 5f009baf8a094da7a58d2a36ea888442 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:30:00.311265 1289 raft_consensus.cc:695] T 90089cf7177a4f67a5cc1bdfb9f179bd P 5f009baf8a094da7a58d2a36ea888442 [term 2 LEADER]: Becoming Leader. State: Replica: 5f009baf8a094da7a58d2a36ea888442, State: Running, Role: LEADER
I20250625 03:30:00.312110 1289 consensus_queue.cc:237] T 90089cf7177a4f67a5cc1bdfb9f179bd P 5f009baf8a094da7a58d2a36ea888442 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:30:00.313477 1074 raft_consensus.cc:2466] T 90089cf7177a4f67a5cc1bdfb9f179bd P 89a9444e93674a9d9e3d988af9c95a3e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f009baf8a094da7a58d2a36ea888442 in term 2.
I20250625 03:30:00.319101 972 catalog_manager.cc:5582] T 90089cf7177a4f67a5cc1bdfb9f179bd P 5f009baf8a094da7a58d2a36ea888442 reported cstate change: term changed from 1 to 2, leader changed from 89a9444e93674a9d9e3d988af9c95a3e (127.0.106.129) to 5f009baf8a094da7a58d2a36ea888442 (127.0.106.130). New cstate: current_term: 2 leader_uuid: "5f009baf8a094da7a58d2a36ea888442" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } health_report { overall_health: UNKNOWN } } }
I20250625 03:30:00.357843 1292 raft_consensus.cc:991] T 86ab18af04f544ef8316b4caeaf781d2 P 5f009baf8a094da7a58d2a36ea888442: : Instructing follower 89a9444e93674a9d9e3d988af9c95a3e to start an election
I20250625 03:30:00.358259 1289 raft_consensus.cc:1079] T 86ab18af04f544ef8316b4caeaf781d2 P 5f009baf8a094da7a58d2a36ea888442 [term 1 LEADER]: Signalling peer 89a9444e93674a9d9e3d988af9c95a3e to start an election
I20250625 03:30:00.359642 1074 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "86ab18af04f544ef8316b4caeaf781d2"
dest_uuid: "89a9444e93674a9d9e3d988af9c95a3e"
from {username='slave'} at 127.0.0.1:60904
I20250625 03:30:00.360150 1074 raft_consensus.cc:491] T 86ab18af04f544ef8316b4caeaf781d2 P 89a9444e93674a9d9e3d988af9c95a3e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:30:00.360419 1074 raft_consensus.cc:3058] T 86ab18af04f544ef8316b4caeaf781d2 P 89a9444e93674a9d9e3d988af9c95a3e [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:30:00.365012 1074 raft_consensus.cc:513] T 86ab18af04f544ef8316b4caeaf781d2 P 89a9444e93674a9d9e3d988af9c95a3e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:30:00.366544 1074 leader_election.cc:290] T 86ab18af04f544ef8316b4caeaf781d2 P 89a9444e93674a9d9e3d988af9c95a3e [CANDIDATE]: Term 2 election: Requested vote from peers 5f009baf8a094da7a58d2a36ea888442 (127.0.106.130:37441), 90c988d9adde44879ef11b8aa6ef4da3 (127.0.106.131:42281)
I20250625 03:30:00.367491 1150 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "86ab18af04f544ef8316b4caeaf781d2" candidate_uuid: "89a9444e93674a9d9e3d988af9c95a3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f009baf8a094da7a58d2a36ea888442"
I20250625 03:30:00.367678 1222 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "86ab18af04f544ef8316b4caeaf781d2" candidate_uuid: "89a9444e93674a9d9e3d988af9c95a3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "90c988d9adde44879ef11b8aa6ef4da3"
I20250625 03:30:00.368181 1222 raft_consensus.cc:3058] T 86ab18af04f544ef8316b4caeaf781d2 P 90c988d9adde44879ef11b8aa6ef4da3 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:30:00.368162 1150 raft_consensus.cc:3053] T 86ab18af04f544ef8316b4caeaf781d2 P 5f009baf8a094da7a58d2a36ea888442 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:30:00.368748 1150 raft_consensus.cc:738] T 86ab18af04f544ef8316b4caeaf781d2 P 5f009baf8a094da7a58d2a36ea888442 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5f009baf8a094da7a58d2a36ea888442, State: Running, Role: LEADER
I20250625 03:30:00.369542 1150 consensus_queue.cc:260] T 86ab18af04f544ef8316b4caeaf781d2 P 5f009baf8a094da7a58d2a36ea888442 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:30:00.370756 1150 raft_consensus.cc:3058] T 86ab18af04f544ef8316b4caeaf781d2 P 5f009baf8a094da7a58d2a36ea888442 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:30:00.375381 1222 raft_consensus.cc:2466] T 86ab18af04f544ef8316b4caeaf781d2 P 90c988d9adde44879ef11b8aa6ef4da3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89a9444e93674a9d9e3d988af9c95a3e in term 2.
I20250625 03:30:00.376708 1041 leader_election.cc:304] T 86ab18af04f544ef8316b4caeaf781d2 P 89a9444e93674a9d9e3d988af9c95a3e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89a9444e93674a9d9e3d988af9c95a3e, 90c988d9adde44879ef11b8aa6ef4da3; no voters:
I20250625 03:30:00.377506 1302 raft_consensus.cc:2802] T 86ab18af04f544ef8316b4caeaf781d2 P 89a9444e93674a9d9e3d988af9c95a3e [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:30:00.377655 1150 raft_consensus.cc:2466] T 86ab18af04f544ef8316b4caeaf781d2 P 5f009baf8a094da7a58d2a36ea888442 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89a9444e93674a9d9e3d988af9c95a3e in term 2.
I20250625 03:30:00.377898 1302 raft_consensus.cc:695] T 86ab18af04f544ef8316b4caeaf781d2 P 89a9444e93674a9d9e3d988af9c95a3e [term 2 LEADER]: Becoming Leader. State: Replica: 89a9444e93674a9d9e3d988af9c95a3e, State: Running, Role: LEADER
I20250625 03:30:00.378647 1302 consensus_queue.cc:237] T 86ab18af04f544ef8316b4caeaf781d2 P 89a9444e93674a9d9e3d988af9c95a3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:30:00.384931 972 catalog_manager.cc:5582] T 86ab18af04f544ef8316b4caeaf781d2 P 89a9444e93674a9d9e3d988af9c95a3e reported cstate change: term changed from 1 to 2, leader changed from 5f009baf8a094da7a58d2a36ea888442 (127.0.106.130) to 89a9444e93674a9d9e3d988af9c95a3e (127.0.106.129). New cstate: current_term: 2 leader_uuid: "89a9444e93674a9d9e3d988af9c95a3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } health_report { overall_health: UNKNOWN } } }
I20250625 03:30:00.435832 1340 raft_consensus.cc:991] T 1d26f90c72ff4068ad7d0b002f4546cc P 90c988d9adde44879ef11b8aa6ef4da3: : Instructing follower 5f009baf8a094da7a58d2a36ea888442 to start an election
I20250625 03:30:00.436317 1340 raft_consensus.cc:1079] T 1d26f90c72ff4068ad7d0b002f4546cc P 90c988d9adde44879ef11b8aa6ef4da3 [term 1 LEADER]: Signalling peer 5f009baf8a094da7a58d2a36ea888442 to start an election
I20250625 03:30:00.436483 1306 raft_consensus.cc:991] T 513e577d0f2f4faea26726a7e8670a8d P 89a9444e93674a9d9e3d988af9c95a3e: : Instructing follower 90c988d9adde44879ef11b8aa6ef4da3 to start an election
I20250625 03:30:00.436995 1306 raft_consensus.cc:1079] T 513e577d0f2f4faea26726a7e8670a8d P 89a9444e93674a9d9e3d988af9c95a3e [term 1 LEADER]: Signalling peer 90c988d9adde44879ef11b8aa6ef4da3 to start an election
I20250625 03:30:00.437867 1150 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "1d26f90c72ff4068ad7d0b002f4546cc"
dest_uuid: "5f009baf8a094da7a58d2a36ea888442"
from {username='slave'} at 127.0.0.1:32952
I20250625 03:30:00.438422 1150 raft_consensus.cc:491] T 1d26f90c72ff4068ad7d0b002f4546cc P 5f009baf8a094da7a58d2a36ea888442 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:30:00.438467 1221 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "513e577d0f2f4faea26726a7e8670a8d"
dest_uuid: "90c988d9adde44879ef11b8aa6ef4da3"
from {username='slave'} at 127.0.0.1:50100
I20250625 03:30:00.438763 1150 raft_consensus.cc:3058] T 1d26f90c72ff4068ad7d0b002f4546cc P 5f009baf8a094da7a58d2a36ea888442 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:30:00.439043 1221 raft_consensus.cc:491] T 513e577d0f2f4faea26726a7e8670a8d P 90c988d9adde44879ef11b8aa6ef4da3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:30:00.439445 1221 raft_consensus.cc:3058] T 513e577d0f2f4faea26726a7e8670a8d P 90c988d9adde44879ef11b8aa6ef4da3 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:30:00.443472 1150 raft_consensus.cc:513] T 1d26f90c72ff4068ad7d0b002f4546cc P 5f009baf8a094da7a58d2a36ea888442 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:30:00.444267 1221 raft_consensus.cc:513] T 513e577d0f2f4faea26726a7e8670a8d P 90c988d9adde44879ef11b8aa6ef4da3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:30:00.445138 1150 leader_election.cc:290] T 1d26f90c72ff4068ad7d0b002f4546cc P 5f009baf8a094da7a58d2a36ea888442 [CANDIDATE]: Term 2 election: Requested vote from peers 89a9444e93674a9d9e3d988af9c95a3e (127.0.106.129:44675), 90c988d9adde44879ef11b8aa6ef4da3 (127.0.106.131:42281)
I20250625 03:30:00.445950 1074 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1d26f90c72ff4068ad7d0b002f4546cc" candidate_uuid: "5f009baf8a094da7a58d2a36ea888442" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89a9444e93674a9d9e3d988af9c95a3e"
I20250625 03:30:00.446206 1222 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1d26f90c72ff4068ad7d0b002f4546cc" candidate_uuid: "5f009baf8a094da7a58d2a36ea888442" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "90c988d9adde44879ef11b8aa6ef4da3"
I20250625 03:30:00.446543 1074 raft_consensus.cc:3058] T 1d26f90c72ff4068ad7d0b002f4546cc P 89a9444e93674a9d9e3d988af9c95a3e [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:30:00.446799 1222 raft_consensus.cc:3053] T 1d26f90c72ff4068ad7d0b002f4546cc P 90c988d9adde44879ef11b8aa6ef4da3 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:30:00.446893 1075 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "513e577d0f2f4faea26726a7e8670a8d" candidate_uuid: "90c988d9adde44879ef11b8aa6ef4da3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89a9444e93674a9d9e3d988af9c95a3e"
I20250625 03:30:00.447180 1222 raft_consensus.cc:738] T 1d26f90c72ff4068ad7d0b002f4546cc P 90c988d9adde44879ef11b8aa6ef4da3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 90c988d9adde44879ef11b8aa6ef4da3, State: Running, Role: LEADER
I20250625 03:30:00.447289 1221 leader_election.cc:290] T 513e577d0f2f4faea26726a7e8670a8d P 90c988d9adde44879ef11b8aa6ef4da3 [CANDIDATE]: Term 2 election: Requested vote from peers 89a9444e93674a9d9e3d988af9c95a3e (127.0.106.129:44675), 5f009baf8a094da7a58d2a36ea888442 (127.0.106.130:37441)
I20250625 03:30:00.447491 1075 raft_consensus.cc:3053] T 513e577d0f2f4faea26726a7e8670a8d P 89a9444e93674a9d9e3d988af9c95a3e [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:30:00.447825 1075 raft_consensus.cc:738] T 513e577d0f2f4faea26726a7e8670a8d P 89a9444e93674a9d9e3d988af9c95a3e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89a9444e93674a9d9e3d988af9c95a3e, State: Running, Role: LEADER
I20250625 03:30:00.448261 1150 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "513e577d0f2f4faea26726a7e8670a8d" candidate_uuid: "90c988d9adde44879ef11b8aa6ef4da3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f009baf8a094da7a58d2a36ea888442"
I20250625 03:30:00.448822 1150 raft_consensus.cc:3058] T 513e577d0f2f4faea26726a7e8670a8d P 5f009baf8a094da7a58d2a36ea888442 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:30:00.448596 1075 consensus_queue.cc:260] T 513e577d0f2f4faea26726a7e8670a8d P 89a9444e93674a9d9e3d988af9c95a3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:30:00.448623 1222 consensus_queue.cc:260] T 1d26f90c72ff4068ad7d0b002f4546cc P 90c988d9adde44879ef11b8aa6ef4da3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:30:00.449923 1075 raft_consensus.cc:3058] T 513e577d0f2f4faea26726a7e8670a8d P 89a9444e93674a9d9e3d988af9c95a3e [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:30:00.450459 1222 raft_consensus.cc:3058] T 1d26f90c72ff4068ad7d0b002f4546cc P 90c988d9adde44879ef11b8aa6ef4da3 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:30:00.453658 1074 raft_consensus.cc:2466] T 1d26f90c72ff4068ad7d0b002f4546cc P 89a9444e93674a9d9e3d988af9c95a3e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f009baf8a094da7a58d2a36ea888442 in term 2.
I20250625 03:30:00.454990 1114 leader_election.cc:304] T 1d26f90c72ff4068ad7d0b002f4546cc P 5f009baf8a094da7a58d2a36ea888442 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f009baf8a094da7a58d2a36ea888442, 89a9444e93674a9d9e3d988af9c95a3e; no voters:
I20250625 03:30:00.455906 1150 raft_consensus.cc:2466] T 513e577d0f2f4faea26726a7e8670a8d P 5f009baf8a094da7a58d2a36ea888442 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90c988d9adde44879ef11b8aa6ef4da3 in term 2.
I20250625 03:30:00.456110 1289 raft_consensus.cc:2802] T 1d26f90c72ff4068ad7d0b002f4546cc P 5f009baf8a094da7a58d2a36ea888442 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:30:00.456770 1289 raft_consensus.cc:695] T 1d26f90c72ff4068ad7d0b002f4546cc P 5f009baf8a094da7a58d2a36ea888442 [term 2 LEADER]: Becoming Leader. State: Replica: 5f009baf8a094da7a58d2a36ea888442, State: Running, Role: LEADER
I20250625 03:30:00.457194 1190 leader_election.cc:304] T 513e577d0f2f4faea26726a7e8670a8d P 90c988d9adde44879ef11b8aa6ef4da3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f009baf8a094da7a58d2a36ea888442, 90c988d9adde44879ef11b8aa6ef4da3; no voters:
I20250625 03:30:00.457538 1222 raft_consensus.cc:2466] T 1d26f90c72ff4068ad7d0b002f4546cc P 90c988d9adde44879ef11b8aa6ef4da3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f009baf8a094da7a58d2a36ea888442 in term 2.
I20250625 03:30:00.457175 1075 raft_consensus.cc:2466] T 513e577d0f2f4faea26726a7e8670a8d P 89a9444e93674a9d9e3d988af9c95a3e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90c988d9adde44879ef11b8aa6ef4da3 in term 2.
I20250625 03:30:00.458114 1340 raft_consensus.cc:2802] T 513e577d0f2f4faea26726a7e8670a8d P 90c988d9adde44879ef11b8aa6ef4da3 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:30:00.457669 1289 consensus_queue.cc:237] T 1d26f90c72ff4068ad7d0b002f4546cc P 5f009baf8a094da7a58d2a36ea888442 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:30:00.458613 1340 raft_consensus.cc:695] T 513e577d0f2f4faea26726a7e8670a8d P 90c988d9adde44879ef11b8aa6ef4da3 [term 2 LEADER]: Becoming Leader. State: Replica: 90c988d9adde44879ef11b8aa6ef4da3, State: Running, Role: LEADER
I20250625 03:30:00.459412 1340 consensus_queue.cc:237] T 513e577d0f2f4faea26726a7e8670a8d P 90c988d9adde44879ef11b8aa6ef4da3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:30:00.465480 972 catalog_manager.cc:5582] T 1d26f90c72ff4068ad7d0b002f4546cc P 5f009baf8a094da7a58d2a36ea888442 reported cstate change: term changed from 1 to 2, leader changed from 90c988d9adde44879ef11b8aa6ef4da3 (127.0.106.131) to 5f009baf8a094da7a58d2a36ea888442 (127.0.106.130). New cstate: current_term: 2 leader_uuid: "5f009baf8a094da7a58d2a36ea888442" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } health_report { overall_health: UNKNOWN } } }
I20250625 03:30:00.467180 973 catalog_manager.cc:5582] T 513e577d0f2f4faea26726a7e8670a8d P 90c988d9adde44879ef11b8aa6ef4da3 reported cstate change: term changed from 1 to 2, leader changed from 89a9444e93674a9d9e3d988af9c95a3e (127.0.106.129) to 90c988d9adde44879ef11b8aa6ef4da3 (127.0.106.131). New cstate: current_term: 2 leader_uuid: "90c988d9adde44879ef11b8aa6ef4da3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } health_report { overall_health: HEALTHY } } }
I20250625 03:30:00.495469 1340 consensus_queue.cc:1035] T 0ee874019a27479a94caf3275d914259 P 90c988d9adde44879ef11b8aa6ef4da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:30:00.501837 1307 raft_consensus.cc:991] T 0ee874019a27479a94caf3275d914259 P 90c988d9adde44879ef11b8aa6ef4da3: : Instructing follower 89a9444e93674a9d9e3d988af9c95a3e to start an election
I20250625 03:30:00.502259 1274 raft_consensus.cc:1079] T 0ee874019a27479a94caf3275d914259 P 90c988d9adde44879ef11b8aa6ef4da3 [term 1 LEADER]: Signalling peer 89a9444e93674a9d9e3d988af9c95a3e to start an election
I20250625 03:30:00.504519 1075 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "0ee874019a27479a94caf3275d914259"
dest_uuid: "89a9444e93674a9d9e3d988af9c95a3e"
from {username='slave'} at 127.0.0.1:60910
I20250625 03:30:00.506172 1075 raft_consensus.cc:491] T 0ee874019a27479a94caf3275d914259 P 89a9444e93674a9d9e3d988af9c95a3e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:30:00.506564 1075 raft_consensus.cc:3058] T 0ee874019a27479a94caf3275d914259 P 89a9444e93674a9d9e3d988af9c95a3e [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:30:00.506698 1340 consensus_queue.cc:1035] T 0ee874019a27479a94caf3275d914259 P 90c988d9adde44879ef11b8aa6ef4da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:30:00.514626 1075 raft_consensus.cc:513] T 0ee874019a27479a94caf3275d914259 P 89a9444e93674a9d9e3d988af9c95a3e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:30:00.518685 1075 leader_election.cc:290] T 0ee874019a27479a94caf3275d914259 P 89a9444e93674a9d9e3d988af9c95a3e [CANDIDATE]: Term 2 election: Requested vote from peers 5f009baf8a094da7a58d2a36ea888442 (127.0.106.130:37441), 90c988d9adde44879ef11b8aa6ef4da3 (127.0.106.131:42281)
I20250625 03:30:00.518611 1222 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0ee874019a27479a94caf3275d914259" candidate_uuid: "89a9444e93674a9d9e3d988af9c95a3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "90c988d9adde44879ef11b8aa6ef4da3"
I20250625 03:30:00.519309 1222 raft_consensus.cc:3053] T 0ee874019a27479a94caf3275d914259 P 90c988d9adde44879ef11b8aa6ef4da3 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:30:00.519678 1222 raft_consensus.cc:738] T 0ee874019a27479a94caf3275d914259 P 90c988d9adde44879ef11b8aa6ef4da3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 90c988d9adde44879ef11b8aa6ef4da3, State: Running, Role: LEADER
I20250625 03:30:00.518611 1150 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0ee874019a27479a94caf3275d914259" candidate_uuid: "89a9444e93674a9d9e3d988af9c95a3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f009baf8a094da7a58d2a36ea888442"
I20250625 03:30:00.520664 1150 raft_consensus.cc:3058] T 0ee874019a27479a94caf3275d914259 P 5f009baf8a094da7a58d2a36ea888442 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:30:00.520709 1222 consensus_queue.cc:260] T 0ee874019a27479a94caf3275d914259 P 90c988d9adde44879ef11b8aa6ef4da3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:30:00.522276 1222 raft_consensus.cc:3058] T 0ee874019a27479a94caf3275d914259 P 90c988d9adde44879ef11b8aa6ef4da3 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:30:00.522683 1271 raft_consensus.cc:991] T 6b62b2927d214886b92f502546868ca0 P 89a9444e93674a9d9e3d988af9c95a3e: : Instructing follower 5f009baf8a094da7a58d2a36ea888442 to start an election
I20250625 03:30:00.523106 1271 raft_consensus.cc:1079] T 6b62b2927d214886b92f502546868ca0 P 89a9444e93674a9d9e3d988af9c95a3e [term 1 LEADER]: Signalling peer 5f009baf8a094da7a58d2a36ea888442 to start an election
I20250625 03:30:00.526427 1289 raft_consensus.cc:991] T 27e1943c0c154ec68f7e0a75b39b1105 P 5f009baf8a094da7a58d2a36ea888442: : Instructing follower 89a9444e93674a9d9e3d988af9c95a3e to start an election
I20250625 03:30:00.526542 1149 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "6b62b2927d214886b92f502546868ca0"
dest_uuid: "5f009baf8a094da7a58d2a36ea888442"
from {username='slave'} at 127.0.0.1:32946
I20250625 03:30:00.527069 1289 raft_consensus.cc:1079] T 27e1943c0c154ec68f7e0a75b39b1105 P 5f009baf8a094da7a58d2a36ea888442 [term 1 LEADER]: Signalling peer 89a9444e93674a9d9e3d988af9c95a3e to start an election
I20250625 03:30:00.527122 1149 raft_consensus.cc:491] T 6b62b2927d214886b92f502546868ca0 P 5f009baf8a094da7a58d2a36ea888442 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:30:00.528187 1149 raft_consensus.cc:3058] T 6b62b2927d214886b92f502546868ca0 P 5f009baf8a094da7a58d2a36ea888442 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:30:00.528187 1150 raft_consensus.cc:2466] T 0ee874019a27479a94caf3275d914259 P 5f009baf8a094da7a58d2a36ea888442 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89a9444e93674a9d9e3d988af9c95a3e in term 2.
I20250625 03:30:00.529170 1222 raft_consensus.cc:2466] T 0ee874019a27479a94caf3275d914259 P 90c988d9adde44879ef11b8aa6ef4da3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89a9444e93674a9d9e3d988af9c95a3e in term 2.
I20250625 03:30:00.529601 1041 leader_election.cc:304] T 0ee874019a27479a94caf3275d914259 P 89a9444e93674a9d9e3d988af9c95a3e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f009baf8a094da7a58d2a36ea888442, 89a9444e93674a9d9e3d988af9c95a3e; no voters:
I20250625 03:30:00.530346 1271 raft_consensus.cc:2802] T 0ee874019a27479a94caf3275d914259 P 89a9444e93674a9d9e3d988af9c95a3e [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:30:00.530798 1271 raft_consensus.cc:695] T 0ee874019a27479a94caf3275d914259 P 89a9444e93674a9d9e3d988af9c95a3e [term 2 LEADER]: Becoming Leader. State: Replica: 89a9444e93674a9d9e3d988af9c95a3e, State: Running, Role: LEADER
I20250625 03:30:00.531821 1075 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "27e1943c0c154ec68f7e0a75b39b1105"
dest_uuid: "89a9444e93674a9d9e3d988af9c95a3e"
from {username='slave'} at 127.0.0.1:60904
I20250625 03:30:00.531719 1271 consensus_queue.cc:237] T 0ee874019a27479a94caf3275d914259 P 89a9444e93674a9d9e3d988af9c95a3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:30:00.532423 1075 raft_consensus.cc:491] T 27e1943c0c154ec68f7e0a75b39b1105 P 89a9444e93674a9d9e3d988af9c95a3e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:30:00.532824 1075 raft_consensus.cc:3058] T 27e1943c0c154ec68f7e0a75b39b1105 P 89a9444e93674a9d9e3d988af9c95a3e [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:30:00.536121 1149 raft_consensus.cc:513] T 6b62b2927d214886b92f502546868ca0 P 5f009baf8a094da7a58d2a36ea888442 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:30:00.539290 1222 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6b62b2927d214886b92f502546868ca0" candidate_uuid: "5f009baf8a094da7a58d2a36ea888442" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "90c988d9adde44879ef11b8aa6ef4da3"
I20250625 03:30:00.539332 1074 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6b62b2927d214886b92f502546868ca0" candidate_uuid: "5f009baf8a094da7a58d2a36ea888442" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89a9444e93674a9d9e3d988af9c95a3e"
I20250625 03:30:00.538612 973 catalog_manager.cc:5582] T 0ee874019a27479a94caf3275d914259 P 89a9444e93674a9d9e3d988af9c95a3e reported cstate change: term changed from 1 to 2, leader changed from 90c988d9adde44879ef11b8aa6ef4da3 (127.0.106.131) to 89a9444e93674a9d9e3d988af9c95a3e (127.0.106.129). New cstate: current_term: 2 leader_uuid: "89a9444e93674a9d9e3d988af9c95a3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } health_report { overall_health: UNKNOWN } } }
I20250625 03:30:00.539775 1149 leader_election.cc:290] T 6b62b2927d214886b92f502546868ca0 P 5f009baf8a094da7a58d2a36ea888442 [CANDIDATE]: Term 2 election: Requested vote from peers 89a9444e93674a9d9e3d988af9c95a3e (127.0.106.129:44675), 90c988d9adde44879ef11b8aa6ef4da3 (127.0.106.131:42281)
I20250625 03:30:00.540068 1074 raft_consensus.cc:3053] T 6b62b2927d214886b92f502546868ca0 P 89a9444e93674a9d9e3d988af9c95a3e [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:30:00.541236 1074 raft_consensus.cc:738] T 6b62b2927d214886b92f502546868ca0 P 89a9444e93674a9d9e3d988af9c95a3e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89a9444e93674a9d9e3d988af9c95a3e, State: Running, Role: LEADER
I20250625 03:30:00.541527 1340 consensus_queue.cc:1035] T bc9758463ec04a4b93042f29add1a1fd P 90c988d9adde44879ef11b8aa6ef4da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:30:00.543056 1075 raft_consensus.cc:513] T 27e1943c0c154ec68f7e0a75b39b1105 P 89a9444e93674a9d9e3d988af9c95a3e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:30:00.541962 1074 consensus_queue.cc:260] T 6b62b2927d214886b92f502546868ca0 P 89a9444e93674a9d9e3d988af9c95a3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:30:00.540199 1222 raft_consensus.cc:3058] T 6b62b2927d214886b92f502546868ca0 P 90c988d9adde44879ef11b8aa6ef4da3 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:30:00.545605 1074 raft_consensus.cc:3058] T 6b62b2927d214886b92f502546868ca0 P 89a9444e93674a9d9e3d988af9c95a3e [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:30:00.549533 1149 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "27e1943c0c154ec68f7e0a75b39b1105" candidate_uuid: "89a9444e93674a9d9e3d988af9c95a3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f009baf8a094da7a58d2a36ea888442"
I20250625 03:30:00.549840 1274 raft_consensus.cc:991] T bc9758463ec04a4b93042f29add1a1fd P 90c988d9adde44879ef11b8aa6ef4da3: : Instructing follower 89a9444e93674a9d9e3d988af9c95a3e to start an election
I20250625 03:30:00.550132 1149 raft_consensus.cc:3053] T 27e1943c0c154ec68f7e0a75b39b1105 P 5f009baf8a094da7a58d2a36ea888442 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:30:00.550287 1307 raft_consensus.cc:1079] T bc9758463ec04a4b93042f29add1a1fd P 90c988d9adde44879ef11b8aa6ef4da3 [term 1 LEADER]: Signalling peer 89a9444e93674a9d9e3d988af9c95a3e to start an election
I20250625 03:30:00.550472 1149 raft_consensus.cc:738] T 27e1943c0c154ec68f7e0a75b39b1105 P 5f009baf8a094da7a58d2a36ea888442 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5f009baf8a094da7a58d2a36ea888442, State: Running, Role: LEADER
I20250625 03:30:00.552630 1075 leader_election.cc:290] T 27e1943c0c154ec68f7e0a75b39b1105 P 89a9444e93674a9d9e3d988af9c95a3e [CANDIDATE]: Term 2 election: Requested vote from peers 5f009baf8a094da7a58d2a36ea888442 (127.0.106.130:37441), 90c988d9adde44879ef11b8aa6ef4da3 (127.0.106.131:42281)
I20250625 03:30:00.552712 1072 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "bc9758463ec04a4b93042f29add1a1fd"
dest_uuid: "89a9444e93674a9d9e3d988af9c95a3e"
from {username='slave'} at 127.0.0.1:60910
I20250625 03:30:00.553859 1149 consensus_queue.cc:260] T 27e1943c0c154ec68f7e0a75b39b1105 P 5f009baf8a094da7a58d2a36ea888442 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:30:00.555042 1149 raft_consensus.cc:3058] T 27e1943c0c154ec68f7e0a75b39b1105 P 5f009baf8a094da7a58d2a36ea888442 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:30:00.555239 1307 consensus_queue.cc:1035] T bc9758463ec04a4b93042f29add1a1fd P 90c988d9adde44879ef11b8aa6ef4da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:30:00.557482 1221 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "27e1943c0c154ec68f7e0a75b39b1105" candidate_uuid: "89a9444e93674a9d9e3d988af9c95a3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "90c988d9adde44879ef11b8aa6ef4da3"
I20250625 03:30:00.558060 1221 raft_consensus.cc:3058] T 27e1943c0c154ec68f7e0a75b39b1105 P 90c988d9adde44879ef11b8aa6ef4da3 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:30:00.559764 1074 raft_consensus.cc:2466] T 6b62b2927d214886b92f502546868ca0 P 89a9444e93674a9d9e3d988af9c95a3e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f009baf8a094da7a58d2a36ea888442 in term 2.
I20250625 03:30:00.561218 1114 leader_election.cc:304] T 6b62b2927d214886b92f502546868ca0 P 5f009baf8a094da7a58d2a36ea888442 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f009baf8a094da7a58d2a36ea888442, 89a9444e93674a9d9e3d988af9c95a3e; no voters:
I20250625 03:30:00.562224 1289 raft_consensus.cc:2802] T 6b62b2927d214886b92f502546868ca0 P 5f009baf8a094da7a58d2a36ea888442 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:30:00.562366 1149 raft_consensus.cc:2466] T 27e1943c0c154ec68f7e0a75b39b1105 P 5f009baf8a094da7a58d2a36ea888442 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89a9444e93674a9d9e3d988af9c95a3e in term 2.
I20250625 03:30:00.562789 1289 raft_consensus.cc:695] T 6b62b2927d214886b92f502546868ca0 P 5f009baf8a094da7a58d2a36ea888442 [term 2 LEADER]: Becoming Leader. State: Replica: 5f009baf8a094da7a58d2a36ea888442, State: Running, Role: LEADER
I20250625 03:30:00.563517 1041 leader_election.cc:304] T 27e1943c0c154ec68f7e0a75b39b1105 P 89a9444e93674a9d9e3d988af9c95a3e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f009baf8a094da7a58d2a36ea888442, 89a9444e93674a9d9e3d988af9c95a3e; no voters:
I20250625 03:30:00.563731 1289 consensus_queue.cc:237] T 6b62b2927d214886b92f502546868ca0 P 5f009baf8a094da7a58d2a36ea888442 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:30:00.564318 1271 raft_consensus.cc:2802] T 27e1943c0c154ec68f7e0a75b39b1105 P 89a9444e93674a9d9e3d988af9c95a3e [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:30:00.564770 1271 raft_consensus.cc:695] T 27e1943c0c154ec68f7e0a75b39b1105 P 89a9444e93674a9d9e3d988af9c95a3e [term 2 LEADER]: Becoming Leader. State: Replica: 89a9444e93674a9d9e3d988af9c95a3e, State: Running, Role: LEADER
I20250625 03:30:00.565538 1271 consensus_queue.cc:237] T 27e1943c0c154ec68f7e0a75b39b1105 P 89a9444e93674a9d9e3d988af9c95a3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:30:00.572916 1072 raft_consensus.cc:491] T bc9758463ec04a4b93042f29add1a1fd P 89a9444e93674a9d9e3d988af9c95a3e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:30:00.573383 1072 raft_consensus.cc:3058] T bc9758463ec04a4b93042f29add1a1fd P 89a9444e93674a9d9e3d988af9c95a3e [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:30:00.575688 973 catalog_manager.cc:5582] T 27e1943c0c154ec68f7e0a75b39b1105 P 89a9444e93674a9d9e3d988af9c95a3e reported cstate change: term changed from 1 to 2, leader changed from 5f009baf8a094da7a58d2a36ea888442 (127.0.106.130) to 89a9444e93674a9d9e3d988af9c95a3e (127.0.106.129). New cstate: current_term: 2 leader_uuid: "89a9444e93674a9d9e3d988af9c95a3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } health_report { overall_health: UNKNOWN } } }
I20250625 03:30:00.579690 1072 raft_consensus.cc:513] T bc9758463ec04a4b93042f29add1a1fd P 89a9444e93674a9d9e3d988af9c95a3e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:30:00.581321 1221 raft_consensus.cc:2466] T 27e1943c0c154ec68f7e0a75b39b1105 P 90c988d9adde44879ef11b8aa6ef4da3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89a9444e93674a9d9e3d988af9c95a3e in term 2.
I20250625 03:30:00.583765 972 catalog_manager.cc:5582] T 6b62b2927d214886b92f502546868ca0 P 5f009baf8a094da7a58d2a36ea888442 reported cstate change: term changed from 1 to 2, leader changed from 89a9444e93674a9d9e3d988af9c95a3e (127.0.106.129) to 5f009baf8a094da7a58d2a36ea888442 (127.0.106.130). New cstate: current_term: 2 leader_uuid: "5f009baf8a094da7a58d2a36ea888442" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } health_report { overall_health: UNKNOWN } } }
I20250625 03:30:00.584475 1222 raft_consensus.cc:2466] T 6b62b2927d214886b92f502546868ca0 P 90c988d9adde44879ef11b8aa6ef4da3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f009baf8a094da7a58d2a36ea888442 in term 2.
I20250625 03:30:00.586651 1072 leader_election.cc:290] T bc9758463ec04a4b93042f29add1a1fd P 89a9444e93674a9d9e3d988af9c95a3e [CANDIDATE]: Term 2 election: Requested vote from peers 5f009baf8a094da7a58d2a36ea888442 (127.0.106.130:37441), 90c988d9adde44879ef11b8aa6ef4da3 (127.0.106.131:42281)
I20250625 03:30:00.587361 1150 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bc9758463ec04a4b93042f29add1a1fd" candidate_uuid: "89a9444e93674a9d9e3d988af9c95a3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f009baf8a094da7a58d2a36ea888442"
I20250625 03:30:00.588328 1150 raft_consensus.cc:3058] T bc9758463ec04a4b93042f29add1a1fd P 5f009baf8a094da7a58d2a36ea888442 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:30:00.587669 1222 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bc9758463ec04a4b93042f29add1a1fd" candidate_uuid: "89a9444e93674a9d9e3d988af9c95a3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "90c988d9adde44879ef11b8aa6ef4da3"
I20250625 03:30:00.589422 1222 raft_consensus.cc:3053] T bc9758463ec04a4b93042f29add1a1fd P 90c988d9adde44879ef11b8aa6ef4da3 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:30:00.589754 1222 raft_consensus.cc:738] T bc9758463ec04a4b93042f29add1a1fd P 90c988d9adde44879ef11b8aa6ef4da3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 90c988d9adde44879ef11b8aa6ef4da3, State: Running, Role: LEADER
I20250625 03:30:00.590392 1222 consensus_queue.cc:260] T bc9758463ec04a4b93042f29add1a1fd P 90c988d9adde44879ef11b8aa6ef4da3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:30:00.591210 1222 raft_consensus.cc:3058] T bc9758463ec04a4b93042f29add1a1fd P 90c988d9adde44879ef11b8aa6ef4da3 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:30:00.595453 1150 raft_consensus.cc:2466] T bc9758463ec04a4b93042f29add1a1fd P 5f009baf8a094da7a58d2a36ea888442 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89a9444e93674a9d9e3d988af9c95a3e in term 2.
I20250625 03:30:00.596141 1222 raft_consensus.cc:2466] T bc9758463ec04a4b93042f29add1a1fd P 90c988d9adde44879ef11b8aa6ef4da3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89a9444e93674a9d9e3d988af9c95a3e in term 2.
I20250625 03:30:00.596500 1041 leader_election.cc:304] T bc9758463ec04a4b93042f29add1a1fd P 89a9444e93674a9d9e3d988af9c95a3e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f009baf8a094da7a58d2a36ea888442, 89a9444e93674a9d9e3d988af9c95a3e; no voters:
I20250625 03:30:00.597158 1271 raft_consensus.cc:2802] T bc9758463ec04a4b93042f29add1a1fd P 89a9444e93674a9d9e3d988af9c95a3e [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:30:00.597530 1271 raft_consensus.cc:695] T bc9758463ec04a4b93042f29add1a1fd P 89a9444e93674a9d9e3d988af9c95a3e [term 2 LEADER]: Becoming Leader. State: Replica: 89a9444e93674a9d9e3d988af9c95a3e, State: Running, Role: LEADER
I20250625 03:30:00.598182 1271 consensus_queue.cc:237] T bc9758463ec04a4b93042f29add1a1fd P 89a9444e93674a9d9e3d988af9c95a3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:30:00.604326 972 catalog_manager.cc:5582] T bc9758463ec04a4b93042f29add1a1fd P 89a9444e93674a9d9e3d988af9c95a3e reported cstate change: term changed from 1 to 2, leader changed from 90c988d9adde44879ef11b8aa6ef4da3 (127.0.106.131) to 89a9444e93674a9d9e3d988af9c95a3e (127.0.106.129). New cstate: current_term: 2 leader_uuid: "89a9444e93674a9d9e3d988af9c95a3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } health_report { overall_health: UNKNOWN } } }
I20250625 03:30:00.671481 1292 raft_consensus.cc:991] T b6138e286d7448baa149c4952eb2fd0c P 5f009baf8a094da7a58d2a36ea888442: : Instructing follower 89a9444e93674a9d9e3d988af9c95a3e to start an election
I20250625 03:30:00.671902 1289 raft_consensus.cc:1079] T b6138e286d7448baa149c4952eb2fd0c P 5f009baf8a094da7a58d2a36ea888442 [term 1 LEADER]: Signalling peer 89a9444e93674a9d9e3d988af9c95a3e to start an election
I20250625 03:30:00.673264 1072 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "b6138e286d7448baa149c4952eb2fd0c"
dest_uuid: "89a9444e93674a9d9e3d988af9c95a3e"
from {username='slave'} at 127.0.0.1:60904
I20250625 03:30:00.673833 1072 raft_consensus.cc:491] T b6138e286d7448baa149c4952eb2fd0c P 89a9444e93674a9d9e3d988af9c95a3e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:30:00.674119 1072 raft_consensus.cc:3058] T b6138e286d7448baa149c4952eb2fd0c P 89a9444e93674a9d9e3d988af9c95a3e [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:30:00.680872 1072 raft_consensus.cc:513] T b6138e286d7448baa149c4952eb2fd0c P 89a9444e93674a9d9e3d988af9c95a3e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } } peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } }
I20250625 03:30:00.682363 1072 leader_election.cc:290] T b6138e286d7448baa149c4952eb2fd0c P 89a9444e93674a9d9e3d988af9c95a3e [CANDIDATE]: Term 2 election: Requested vote from peers 90c988d9adde44879ef11b8aa6ef4da3 (127.0.106.131:42281), 5f009baf8a094da7a58d2a36ea888442 (127.0.106.130:37441)
I20250625 03:30:00.683246 1222 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b6138e286d7448baa149c4952eb2fd0c" candidate_uuid: "89a9444e93674a9d9e3d988af9c95a3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "90c988d9adde44879ef11b8aa6ef4da3"
I20250625 03:30:00.683509 1150 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b6138e286d7448baa149c4952eb2fd0c" candidate_uuid: "89a9444e93674a9d9e3d988af9c95a3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f009baf8a094da7a58d2a36ea888442"
I20250625 03:30:00.683846 1222 raft_consensus.cc:3058] T b6138e286d7448baa149c4952eb2fd0c P 90c988d9adde44879ef11b8aa6ef4da3 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:30:00.684057 1150 raft_consensus.cc:3053] T b6138e286d7448baa149c4952eb2fd0c P 5f009baf8a094da7a58d2a36ea888442 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:30:00.684401 1150 raft_consensus.cc:738] T b6138e286d7448baa149c4952eb2fd0c P 5f009baf8a094da7a58d2a36ea888442 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5f009baf8a094da7a58d2a36ea888442, State: Running, Role: LEADER
I20250625 03:30:00.685660 1150 consensus_queue.cc:260] T b6138e286d7448baa149c4952eb2fd0c P 5f009baf8a094da7a58d2a36ea888442 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } } peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } }
I20250625 03:30:00.686913 1150 raft_consensus.cc:3058] T b6138e286d7448baa149c4952eb2fd0c P 5f009baf8a094da7a58d2a36ea888442 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:30:00.690934 1222 raft_consensus.cc:2466] T b6138e286d7448baa149c4952eb2fd0c P 90c988d9adde44879ef11b8aa6ef4da3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89a9444e93674a9d9e3d988af9c95a3e in term 2.
I20250625 03:30:00.692062 1041 leader_election.cc:304] T b6138e286d7448baa149c4952eb2fd0c P 89a9444e93674a9d9e3d988af9c95a3e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89a9444e93674a9d9e3d988af9c95a3e, 90c988d9adde44879ef11b8aa6ef4da3; no voters:
I20250625 03:30:00.692698 1271 raft_consensus.cc:2802] T b6138e286d7448baa149c4952eb2fd0c P 89a9444e93674a9d9e3d988af9c95a3e [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:30:00.693063 1271 raft_consensus.cc:695] T b6138e286d7448baa149c4952eb2fd0c P 89a9444e93674a9d9e3d988af9c95a3e [term 2 LEADER]: Becoming Leader. State: Replica: 89a9444e93674a9d9e3d988af9c95a3e, State: Running, Role: LEADER
I20250625 03:30:00.693179 1150 raft_consensus.cc:2466] T b6138e286d7448baa149c4952eb2fd0c P 5f009baf8a094da7a58d2a36ea888442 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89a9444e93674a9d9e3d988af9c95a3e in term 2.
I20250625 03:30:00.693805 1271 consensus_queue.cc:237] T b6138e286d7448baa149c4952eb2fd0c P 89a9444e93674a9d9e3d988af9c95a3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } } peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } }
I20250625 03:30:00.699473 972 catalog_manager.cc:5582] T b6138e286d7448baa149c4952eb2fd0c P 89a9444e93674a9d9e3d988af9c95a3e reported cstate change: term changed from 1 to 2, leader changed from 5f009baf8a094da7a58d2a36ea888442 (127.0.106.130) to 89a9444e93674a9d9e3d988af9c95a3e (127.0.106.129). New cstate: current_term: 2 leader_uuid: "89a9444e93674a9d9e3d988af9c95a3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } health_report { overall_health: UNKNOWN } } }
I20250625 03:30:00.727475 1274 raft_consensus.cc:991] T 93d7b80866e64a77b925f730e300fe88 P 90c988d9adde44879ef11b8aa6ef4da3: : Instructing follower 5f009baf8a094da7a58d2a36ea888442 to start an election
I20250625 03:30:00.727878 1274 raft_consensus.cc:1079] T 93d7b80866e64a77b925f730e300fe88 P 90c988d9adde44879ef11b8aa6ef4da3 [term 1 LEADER]: Signalling peer 5f009baf8a094da7a58d2a36ea888442 to start an election
I20250625 03:30:00.729197 1150 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "93d7b80866e64a77b925f730e300fe88"
dest_uuid: "5f009baf8a094da7a58d2a36ea888442"
from {username='slave'} at 127.0.0.1:32952
I20250625 03:30:00.729653 1150 raft_consensus.cc:491] T 93d7b80866e64a77b925f730e300fe88 P 5f009baf8a094da7a58d2a36ea888442 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:30:00.729941 1150 raft_consensus.cc:3058] T 93d7b80866e64a77b925f730e300fe88 P 5f009baf8a094da7a58d2a36ea888442 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:30:00.734812 1150 raft_consensus.cc:513] T 93d7b80866e64a77b925f730e300fe88 P 5f009baf8a094da7a58d2a36ea888442 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:30:00.736792 1150 leader_election.cc:290] T 93d7b80866e64a77b925f730e300fe88 P 5f009baf8a094da7a58d2a36ea888442 [CANDIDATE]: Term 2 election: Requested vote from peers 89a9444e93674a9d9e3d988af9c95a3e (127.0.106.129:44675), 90c988d9adde44879ef11b8aa6ef4da3 (127.0.106.131:42281)
I20250625 03:30:00.737704 1072 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "93d7b80866e64a77b925f730e300fe88" candidate_uuid: "5f009baf8a094da7a58d2a36ea888442" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89a9444e93674a9d9e3d988af9c95a3e"
I20250625 03:30:00.737728 1222 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "93d7b80866e64a77b925f730e300fe88" candidate_uuid: "5f009baf8a094da7a58d2a36ea888442" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "90c988d9adde44879ef11b8aa6ef4da3"
I20250625 03:30:00.738466 1072 raft_consensus.cc:3058] T 93d7b80866e64a77b925f730e300fe88 P 89a9444e93674a9d9e3d988af9c95a3e [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:30:00.738487 1222 raft_consensus.cc:3053] T 93d7b80866e64a77b925f730e300fe88 P 90c988d9adde44879ef11b8aa6ef4da3 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:30:00.739164 1222 raft_consensus.cc:738] T 93d7b80866e64a77b925f730e300fe88 P 90c988d9adde44879ef11b8aa6ef4da3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 90c988d9adde44879ef11b8aa6ef4da3, State: Running, Role: LEADER
I20250625 03:30:00.740067 1222 consensus_queue.cc:260] T 93d7b80866e64a77b925f730e300fe88 P 90c988d9adde44879ef11b8aa6ef4da3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:30:00.741245 1222 raft_consensus.cc:3058] T 93d7b80866e64a77b925f730e300fe88 P 90c988d9adde44879ef11b8aa6ef4da3 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:30:00.745723 1072 raft_consensus.cc:2466] T 93d7b80866e64a77b925f730e300fe88 P 89a9444e93674a9d9e3d988af9c95a3e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f009baf8a094da7a58d2a36ea888442 in term 2.
I20250625 03:30:00.746851 1114 leader_election.cc:304] T 93d7b80866e64a77b925f730e300fe88 P 5f009baf8a094da7a58d2a36ea888442 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f009baf8a094da7a58d2a36ea888442, 89a9444e93674a9d9e3d988af9c95a3e; no voters:
I20250625 03:30:00.747619 1289 raft_consensus.cc:2802] T 93d7b80866e64a77b925f730e300fe88 P 5f009baf8a094da7a58d2a36ea888442 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:30:00.747869 1222 raft_consensus.cc:2466] T 93d7b80866e64a77b925f730e300fe88 P 90c988d9adde44879ef11b8aa6ef4da3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f009baf8a094da7a58d2a36ea888442 in term 2.
I20250625 03:30:00.748040 1289 raft_consensus.cc:695] T 93d7b80866e64a77b925f730e300fe88 P 5f009baf8a094da7a58d2a36ea888442 [term 2 LEADER]: Becoming Leader. State: Replica: 5f009baf8a094da7a58d2a36ea888442, State: Running, Role: LEADER
I20250625 03:30:00.748880 1289 consensus_queue.cc:237] T 93d7b80866e64a77b925f730e300fe88 P 5f009baf8a094da7a58d2a36ea888442 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:30:00.754813 972 catalog_manager.cc:5582] T 93d7b80866e64a77b925f730e300fe88 P 5f009baf8a094da7a58d2a36ea888442 reported cstate change: term changed from 1 to 2, leader changed from 90c988d9adde44879ef11b8aa6ef4da3 (127.0.106.131) to 5f009baf8a094da7a58d2a36ea888442 (127.0.106.130). New cstate: current_term: 2 leader_uuid: "5f009baf8a094da7a58d2a36ea888442" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } health_report { overall_health: UNKNOWN } } }
I20250625 03:30:00.801451 1072 raft_consensus.cc:1273] T 90089cf7177a4f67a5cc1bdfb9f179bd P 89a9444e93674a9d9e3d988af9c95a3e [term 2 FOLLOWER]: Refusing update from remote peer 5f009baf8a094da7a58d2a36ea888442: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:30:00.802685 1289 consensus_queue.cc:1035] T 90089cf7177a4f67a5cc1bdfb9f179bd P 5f009baf8a094da7a58d2a36ea888442 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:30:00.809834 1222 raft_consensus.cc:1273] T 90089cf7177a4f67a5cc1bdfb9f179bd P 90c988d9adde44879ef11b8aa6ef4da3 [term 2 FOLLOWER]: Refusing update from remote peer 5f009baf8a094da7a58d2a36ea888442: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:30:00.811586 1289 consensus_queue.cc:1035] T 90089cf7177a4f67a5cc1bdfb9f179bd P 5f009baf8a094da7a58d2a36ea888442 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:30:00.869346 1072 raft_consensus.cc:1273] T 1d26f90c72ff4068ad7d0b002f4546cc P 89a9444e93674a9d9e3d988af9c95a3e [term 2 FOLLOWER]: Refusing update from remote peer 5f009baf8a094da7a58d2a36ea888442: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:30:00.870697 1289 consensus_queue.cc:1035] T 1d26f90c72ff4068ad7d0b002f4546cc P 5f009baf8a094da7a58d2a36ea888442 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:30:00.879241 1222 raft_consensus.cc:1273] T 1d26f90c72ff4068ad7d0b002f4546cc P 90c988d9adde44879ef11b8aa6ef4da3 [term 2 FOLLOWER]: Refusing update from remote peer 5f009baf8a094da7a58d2a36ea888442: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:30:00.880786 1289 consensus_queue.cc:1035] T 1d26f90c72ff4068ad7d0b002f4546cc P 5f009baf8a094da7a58d2a36ea888442 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:30:00.892819 1150 raft_consensus.cc:1273] T 86ab18af04f544ef8316b4caeaf781d2 P 5f009baf8a094da7a58d2a36ea888442 [term 2 FOLLOWER]: Refusing update from remote peer 89a9444e93674a9d9e3d988af9c95a3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:30:00.893959 1271 consensus_queue.cc:1035] T 86ab18af04f544ef8316b4caeaf781d2 P 89a9444e93674a9d9e3d988af9c95a3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:30:00.901912 1222 raft_consensus.cc:1273] T 86ab18af04f544ef8316b4caeaf781d2 P 90c988d9adde44879ef11b8aa6ef4da3 [term 2 FOLLOWER]: Refusing update from remote peer 89a9444e93674a9d9e3d988af9c95a3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:30:00.903600 1304 consensus_queue.cc:1035] T 86ab18af04f544ef8316b4caeaf781d2 P 89a9444e93674a9d9e3d988af9c95a3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:30:00.974088 1222 raft_consensus.cc:1273] T 0ee874019a27479a94caf3275d914259 P 90c988d9adde44879ef11b8aa6ef4da3 [term 2 FOLLOWER]: Refusing update from remote peer 89a9444e93674a9d9e3d988af9c95a3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:30:00.975517 1304 consensus_queue.cc:1035] T 0ee874019a27479a94caf3275d914259 P 89a9444e93674a9d9e3d988af9c95a3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:30:00.982692 1150 raft_consensus.cc:1273] T 0ee874019a27479a94caf3275d914259 P 5f009baf8a094da7a58d2a36ea888442 [term 2 FOLLOWER]: Refusing update from remote peer 89a9444e93674a9d9e3d988af9c95a3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:30:00.984522 1271 consensus_queue.cc:1035] T 0ee874019a27479a94caf3275d914259 P 89a9444e93674a9d9e3d988af9c95a3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:30:00.992316 1222 raft_consensus.cc:1273] T 6b62b2927d214886b92f502546868ca0 P 90c988d9adde44879ef11b8aa6ef4da3 [term 2 FOLLOWER]: Refusing update from remote peer 5f009baf8a094da7a58d2a36ea888442: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:30:00.993343 1289 consensus_queue.cc:1035] T 6b62b2927d214886b92f502546868ca0 P 5f009baf8a094da7a58d2a36ea888442 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:30:01.001724 1072 raft_consensus.cc:1273] T 6b62b2927d214886b92f502546868ca0 P 89a9444e93674a9d9e3d988af9c95a3e [term 2 FOLLOWER]: Refusing update from remote peer 5f009baf8a094da7a58d2a36ea888442: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:30:01.003810 1289 consensus_queue.cc:1035] T 6b62b2927d214886b92f502546868ca0 P 5f009baf8a094da7a58d2a36ea888442 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:30:01.042424 1150 raft_consensus.cc:1273] T bc9758463ec04a4b93042f29add1a1fd P 5f009baf8a094da7a58d2a36ea888442 [term 2 FOLLOWER]: Refusing update from remote peer 89a9444e93674a9d9e3d988af9c95a3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:30:01.043675 1271 consensus_queue.cc:1035] T bc9758463ec04a4b93042f29add1a1fd P 89a9444e93674a9d9e3d988af9c95a3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:30:01.050817 1222 raft_consensus.cc:1273] T bc9758463ec04a4b93042f29add1a1fd P 90c988d9adde44879ef11b8aa6ef4da3 [term 2 FOLLOWER]: Refusing update from remote peer 89a9444e93674a9d9e3d988af9c95a3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:30:01.052232 1304 consensus_queue.cc:1035] T bc9758463ec04a4b93042f29add1a1fd P 89a9444e93674a9d9e3d988af9c95a3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:30:01.057109 1150 raft_consensus.cc:1273] T 27e1943c0c154ec68f7e0a75b39b1105 P 5f009baf8a094da7a58d2a36ea888442 [term 2 FOLLOWER]: Refusing update from remote peer 89a9444e93674a9d9e3d988af9c95a3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:30:01.058768 1271 consensus_queue.cc:1035] T 27e1943c0c154ec68f7e0a75b39b1105 P 89a9444e93674a9d9e3d988af9c95a3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:30:01.070458 1222 raft_consensus.cc:1273] T 27e1943c0c154ec68f7e0a75b39b1105 P 90c988d9adde44879ef11b8aa6ef4da3 [term 2 FOLLOWER]: Refusing update from remote peer 89a9444e93674a9d9e3d988af9c95a3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:30:01.071631 1306 consensus_queue.cc:1035] T 27e1943c0c154ec68f7e0a75b39b1105 P 89a9444e93674a9d9e3d988af9c95a3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:30:01.075763 1150 raft_consensus.cc:1273] T 513e577d0f2f4faea26726a7e8670a8d P 5f009baf8a094da7a58d2a36ea888442 [term 2 FOLLOWER]: Refusing update from remote peer 90c988d9adde44879ef11b8aa6ef4da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:30:01.077188 1274 consensus_queue.cc:1035] T 513e577d0f2f4faea26726a7e8670a8d P 90c988d9adde44879ef11b8aa6ef4da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:30:01.082525 1072 raft_consensus.cc:1273] T 513e577d0f2f4faea26726a7e8670a8d P 89a9444e93674a9d9e3d988af9c95a3e [term 2 FOLLOWER]: Refusing update from remote peer 90c988d9adde44879ef11b8aa6ef4da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:30:01.084488 1307 consensus_queue.cc:1035] T 513e577d0f2f4faea26726a7e8670a8d P 90c988d9adde44879ef11b8aa6ef4da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:30:01.097301 1150 raft_consensus.cc:1273] T b6138e286d7448baa149c4952eb2fd0c P 5f009baf8a094da7a58d2a36ea888442 [term 2 FOLLOWER]: Refusing update from remote peer 89a9444e93674a9d9e3d988af9c95a3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:30:01.098527 1306 consensus_queue.cc:1035] T b6138e286d7448baa149c4952eb2fd0c P 89a9444e93674a9d9e3d988af9c95a3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:30:01.109706 1222 raft_consensus.cc:1273] T b6138e286d7448baa149c4952eb2fd0c P 90c988d9adde44879ef11b8aa6ef4da3 [term 2 FOLLOWER]: Refusing update from remote peer 89a9444e93674a9d9e3d988af9c95a3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:30:01.111400 1302 consensus_queue.cc:1035] T b6138e286d7448baa149c4952eb2fd0c P 89a9444e93674a9d9e3d988af9c95a3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:30:01.162935 1222 raft_consensus.cc:1273] T 93d7b80866e64a77b925f730e300fe88 P 90c988d9adde44879ef11b8aa6ef4da3 [term 2 FOLLOWER]: Refusing update from remote peer 5f009baf8a094da7a58d2a36ea888442: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:30:01.164001 1289 consensus_queue.cc:1035] T 93d7b80866e64a77b925f730e300fe88 P 5f009baf8a094da7a58d2a36ea888442 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:30:01.172622 1072 raft_consensus.cc:1273] T 93d7b80866e64a77b925f730e300fe88 P 89a9444e93674a9d9e3d988af9c95a3e [term 2 FOLLOWER]: Refusing update from remote peer 5f009baf8a094da7a58d2a36ea888442: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:30:01.174495 1270 consensus_queue.cc:1035] T 93d7b80866e64a77b925f730e300fe88 P 5f009baf8a094da7a58d2a36ea888442 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20250625 03:30:02.485288 1096 debug-util.cc:398] Leaking SignalData structure 0x7b0800195be0 after lost signal to thread 429
W20250625 03:30:02.485981 1096 debug-util.cc:398] Leaking SignalData structure 0x7b0800147f20 after lost signal to thread 1007
W20250625 03:30:02.486707 1096 debug-util.cc:398] Leaking SignalData structure 0x7b08000482a0 after lost signal to thread 1099
W20250625 03:30:02.487341 1096 debug-util.cc:398] Leaking SignalData structure 0x7b08000966e0 after lost signal to thread 1174
W20250625 03:30:02.487964 1096 debug-util.cc:398] Leaking SignalData structure 0x7b080009e580 after lost signal to thread 1248
I20250625 03:30:03.395236 426 auto_leader_rebalancer-test.cc:343] The leader distribution is
I20250625 03:30:03.395856 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:30:03.411028 1072 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "0ee874019a27479a94caf3275d914259"
dest_uuid: "89a9444e93674a9d9e3d988af9c95a3e"
mode: GRACEFUL
new_leader_uuid: "90c988d9adde44879ef11b8aa6ef4da3"
from {username='slave'} at 127.0.0.1:60934
I20250625 03:30:03.411509 1072 raft_consensus.cc:604] T 0ee874019a27479a94caf3275d914259 P 89a9444e93674a9d9e3d988af9c95a3e [term 2 LEADER]: Received request to transfer leadership to TS 90c988d9adde44879ef11b8aa6ef4da3
I20250625 03:30:03.413658 1072 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "bc9758463ec04a4b93042f29add1a1fd"
dest_uuid: "89a9444e93674a9d9e3d988af9c95a3e"
mode: GRACEFUL
new_leader_uuid: "90c988d9adde44879ef11b8aa6ef4da3"
from {username='slave'} at 127.0.0.1:60934
I20250625 03:30:03.414127 1072 raft_consensus.cc:604] T bc9758463ec04a4b93042f29add1a1fd P 89a9444e93674a9d9e3d988af9c95a3e [term 2 LEADER]: Received request to transfer leadership to TS 90c988d9adde44879ef11b8aa6ef4da3
I20250625 03:30:03.414968 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20250625 03:30:03.415356 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:30:03.444640 1304 raft_consensus.cc:991] T 0ee874019a27479a94caf3275d914259 P 89a9444e93674a9d9e3d988af9c95a3e: : Instructing follower 90c988d9adde44879ef11b8aa6ef4da3 to start an election
I20250625 03:30:03.445055 1304 raft_consensus.cc:1079] T 0ee874019a27479a94caf3275d914259 P 89a9444e93674a9d9e3d988af9c95a3e [term 2 LEADER]: Signalling peer 90c988d9adde44879ef11b8aa6ef4da3 to start an election
I20250625 03:30:03.446374 1221 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "0ee874019a27479a94caf3275d914259"
dest_uuid: "90c988d9adde44879ef11b8aa6ef4da3"
from {username='slave'} at 127.0.0.1:50100
I20250625 03:30:03.446815 1221 raft_consensus.cc:491] T 0ee874019a27479a94caf3275d914259 P 90c988d9adde44879ef11b8aa6ef4da3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:30:03.447084 1221 raft_consensus.cc:3058] T 0ee874019a27479a94caf3275d914259 P 90c988d9adde44879ef11b8aa6ef4da3 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:30:03.453449 1221 raft_consensus.cc:513] T 0ee874019a27479a94caf3275d914259 P 90c988d9adde44879ef11b8aa6ef4da3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:30:03.455248 1221 leader_election.cc:290] T 0ee874019a27479a94caf3275d914259 P 90c988d9adde44879ef11b8aa6ef4da3 [CANDIDATE]: Term 3 election: Requested vote from peers 89a9444e93674a9d9e3d988af9c95a3e (127.0.106.129:44675), 5f009baf8a094da7a58d2a36ea888442 (127.0.106.130:37441)
I20250625 03:30:03.455669 1072 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0ee874019a27479a94caf3275d914259" candidate_uuid: "90c988d9adde44879ef11b8aa6ef4da3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "89a9444e93674a9d9e3d988af9c95a3e"
I20250625 03:30:03.455850 1150 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0ee874019a27479a94caf3275d914259" candidate_uuid: "90c988d9adde44879ef11b8aa6ef4da3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5f009baf8a094da7a58d2a36ea888442"
I20250625 03:30:03.456326 1072 raft_consensus.cc:3053] T 0ee874019a27479a94caf3275d914259 P 89a9444e93674a9d9e3d988af9c95a3e [term 2 LEADER]: Stepping down as leader of term 2
I20250625 03:30:03.456399 1150 raft_consensus.cc:3058] T 0ee874019a27479a94caf3275d914259 P 5f009baf8a094da7a58d2a36ea888442 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:30:03.456758 1072 raft_consensus.cc:738] T 0ee874019a27479a94caf3275d914259 P 89a9444e93674a9d9e3d988af9c95a3e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 89a9444e93674a9d9e3d988af9c95a3e, State: Running, Role: LEADER
I20250625 03:30:03.457585 1072 consensus_queue.cc:260] T 0ee874019a27479a94caf3275d914259 P 89a9444e93674a9d9e3d988af9c95a3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:30:03.458868 1072 raft_consensus.cc:3058] T 0ee874019a27479a94caf3275d914259 P 89a9444e93674a9d9e3d988af9c95a3e [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:30:03.460608 1150 raft_consensus.cc:2466] T 0ee874019a27479a94caf3275d914259 P 5f009baf8a094da7a58d2a36ea888442 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90c988d9adde44879ef11b8aa6ef4da3 in term 3.
I20250625 03:30:03.461598 1190 leader_election.cc:304] T 0ee874019a27479a94caf3275d914259 P 90c988d9adde44879ef11b8aa6ef4da3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f009baf8a094da7a58d2a36ea888442, 90c988d9adde44879ef11b8aa6ef4da3; no voters:
I20250625 03:30:03.462488 1367 raft_consensus.cc:2802] T 0ee874019a27479a94caf3275d914259 P 90c988d9adde44879ef11b8aa6ef4da3 [term 3 FOLLOWER]: Leader election won for term 3
I20250625 03:30:03.463811 1367 raft_consensus.cc:695] T 0ee874019a27479a94caf3275d914259 P 90c988d9adde44879ef11b8aa6ef4da3 [term 3 LEADER]: Becoming Leader. State: Replica: 90c988d9adde44879ef11b8aa6ef4da3, State: Running, Role: LEADER
I20250625 03:30:03.464639 1367 consensus_queue.cc:237] T 0ee874019a27479a94caf3275d914259 P 90c988d9adde44879ef11b8aa6ef4da3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:30:03.469028 1072 raft_consensus.cc:2466] T 0ee874019a27479a94caf3275d914259 P 89a9444e93674a9d9e3d988af9c95a3e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90c988d9adde44879ef11b8aa6ef4da3 in term 3.
I20250625 03:30:03.474707 972 catalog_manager.cc:5582] T 0ee874019a27479a94caf3275d914259 P 90c988d9adde44879ef11b8aa6ef4da3 reported cstate change: term changed from 2 to 3, leader changed from 89a9444e93674a9d9e3d988af9c95a3e (127.0.106.129) to 90c988d9adde44879ef11b8aa6ef4da3 (127.0.106.131). New cstate: current_term: 3 leader_uuid: "90c988d9adde44879ef11b8aa6ef4da3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } health_report { overall_health: HEALTHY } } }
I20250625 03:30:03.748924 1368 raft_consensus.cc:991] T bc9758463ec04a4b93042f29add1a1fd P 89a9444e93674a9d9e3d988af9c95a3e: : Instructing follower 90c988d9adde44879ef11b8aa6ef4da3 to start an election
I20250625 03:30:03.749349 1304 raft_consensus.cc:1079] T bc9758463ec04a4b93042f29add1a1fd P 89a9444e93674a9d9e3d988af9c95a3e [term 2 LEADER]: Signalling peer 90c988d9adde44879ef11b8aa6ef4da3 to start an election
I20250625 03:30:03.750828 1221 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "bc9758463ec04a4b93042f29add1a1fd"
dest_uuid: "90c988d9adde44879ef11b8aa6ef4da3"
from {username='slave'} at 127.0.0.1:50100
I20250625 03:30:03.751431 1221 raft_consensus.cc:491] T bc9758463ec04a4b93042f29add1a1fd P 90c988d9adde44879ef11b8aa6ef4da3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:30:03.751801 1221 raft_consensus.cc:3058] T bc9758463ec04a4b93042f29add1a1fd P 90c988d9adde44879ef11b8aa6ef4da3 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:30:03.759452 1221 raft_consensus.cc:513] T bc9758463ec04a4b93042f29add1a1fd P 90c988d9adde44879ef11b8aa6ef4da3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:30:03.761536 1221 leader_election.cc:290] T bc9758463ec04a4b93042f29add1a1fd P 90c988d9adde44879ef11b8aa6ef4da3 [CANDIDATE]: Term 3 election: Requested vote from peers 89a9444e93674a9d9e3d988af9c95a3e (127.0.106.129:44675), 5f009baf8a094da7a58d2a36ea888442 (127.0.106.130:37441)
I20250625 03:30:03.762729 1150 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bc9758463ec04a4b93042f29add1a1fd" candidate_uuid: "90c988d9adde44879ef11b8aa6ef4da3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5f009baf8a094da7a58d2a36ea888442"
I20250625 03:30:03.762729 1072 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bc9758463ec04a4b93042f29add1a1fd" candidate_uuid: "90c988d9adde44879ef11b8aa6ef4da3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "89a9444e93674a9d9e3d988af9c95a3e"
I20250625 03:30:03.763417 1150 raft_consensus.cc:3058] T bc9758463ec04a4b93042f29add1a1fd P 5f009baf8a094da7a58d2a36ea888442 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:30:03.763501 1072 raft_consensus.cc:3053] T bc9758463ec04a4b93042f29add1a1fd P 89a9444e93674a9d9e3d988af9c95a3e [term 2 LEADER]: Stepping down as leader of term 2
I20250625 03:30:03.763878 1072 raft_consensus.cc:738] T bc9758463ec04a4b93042f29add1a1fd P 89a9444e93674a9d9e3d988af9c95a3e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 89a9444e93674a9d9e3d988af9c95a3e, State: Running, Role: LEADER
I20250625 03:30:03.764665 1072 consensus_queue.cc:260] T bc9758463ec04a4b93042f29add1a1fd P 89a9444e93674a9d9e3d988af9c95a3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:30:03.765830 1072 raft_consensus.cc:3058] T bc9758463ec04a4b93042f29add1a1fd P 89a9444e93674a9d9e3d988af9c95a3e [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:30:03.770044 1150 raft_consensus.cc:2466] T bc9758463ec04a4b93042f29add1a1fd P 5f009baf8a094da7a58d2a36ea888442 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90c988d9adde44879ef11b8aa6ef4da3 in term 3.
I20250625 03:30:03.771139 1190 leader_election.cc:304] T bc9758463ec04a4b93042f29add1a1fd P 90c988d9adde44879ef11b8aa6ef4da3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f009baf8a094da7a58d2a36ea888442, 90c988d9adde44879ef11b8aa6ef4da3; no voters:
I20250625 03:30:03.771934 1367 raft_consensus.cc:2802] T bc9758463ec04a4b93042f29add1a1fd P 90c988d9adde44879ef11b8aa6ef4da3 [term 3 FOLLOWER]: Leader election won for term 3
I20250625 03:30:03.772449 1072 raft_consensus.cc:2466] T bc9758463ec04a4b93042f29add1a1fd P 89a9444e93674a9d9e3d988af9c95a3e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90c988d9adde44879ef11b8aa6ef4da3 in term 3.
I20250625 03:30:03.772477 1367 raft_consensus.cc:695] T bc9758463ec04a4b93042f29add1a1fd P 90c988d9adde44879ef11b8aa6ef4da3 [term 3 LEADER]: Becoming Leader. State: Replica: 90c988d9adde44879ef11b8aa6ef4da3, State: Running, Role: LEADER
I20250625 03:30:03.773660 1367 consensus_queue.cc:237] T bc9758463ec04a4b93042f29add1a1fd P 90c988d9adde44879ef11b8aa6ef4da3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:30:03.784737 972 catalog_manager.cc:5582] T bc9758463ec04a4b93042f29add1a1fd P 90c988d9adde44879ef11b8aa6ef4da3 reported cstate change: term changed from 2 to 3, leader changed from 89a9444e93674a9d9e3d988af9c95a3e (127.0.106.129) to 90c988d9adde44879ef11b8aa6ef4da3 (127.0.106.131). New cstate: current_term: 3 leader_uuid: "90c988d9adde44879ef11b8aa6ef4da3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } health_report { overall_health: HEALTHY } } }
I20250625 03:30:03.902884 1150 raft_consensus.cc:1273] T 0ee874019a27479a94caf3275d914259 P 5f009baf8a094da7a58d2a36ea888442 [term 3 FOLLOWER]: Refusing update from remote peer 90c988d9adde44879ef11b8aa6ef4da3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250625 03:30:03.903951 1367 consensus_queue.cc:1035] T 0ee874019a27479a94caf3275d914259 P 90c988d9adde44879ef11b8aa6ef4da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:30:03.917825 1072 raft_consensus.cc:1273] T 0ee874019a27479a94caf3275d914259 P 89a9444e93674a9d9e3d988af9c95a3e [term 3 FOLLOWER]: Refusing update from remote peer 90c988d9adde44879ef11b8aa6ef4da3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250625 03:30:03.919886 1371 consensus_queue.cc:1035] T 0ee874019a27479a94caf3275d914259 P 90c988d9adde44879ef11b8aa6ef4da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20250625 03:30:04.164899 1072 raft_consensus.cc:1273] T bc9758463ec04a4b93042f29add1a1fd P 89a9444e93674a9d9e3d988af9c95a3e [term 3 FOLLOWER]: Refusing update from remote peer 90c988d9adde44879ef11b8aa6ef4da3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250625 03:30:04.166412 1367 consensus_queue.cc:1035] T bc9758463ec04a4b93042f29add1a1fd P 90c988d9adde44879ef11b8aa6ef4da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:30:04.176455 1150 raft_consensus.cc:1273] T bc9758463ec04a4b93042f29add1a1fd P 5f009baf8a094da7a58d2a36ea888442 [term 3 FOLLOWER]: Refusing update from remote peer 90c988d9adde44879ef11b8aa6ef4da3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250625 03:30:04.179190 1367 consensus_queue.cc:1035] T bc9758463ec04a4b93042f29add1a1fd P 90c988d9adde44879ef11b8aa6ef4da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:30:04.416263 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:30:04.421736 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250625 03:30:04.422155 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:30:05.487906 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:30:05.493728 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250625 03:30:05.494094 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
W20250625 03:30:05.944507 1096 debug-util.cc:398] Leaking SignalData structure 0x7b080008b600 after lost signal to thread 429
W20250625 03:30:05.945181 1096 debug-util.cc:398] Leaking SignalData structure 0x7b080013a580 after lost signal to thread 1007
W20250625 03:30:05.945853 1096 debug-util.cc:398] Leaking SignalData structure 0x7b0800147fa0 after lost signal to thread 1099
W20250625 03:30:05.946455 1096 debug-util.cc:398] Leaking SignalData structure 0x7b080014dec0 after lost signal to thread 1174
W20250625 03:30:05.947044 1096 debug-util.cc:398] Leaking SignalData structure 0x7b08001e4480 after lost signal to thread 1248
I20250625 03:30:06.552867 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:30:06.558286 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250625 03:30:06.558751 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
W20250625 03:30:07.152946 1096 debug-util.cc:398] Leaking SignalData structure 0x7b08001ac680 after lost signal to thread 429
W20250625 03:30:07.154029 1096 debug-util.cc:398] Leaking SignalData structure 0x7b08001a6580 after lost signal to thread 1007
W20250625 03:30:07.154989 1096 debug-util.cc:398] Leaking SignalData structure 0x7b0800155d80 after lost signal to thread 1099
W20250625 03:30:07.156589 1096 debug-util.cc:398] Leaking SignalData structure 0x7b08000ce3c0 after lost signal to thread 1174
W20250625 03:30:07.157804 1096 debug-util.cc:398] Leaking SignalData structure 0x7b0800197480 after lost signal to thread 1248
I20250625 03:30:07.559856 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:30:07.565105 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250625 03:30:07.565550 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:30:08.566568 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:30:08.572795 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250625 03:30:08.573253 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:30:09.574091 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:30:09.579533 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250625 03:30:09.579936 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:30:10.580824 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:30:10.586088 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250625 03:30:10.586506 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:30:11.587338 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:30:11.592540 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250625 03:30:11.592958 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:30:12.593839 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:30:12.598982 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250625 03:30:12.599413 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:30:13.629334 426 auto_leader_rebalancer-test.cc:362] The leader distribution is
I20250625 03:30:13.635731 1222 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "bc9758463ec04a4b93042f29add1a1fd"
dest_uuid: "90c988d9adde44879ef11b8aa6ef4da3"
mode: GRACEFUL
new_leader_uuid: "89a9444e93674a9d9e3d988af9c95a3e"
from {username='slave'} at 127.0.0.1:50114
I20250625 03:30:13.636404 1222 raft_consensus.cc:604] T bc9758463ec04a4b93042f29add1a1fd P 90c988d9adde44879ef11b8aa6ef4da3 [term 3 LEADER]: Received request to transfer leadership to TS 89a9444e93674a9d9e3d988af9c95a3e
I20250625 03:30:13.642982 1222 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "0ee874019a27479a94caf3275d914259"
dest_uuid: "90c988d9adde44879ef11b8aa6ef4da3"
mode: GRACEFUL
new_leader_uuid: "89a9444e93674a9d9e3d988af9c95a3e"
from {username='slave'} at 127.0.0.1:50114
I20250625 03:30:13.643428 1222 raft_consensus.cc:604] T 0ee874019a27479a94caf3275d914259 P 90c988d9adde44879ef11b8aa6ef4da3 [term 3 LEADER]: Received request to transfer leadership to TS 89a9444e93674a9d9e3d988af9c95a3e
I20250625 03:30:13.649783 1149 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "6b62b2927d214886b92f502546868ca0"
dest_uuid: "5f009baf8a094da7a58d2a36ea888442"
mode: GRACEFUL
new_leader_uuid: "89a9444e93674a9d9e3d988af9c95a3e"
from {username='slave'} at 127.0.0.1:32960
I20250625 03:30:13.650256 1149 raft_consensus.cc:604] T 6b62b2927d214886b92f502546868ca0 P 5f009baf8a094da7a58d2a36ea888442 [term 2 LEADER]: Received request to transfer leadership to TS 89a9444e93674a9d9e3d988af9c95a3e
I20250625 03:30:13.654625 1149 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "1d26f90c72ff4068ad7d0b002f4546cc"
dest_uuid: "5f009baf8a094da7a58d2a36ea888442"
mode: GRACEFUL
new_leader_uuid: "89a9444e93674a9d9e3d988af9c95a3e"
from {username='slave'} at 127.0.0.1:32960
I20250625 03:30:13.655071 1149 raft_consensus.cc:604] T 1d26f90c72ff4068ad7d0b002f4546cc P 5f009baf8a094da7a58d2a36ea888442 [term 2 LEADER]: Received request to transfer leadership to TS 89a9444e93674a9d9e3d988af9c95a3e
I20250625 03:30:13.659126 1149 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "93d7b80866e64a77b925f730e300fe88"
dest_uuid: "5f009baf8a094da7a58d2a36ea888442"
mode: GRACEFUL
new_leader_uuid: "89a9444e93674a9d9e3d988af9c95a3e"
from {username='slave'} at 127.0.0.1:32960
I20250625 03:30:13.659565 1149 raft_consensus.cc:604] T 93d7b80866e64a77b925f730e300fe88 P 5f009baf8a094da7a58d2a36ea888442 [term 2 LEADER]: Received request to transfer leadership to TS 89a9444e93674a9d9e3d988af9c95a3e
I20250625 03:30:13.665515 1403 raft_consensus.cc:991] T 1d26f90c72ff4068ad7d0b002f4546cc P 5f009baf8a094da7a58d2a36ea888442: : Instructing follower 89a9444e93674a9d9e3d988af9c95a3e to start an election
I20250625 03:30:13.666092 1397 raft_consensus.cc:1079] T 1d26f90c72ff4068ad7d0b002f4546cc P 5f009baf8a094da7a58d2a36ea888442 [term 2 LEADER]: Signalling peer 89a9444e93674a9d9e3d988af9c95a3e to start an election
I20250625 03:30:13.667490 1072 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "1d26f90c72ff4068ad7d0b002f4546cc"
dest_uuid: "89a9444e93674a9d9e3d988af9c95a3e"
from {username='slave'} at 127.0.0.1:60904
I20250625 03:30:13.667901 1072 raft_consensus.cc:491] T 1d26f90c72ff4068ad7d0b002f4546cc P 89a9444e93674a9d9e3d988af9c95a3e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:30:13.668251 1072 raft_consensus.cc:3058] T 1d26f90c72ff4068ad7d0b002f4546cc P 89a9444e93674a9d9e3d988af9c95a3e [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:30:13.673272 1072 raft_consensus.cc:513] T 1d26f90c72ff4068ad7d0b002f4546cc P 89a9444e93674a9d9e3d988af9c95a3e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:30:13.674818 1072 leader_election.cc:290] T 1d26f90c72ff4068ad7d0b002f4546cc P 89a9444e93674a9d9e3d988af9c95a3e [CANDIDATE]: Term 3 election: Requested vote from peers 5f009baf8a094da7a58d2a36ea888442 (127.0.106.130:37441), 90c988d9adde44879ef11b8aa6ef4da3 (127.0.106.131:42281)
I20250625 03:30:13.675628 1149 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1d26f90c72ff4068ad7d0b002f4546cc" candidate_uuid: "89a9444e93674a9d9e3d988af9c95a3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5f009baf8a094da7a58d2a36ea888442"
I20250625 03:30:13.675873 1222 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1d26f90c72ff4068ad7d0b002f4546cc" candidate_uuid: "89a9444e93674a9d9e3d988af9c95a3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "90c988d9adde44879ef11b8aa6ef4da3"
I20250625 03:30:13.676388 1222 raft_consensus.cc:3058] T 1d26f90c72ff4068ad7d0b002f4546cc P 90c988d9adde44879ef11b8aa6ef4da3 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:30:13.676388 1149 raft_consensus.cc:3053] T 1d26f90c72ff4068ad7d0b002f4546cc P 5f009baf8a094da7a58d2a36ea888442 [term 2 LEADER]: Stepping down as leader of term 2
I20250625 03:30:13.676851 1149 raft_consensus.cc:738] T 1d26f90c72ff4068ad7d0b002f4546cc P 5f009baf8a094da7a58d2a36ea888442 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5f009baf8a094da7a58d2a36ea888442, State: Running, Role: LEADER
I20250625 03:30:13.677673 1149 consensus_queue.cc:260] T 1d26f90c72ff4068ad7d0b002f4546cc P 5f009baf8a094da7a58d2a36ea888442 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:30:13.679054 1149 raft_consensus.cc:3058] T 1d26f90c72ff4068ad7d0b002f4546cc P 5f009baf8a094da7a58d2a36ea888442 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:30:13.683513 1222 raft_consensus.cc:2466] T 1d26f90c72ff4068ad7d0b002f4546cc P 90c988d9adde44879ef11b8aa6ef4da3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89a9444e93674a9d9e3d988af9c95a3e in term 3.
I20250625 03:30:13.684772 1041 leader_election.cc:304] T 1d26f90c72ff4068ad7d0b002f4546cc P 89a9444e93674a9d9e3d988af9c95a3e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89a9444e93674a9d9e3d988af9c95a3e, 90c988d9adde44879ef11b8aa6ef4da3; no voters:
I20250625 03:30:13.685554 1401 raft_consensus.cc:2802] T 1d26f90c72ff4068ad7d0b002f4546cc P 89a9444e93674a9d9e3d988af9c95a3e [term 3 FOLLOWER]: Leader election won for term 3
I20250625 03:30:13.685595 1149 raft_consensus.cc:2466] T 1d26f90c72ff4068ad7d0b002f4546cc P 5f009baf8a094da7a58d2a36ea888442 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89a9444e93674a9d9e3d988af9c95a3e in term 3.
I20250625 03:30:13.686726 1401 raft_consensus.cc:695] T 1d26f90c72ff4068ad7d0b002f4546cc P 89a9444e93674a9d9e3d988af9c95a3e [term 3 LEADER]: Becoming Leader. State: Replica: 89a9444e93674a9d9e3d988af9c95a3e, State: Running, Role: LEADER
I20250625 03:30:13.687633 1401 consensus_queue.cc:237] T 1d26f90c72ff4068ad7d0b002f4546cc P 89a9444e93674a9d9e3d988af9c95a3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:30:13.698753 972 catalog_manager.cc:5582] T 1d26f90c72ff4068ad7d0b002f4546cc P 89a9444e93674a9d9e3d988af9c95a3e reported cstate change: term changed from 2 to 3, leader changed from 5f009baf8a094da7a58d2a36ea888442 (127.0.106.130) to 89a9444e93674a9d9e3d988af9c95a3e (127.0.106.129). New cstate: current_term: 3 leader_uuid: "89a9444e93674a9d9e3d988af9c95a3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } health_report { overall_health: UNKNOWN } } }
I20250625 03:30:13.717041 1403 raft_consensus.cc:991] T 6b62b2927d214886b92f502546868ca0 P 5f009baf8a094da7a58d2a36ea888442: : Instructing follower 89a9444e93674a9d9e3d988af9c95a3e to start an election
I20250625 03:30:13.717450 1397 raft_consensus.cc:1079] T 6b62b2927d214886b92f502546868ca0 P 5f009baf8a094da7a58d2a36ea888442 [term 2 LEADER]: Signalling peer 89a9444e93674a9d9e3d988af9c95a3e to start an election
I20250625 03:30:13.718767 1072 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "6b62b2927d214886b92f502546868ca0"
dest_uuid: "89a9444e93674a9d9e3d988af9c95a3e"
from {username='slave'} at 127.0.0.1:60904
I20250625 03:30:13.719223 1072 raft_consensus.cc:491] T 6b62b2927d214886b92f502546868ca0 P 89a9444e93674a9d9e3d988af9c95a3e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:30:13.719472 1072 raft_consensus.cc:3058] T 6b62b2927d214886b92f502546868ca0 P 89a9444e93674a9d9e3d988af9c95a3e [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:30:13.724951 1072 raft_consensus.cc:513] T 6b62b2927d214886b92f502546868ca0 P 89a9444e93674a9d9e3d988af9c95a3e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:30:13.726397 1072 leader_election.cc:290] T 6b62b2927d214886b92f502546868ca0 P 89a9444e93674a9d9e3d988af9c95a3e [CANDIDATE]: Term 3 election: Requested vote from peers 5f009baf8a094da7a58d2a36ea888442 (127.0.106.130:37441), 90c988d9adde44879ef11b8aa6ef4da3 (127.0.106.131:42281)
I20250625 03:30:13.727139 1149 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6b62b2927d214886b92f502546868ca0" candidate_uuid: "89a9444e93674a9d9e3d988af9c95a3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5f009baf8a094da7a58d2a36ea888442"
I20250625 03:30:13.727428 1222 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6b62b2927d214886b92f502546868ca0" candidate_uuid: "89a9444e93674a9d9e3d988af9c95a3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "90c988d9adde44879ef11b8aa6ef4da3"
I20250625 03:30:13.727674 1149 raft_consensus.cc:3053] T 6b62b2927d214886b92f502546868ca0 P 5f009baf8a094da7a58d2a36ea888442 [term 2 LEADER]: Stepping down as leader of term 2
I20250625 03:30:13.727869 1222 raft_consensus.cc:3058] T 6b62b2927d214886b92f502546868ca0 P 90c988d9adde44879ef11b8aa6ef4da3 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:30:13.727949 1149 raft_consensus.cc:738] T 6b62b2927d214886b92f502546868ca0 P 5f009baf8a094da7a58d2a36ea888442 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5f009baf8a094da7a58d2a36ea888442, State: Running, Role: LEADER
I20250625 03:30:13.728879 1149 consensus_queue.cc:260] T 6b62b2927d214886b92f502546868ca0 P 5f009baf8a094da7a58d2a36ea888442 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:30:13.729769 1149 raft_consensus.cc:3058] T 6b62b2927d214886b92f502546868ca0 P 5f009baf8a094da7a58d2a36ea888442 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:30:13.732205 1222 raft_consensus.cc:2466] T 6b62b2927d214886b92f502546868ca0 P 90c988d9adde44879ef11b8aa6ef4da3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89a9444e93674a9d9e3d988af9c95a3e in term 3.
I20250625 03:30:13.733134 1041 leader_election.cc:304] T 6b62b2927d214886b92f502546868ca0 P 89a9444e93674a9d9e3d988af9c95a3e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89a9444e93674a9d9e3d988af9c95a3e, 90c988d9adde44879ef11b8aa6ef4da3; no voters:
I20250625 03:30:13.733839 1401 raft_consensus.cc:2802] T 6b62b2927d214886b92f502546868ca0 P 89a9444e93674a9d9e3d988af9c95a3e [term 3 FOLLOWER]: Leader election won for term 3
I20250625 03:30:13.734284 1401 raft_consensus.cc:695] T 6b62b2927d214886b92f502546868ca0 P 89a9444e93674a9d9e3d988af9c95a3e [term 3 LEADER]: Becoming Leader. State: Replica: 89a9444e93674a9d9e3d988af9c95a3e, State: Running, Role: LEADER
I20250625 03:30:13.734453 1149 raft_consensus.cc:2466] T 6b62b2927d214886b92f502546868ca0 P 5f009baf8a094da7a58d2a36ea888442 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89a9444e93674a9d9e3d988af9c95a3e in term 3.
I20250625 03:30:13.735112 1401 consensus_queue.cc:237] T 6b62b2927d214886b92f502546868ca0 P 89a9444e93674a9d9e3d988af9c95a3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:30:13.737214 1410 raft_consensus.cc:991] T bc9758463ec04a4b93042f29add1a1fd P 90c988d9adde44879ef11b8aa6ef4da3: : Instructing follower 89a9444e93674a9d9e3d988af9c95a3e to start an election
I20250625 03:30:13.737903 1400 raft_consensus.cc:1079] T bc9758463ec04a4b93042f29add1a1fd P 90c988d9adde44879ef11b8aa6ef4da3 [term 3 LEADER]: Signalling peer 89a9444e93674a9d9e3d988af9c95a3e to start an election
I20250625 03:30:13.739804 1072 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "bc9758463ec04a4b93042f29add1a1fd"
dest_uuid: "89a9444e93674a9d9e3d988af9c95a3e"
from {username='slave'} at 127.0.0.1:60910
I20250625 03:30:13.740525 1072 raft_consensus.cc:491] T bc9758463ec04a4b93042f29add1a1fd P 89a9444e93674a9d9e3d988af9c95a3e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:30:13.740854 1072 raft_consensus.cc:3058] T bc9758463ec04a4b93042f29add1a1fd P 89a9444e93674a9d9e3d988af9c95a3e [term 3 FOLLOWER]: Advancing to term 4
I20250625 03:30:13.745710 972 catalog_manager.cc:5582] T 6b62b2927d214886b92f502546868ca0 P 89a9444e93674a9d9e3d988af9c95a3e reported cstate change: term changed from 2 to 3, leader changed from 5f009baf8a094da7a58d2a36ea888442 (127.0.106.130) to 89a9444e93674a9d9e3d988af9c95a3e (127.0.106.129). New cstate: current_term: 3 leader_uuid: "89a9444e93674a9d9e3d988af9c95a3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } health_report { overall_health: UNKNOWN } } }
I20250625 03:30:13.747354 1072 raft_consensus.cc:513] T bc9758463ec04a4b93042f29add1a1fd P 89a9444e93674a9d9e3d988af9c95a3e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:30:13.748867 1072 leader_election.cc:290] T bc9758463ec04a4b93042f29add1a1fd P 89a9444e93674a9d9e3d988af9c95a3e [CANDIDATE]: Term 4 election: Requested vote from peers 5f009baf8a094da7a58d2a36ea888442 (127.0.106.130:37441), 90c988d9adde44879ef11b8aa6ef4da3 (127.0.106.131:42281)
I20250625 03:30:13.749759 1149 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bc9758463ec04a4b93042f29add1a1fd" candidate_uuid: "89a9444e93674a9d9e3d988af9c95a3e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5f009baf8a094da7a58d2a36ea888442"
I20250625 03:30:13.749955 1222 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bc9758463ec04a4b93042f29add1a1fd" candidate_uuid: "89a9444e93674a9d9e3d988af9c95a3e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "90c988d9adde44879ef11b8aa6ef4da3"
I20250625 03:30:13.750269 1149 raft_consensus.cc:3058] T bc9758463ec04a4b93042f29add1a1fd P 5f009baf8a094da7a58d2a36ea888442 [term 3 FOLLOWER]: Advancing to term 4
I20250625 03:30:13.750409 1222 raft_consensus.cc:3053] T bc9758463ec04a4b93042f29add1a1fd P 90c988d9adde44879ef11b8aa6ef4da3 [term 3 LEADER]: Stepping down as leader of term 3
I20250625 03:30:13.750720 1222 raft_consensus.cc:738] T bc9758463ec04a4b93042f29add1a1fd P 90c988d9adde44879ef11b8aa6ef4da3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 90c988d9adde44879ef11b8aa6ef4da3, State: Running, Role: LEADER
I20250625 03:30:13.751441 1222 consensus_queue.cc:260] T bc9758463ec04a4b93042f29add1a1fd P 90c988d9adde44879ef11b8aa6ef4da3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:30:13.752516 1222 raft_consensus.cc:3058] T bc9758463ec04a4b93042f29add1a1fd P 90c988d9adde44879ef11b8aa6ef4da3 [term 3 FOLLOWER]: Advancing to term 4
I20250625 03:30:13.756664 1149 raft_consensus.cc:2466] T bc9758463ec04a4b93042f29add1a1fd P 5f009baf8a094da7a58d2a36ea888442 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89a9444e93674a9d9e3d988af9c95a3e in term 4.
I20250625 03:30:13.757711 1041 leader_election.cc:304] T bc9758463ec04a4b93042f29add1a1fd P 89a9444e93674a9d9e3d988af9c95a3e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f009baf8a094da7a58d2a36ea888442, 89a9444e93674a9d9e3d988af9c95a3e; no voters:
I20250625 03:30:13.758479 1401 raft_consensus.cc:2802] T bc9758463ec04a4b93042f29add1a1fd P 89a9444e93674a9d9e3d988af9c95a3e [term 4 FOLLOWER]: Leader election won for term 4
I20250625 03:30:13.758895 1401 raft_consensus.cc:695] T bc9758463ec04a4b93042f29add1a1fd P 89a9444e93674a9d9e3d988af9c95a3e [term 4 LEADER]: Becoming Leader. State: Replica: 89a9444e93674a9d9e3d988af9c95a3e, State: Running, Role: LEADER
I20250625 03:30:13.758940 1222 raft_consensus.cc:2466] T bc9758463ec04a4b93042f29add1a1fd P 90c988d9adde44879ef11b8aa6ef4da3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89a9444e93674a9d9e3d988af9c95a3e in term 4.
I20250625 03:30:13.759799 1401 consensus_queue.cc:237] T bc9758463ec04a4b93042f29add1a1fd P 89a9444e93674a9d9e3d988af9c95a3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:30:13.766206 972 catalog_manager.cc:5582] T bc9758463ec04a4b93042f29add1a1fd P 89a9444e93674a9d9e3d988af9c95a3e reported cstate change: term changed from 3 to 4, leader changed from 90c988d9adde44879ef11b8aa6ef4da3 (127.0.106.131) to 89a9444e93674a9d9e3d988af9c95a3e (127.0.106.129). New cstate: current_term: 4 leader_uuid: "89a9444e93674a9d9e3d988af9c95a3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } health_report { overall_health: UNKNOWN } } }
I20250625 03:30:13.902786 1410 raft_consensus.cc:991] T 0ee874019a27479a94caf3275d914259 P 90c988d9adde44879ef11b8aa6ef4da3: : Instructing follower 89a9444e93674a9d9e3d988af9c95a3e to start an election
I20250625 03:30:13.903321 1400 raft_consensus.cc:1079] T 0ee874019a27479a94caf3275d914259 P 90c988d9adde44879ef11b8aa6ef4da3 [term 3 LEADER]: Signalling peer 89a9444e93674a9d9e3d988af9c95a3e to start an election
I20250625 03:30:13.904767 1072 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "0ee874019a27479a94caf3275d914259"
dest_uuid: "89a9444e93674a9d9e3d988af9c95a3e"
from {username='slave'} at 127.0.0.1:60910
I20250625 03:30:13.905231 1072 raft_consensus.cc:491] T 0ee874019a27479a94caf3275d914259 P 89a9444e93674a9d9e3d988af9c95a3e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:30:13.905485 1072 raft_consensus.cc:3058] T 0ee874019a27479a94caf3275d914259 P 89a9444e93674a9d9e3d988af9c95a3e [term 3 FOLLOWER]: Advancing to term 4
I20250625 03:30:13.909627 1072 raft_consensus.cc:513] T 0ee874019a27479a94caf3275d914259 P 89a9444e93674a9d9e3d988af9c95a3e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:30:13.910907 1072 leader_election.cc:290] T 0ee874019a27479a94caf3275d914259 P 89a9444e93674a9d9e3d988af9c95a3e [CANDIDATE]: Term 4 election: Requested vote from peers 5f009baf8a094da7a58d2a36ea888442 (127.0.106.130:37441), 90c988d9adde44879ef11b8aa6ef4da3 (127.0.106.131:42281)
I20250625 03:30:13.911757 1149 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0ee874019a27479a94caf3275d914259" candidate_uuid: "89a9444e93674a9d9e3d988af9c95a3e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5f009baf8a094da7a58d2a36ea888442"
I20250625 03:30:13.911978 1222 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0ee874019a27479a94caf3275d914259" candidate_uuid: "89a9444e93674a9d9e3d988af9c95a3e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "90c988d9adde44879ef11b8aa6ef4da3"
I20250625 03:30:13.912217 1149 raft_consensus.cc:3058] T 0ee874019a27479a94caf3275d914259 P 5f009baf8a094da7a58d2a36ea888442 [term 3 FOLLOWER]: Advancing to term 4
I20250625 03:30:13.912477 1222 raft_consensus.cc:3053] T 0ee874019a27479a94caf3275d914259 P 90c988d9adde44879ef11b8aa6ef4da3 [term 3 LEADER]: Stepping down as leader of term 3
I20250625 03:30:13.912708 1222 raft_consensus.cc:738] T 0ee874019a27479a94caf3275d914259 P 90c988d9adde44879ef11b8aa6ef4da3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 90c988d9adde44879ef11b8aa6ef4da3, State: Running, Role: LEADER
I20250625 03:30:13.913466 1222 consensus_queue.cc:260] T 0ee874019a27479a94caf3275d914259 P 90c988d9adde44879ef11b8aa6ef4da3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:30:13.914350 1222 raft_consensus.cc:3058] T 0ee874019a27479a94caf3275d914259 P 90c988d9adde44879ef11b8aa6ef4da3 [term 3 FOLLOWER]: Advancing to term 4
I20250625 03:30:13.916663 1149 raft_consensus.cc:2466] T 0ee874019a27479a94caf3275d914259 P 5f009baf8a094da7a58d2a36ea888442 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89a9444e93674a9d9e3d988af9c95a3e in term 4.
I20250625 03:30:13.917582 1041 leader_election.cc:304] T 0ee874019a27479a94caf3275d914259 P 89a9444e93674a9d9e3d988af9c95a3e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f009baf8a094da7a58d2a36ea888442, 89a9444e93674a9d9e3d988af9c95a3e; no voters:
I20250625 03:30:13.918305 1401 raft_consensus.cc:2802] T 0ee874019a27479a94caf3275d914259 P 89a9444e93674a9d9e3d988af9c95a3e [term 4 FOLLOWER]: Leader election won for term 4
I20250625 03:30:13.918668 1401 raft_consensus.cc:695] T 0ee874019a27479a94caf3275d914259 P 89a9444e93674a9d9e3d988af9c95a3e [term 4 LEADER]: Becoming Leader. State: Replica: 89a9444e93674a9d9e3d988af9c95a3e, State: Running, Role: LEADER
I20250625 03:30:13.918923 1222 raft_consensus.cc:2466] T 0ee874019a27479a94caf3275d914259 P 90c988d9adde44879ef11b8aa6ef4da3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89a9444e93674a9d9e3d988af9c95a3e in term 4.
I20250625 03:30:13.919420 1401 consensus_queue.cc:237] T 0ee874019a27479a94caf3275d914259 P 89a9444e93674a9d9e3d988af9c95a3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:30:13.926167 972 catalog_manager.cc:5582] T 0ee874019a27479a94caf3275d914259 P 89a9444e93674a9d9e3d988af9c95a3e reported cstate change: term changed from 3 to 4, leader changed from 90c988d9adde44879ef11b8aa6ef4da3 (127.0.106.131) to 89a9444e93674a9d9e3d988af9c95a3e (127.0.106.129). New cstate: current_term: 4 leader_uuid: "89a9444e93674a9d9e3d988af9c95a3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } health_report { overall_health: UNKNOWN } } }
I20250625 03:30:13.980242 1403 raft_consensus.cc:991] T 93d7b80866e64a77b925f730e300fe88 P 5f009baf8a094da7a58d2a36ea888442: : Instructing follower 89a9444e93674a9d9e3d988af9c95a3e to start an election
I20250625 03:30:13.980701 1397 raft_consensus.cc:1079] T 93d7b80866e64a77b925f730e300fe88 P 5f009baf8a094da7a58d2a36ea888442 [term 2 LEADER]: Signalling peer 89a9444e93674a9d9e3d988af9c95a3e to start an election
I20250625 03:30:13.981946 1072 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "93d7b80866e64a77b925f730e300fe88"
dest_uuid: "89a9444e93674a9d9e3d988af9c95a3e"
from {username='slave'} at 127.0.0.1:60904
I20250625 03:30:13.982390 1072 raft_consensus.cc:491] T 93d7b80866e64a77b925f730e300fe88 P 89a9444e93674a9d9e3d988af9c95a3e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:30:13.982641 1072 raft_consensus.cc:3058] T 93d7b80866e64a77b925f730e300fe88 P 89a9444e93674a9d9e3d988af9c95a3e [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:30:13.986660 1072 raft_consensus.cc:513] T 93d7b80866e64a77b925f730e300fe88 P 89a9444e93674a9d9e3d988af9c95a3e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:30:13.988103 1072 leader_election.cc:290] T 93d7b80866e64a77b925f730e300fe88 P 89a9444e93674a9d9e3d988af9c95a3e [CANDIDATE]: Term 3 election: Requested vote from peers 5f009baf8a094da7a58d2a36ea888442 (127.0.106.130:37441), 90c988d9adde44879ef11b8aa6ef4da3 (127.0.106.131:42281)
I20250625 03:30:13.988921 1149 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "93d7b80866e64a77b925f730e300fe88" candidate_uuid: "89a9444e93674a9d9e3d988af9c95a3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5f009baf8a094da7a58d2a36ea888442"
I20250625 03:30:13.989012 1222 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "93d7b80866e64a77b925f730e300fe88" candidate_uuid: "89a9444e93674a9d9e3d988af9c95a3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "90c988d9adde44879ef11b8aa6ef4da3"
I20250625 03:30:13.989475 1149 raft_consensus.cc:3053] T 93d7b80866e64a77b925f730e300fe88 P 5f009baf8a094da7a58d2a36ea888442 [term 2 LEADER]: Stepping down as leader of term 2
I20250625 03:30:13.989532 1222 raft_consensus.cc:3058] T 93d7b80866e64a77b925f730e300fe88 P 90c988d9adde44879ef11b8aa6ef4da3 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:30:13.989730 1149 raft_consensus.cc:738] T 93d7b80866e64a77b925f730e300fe88 P 5f009baf8a094da7a58d2a36ea888442 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5f009baf8a094da7a58d2a36ea888442, State: Running, Role: LEADER
I20250625 03:30:13.990401 1149 consensus_queue.cc:260] T 93d7b80866e64a77b925f730e300fe88 P 5f009baf8a094da7a58d2a36ea888442 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:30:13.991255 1149 raft_consensus.cc:3058] T 93d7b80866e64a77b925f730e300fe88 P 5f009baf8a094da7a58d2a36ea888442 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:30:13.993602 1222 raft_consensus.cc:2466] T 93d7b80866e64a77b925f730e300fe88 P 90c988d9adde44879ef11b8aa6ef4da3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89a9444e93674a9d9e3d988af9c95a3e in term 3.
I20250625 03:30:13.994475 1041 leader_election.cc:304] T 93d7b80866e64a77b925f730e300fe88 P 89a9444e93674a9d9e3d988af9c95a3e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89a9444e93674a9d9e3d988af9c95a3e, 90c988d9adde44879ef11b8aa6ef4da3; no voters:
I20250625 03:30:13.995203 1401 raft_consensus.cc:2802] T 93d7b80866e64a77b925f730e300fe88 P 89a9444e93674a9d9e3d988af9c95a3e [term 3 FOLLOWER]: Leader election won for term 3
I20250625 03:30:13.995609 1401 raft_consensus.cc:695] T 93d7b80866e64a77b925f730e300fe88 P 89a9444e93674a9d9e3d988af9c95a3e [term 3 LEADER]: Becoming Leader. State: Replica: 89a9444e93674a9d9e3d988af9c95a3e, State: Running, Role: LEADER
I20250625 03:30:13.996446 1149 raft_consensus.cc:2466] T 93d7b80866e64a77b925f730e300fe88 P 5f009baf8a094da7a58d2a36ea888442 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89a9444e93674a9d9e3d988af9c95a3e in term 3.
I20250625 03:30:13.996364 1401 consensus_queue.cc:237] T 93d7b80866e64a77b925f730e300fe88 P 89a9444e93674a9d9e3d988af9c95a3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:30:14.003290 972 catalog_manager.cc:5582] T 93d7b80866e64a77b925f730e300fe88 P 89a9444e93674a9d9e3d988af9c95a3e reported cstate change: term changed from 2 to 3, leader changed from 5f009baf8a094da7a58d2a36ea888442 (127.0.106.130) to 89a9444e93674a9d9e3d988af9c95a3e (127.0.106.129). New cstate: current_term: 3 leader_uuid: "89a9444e93674a9d9e3d988af9c95a3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } health_report { overall_health: UNKNOWN } } }
I20250625 03:30:14.174094 1149 raft_consensus.cc:1273] T 6b62b2927d214886b92f502546868ca0 P 5f009baf8a094da7a58d2a36ea888442 [term 3 FOLLOWER]: Refusing update from remote peer 89a9444e93674a9d9e3d988af9c95a3e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250625 03:30:14.175498 1401 consensus_queue.cc:1035] T 6b62b2927d214886b92f502546868ca0 P 89a9444e93674a9d9e3d988af9c95a3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:30:14.189805 1222 raft_consensus.cc:1273] T 6b62b2927d214886b92f502546868ca0 P 90c988d9adde44879ef11b8aa6ef4da3 [term 3 FOLLOWER]: Refusing update from remote peer 89a9444e93674a9d9e3d988af9c95a3e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250625 03:30:14.191484 1401 consensus_queue.cc:1035] T 6b62b2927d214886b92f502546868ca0 P 89a9444e93674a9d9e3d988af9c95a3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20250625 03:30:14.215559 1149 raft_consensus.cc:1273] T bc9758463ec04a4b93042f29add1a1fd P 5f009baf8a094da7a58d2a36ea888442 [term 4 FOLLOWER]: Refusing update from remote peer 89a9444e93674a9d9e3d988af9c95a3e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20250625 03:30:14.217105 1404 consensus_queue.cc:1035] T bc9758463ec04a4b93042f29add1a1fd P 89a9444e93674a9d9e3d988af9c95a3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20250625 03:30:14.223305 1222 raft_consensus.cc:1273] T bc9758463ec04a4b93042f29add1a1fd P 90c988d9adde44879ef11b8aa6ef4da3 [term 4 FOLLOWER]: Refusing update from remote peer 89a9444e93674a9d9e3d988af9c95a3e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20250625 03:30:14.224999 1404 consensus_queue.cc:1035] T bc9758463ec04a4b93042f29add1a1fd P 89a9444e93674a9d9e3d988af9c95a3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20250625 03:30:14.243674 1149 raft_consensus.cc:1273] T 1d26f90c72ff4068ad7d0b002f4546cc P 5f009baf8a094da7a58d2a36ea888442 [term 3 FOLLOWER]: Refusing update from remote peer 89a9444e93674a9d9e3d988af9c95a3e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250625 03:30:14.245045 1404 consensus_queue.cc:1035] T 1d26f90c72ff4068ad7d0b002f4546cc P 89a9444e93674a9d9e3d988af9c95a3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:30:14.248775 1221 raft_consensus.cc:1273] T 1d26f90c72ff4068ad7d0b002f4546cc P 90c988d9adde44879ef11b8aa6ef4da3 [term 3 FOLLOWER]: Refusing update from remote peer 89a9444e93674a9d9e3d988af9c95a3e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250625 03:30:14.250406 1422 consensus_queue.cc:1035] T 1d26f90c72ff4068ad7d0b002f4546cc P 89a9444e93674a9d9e3d988af9c95a3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20250625 03:30:14.373818 1221 raft_consensus.cc:1273] T 0ee874019a27479a94caf3275d914259 P 90c988d9adde44879ef11b8aa6ef4da3 [term 4 FOLLOWER]: Refusing update from remote peer 89a9444e93674a9d9e3d988af9c95a3e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20250625 03:30:14.375171 1423 consensus_queue.cc:1035] T 0ee874019a27479a94caf3275d914259 P 89a9444e93674a9d9e3d988af9c95a3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:30:14.384361 1149 raft_consensus.cc:1273] T 0ee874019a27479a94caf3275d914259 P 5f009baf8a094da7a58d2a36ea888442 [term 4 FOLLOWER]: Refusing update from remote peer 89a9444e93674a9d9e3d988af9c95a3e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20250625 03:30:14.386171 1404 consensus_queue.cc:1035] T 0ee874019a27479a94caf3275d914259 P 89a9444e93674a9d9e3d988af9c95a3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:30:14.388325 1221 raft_consensus.cc:1273] T 93d7b80866e64a77b925f730e300fe88 P 90c988d9adde44879ef11b8aa6ef4da3 [term 3 FOLLOWER]: Refusing update from remote peer 89a9444e93674a9d9e3d988af9c95a3e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250625 03:30:14.389714 1404 consensus_queue.cc:1035] T 93d7b80866e64a77b925f730e300fe88 P 89a9444e93674a9d9e3d988af9c95a3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:30:14.401036 1149 raft_consensus.cc:1273] T 93d7b80866e64a77b925f730e300fe88 P 5f009baf8a094da7a58d2a36ea888442 [term 3 FOLLOWER]: Refusing update from remote peer 89a9444e93674a9d9e3d988af9c95a3e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250625 03:30:14.402184 1423 consensus_queue.cc:1035] T 93d7b80866e64a77b925f730e300fe88 P 89a9444e93674a9d9e3d988af9c95a3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:30:16.693918 426 auto_leader_rebalancer-test.cc:377] The leader distribution is
I20250625 03:30:16.694494 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:30:16.701251 1072 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "0ee874019a27479a94caf3275d914259"
dest_uuid: "89a9444e93674a9d9e3d988af9c95a3e"
mode: GRACEFUL
new_leader_uuid: "5f009baf8a094da7a58d2a36ea888442"
from {username='slave'} at 127.0.0.1:60934
I20250625 03:30:16.701753 1072 raft_consensus.cc:604] T 0ee874019a27479a94caf3275d914259 P 89a9444e93674a9d9e3d988af9c95a3e [term 4 LEADER]: Received request to transfer leadership to TS 5f009baf8a094da7a58d2a36ea888442
I20250625 03:30:16.704038 1072 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "1d26f90c72ff4068ad7d0b002f4546cc"
dest_uuid: "89a9444e93674a9d9e3d988af9c95a3e"
mode: GRACEFUL
new_leader_uuid: "5f009baf8a094da7a58d2a36ea888442"
from {username='slave'} at 127.0.0.1:60934
I20250625 03:30:16.704486 1072 raft_consensus.cc:604] T 1d26f90c72ff4068ad7d0b002f4546cc P 89a9444e93674a9d9e3d988af9c95a3e [term 3 LEADER]: Received request to transfer leadership to TS 5f009baf8a094da7a58d2a36ea888442
I20250625 03:30:16.706499 1072 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "27e1943c0c154ec68f7e0a75b39b1105"
dest_uuid: "89a9444e93674a9d9e3d988af9c95a3e"
mode: GRACEFUL
new_leader_uuid: "90c988d9adde44879ef11b8aa6ef4da3"
from {username='slave'} at 127.0.0.1:60934
I20250625 03:30:16.706940 1072 raft_consensus.cc:604] T 27e1943c0c154ec68f7e0a75b39b1105 P 89a9444e93674a9d9e3d988af9c95a3e [term 2 LEADER]: Received request to transfer leadership to TS 90c988d9adde44879ef11b8aa6ef4da3
I20250625 03:30:16.709245 1072 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "93d7b80866e64a77b925f730e300fe88"
dest_uuid: "89a9444e93674a9d9e3d988af9c95a3e"
mode: GRACEFUL
new_leader_uuid: "90c988d9adde44879ef11b8aa6ef4da3"
from {username='slave'} at 127.0.0.1:60934
I20250625 03:30:16.709785 1072 raft_consensus.cc:604] T 93d7b80866e64a77b925f730e300fe88 P 89a9444e93674a9d9e3d988af9c95a3e [term 3 LEADER]: Received request to transfer leadership to TS 90c988d9adde44879ef11b8aa6ef4da3
I20250625 03:30:16.710832 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 4
I20250625 03:30:16.711328 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:30:16.725522 1404 raft_consensus.cc:991] T 0ee874019a27479a94caf3275d914259 P 89a9444e93674a9d9e3d988af9c95a3e: : Instructing follower 5f009baf8a094da7a58d2a36ea888442 to start an election
I20250625 03:30:16.726039 1430 raft_consensus.cc:1079] T 0ee874019a27479a94caf3275d914259 P 89a9444e93674a9d9e3d988af9c95a3e [term 4 LEADER]: Signalling peer 5f009baf8a094da7a58d2a36ea888442 to start an election
I20250625 03:30:16.727345 1149 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "0ee874019a27479a94caf3275d914259"
dest_uuid: "5f009baf8a094da7a58d2a36ea888442"
from {username='slave'} at 127.0.0.1:32946
I20250625 03:30:16.727852 1149 raft_consensus.cc:491] T 0ee874019a27479a94caf3275d914259 P 5f009baf8a094da7a58d2a36ea888442 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:30:16.728211 1149 raft_consensus.cc:3058] T 0ee874019a27479a94caf3275d914259 P 5f009baf8a094da7a58d2a36ea888442 [term 4 FOLLOWER]: Advancing to term 5
I20250625 03:30:16.733886 1149 raft_consensus.cc:513] T 0ee874019a27479a94caf3275d914259 P 5f009baf8a094da7a58d2a36ea888442 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:30:16.735755 1149 leader_election.cc:290] T 0ee874019a27479a94caf3275d914259 P 5f009baf8a094da7a58d2a36ea888442 [CANDIDATE]: Term 5 election: Requested vote from peers 89a9444e93674a9d9e3d988af9c95a3e (127.0.106.129:44675), 90c988d9adde44879ef11b8aa6ef4da3 (127.0.106.131:42281)
I20250625 03:30:16.736670 1072 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0ee874019a27479a94caf3275d914259" candidate_uuid: "5f009baf8a094da7a58d2a36ea888442" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "89a9444e93674a9d9e3d988af9c95a3e"
I20250625 03:30:16.737073 1222 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0ee874019a27479a94caf3275d914259" candidate_uuid: "5f009baf8a094da7a58d2a36ea888442" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "90c988d9adde44879ef11b8aa6ef4da3"
I20250625 03:30:16.737231 1072 raft_consensus.cc:3053] T 0ee874019a27479a94caf3275d914259 P 89a9444e93674a9d9e3d988af9c95a3e [term 4 LEADER]: Stepping down as leader of term 4
I20250625 03:30:16.737566 1072 raft_consensus.cc:738] T 0ee874019a27479a94caf3275d914259 P 89a9444e93674a9d9e3d988af9c95a3e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 89a9444e93674a9d9e3d988af9c95a3e, State: Running, Role: LEADER
I20250625 03:30:16.737617 1222 raft_consensus.cc:3058] T 0ee874019a27479a94caf3275d914259 P 90c988d9adde44879ef11b8aa6ef4da3 [term 4 FOLLOWER]: Advancing to term 5
I20250625 03:30:16.740402 1072 consensus_queue.cc:260] T 0ee874019a27479a94caf3275d914259 P 89a9444e93674a9d9e3d988af9c95a3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:30:16.741194 1072 raft_consensus.cc:3058] T 0ee874019a27479a94caf3275d914259 P 89a9444e93674a9d9e3d988af9c95a3e [term 4 FOLLOWER]: Advancing to term 5
I20250625 03:30:16.741955 1222 raft_consensus.cc:2466] T 0ee874019a27479a94caf3275d914259 P 90c988d9adde44879ef11b8aa6ef4da3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f009baf8a094da7a58d2a36ea888442 in term 5.
I20250625 03:30:16.742940 1116 leader_election.cc:304] T 0ee874019a27479a94caf3275d914259 P 5f009baf8a094da7a58d2a36ea888442 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f009baf8a094da7a58d2a36ea888442, 90c988d9adde44879ef11b8aa6ef4da3; no voters:
I20250625 03:30:16.743543 1397 raft_consensus.cc:2802] T 0ee874019a27479a94caf3275d914259 P 5f009baf8a094da7a58d2a36ea888442 [term 5 FOLLOWER]: Leader election won for term 5
I20250625 03:30:16.744452 1397 raft_consensus.cc:695] T 0ee874019a27479a94caf3275d914259 P 5f009baf8a094da7a58d2a36ea888442 [term 5 LEADER]: Becoming Leader. State: Replica: 5f009baf8a094da7a58d2a36ea888442, State: Running, Role: LEADER
I20250625 03:30:16.745254 1397 consensus_queue.cc:237] T 0ee874019a27479a94caf3275d914259 P 5f009baf8a094da7a58d2a36ea888442 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:30:16.746810 1072 raft_consensus.cc:2466] T 0ee874019a27479a94caf3275d914259 P 89a9444e93674a9d9e3d988af9c95a3e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f009baf8a094da7a58d2a36ea888442 in term 5.
I20250625 03:30:16.752519 973 catalog_manager.cc:5582] T 0ee874019a27479a94caf3275d914259 P 5f009baf8a094da7a58d2a36ea888442 reported cstate change: term changed from 4 to 5, leader changed from 89a9444e93674a9d9e3d988af9c95a3e (127.0.106.129) to 5f009baf8a094da7a58d2a36ea888442 (127.0.106.130). New cstate: current_term: 5 leader_uuid: "5f009baf8a094da7a58d2a36ea888442" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } health_report { overall_health: UNKNOWN } } }
I20250625 03:30:16.783178 1404 raft_consensus.cc:991] T 93d7b80866e64a77b925f730e300fe88 P 89a9444e93674a9d9e3d988af9c95a3e: : Instructing follower 90c988d9adde44879ef11b8aa6ef4da3 to start an election
I20250625 03:30:16.783639 1430 raft_consensus.cc:1079] T 93d7b80866e64a77b925f730e300fe88 P 89a9444e93674a9d9e3d988af9c95a3e [term 3 LEADER]: Signalling peer 90c988d9adde44879ef11b8aa6ef4da3 to start an election
I20250625 03:30:16.785024 1222 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "93d7b80866e64a77b925f730e300fe88"
dest_uuid: "90c988d9adde44879ef11b8aa6ef4da3"
from {username='slave'} at 127.0.0.1:50100
I20250625 03:30:16.785419 1222 raft_consensus.cc:491] T 93d7b80866e64a77b925f730e300fe88 P 90c988d9adde44879ef11b8aa6ef4da3 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:30:16.785686 1222 raft_consensus.cc:3058] T 93d7b80866e64a77b925f730e300fe88 P 90c988d9adde44879ef11b8aa6ef4da3 [term 3 FOLLOWER]: Advancing to term 4
I20250625 03:30:16.788884 1404 raft_consensus.cc:991] T 1d26f90c72ff4068ad7d0b002f4546cc P 89a9444e93674a9d9e3d988af9c95a3e: : Instructing follower 5f009baf8a094da7a58d2a36ea888442 to start an election
I20250625 03:30:16.789309 1404 raft_consensus.cc:1079] T 1d26f90c72ff4068ad7d0b002f4546cc P 89a9444e93674a9d9e3d988af9c95a3e [term 3 LEADER]: Signalling peer 5f009baf8a094da7a58d2a36ea888442 to start an election
I20250625 03:30:16.790724 1149 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "1d26f90c72ff4068ad7d0b002f4546cc"
dest_uuid: "5f009baf8a094da7a58d2a36ea888442"
from {username='slave'} at 127.0.0.1:32946
I20250625 03:30:16.791220 1149 raft_consensus.cc:491] T 1d26f90c72ff4068ad7d0b002f4546cc P 5f009baf8a094da7a58d2a36ea888442 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:30:16.791684 1149 raft_consensus.cc:3058] T 1d26f90c72ff4068ad7d0b002f4546cc P 5f009baf8a094da7a58d2a36ea888442 [term 3 FOLLOWER]: Advancing to term 4
I20250625 03:30:16.791702 1222 raft_consensus.cc:513] T 93d7b80866e64a77b925f730e300fe88 P 90c988d9adde44879ef11b8aa6ef4da3 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:30:16.794214 1222 leader_election.cc:290] T 93d7b80866e64a77b925f730e300fe88 P 90c988d9adde44879ef11b8aa6ef4da3 [CANDIDATE]: Term 4 election: Requested vote from peers 89a9444e93674a9d9e3d988af9c95a3e (127.0.106.129:44675), 5f009baf8a094da7a58d2a36ea888442 (127.0.106.130:37441)
I20250625 03:30:16.795094 1072 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "93d7b80866e64a77b925f730e300fe88" candidate_uuid: "90c988d9adde44879ef11b8aa6ef4da3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "89a9444e93674a9d9e3d988af9c95a3e"
I20250625 03:30:16.795580 1072 raft_consensus.cc:3053] T 93d7b80866e64a77b925f730e300fe88 P 89a9444e93674a9d9e3d988af9c95a3e [term 3 LEADER]: Stepping down as leader of term 3
I20250625 03:30:16.795439 1148 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "93d7b80866e64a77b925f730e300fe88" candidate_uuid: "90c988d9adde44879ef11b8aa6ef4da3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5f009baf8a094da7a58d2a36ea888442"
I20250625 03:30:16.795840 1072 raft_consensus.cc:738] T 93d7b80866e64a77b925f730e300fe88 P 89a9444e93674a9d9e3d988af9c95a3e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 89a9444e93674a9d9e3d988af9c95a3e, State: Running, Role: LEADER
I20250625 03:30:16.796087 1148 raft_consensus.cc:3058] T 93d7b80866e64a77b925f730e300fe88 P 5f009baf8a094da7a58d2a36ea888442 [term 3 FOLLOWER]: Advancing to term 4
I20250625 03:30:16.796545 1072 consensus_queue.cc:260] T 93d7b80866e64a77b925f730e300fe88 P 89a9444e93674a9d9e3d988af9c95a3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:30:16.797330 1072 raft_consensus.cc:3058] T 93d7b80866e64a77b925f730e300fe88 P 89a9444e93674a9d9e3d988af9c95a3e [term 3 FOLLOWER]: Advancing to term 4
I20250625 03:30:16.799295 1149 raft_consensus.cc:513] T 1d26f90c72ff4068ad7d0b002f4546cc P 5f009baf8a094da7a58d2a36ea888442 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:30:16.801880 1149 leader_election.cc:290] T 1d26f90c72ff4068ad7d0b002f4546cc P 5f009baf8a094da7a58d2a36ea888442 [CANDIDATE]: Term 4 election: Requested vote from peers 89a9444e93674a9d9e3d988af9c95a3e (127.0.106.129:44675), 90c988d9adde44879ef11b8aa6ef4da3 (127.0.106.131:42281)
I20250625 03:30:16.801857 1074 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1d26f90c72ff4068ad7d0b002f4546cc" candidate_uuid: "5f009baf8a094da7a58d2a36ea888442" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "89a9444e93674a9d9e3d988af9c95a3e"
I20250625 03:30:16.802758 1074 raft_consensus.cc:3053] T 1d26f90c72ff4068ad7d0b002f4546cc P 89a9444e93674a9d9e3d988af9c95a3e [term 3 LEADER]: Stepping down as leader of term 3
I20250625 03:30:16.802888 1148 raft_consensus.cc:2466] T 93d7b80866e64a77b925f730e300fe88 P 5f009baf8a094da7a58d2a36ea888442 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90c988d9adde44879ef11b8aa6ef4da3 in term 4.
I20250625 03:30:16.803086 1074 raft_consensus.cc:738] T 1d26f90c72ff4068ad7d0b002f4546cc P 89a9444e93674a9d9e3d988af9c95a3e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 89a9444e93674a9d9e3d988af9c95a3e, State: Running, Role: LEADER
I20250625 03:30:16.803994 1190 leader_election.cc:304] T 93d7b80866e64a77b925f730e300fe88 P 90c988d9adde44879ef11b8aa6ef4da3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f009baf8a094da7a58d2a36ea888442, 90c988d9adde44879ef11b8aa6ef4da3; no voters:
I20250625 03:30:16.803051 1072 raft_consensus.cc:2466] T 93d7b80866e64a77b925f730e300fe88 P 89a9444e93674a9d9e3d988af9c95a3e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90c988d9adde44879ef11b8aa6ef4da3 in term 4.
I20250625 03:30:16.804337 1221 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1d26f90c72ff4068ad7d0b002f4546cc" candidate_uuid: "5f009baf8a094da7a58d2a36ea888442" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "90c988d9adde44879ef11b8aa6ef4da3"
I20250625 03:30:16.803936 1074 consensus_queue.cc:260] T 1d26f90c72ff4068ad7d0b002f4546cc P 89a9444e93674a9d9e3d988af9c95a3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:30:16.804883 1221 raft_consensus.cc:3058] T 1d26f90c72ff4068ad7d0b002f4546cc P 90c988d9adde44879ef11b8aa6ef4da3 [term 3 FOLLOWER]: Advancing to term 4
I20250625 03:30:16.805332 1074 raft_consensus.cc:3058] T 1d26f90c72ff4068ad7d0b002f4546cc P 89a9444e93674a9d9e3d988af9c95a3e [term 3 FOLLOWER]: Advancing to term 4
I20250625 03:30:16.805912 1400 raft_consensus.cc:2802] T 93d7b80866e64a77b925f730e300fe88 P 90c988d9adde44879ef11b8aa6ef4da3 [term 4 FOLLOWER]: Leader election won for term 4
I20250625 03:30:16.807440 1400 raft_consensus.cc:695] T 93d7b80866e64a77b925f730e300fe88 P 90c988d9adde44879ef11b8aa6ef4da3 [term 4 LEADER]: Becoming Leader. State: Replica: 90c988d9adde44879ef11b8aa6ef4da3, State: Running, Role: LEADER
I20250625 03:30:16.808301 1400 consensus_queue.cc:237] T 93d7b80866e64a77b925f730e300fe88 P 90c988d9adde44879ef11b8aa6ef4da3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:30:16.809837 1221 raft_consensus.cc:2466] T 1d26f90c72ff4068ad7d0b002f4546cc P 90c988d9adde44879ef11b8aa6ef4da3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f009baf8a094da7a58d2a36ea888442 in term 4.
I20250625 03:30:16.810690 1116 leader_election.cc:304] T 1d26f90c72ff4068ad7d0b002f4546cc P 5f009baf8a094da7a58d2a36ea888442 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f009baf8a094da7a58d2a36ea888442, 90c988d9adde44879ef11b8aa6ef4da3; no voters:
I20250625 03:30:16.811257 1397 raft_consensus.cc:2802] T 1d26f90c72ff4068ad7d0b002f4546cc P 5f009baf8a094da7a58d2a36ea888442 [term 4 FOLLOWER]: Leader election won for term 4
I20250625 03:30:16.811674 1397 raft_consensus.cc:695] T 1d26f90c72ff4068ad7d0b002f4546cc P 5f009baf8a094da7a58d2a36ea888442 [term 4 LEADER]: Becoming Leader. State: Replica: 5f009baf8a094da7a58d2a36ea888442, State: Running, Role: LEADER
I20250625 03:30:16.812191 1074 raft_consensus.cc:2466] T 1d26f90c72ff4068ad7d0b002f4546cc P 89a9444e93674a9d9e3d988af9c95a3e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f009baf8a094da7a58d2a36ea888442 in term 4.
I20250625 03:30:16.812580 1397 consensus_queue.cc:237] T 1d26f90c72ff4068ad7d0b002f4546cc P 5f009baf8a094da7a58d2a36ea888442 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:30:16.816238 973 catalog_manager.cc:5582] T 93d7b80866e64a77b925f730e300fe88 P 90c988d9adde44879ef11b8aa6ef4da3 reported cstate change: term changed from 3 to 4, leader changed from 89a9444e93674a9d9e3d988af9c95a3e (127.0.106.129) to 90c988d9adde44879ef11b8aa6ef4da3 (127.0.106.131). New cstate: current_term: 4 leader_uuid: "90c988d9adde44879ef11b8aa6ef4da3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } health_report { overall_health: HEALTHY } } }
I20250625 03:30:16.821002 972 catalog_manager.cc:5582] T 1d26f90c72ff4068ad7d0b002f4546cc P 5f009baf8a094da7a58d2a36ea888442 reported cstate change: term changed from 3 to 4, leader changed from 89a9444e93674a9d9e3d988af9c95a3e (127.0.106.129) to 5f009baf8a094da7a58d2a36ea888442 (127.0.106.130). New cstate: current_term: 4 leader_uuid: "5f009baf8a094da7a58d2a36ea888442" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } health_report { overall_health: UNKNOWN } } }
I20250625 03:30:16.986888 1430 raft_consensus.cc:991] T 27e1943c0c154ec68f7e0a75b39b1105 P 89a9444e93674a9d9e3d988af9c95a3e: : Instructing follower 90c988d9adde44879ef11b8aa6ef4da3 to start an election
I20250625 03:30:16.987293 1404 raft_consensus.cc:1079] T 27e1943c0c154ec68f7e0a75b39b1105 P 89a9444e93674a9d9e3d988af9c95a3e [term 2 LEADER]: Signalling peer 90c988d9adde44879ef11b8aa6ef4da3 to start an election
I20250625 03:30:16.988875 1221 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "27e1943c0c154ec68f7e0a75b39b1105"
dest_uuid: "90c988d9adde44879ef11b8aa6ef4da3"
from {username='slave'} at 127.0.0.1:50100
I20250625 03:30:16.989351 1221 raft_consensus.cc:491] T 27e1943c0c154ec68f7e0a75b39b1105 P 90c988d9adde44879ef11b8aa6ef4da3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:30:16.989641 1221 raft_consensus.cc:3058] T 27e1943c0c154ec68f7e0a75b39b1105 P 90c988d9adde44879ef11b8aa6ef4da3 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:30:16.993767 1221 raft_consensus.cc:513] T 27e1943c0c154ec68f7e0a75b39b1105 P 90c988d9adde44879ef11b8aa6ef4da3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:30:16.995062 1221 leader_election.cc:290] T 27e1943c0c154ec68f7e0a75b39b1105 P 90c988d9adde44879ef11b8aa6ef4da3 [CANDIDATE]: Term 3 election: Requested vote from peers 89a9444e93674a9d9e3d988af9c95a3e (127.0.106.129:44675), 5f009baf8a094da7a58d2a36ea888442 (127.0.106.130:37441)
I20250625 03:30:16.995960 1074 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "27e1943c0c154ec68f7e0a75b39b1105" candidate_uuid: "90c988d9adde44879ef11b8aa6ef4da3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "89a9444e93674a9d9e3d988af9c95a3e"
I20250625 03:30:16.996127 1148 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "27e1943c0c154ec68f7e0a75b39b1105" candidate_uuid: "90c988d9adde44879ef11b8aa6ef4da3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5f009baf8a094da7a58d2a36ea888442"
I20250625 03:30:16.996428 1074 raft_consensus.cc:3053] T 27e1943c0c154ec68f7e0a75b39b1105 P 89a9444e93674a9d9e3d988af9c95a3e [term 2 LEADER]: Stepping down as leader of term 2
I20250625 03:30:16.996595 1148 raft_consensus.cc:3058] T 27e1943c0c154ec68f7e0a75b39b1105 P 5f009baf8a094da7a58d2a36ea888442 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:30:16.996708 1074 raft_consensus.cc:738] T 27e1943c0c154ec68f7e0a75b39b1105 P 89a9444e93674a9d9e3d988af9c95a3e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 89a9444e93674a9d9e3d988af9c95a3e, State: Running, Role: LEADER
I20250625 03:30:16.997388 1074 consensus_queue.cc:260] T 27e1943c0c154ec68f7e0a75b39b1105 P 89a9444e93674a9d9e3d988af9c95a3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:30:16.998232 1074 raft_consensus.cc:3058] T 27e1943c0c154ec68f7e0a75b39b1105 P 89a9444e93674a9d9e3d988af9c95a3e [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:30:17.001140 1148 raft_consensus.cc:2466] T 27e1943c0c154ec68f7e0a75b39b1105 P 5f009baf8a094da7a58d2a36ea888442 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90c988d9adde44879ef11b8aa6ef4da3 in term 3.
I20250625 03:30:17.002080 1190 leader_election.cc:304] T 27e1943c0c154ec68f7e0a75b39b1105 P 90c988d9adde44879ef11b8aa6ef4da3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f009baf8a094da7a58d2a36ea888442, 90c988d9adde44879ef11b8aa6ef4da3; no voters:
I20250625 03:30:17.002219 1074 raft_consensus.cc:2466] T 27e1943c0c154ec68f7e0a75b39b1105 P 89a9444e93674a9d9e3d988af9c95a3e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90c988d9adde44879ef11b8aa6ef4da3 in term 3.
I20250625 03:30:17.002912 1400 raft_consensus.cc:2802] T 27e1943c0c154ec68f7e0a75b39b1105 P 90c988d9adde44879ef11b8aa6ef4da3 [term 3 FOLLOWER]: Leader election won for term 3
I20250625 03:30:17.003302 1400 raft_consensus.cc:695] T 27e1943c0c154ec68f7e0a75b39b1105 P 90c988d9adde44879ef11b8aa6ef4da3 [term 3 LEADER]: Becoming Leader. State: Replica: 90c988d9adde44879ef11b8aa6ef4da3, State: Running, Role: LEADER
I20250625 03:30:17.004001 1400 consensus_queue.cc:237] T 27e1943c0c154ec68f7e0a75b39b1105 P 90c988d9adde44879ef11b8aa6ef4da3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } }
I20250625 03:30:17.010772 972 catalog_manager.cc:5582] T 27e1943c0c154ec68f7e0a75b39b1105 P 90c988d9adde44879ef11b8aa6ef4da3 reported cstate change: term changed from 2 to 3, leader changed from 89a9444e93674a9d9e3d988af9c95a3e (127.0.106.129) to 90c988d9adde44879ef11b8aa6ef4da3 (127.0.106.131). New cstate: current_term: 3 leader_uuid: "90c988d9adde44879ef11b8aa6ef4da3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 } health_report { overall_health: HEALTHY } } }
I20250625 03:30:17.142839 1221 raft_consensus.cc:1273] T 0ee874019a27479a94caf3275d914259 P 90c988d9adde44879ef11b8aa6ef4da3 [term 5 FOLLOWER]: Refusing update from remote peer 5f009baf8a094da7a58d2a36ea888442: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20250625 03:30:17.144272 1397 consensus_queue.cc:1035] T 0ee874019a27479a94caf3275d914259 P 5f009baf8a094da7a58d2a36ea888442 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20250625 03:30:17.159907 1074 raft_consensus.cc:1273] T 0ee874019a27479a94caf3275d914259 P 89a9444e93674a9d9e3d988af9c95a3e [term 5 FOLLOWER]: Refusing update from remote peer 5f009baf8a094da7a58d2a36ea888442: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20250625 03:30:17.161756 1397 consensus_queue.cc:1035] T 0ee874019a27479a94caf3275d914259 P 5f009baf8a094da7a58d2a36ea888442 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250625 03:30:17.192528 1074 raft_consensus.cc:1273] T 1d26f90c72ff4068ad7d0b002f4546cc P 89a9444e93674a9d9e3d988af9c95a3e [term 4 FOLLOWER]: Refusing update from remote peer 5f009baf8a094da7a58d2a36ea888442: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20250625 03:30:17.193573 1397 consensus_queue.cc:1035] T 1d26f90c72ff4068ad7d0b002f4546cc P 5f009baf8a094da7a58d2a36ea888442 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:30:17.202785 1221 raft_consensus.cc:1273] T 1d26f90c72ff4068ad7d0b002f4546cc P 90c988d9adde44879ef11b8aa6ef4da3 [term 4 FOLLOWER]: Refusing update from remote peer 5f009baf8a094da7a58d2a36ea888442: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20250625 03:30:17.204229 1397 consensus_queue.cc:1035] T 1d26f90c72ff4068ad7d0b002f4546cc P 5f009baf8a094da7a58d2a36ea888442 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90c988d9adde44879ef11b8aa6ef4da3" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 42281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:30:17.255554 1074 raft_consensus.cc:1273] T 93d7b80866e64a77b925f730e300fe88 P 89a9444e93674a9d9e3d988af9c95a3e [term 4 FOLLOWER]: Refusing update from remote peer 90c988d9adde44879ef11b8aa6ef4da3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20250625 03:30:17.256971 1400 consensus_queue.cc:1035] T 93d7b80866e64a77b925f730e300fe88 P 90c988d9adde44879ef11b8aa6ef4da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:30:17.266654 1148 raft_consensus.cc:1273] T 93d7b80866e64a77b925f730e300fe88 P 5f009baf8a094da7a58d2a36ea888442 [term 4 FOLLOWER]: Refusing update from remote peer 90c988d9adde44879ef11b8aa6ef4da3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20250625 03:30:17.268132 1400 consensus_queue.cc:1035] T 93d7b80866e64a77b925f730e300fe88 P 90c988d9adde44879ef11b8aa6ef4da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:30:17.432433 1074 raft_consensus.cc:1273] T 27e1943c0c154ec68f7e0a75b39b1105 P 89a9444e93674a9d9e3d988af9c95a3e [term 3 FOLLOWER]: Refusing update from remote peer 90c988d9adde44879ef11b8aa6ef4da3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250625 03:30:17.433490 1400 consensus_queue.cc:1035] T 27e1943c0c154ec68f7e0a75b39b1105 P 90c988d9adde44879ef11b8aa6ef4da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89a9444e93674a9d9e3d988af9c95a3e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:30:17.436085 1148 raft_consensus.cc:1273] T 27e1943c0c154ec68f7e0a75b39b1105 P 5f009baf8a094da7a58d2a36ea888442 [term 3 FOLLOWER]: Refusing update from remote peer 90c988d9adde44879ef11b8aa6ef4da3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250625 03:30:17.437525 1437 consensus_queue.cc:1035] T 27e1943c0c154ec68f7e0a75b39b1105 P 90c988d9adde44879ef11b8aa6ef4da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f009baf8a094da7a58d2a36ea888442" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 37441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20250625 03:30:17.712572 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:30:17.718007 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250625 03:30:17.718462 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:30:18.719509 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:30:18.724673 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250625 03:30:18.725087 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:30:19.726001 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:30:19.731578 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250625 03:30:19.732035 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:30:20.732976 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:30:20.738126 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250625 03:30:20.738556 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:30:21.739451 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:30:21.744560 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250625 03:30:21.744979 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:30:22.745826 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:30:22.751348 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250625 03:30:22.751823 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:30:23.752774 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:30:23.761590 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250625 03:30:23.762180 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:30:24.763378 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:30:24.769615 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250625 03:30:24.769986 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:30:25.770901 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:30:25.777441 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250625 03:30:25.777814 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:30:26.805945 426 auto_leader_rebalancer-test.cc:388] The leader distribution is
I20250625 03:30:26.806427 426 tablet_server.cc:178] TabletServer@127.0.106.129:0 shutting down...
W20250625 03:30:26.824132 1188 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 2 similar messages]
W20250625 03:30:26.828401 1188 consensus_peers.cc:487] T 27e1943c0c154ec68f7e0a75b39b1105 P 90c988d9adde44879ef11b8aa6ef4da3 -> Peer 89a9444e93674a9d9e3d988af9c95a3e (127.0.106.129:44675): Couldn't send request to peer 89a9444e93674a9d9e3d988af9c95a3e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:30:26.834228 426 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250625 03:30:26.834996 426 tablet_replica.cc:331] T 0ee874019a27479a94caf3275d914259 P 89a9444e93674a9d9e3d988af9c95a3e: stopping tablet replica
I20250625 03:30:26.835678 426 raft_consensus.cc:2241] T 0ee874019a27479a94caf3275d914259 P 89a9444e93674a9d9e3d988af9c95a3e [term 5 FOLLOWER]: Raft consensus shutting down.
I20250625 03:30:26.836241 426 raft_consensus.cc:2270] T 0ee874019a27479a94caf3275d914259 P 89a9444e93674a9d9e3d988af9c95a3e [term 5 FOLLOWER]: Raft consensus is shut down!
W20250625 03:30:26.838431 1114 consensus_peers.cc:487] T 0ee874019a27479a94caf3275d914259 P 5f009baf8a094da7a58d2a36ea888442 -> Peer 89a9444e93674a9d9e3d988af9c95a3e (127.0.106.129:44675): Couldn't send request to peer 89a9444e93674a9d9e3d988af9c95a3e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:30:26.838672 426 tablet_replica.cc:331] T bc9758463ec04a4b93042f29add1a1fd P 89a9444e93674a9d9e3d988af9c95a3e: stopping tablet replica
I20250625 03:30:26.839202 426 raft_consensus.cc:2241] T bc9758463ec04a4b93042f29add1a1fd P 89a9444e93674a9d9e3d988af9c95a3e [term 4 LEADER]: Raft consensus shutting down.
I20250625 03:30:26.839915 426 raft_consensus.cc:2270] T bc9758463ec04a4b93042f29add1a1fd P 89a9444e93674a9d9e3d988af9c95a3e [term 4 FOLLOWER]: Raft consensus is shut down!
I20250625 03:30:26.841679 426 tablet_replica.cc:331] T 90089cf7177a4f67a5cc1bdfb9f179bd P 89a9444e93674a9d9e3d988af9c95a3e: stopping tablet replica
I20250625 03:30:26.842175 426 raft_consensus.cc:2241] T 90089cf7177a4f67a5cc1bdfb9f179bd P 89a9444e93674a9d9e3d988af9c95a3e [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:30:26.842545 426 raft_consensus.cc:2270] T 90089cf7177a4f67a5cc1bdfb9f179bd P 89a9444e93674a9d9e3d988af9c95a3e [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:30:26.844282 426 tablet_replica.cc:331] T 1d26f90c72ff4068ad7d0b002f4546cc P 89a9444e93674a9d9e3d988af9c95a3e: stopping tablet replica
I20250625 03:30:26.844712 426 raft_consensus.cc:2241] T 1d26f90c72ff4068ad7d0b002f4546cc P 89a9444e93674a9d9e3d988af9c95a3e [term 4 FOLLOWER]: Raft consensus shutting down.
I20250625 03:30:26.845049 426 raft_consensus.cc:2270] T 1d26f90c72ff4068ad7d0b002f4546cc P 89a9444e93674a9d9e3d988af9c95a3e [term 4 FOLLOWER]: Raft consensus is shut down!
I20250625 03:30:26.846501 426 tablet_replica.cc:331] T 86ab18af04f544ef8316b4caeaf781d2 P 89a9444e93674a9d9e3d988af9c95a3e: stopping tablet replica
I20250625 03:30:26.846954 426 raft_consensus.cc:2241] T 86ab18af04f544ef8316b4caeaf781d2 P 89a9444e93674a9d9e3d988af9c95a3e [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:30:26.847674 426 raft_consensus.cc:2270] T 86ab18af04f544ef8316b4caeaf781d2 P 89a9444e93674a9d9e3d988af9c95a3e [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:30:26.849296 426 tablet_replica.cc:331] T 93d7b80866e64a77b925f730e300fe88 P 89a9444e93674a9d9e3d988af9c95a3e: stopping tablet replica
I20250625 03:30:26.849763 426 raft_consensus.cc:2241] T 93d7b80866e64a77b925f730e300fe88 P 89a9444e93674a9d9e3d988af9c95a3e [term 4 FOLLOWER]: Raft consensus shutting down.
I20250625 03:30:26.850135 426 raft_consensus.cc:2270] T 93d7b80866e64a77b925f730e300fe88 P 89a9444e93674a9d9e3d988af9c95a3e [term 4 FOLLOWER]: Raft consensus is shut down!
I20250625 03:30:26.851644 426 tablet_replica.cc:331] T 6b62b2927d214886b92f502546868ca0 P 89a9444e93674a9d9e3d988af9c95a3e: stopping tablet replica
I20250625 03:30:26.852188 426 raft_consensus.cc:2241] T 6b62b2927d214886b92f502546868ca0 P 89a9444e93674a9d9e3d988af9c95a3e [term 3 LEADER]: Raft consensus shutting down.
I20250625 03:30:26.853068 426 raft_consensus.cc:2270] T 6b62b2927d214886b92f502546868ca0 P 89a9444e93674a9d9e3d988af9c95a3e [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:30:26.854883 426 tablet_replica.cc:331] T 513e577d0f2f4faea26726a7e8670a8d P 89a9444e93674a9d9e3d988af9c95a3e: stopping tablet replica
I20250625 03:30:26.855342 426 raft_consensus.cc:2241] T 513e577d0f2f4faea26726a7e8670a8d P 89a9444e93674a9d9e3d988af9c95a3e [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:30:26.855719 426 raft_consensus.cc:2270] T 513e577d0f2f4faea26726a7e8670a8d P 89a9444e93674a9d9e3d988af9c95a3e [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:30:26.857319 426 tablet_replica.cc:331] T 27e1943c0c154ec68f7e0a75b39b1105 P 89a9444e93674a9d9e3d988af9c95a3e: stopping tablet replica
I20250625 03:30:26.857746 426 raft_consensus.cc:2241] T 27e1943c0c154ec68f7e0a75b39b1105 P 89a9444e93674a9d9e3d988af9c95a3e [term 3 FOLLOWER]: Raft consensus shutting down.
I20250625 03:30:26.858109 426 raft_consensus.cc:2270] T 27e1943c0c154ec68f7e0a75b39b1105 P 89a9444e93674a9d9e3d988af9c95a3e [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:30:26.859673 426 tablet_replica.cc:331] T b6138e286d7448baa149c4952eb2fd0c P 89a9444e93674a9d9e3d988af9c95a3e: stopping tablet replica
I20250625 03:30:26.860129 426 raft_consensus.cc:2241] T b6138e286d7448baa149c4952eb2fd0c P 89a9444e93674a9d9e3d988af9c95a3e [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:30:26.860818 426 raft_consensus.cc:2270] T b6138e286d7448baa149c4952eb2fd0c P 89a9444e93674a9d9e3d988af9c95a3e [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:30:26.908663 426 tablet_server.cc:195] TabletServer@127.0.106.129:0 shutdown complete.
I20250625 03:30:26.927758 426 tablet_server.cc:178] TabletServer@127.0.106.130:0 shutting down...
I20250625 03:30:26.954969 426 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250625 03:30:26.955636 426 tablet_replica.cc:331] T 513e577d0f2f4faea26726a7e8670a8d P 5f009baf8a094da7a58d2a36ea888442: stopping tablet replica
I20250625 03:30:26.956305 426 raft_consensus.cc:2241] T 513e577d0f2f4faea26726a7e8670a8d P 5f009baf8a094da7a58d2a36ea888442 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:30:26.956794 426 raft_consensus.cc:2270] T 513e577d0f2f4faea26726a7e8670a8d P 5f009baf8a094da7a58d2a36ea888442 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:30:26.958515 426 tablet_replica.cc:331] T 27e1943c0c154ec68f7e0a75b39b1105 P 5f009baf8a094da7a58d2a36ea888442: stopping tablet replica
I20250625 03:30:26.958998 426 raft_consensus.cc:2241] T 27e1943c0c154ec68f7e0a75b39b1105 P 5f009baf8a094da7a58d2a36ea888442 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250625 03:30:26.959399 426 raft_consensus.cc:2270] T 27e1943c0c154ec68f7e0a75b39b1105 P 5f009baf8a094da7a58d2a36ea888442 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:30:26.961068 426 tablet_replica.cc:331] T b6138e286d7448baa149c4952eb2fd0c P 5f009baf8a094da7a58d2a36ea888442: stopping tablet replica
I20250625 03:30:26.961570 426 raft_consensus.cc:2241] T b6138e286d7448baa149c4952eb2fd0c P 5f009baf8a094da7a58d2a36ea888442 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:30:26.961956 426 raft_consensus.cc:2270] T b6138e286d7448baa149c4952eb2fd0c P 5f009baf8a094da7a58d2a36ea888442 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:30:26.963517 426 tablet_replica.cc:331] T 0ee874019a27479a94caf3275d914259 P 5f009baf8a094da7a58d2a36ea888442: stopping tablet replica
I20250625 03:30:26.963972 426 raft_consensus.cc:2241] T 0ee874019a27479a94caf3275d914259 P 5f009baf8a094da7a58d2a36ea888442 [term 5 LEADER]: Raft consensus shutting down.
I20250625 03:30:26.964696 426 raft_consensus.cc:2270] T 0ee874019a27479a94caf3275d914259 P 5f009baf8a094da7a58d2a36ea888442 [term 5 FOLLOWER]: Raft consensus is shut down!
I20250625 03:30:26.966313 426 tablet_replica.cc:331] T 1d26f90c72ff4068ad7d0b002f4546cc P 5f009baf8a094da7a58d2a36ea888442: stopping tablet replica
I20250625 03:30:26.966785 426 raft_consensus.cc:2241] T 1d26f90c72ff4068ad7d0b002f4546cc P 5f009baf8a094da7a58d2a36ea888442 [term 4 LEADER]: Raft consensus shutting down.
I20250625 03:30:26.967435 426 raft_consensus.cc:2270] T 1d26f90c72ff4068ad7d0b002f4546cc P 5f009baf8a094da7a58d2a36ea888442 [term 4 FOLLOWER]: Raft consensus is shut down!
I20250625 03:30:26.969165 426 tablet_replica.cc:331] T 86ab18af04f544ef8316b4caeaf781d2 P 5f009baf8a094da7a58d2a36ea888442: stopping tablet replica
I20250625 03:30:26.969622 426 raft_consensus.cc:2241] T 86ab18af04f544ef8316b4caeaf781d2 P 5f009baf8a094da7a58d2a36ea888442 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:30:26.969990 426 raft_consensus.cc:2270] T 86ab18af04f544ef8316b4caeaf781d2 P 5f009baf8a094da7a58d2a36ea888442 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:30:26.971575 426 tablet_replica.cc:331] T 93d7b80866e64a77b925f730e300fe88 P 5f009baf8a094da7a58d2a36ea888442: stopping tablet replica
I20250625 03:30:26.972115 426 raft_consensus.cc:2241] T 93d7b80866e64a77b925f730e300fe88 P 5f009baf8a094da7a58d2a36ea888442 [term 4 FOLLOWER]: Raft consensus shutting down.
I20250625 03:30:26.972558 426 raft_consensus.cc:2270] T 93d7b80866e64a77b925f730e300fe88 P 5f009baf8a094da7a58d2a36ea888442 [term 4 FOLLOWER]: Raft consensus is shut down!
I20250625 03:30:26.974045 426 tablet_replica.cc:331] T 6b62b2927d214886b92f502546868ca0 P 5f009baf8a094da7a58d2a36ea888442: stopping tablet replica
I20250625 03:30:26.974480 426 raft_consensus.cc:2241] T 6b62b2927d214886b92f502546868ca0 P 5f009baf8a094da7a58d2a36ea888442 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250625 03:30:26.974905 426 raft_consensus.cc:2270] T 6b62b2927d214886b92f502546868ca0 P 5f009baf8a094da7a58d2a36ea888442 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:30:26.976517 426 tablet_replica.cc:331] T bc9758463ec04a4b93042f29add1a1fd P 5f009baf8a094da7a58d2a36ea888442: stopping tablet replica
I20250625 03:30:26.976949 426 raft_consensus.cc:2241] T bc9758463ec04a4b93042f29add1a1fd P 5f009baf8a094da7a58d2a36ea888442 [term 4 FOLLOWER]: Raft consensus shutting down.
I20250625 03:30:26.977337 426 raft_consensus.cc:2270] T bc9758463ec04a4b93042f29add1a1fd P 5f009baf8a094da7a58d2a36ea888442 [term 4 FOLLOWER]: Raft consensus is shut down!
I20250625 03:30:26.979171 426 tablet_replica.cc:331] T 90089cf7177a4f67a5cc1bdfb9f179bd P 5f009baf8a094da7a58d2a36ea888442: stopping tablet replica
I20250625 03:30:26.979642 426 raft_consensus.cc:2241] T 90089cf7177a4f67a5cc1bdfb9f179bd P 5f009baf8a094da7a58d2a36ea888442 [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:30:26.980391 426 raft_consensus.cc:2270] T 90089cf7177a4f67a5cc1bdfb9f179bd P 5f009baf8a094da7a58d2a36ea888442 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:30:27.009238 426 tablet_server.cc:195] TabletServer@127.0.106.130:0 shutdown complete.
I20250625 03:30:27.028194 426 tablet_server.cc:178] TabletServer@127.0.106.131:0 shutting down...
I20250625 03:30:27.057379 426 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250625 03:30:27.058116 426 tablet_replica.cc:331] T 90089cf7177a4f67a5cc1bdfb9f179bd P 90c988d9adde44879ef11b8aa6ef4da3: stopping tablet replica
I20250625 03:30:27.058817 426 raft_consensus.cc:2241] T 90089cf7177a4f67a5cc1bdfb9f179bd P 90c988d9adde44879ef11b8aa6ef4da3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:30:27.059293 426 raft_consensus.cc:2270] T 90089cf7177a4f67a5cc1bdfb9f179bd P 90c988d9adde44879ef11b8aa6ef4da3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:30:27.061149 426 tablet_replica.cc:331] T 513e577d0f2f4faea26726a7e8670a8d P 90c988d9adde44879ef11b8aa6ef4da3: stopping tablet replica
I20250625 03:30:27.061662 426 raft_consensus.cc:2241] T 513e577d0f2f4faea26726a7e8670a8d P 90c988d9adde44879ef11b8aa6ef4da3 [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:30:27.062433 426 raft_consensus.cc:2270] T 513e577d0f2f4faea26726a7e8670a8d P 90c988d9adde44879ef11b8aa6ef4da3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:30:27.064534 426 tablet_replica.cc:331] T bc9758463ec04a4b93042f29add1a1fd P 90c988d9adde44879ef11b8aa6ef4da3: stopping tablet replica
I20250625 03:30:27.065028 426 raft_consensus.cc:2241] T bc9758463ec04a4b93042f29add1a1fd P 90c988d9adde44879ef11b8aa6ef4da3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20250625 03:30:27.065423 426 raft_consensus.cc:2270] T bc9758463ec04a4b93042f29add1a1fd P 90c988d9adde44879ef11b8aa6ef4da3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20250625 03:30:27.067106 426 tablet_replica.cc:331] T 0ee874019a27479a94caf3275d914259 P 90c988d9adde44879ef11b8aa6ef4da3: stopping tablet replica
I20250625 03:30:27.067580 426 raft_consensus.cc:2241] T 0ee874019a27479a94caf3275d914259 P 90c988d9adde44879ef11b8aa6ef4da3 [term 5 FOLLOWER]: Raft consensus shutting down.
I20250625 03:30:27.067972 426 raft_consensus.cc:2270] T 0ee874019a27479a94caf3275d914259 P 90c988d9adde44879ef11b8aa6ef4da3 [term 5 FOLLOWER]: Raft consensus is shut down!
I20250625 03:30:27.070081 426 tablet_replica.cc:331] T 1d26f90c72ff4068ad7d0b002f4546cc P 90c988d9adde44879ef11b8aa6ef4da3: stopping tablet replica
I20250625 03:30:27.070768 426 raft_consensus.cc:2241] T 1d26f90c72ff4068ad7d0b002f4546cc P 90c988d9adde44879ef11b8aa6ef4da3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20250625 03:30:27.071406 426 raft_consensus.cc:2270] T 1d26f90c72ff4068ad7d0b002f4546cc P 90c988d9adde44879ef11b8aa6ef4da3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20250625 03:30:27.074417 426 tablet_replica.cc:331] T 86ab18af04f544ef8316b4caeaf781d2 P 90c988d9adde44879ef11b8aa6ef4da3: stopping tablet replica
I20250625 03:30:27.075030 426 raft_consensus.cc:2241] T 86ab18af04f544ef8316b4caeaf781d2 P 90c988d9adde44879ef11b8aa6ef4da3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:30:27.075543 426 raft_consensus.cc:2270] T 86ab18af04f544ef8316b4caeaf781d2 P 90c988d9adde44879ef11b8aa6ef4da3 [term 2 FOLLOWER]: Raft consensus is shut down!
W20250625 03:30:27.075487 1190 consensus_peers.cc:487] T 27e1943c0c154ec68f7e0a75b39b1105 P 90c988d9adde44879ef11b8aa6ef4da3 -> Peer 5f009baf8a094da7a58d2a36ea888442 (127.0.106.130:37441): Couldn't send request to peer 5f009baf8a094da7a58d2a36ea888442. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.130:37441: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250625 03:30:27.077483 426 tablet_replica.cc:331] T 6b62b2927d214886b92f502546868ca0 P 90c988d9adde44879ef11b8aa6ef4da3: stopping tablet replica
I20250625 03:30:27.077961 426 raft_consensus.cc:2241] T 6b62b2927d214886b92f502546868ca0 P 90c988d9adde44879ef11b8aa6ef4da3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250625 03:30:27.078297 426 raft_consensus.cc:2270] T 6b62b2927d214886b92f502546868ca0 P 90c988d9adde44879ef11b8aa6ef4da3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:30:27.080096 426 tablet_replica.cc:331] T 93d7b80866e64a77b925f730e300fe88 P 90c988d9adde44879ef11b8aa6ef4da3: stopping tablet replica
I20250625 03:30:27.080598 426 raft_consensus.cc:2241] T 93d7b80866e64a77b925f730e300fe88 P 90c988d9adde44879ef11b8aa6ef4da3 [term 4 LEADER]: Raft consensus shutting down.
I20250625 03:30:27.081321 426 raft_consensus.cc:2270] T 93d7b80866e64a77b925f730e300fe88 P 90c988d9adde44879ef11b8aa6ef4da3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20250625 03:30:27.082916 426 tablet_replica.cc:331] T 27e1943c0c154ec68f7e0a75b39b1105 P 90c988d9adde44879ef11b8aa6ef4da3: stopping tablet replica
I20250625 03:30:27.083405 426 raft_consensus.cc:2241] T 27e1943c0c154ec68f7e0a75b39b1105 P 90c988d9adde44879ef11b8aa6ef4da3 [term 3 LEADER]: Raft consensus shutting down.
I20250625 03:30:27.096802 426 raft_consensus.cc:2270] T 27e1943c0c154ec68f7e0a75b39b1105 P 90c988d9adde44879ef11b8aa6ef4da3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:30:27.099947 426 tablet_replica.cc:331] T b6138e286d7448baa149c4952eb2fd0c P 90c988d9adde44879ef11b8aa6ef4da3: stopping tablet replica
I20250625 03:30:27.100596 426 raft_consensus.cc:2241] T b6138e286d7448baa149c4952eb2fd0c P 90c988d9adde44879ef11b8aa6ef4da3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:30:27.101209 426 raft_consensus.cc:2270] T b6138e286d7448baa149c4952eb2fd0c P 90c988d9adde44879ef11b8aa6ef4da3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:30:27.134325 426 tablet_server.cc:195] TabletServer@127.0.106.131:0 shutdown complete.
I20250625 03:30:27.158017 426 master.cc:561] Master@127.0.106.190:34593 shutting down...
I20250625 03:30:27.181273 426 raft_consensus.cc:2241] T 00000000000000000000000000000000 P 0e50f47b0e5c4dec9dd35afe9044df8b [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:30:27.182008 426 raft_consensus.cc:2270] T 00000000000000000000000000000000 P 0e50f47b0e5c4dec9dd35afe9044df8b [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:30:27.182367 426 tablet_replica.cc:331] T 00000000000000000000000000000000 P 0e50f47b0e5c4dec9dd35afe9044df8b: stopping tablet replica
I20250625 03:30:27.202512 426 master.cc:583] Master@127.0.106.190:34593 shutdown complete.
5f009baf8a094da7a58d2a36ea888442 4
89a9444e93674a9d9e3d988af9c95a3e 5
90c988d9adde44879ef11b8aa6ef4da3 1
5f009baf8a094da7a58d2a36ea888442 4
89a9444e93674a9d9e3d988af9c95a3e 3
90c988d9adde44879ef11b8aa6ef4da3 3
5f009baf8a094da7a58d2a36ea888442 1
89a9444e93674a9d9e3d988af9c95a3e 8
90c988d9adde44879ef11b8aa6ef4da3 1
5f009baf8a094da7a58d2a36ea888442 3
89a9444e93674a9d9e3d988af9c95a3e 4
90c988d9adde44879ef11b8aa6ef4da3 3
[ OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (29084 ms)
[ RUN ] LeaderRebalancerTest.AddTserver
I20250625 03:30:27.246907 426 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.106.190:39719
I20250625 03:30:27.248174 426 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250625 03:30:27.253461 1469 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250625 03:30:27.254493 1470 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250625 03:30:27.255369 1472 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250625 03:30:27.255647 426 server_base.cc:1048] running on GCE node
I20250625 03:30:27.256680 426 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250625 03:30:27.256865 426 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250625 03:30:27.256976 426 hybrid_clock.cc:648] HybridClock initialized: now 1750822227256965 us; error 0 us; skew 500 ppm
I20250625 03:30:27.257408 426 server_base.cc:848] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250625 03:30:27.260224 426 webserver.cc:469] Webserver started at http://127.0.106.190:34963/ using document root <none> and password file <none>
I20250625 03:30:27.260687 426 fs_manager.cc:362] Metadata directory not provided
I20250625 03:30:27.260834 426 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250625 03:30:27.261076 426 server_base.cc:896] This appears to be a new deployment of Kudu; creating new FS layout
I20250625 03:30:27.262288 426 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/master-0-root/instance:
uuid: "681a0ea90ed74b9d816182c76d9421d9"
format_stamp: "Formatted at 2025-06-25 03:30:27 on dist-test-slave-lj23"
I20250625 03:30:27.267112 426 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20250625 03:30:27.270473 1477 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250625 03:30:27.271310 426 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20250625 03:30:27.271591 426 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/master-0-root
uuid: "681a0ea90ed74b9d816182c76d9421d9"
format_stamp: "Formatted at 2025-06-25 03:30:27 on dist-test-slave-lj23"
I20250625 03:30:27.271888 426 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250625 03:30:27.296528 426 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250625 03:30:27.298128 426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250625 03:30:27.337132 426 rpc_server.cc:307] RPC server started. Bound to: 127.0.106.190:39719
I20250625 03:30:27.337234 1528 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.106.190:39719 every 8 connection(s)
I20250625 03:30:27.341149 1529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:27.351294 1529 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 681a0ea90ed74b9d816182c76d9421d9: Bootstrap starting.
I20250625 03:30:27.355814 1529 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 681a0ea90ed74b9d816182c76d9421d9: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:27.360291 1529 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 681a0ea90ed74b9d816182c76d9421d9: No bootstrap required, opened a new log
I20250625 03:30:27.362443 1529 raft_consensus.cc:357] T 00000000000000000000000000000000 P 681a0ea90ed74b9d816182c76d9421d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "681a0ea90ed74b9d816182c76d9421d9" member_type: VOTER }
I20250625 03:30:27.362866 1529 raft_consensus.cc:383] T 00000000000000000000000000000000 P 681a0ea90ed74b9d816182c76d9421d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:27.363050 1529 raft_consensus.cc:738] T 00000000000000000000000000000000 P 681a0ea90ed74b9d816182c76d9421d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 681a0ea90ed74b9d816182c76d9421d9, State: Initialized, Role: FOLLOWER
I20250625 03:30:27.363539 1529 consensus_queue.cc:260] T 00000000000000000000000000000000 P 681a0ea90ed74b9d816182c76d9421d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "681a0ea90ed74b9d816182c76d9421d9" member_type: VOTER }
I20250625 03:30:27.363998 1529 raft_consensus.cc:397] T 00000000000000000000000000000000 P 681a0ea90ed74b9d816182c76d9421d9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250625 03:30:27.364233 1529 raft_consensus.cc:491] T 00000000000000000000000000000000 P 681a0ea90ed74b9d816182c76d9421d9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250625 03:30:27.364447 1529 raft_consensus.cc:3058] T 00000000000000000000000000000000 P 681a0ea90ed74b9d816182c76d9421d9 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:27.368830 1529 raft_consensus.cc:513] T 00000000000000000000000000000000 P 681a0ea90ed74b9d816182c76d9421d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "681a0ea90ed74b9d816182c76d9421d9" member_type: VOTER }
I20250625 03:30:27.369324 1529 leader_election.cc:304] T 00000000000000000000000000000000 P 681a0ea90ed74b9d816182c76d9421d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 681a0ea90ed74b9d816182c76d9421d9; no voters:
I20250625 03:30:27.370394 1529 leader_election.cc:290] T 00000000000000000000000000000000 P 681a0ea90ed74b9d816182c76d9421d9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20250625 03:30:27.370779 1532 raft_consensus.cc:2802] T 00000000000000000000000000000000 P 681a0ea90ed74b9d816182c76d9421d9 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:30:27.372099 1532 raft_consensus.cc:695] T 00000000000000000000000000000000 P 681a0ea90ed74b9d816182c76d9421d9 [term 1 LEADER]: Becoming Leader. State: Replica: 681a0ea90ed74b9d816182c76d9421d9, State: Running, Role: LEADER
I20250625 03:30:27.372725 1532 consensus_queue.cc:237] T 00000000000000000000000000000000 P 681a0ea90ed74b9d816182c76d9421d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "681a0ea90ed74b9d816182c76d9421d9" member_type: VOTER }
I20250625 03:30:27.373448 1529 sys_catalog.cc:564] T 00000000000000000000000000000000 P 681a0ea90ed74b9d816182c76d9421d9 [sys.catalog]: configured and running, proceeding with master startup.
I20250625 03:30:27.379256 1534 sys_catalog.cc:455] T 00000000000000000000000000000000 P 681a0ea90ed74b9d816182c76d9421d9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 681a0ea90ed74b9d816182c76d9421d9. Latest consensus state: current_term: 1 leader_uuid: "681a0ea90ed74b9d816182c76d9421d9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "681a0ea90ed74b9d816182c76d9421d9" member_type: VOTER } }
I20250625 03:30:27.379884 1534 sys_catalog.cc:458] T 00000000000000000000000000000000 P 681a0ea90ed74b9d816182c76d9421d9 [sys.catalog]: This master's current role is: LEADER
I20250625 03:30:27.379796 1533 sys_catalog.cc:455] T 00000000000000000000000000000000 P 681a0ea90ed74b9d816182c76d9421d9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "681a0ea90ed74b9d816182c76d9421d9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "681a0ea90ed74b9d816182c76d9421d9" member_type: VOTER } }
I20250625 03:30:27.380458 1533 sys_catalog.cc:458] T 00000000000000000000000000000000 P 681a0ea90ed74b9d816182c76d9421d9 [sys.catalog]: This master's current role is: LEADER
I20250625 03:30:27.382112 1539 catalog_manager.cc:1477] Loading table and tablet metadata into memory...
I20250625 03:30:27.389816 1539 catalog_manager.cc:1486] Initializing Kudu cluster ID...
I20250625 03:30:27.390836 426 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20250625 03:30:27.398960 1539 catalog_manager.cc:1349] Generated new cluster ID: caa2a5cba7934e649b71c7aa7234b397
I20250625 03:30:27.399268 1539 catalog_manager.cc:1497] Initializing Kudu internal certificate authority...
I20250625 03:30:27.414690 1539 catalog_manager.cc:1372] Generated new certificate authority record
I20250625 03:30:27.415953 1539 catalog_manager.cc:1506] Loading token signing keys...
I20250625 03:30:27.431603 1539 catalog_manager.cc:5955] T 00000000000000000000000000000000 P 681a0ea90ed74b9d816182c76d9421d9: Generated new TSK 0
I20250625 03:30:27.432211 1539 catalog_manager.cc:1516] Initializing in-progress tserver states...
I20250625 03:30:27.457324 426 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250625 03:30:27.463204 1550 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250625 03:30:27.464146 1551 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250625 03:30:27.465688 1553 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250625 03:30:27.466468 426 server_base.cc:1048] running on GCE node
I20250625 03:30:27.467377 426 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250625 03:30:27.467573 426 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250625 03:30:27.467738 426 hybrid_clock.cc:648] HybridClock initialized: now 1750822227467718 us; error 0 us; skew 500 ppm
I20250625 03:30:27.468305 426 server_base.cc:848] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250625 03:30:27.470785 426 webserver.cc:469] Webserver started at http://127.0.106.129:33383/ using document root <none> and password file <none>
I20250625 03:30:27.471277 426 fs_manager.cc:362] Metadata directory not provided
I20250625 03:30:27.471437 426 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250625 03:30:27.471714 426 server_base.cc:896] This appears to be a new deployment of Kudu; creating new FS layout
I20250625 03:30:27.472924 426 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/ts-0-root/instance:
uuid: "7e9c4f2e01164f33b2e9034ed148398e"
format_stamp: "Formatted at 2025-06-25 03:30:27 on dist-test-slave-lj23"
I20250625 03:30:27.477596 426 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20250625 03:30:27.480955 1558 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250625 03:30:27.481781 426 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20250625 03:30:27.482069 426 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/ts-0-root
uuid: "7e9c4f2e01164f33b2e9034ed148398e"
format_stamp: "Formatted at 2025-06-25 03:30:27 on dist-test-slave-lj23"
I20250625 03:30:27.482316 426 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250625 03:30:27.511449 426 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250625 03:30:27.512663 426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250625 03:30:27.514211 426 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20250625 03:30:27.516460 426 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250625 03:30:27.516664 426 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250625 03:30:27.516846 426 ts_tablet_manager.cc:610] Registered 0 tablets
I20250625 03:30:27.516983 426 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250625 03:30:27.557147 426 rpc_server.cc:307] RPC server started. Bound to: 127.0.106.129:39903
I20250625 03:30:27.557224 1620 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.106.129:39903 every 8 connection(s)
I20250625 03:30:27.561743 426 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250625 03:30:27.569337 1625 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250625 03:30:27.571317 1626 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250625 03:30:27.574947 1628 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250625 03:30:27.576407 426 server_base.cc:1048] running on GCE node
I20250625 03:30:27.577446 426 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250625 03:30:27.577644 426 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250625 03:30:27.577852 426 hybrid_clock.cc:648] HybridClock initialized: now 1750822227577832 us; error 0 us; skew 500 ppm
I20250625 03:30:27.577922 1621 heartbeater.cc:344] Connected to a master server at 127.0.106.190:39719
I20250625 03:30:27.578516 1621 heartbeater.cc:461] Registering TS with master...
I20250625 03:30:27.578902 426 server_base.cc:848] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250625 03:30:27.579293 1621 heartbeater.cc:507] Master 127.0.106.190:39719 requested a full tablet report, sending...
I20250625 03:30:27.581496 1494 ts_manager.cc:194] Registered new tserver with Master: 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903)
I20250625 03:30:27.581699 426 webserver.cc:469] Webserver started at http://127.0.106.130:42151/ using document root <none> and password file <none>
I20250625 03:30:27.582252 426 fs_manager.cc:362] Metadata directory not provided
I20250625 03:30:27.582448 426 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250625 03:30:27.582693 426 server_base.cc:896] This appears to be a new deployment of Kudu; creating new FS layout
I20250625 03:30:27.583360 1494 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38140
I20250625 03:30:27.583923 426 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/ts-1-root/instance:
uuid: "3f2aa40978064c9e9983cf3745eed206"
format_stamp: "Formatted at 2025-06-25 03:30:27 on dist-test-slave-lj23"
I20250625 03:30:27.588570 426 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20250625 03:30:27.591912 1633 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250625 03:30:27.592778 426 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20250625 03:30:27.593034 426 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/ts-1-root
uuid: "3f2aa40978064c9e9983cf3745eed206"
format_stamp: "Formatted at 2025-06-25 03:30:27 on dist-test-slave-lj23"
I20250625 03:30:27.593272 426 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250625 03:30:27.631735 426 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250625 03:30:27.633059 426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250625 03:30:27.634478 426 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20250625 03:30:27.636679 426 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250625 03:30:27.636862 426 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250625 03:30:27.637035 426 ts_tablet_manager.cc:610] Registered 0 tablets
I20250625 03:30:27.637156 426 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250625 03:30:27.677778 426 rpc_server.cc:307] RPC server started. Bound to: 127.0.106.130:34293
I20250625 03:30:27.677886 1695 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.106.130:34293 every 8 connection(s)
I20250625 03:30:27.682384 426 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250625 03:30:27.691008 1699 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250625 03:30:27.692184 1700 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250625 03:30:27.693840 1702 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250625 03:30:27.694173 1696 heartbeater.cc:344] Connected to a master server at 127.0.106.190:39719
I20250625 03:30:27.694586 1696 heartbeater.cc:461] Registering TS with master...
I20250625 03:30:27.695317 1696 heartbeater.cc:507] Master 127.0.106.190:39719 requested a full tablet report, sending...
I20250625 03:30:27.697247 1494 ts_manager.cc:194] Registered new tserver with Master: 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:27.697795 426 server_base.cc:1048] running on GCE node
I20250625 03:30:27.698858 426 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20250625 03:30:27.699019 1494 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38146
W20250625 03:30:27.699136 426 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250625 03:30:27.699442 426 hybrid_clock.cc:648] HybridClock initialized: now 1750822227699423 us; error 0 us; skew 500 ppm
I20250625 03:30:27.700277 426 server_base.cc:848] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250625 03:30:27.702773 426 webserver.cc:469] Webserver started at http://127.0.106.131:41741/ using document root <none> and password file <none>
I20250625 03:30:27.703238 426 fs_manager.cc:362] Metadata directory not provided
I20250625 03:30:27.703409 426 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250625 03:30:27.703648 426 server_base.cc:896] This appears to be a new deployment of Kudu; creating new FS layout
I20250625 03:30:27.704841 426 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/ts-2-root/instance:
uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
format_stamp: "Formatted at 2025-06-25 03:30:27 on dist-test-slave-lj23"
I20250625 03:30:27.709156 426 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20250625 03:30:27.712447 1707 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250625 03:30:27.713193 426 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20250625 03:30:27.713478 426 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/ts-2-root
uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
format_stamp: "Formatted at 2025-06-25 03:30:27 on dist-test-slave-lj23"
I20250625 03:30:27.713757 426 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250625 03:30:27.724326 426 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250625 03:30:27.725565 426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250625 03:30:27.727030 426 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20250625 03:30:27.729310 426 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250625 03:30:27.729524 426 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250625 03:30:27.729763 426 ts_tablet_manager.cc:610] Registered 0 tablets
I20250625 03:30:27.729925 426 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250625 03:30:27.768702 426 rpc_server.cc:307] RPC server started. Bound to: 127.0.106.131:39359
I20250625 03:30:27.768816 1769 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.106.131:39359 every 8 connection(s)
I20250625 03:30:27.783035 1770 heartbeater.cc:344] Connected to a master server at 127.0.106.190:39719
I20250625 03:30:27.783378 1770 heartbeater.cc:461] Registering TS with master...
I20250625 03:30:27.784140 1770 heartbeater.cc:507] Master 127.0.106.190:39719 requested a full tablet report, sending...
I20250625 03:30:27.786010 1494 ts_manager.cc:194] Registered new tserver with Master: ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:27.786471 426 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014849622s
I20250625 03:30:27.787284 1494 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38160
I20250625 03:30:27.789096 426 test_util.cc:276] Using random seed: 284411154
I20250625 03:30:27.812420 1494 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38164:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 03:30:27.818728 1494 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 03:30:28.027212 1660 tablet_service.cc:1468] Processing CreateTablet for tablet afe48b30a4e64a4d8faf2a5b42d5c706 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20250625 03:30:28.028367 1735 tablet_service.cc:1468] Processing CreateTablet for tablet 1fff19a38e8d4880a14da6b4c8284cc2 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION VALUES < 36398027
I20250625 03:30:28.028851 1660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afe48b30a4e64a4d8faf2a5b42d5c706. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.029757 1735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fff19a38e8d4880a14da6b4c8284cc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.029378 1659 tablet_service.cc:1468] Processing CreateTablet for tablet b15eb94b9d3d4f6987b5fa5e20193655 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20250625 03:30:28.030745 1659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b15eb94b9d3d4f6987b5fa5e20193655. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.031508 1726 tablet_service.cc:1468] Processing CreateTablet for tablet c4354f7ffc0e4eabbc92a141d46b7984 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20250625 03:30:28.031679 1661 tablet_service.cc:1468] Processing CreateTablet for tablet 1fff19a38e8d4880a14da6b4c8284cc2 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION VALUES < 36398027
I20250625 03:30:28.032856 1726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4354f7ffc0e4eabbc92a141d46b7984. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.033031 1661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fff19a38e8d4880a14da6b4c8284cc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.033219 1658 tablet_service.cc:1468] Processing CreateTablet for tablet 6e7283d035e1429f946d8ebb98978656 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20250625 03:30:28.033267 1727 tablet_service.cc:1468] Processing CreateTablet for tablet 731095860aad436e9658ab3ff5010f9d (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20250625 03:30:28.034556 1658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e7283d035e1429f946d8ebb98978656. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.034672 1727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 731095860aad436e9658ab3ff5010f9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.037240 1657 tablet_service.cc:1468] Processing CreateTablet for tablet 40b74a261fdd495f84ceb0690f0b30ba (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20250625 03:30:28.038630 1657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40b74a261fdd495f84ceb0690f0b30ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.038447 1729 tablet_service.cc:1468] Processing CreateTablet for tablet 9643cfd400804eb8b9037c5e9efddfba (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20250625 03:30:28.039775 1729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9643cfd400804eb8b9037c5e9efddfba. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.041198 1656 tablet_service.cc:1468] Processing CreateTablet for tablet 85e02bb33a944989ada7f600c1e802da (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20250625 03:30:28.042488 1656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85e02bb33a944989ada7f600c1e802da. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.042354 1731 tablet_service.cc:1468] Processing CreateTablet for tablet 40b74a261fdd495f84ceb0690f0b30ba (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20250625 03:30:28.044675 1732 tablet_service.cc:1468] Processing CreateTablet for tablet 6e7283d035e1429f946d8ebb98978656 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20250625 03:30:28.045222 1655 tablet_service.cc:1468] Processing CreateTablet for tablet 9643cfd400804eb8b9037c5e9efddfba (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20250625 03:30:28.046496 1655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9643cfd400804eb8b9037c5e9efddfba. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.046962 1733 tablet_service.cc:1468] Processing CreateTablet for tablet b15eb94b9d3d4f6987b5fa5e20193655 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20250625 03:30:28.041199 1730 tablet_service.cc:1468] Processing CreateTablet for tablet 85e02bb33a944989ada7f600c1e802da (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20250625 03:30:28.037266 1728 tablet_service.cc:1468] Processing CreateTablet for tablet e4034c33d83e4a96a187eaed46416e3c (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20250625 03:30:28.052980 1652 tablet_service.cc:1468] Processing CreateTablet for tablet c4354f7ffc0e4eabbc92a141d46b7984 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20250625 03:30:28.053848 1654 tablet_service.cc:1468] Processing CreateTablet for tablet e4034c33d83e4a96a187eaed46416e3c (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20250625 03:30:28.054504 1652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4354f7ffc0e4eabbc92a141d46b7984. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.055157 1654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4034c33d83e4a96a187eaed46416e3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.049110 1734 tablet_service.cc:1468] Processing CreateTablet for tablet afe48b30a4e64a4d8faf2a5b42d5c706 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20250625 03:30:28.053138 1653 tablet_service.cc:1468] Processing CreateTablet for tablet 731095860aad436e9658ab3ff5010f9d (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20250625 03:30:28.061376 1733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b15eb94b9d3d4f6987b5fa5e20193655. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.064356 1728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4034c33d83e4a96a187eaed46416e3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.065146 1653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 731095860aad436e9658ab3ff5010f9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.065575 1730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85e02bb33a944989ada7f600c1e802da. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.066340 1734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afe48b30a4e64a4d8faf2a5b42d5c706. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.066982 1731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40b74a261fdd495f84ceb0690f0b30ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.067592 1732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e7283d035e1429f946d8ebb98978656. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.081224 1586 tablet_service.cc:1468] Processing CreateTablet for tablet 1fff19a38e8d4880a14da6b4c8284cc2 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION VALUES < 36398027
I20250625 03:30:28.082580 1586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fff19a38e8d4880a14da6b4c8284cc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.085233 1585 tablet_service.cc:1468] Processing CreateTablet for tablet afe48b30a4e64a4d8faf2a5b42d5c706 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20250625 03:30:28.086566 1585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afe48b30a4e64a4d8faf2a5b42d5c706. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.089624 1584 tablet_service.cc:1468] Processing CreateTablet for tablet b15eb94b9d3d4f6987b5fa5e20193655 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20250625 03:30:28.091553 1584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b15eb94b9d3d4f6987b5fa5e20193655. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.097262 1583 tablet_service.cc:1468] Processing CreateTablet for tablet 6e7283d035e1429f946d8ebb98978656 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20250625 03:30:28.098664 1583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e7283d035e1429f946d8ebb98978656. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.101269 1582 tablet_service.cc:1468] Processing CreateTablet for tablet 40b74a261fdd495f84ceb0690f0b30ba (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20250625 03:30:28.102639 1582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40b74a261fdd495f84ceb0690f0b30ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.105201 1580 tablet_service.cc:1468] Processing CreateTablet for tablet 9643cfd400804eb8b9037c5e9efddfba (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20250625 03:30:28.106611 1580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9643cfd400804eb8b9037c5e9efddfba. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.112601 1581 tablet_service.cc:1468] Processing CreateTablet for tablet 85e02bb33a944989ada7f600c1e802da (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20250625 03:30:28.114019 1581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85e02bb33a944989ada7f600c1e802da. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.115782 1653 tablet_service.cc:1468] Processing CreateTablet for tablet 542f85d76df8432593ee963669155a9d (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20250625 03:30:28.118456 1653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 542f85d76df8432593ee963669155a9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.120904 1578 tablet_service.cc:1468] Processing CreateTablet for tablet 731095860aad436e9658ab3ff5010f9d (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20250625 03:30:28.122248 1578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 731095860aad436e9658ab3ff5010f9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.125738 1577 tablet_service.cc:1468] Processing CreateTablet for tablet c4354f7ffc0e4eabbc92a141d46b7984 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20250625 03:30:28.118659 1579 tablet_service.cc:1468] Processing CreateTablet for tablet e4034c33d83e4a96a187eaed46416e3c (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20250625 03:30:28.127787 1577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4354f7ffc0e4eabbc92a141d46b7984. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.127456 1655 tablet_service.cc:1468] Processing CreateTablet for tablet f957bf9749c54be48094092cb80e9055 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20250625 03:30:28.128763 1655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f957bf9749c54be48094092cb80e9055. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.130812 1658 tablet_service.cc:1468] Processing CreateTablet for tablet d9038fc1ce0d4b528c02c68012e1277d (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20250625 03:30:28.140151 1658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9038fc1ce0d4b528c02c68012e1277d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.140787 1579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4034c33d83e4a96a187eaed46416e3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.149226 1652 tablet_service.cc:1468] Processing CreateTablet for tablet fb6e83db706647e28e491a02f1641980 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20250625 03:30:28.155401 1652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb6e83db706647e28e491a02f1641980. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.174253 1735 tablet_service.cc:1468] Processing CreateTablet for tablet 542f85d76df8432593ee963669155a9d (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20250625 03:30:28.181628 1660 tablet_service.cc:1468] Processing CreateTablet for tablet f9458dec7953448d8550396d67fad249 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20250625 03:30:28.182926 1660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9458dec7953448d8550396d67fad249. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.184736 1735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 542f85d76df8432593ee963669155a9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.188551 1727 tablet_service.cc:1468] Processing CreateTablet for tablet f957bf9749c54be48094092cb80e9055 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20250625 03:30:28.189934 1727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f957bf9749c54be48094092cb80e9055. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.189610 1654 tablet_service.cc:1468] Processing CreateTablet for tablet d50c52b197294003b238a37da2fb55d8 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20250625 03:30:28.191309 1654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d50c52b197294003b238a37da2fb55d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.204843 1728 tablet_service.cc:1468] Processing CreateTablet for tablet d9038fc1ce0d4b528c02c68012e1277d (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20250625 03:30:28.206888 1728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9038fc1ce0d4b528c02c68012e1277d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.204843 1659 tablet_service.cc:1468] Processing CreateTablet for tablet 615cebbffcfc44e19b8f7a1e842073a3 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20250625 03:30:28.210242 1659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 615cebbffcfc44e19b8f7a1e842073a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.219843 1726 tablet_service.cc:1468] Processing CreateTablet for tablet fb6e83db706647e28e491a02f1641980 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20250625 03:30:28.221349 1726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb6e83db706647e28e491a02f1641980. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.224862 1655 tablet_service.cc:1468] Processing CreateTablet for tablet 6cc384f27ff041c0be70bb661ae610dd (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20250625 03:30:28.226439 1655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cc384f27ff041c0be70bb661ae610dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.242491 1787 tablet_bootstrap.cc:492] T e4034c33d83e4a96a187eaed46416e3c P 7e9c4f2e01164f33b2e9034ed148398e: Bootstrap starting.
I20250625 03:30:28.242347 1579 tablet_service.cc:1468] Processing CreateTablet for tablet fb6e83db706647e28e491a02f1641980 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20250625 03:30:28.242647 1583 tablet_service.cc:1468] Processing CreateTablet for tablet f9458dec7953448d8550396d67fad249 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20250625 03:30:28.244956 1579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb6e83db706647e28e491a02f1641980. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.245568 1583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9458dec7953448d8550396d67fad249. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.248754 1656 tablet_service.cc:1468] Processing CreateTablet for tablet f8c715109ff0405997e1ca9952678c0d (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20250625 03:30:28.250032 1656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8c715109ff0405997e1ca9952678c0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.249892 1578 tablet_service.cc:1468] Processing CreateTablet for tablet d9038fc1ce0d4b528c02c68012e1277d (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20250625 03:30:28.253218 1734 tablet_service.cc:1468] Processing CreateTablet for tablet f9458dec7953448d8550396d67fad249 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20250625 03:30:28.253927 1578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9038fc1ce0d4b528c02c68012e1277d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.255163 1730 tablet_service.cc:1468] Processing CreateTablet for tablet d50c52b197294003b238a37da2fb55d8 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20250625 03:30:28.257035 1657 tablet_service.cc:1468] Processing CreateTablet for tablet dea2dcc26f144802a16f0884fdd99063 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20250625 03:30:28.258229 1657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dea2dcc26f144802a16f0884fdd99063. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.258548 1584 tablet_service.cc:1468] Processing CreateTablet for tablet f957bf9749c54be48094092cb80e9055 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20250625 03:30:28.260125 1582 tablet_service.cc:1468] Processing CreateTablet for tablet 542f85d76df8432593ee963669155a9d (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20250625 03:30:28.254465 1734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9458dec7953448d8550396d67fad249. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.269673 1661 tablet_service.cc:1468] Processing CreateTablet for tablet af4573692c104d67994dbb1bc518b568 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20250625 03:30:28.270994 1661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af4573692c104d67994dbb1bc518b568. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.273736 1733 tablet_service.cc:1468] Processing CreateTablet for tablet 6cc384f27ff041c0be70bb661ae610dd (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20250625 03:30:28.278029 1729 tablet_service.cc:1468] Processing CreateTablet for tablet f8c715109ff0405997e1ca9952678c0d (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20250625 03:30:28.278784 1726 tablet_service.cc:1468] Processing CreateTablet for tablet 615cebbffcfc44e19b8f7a1e842073a3 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20250625 03:30:28.286777 1652 tablet_service.cc:1468] Processing CreateTablet for tablet 465c15a46933411a985f29059fdb1c9f (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20250625 03:30:28.287535 1787 tablet_bootstrap.cc:654] T e4034c33d83e4a96a187eaed46416e3c P 7e9c4f2e01164f33b2e9034ed148398e: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:28.290437 1733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cc384f27ff041c0be70bb661ae610dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.296327 1730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d50c52b197294003b238a37da2fb55d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.301576 1580 tablet_service.cc:1468] Processing CreateTablet for tablet d50c52b197294003b238a37da2fb55d8 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20250625 03:30:28.302984 1580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d50c52b197294003b238a37da2fb55d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.312672 1785 tablet_bootstrap.cc:492] T 1fff19a38e8d4880a14da6b4c8284cc2 P 3f2aa40978064c9e9983cf3745eed206: Bootstrap starting.
I20250625 03:30:28.312923 1786 tablet_bootstrap.cc:492] T c4354f7ffc0e4eabbc92a141d46b7984 P ba464e89e0f044a0a0ea3e6125cbf2a1: Bootstrap starting.
I20250625 03:30:28.313473 1581 tablet_service.cc:1468] Processing CreateTablet for tablet 615cebbffcfc44e19b8f7a1e842073a3 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20250625 03:30:28.325057 1659 tablet_service.cc:1468] Processing CreateTablet for tablet 0c2b6052daaa4c57aaa55361e8d6e01c (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20250625 03:30:28.325532 1586 tablet_service.cc:1468] Processing CreateTablet for tablet dea2dcc26f144802a16f0884fdd99063 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20250625 03:30:28.325057 1578 tablet_service.cc:1468] Processing CreateTablet for tablet f8c715109ff0405997e1ca9952678c0d (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20250625 03:30:28.328193 1729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8c715109ff0405997e1ca9952678c0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.332195 1733 tablet_service.cc:1468] Processing CreateTablet for tablet dea2dcc26f144802a16f0884fdd99063 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20250625 03:30:28.334187 1731 tablet_service.cc:1468] Processing CreateTablet for tablet af4573692c104d67994dbb1bc518b568 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20250625 03:30:28.334612 1733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dea2dcc26f144802a16f0884fdd99063. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.334164 1786 tablet_bootstrap.cc:654] T c4354f7ffc0e4eabbc92a141d46b7984 P ba464e89e0f044a0a0ea3e6125cbf2a1: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:28.336959 1731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af4573692c104d67994dbb1bc518b568. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.340914 1728 tablet_service.cc:1468] Processing CreateTablet for tablet 465c15a46933411a985f29059fdb1c9f (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20250625 03:30:28.342231 1728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 465c15a46933411a985f29059fdb1c9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.344265 1584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f957bf9749c54be48094092cb80e9055. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.348325 1582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 542f85d76df8432593ee963669155a9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.350251 1581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 615cebbffcfc44e19b8f7a1e842073a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.352365 1733 tablet_service.cc:1468] Processing CreateTablet for tablet 0c2b6052daaa4c57aaa55361e8d6e01c (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20250625 03:30:28.353256 1579 tablet_service.cc:1468] Processing CreateTablet for tablet 6cc384f27ff041c0be70bb661ae610dd (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20250625 03:30:28.353731 1733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c2b6052daaa4c57aaa55361e8d6e01c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.354489 1579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cc384f27ff041c0be70bb661ae610dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.356316 1586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dea2dcc26f144802a16f0884fdd99063. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.356981 1734 tablet_service.cc:1468] Processing CreateTablet for tablet 3c2c045dee4b4b4faa93fa9d0ccdaa1c (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20250625 03:30:28.358294 1734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c2c045dee4b4b4faa93fa9d0ccdaa1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.362082 1655 tablet_service.cc:1468] Processing CreateTablet for tablet 3c2c045dee4b4b4faa93fa9d0ccdaa1c (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20250625 03:30:28.314282 1652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 465c15a46933411a985f29059fdb1c9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.373142 1728 tablet_service.cc:1468] Processing CreateTablet for tablet e88f79ed06514e01a9bc48261a5acfbb (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20250625 03:30:28.373049 1733 tablet_service.cc:1468] Processing CreateTablet for tablet 0e7eb287e9514c838aeed599d2703682 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20250625 03:30:28.374449 1728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e88f79ed06514e01a9bc48261a5acfbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.374663 1659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c2b6052daaa4c57aaa55361e8d6e01c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.375205 1733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e7eb287e9514c838aeed599d2703682. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.380131 1577 tablet_service.cc:1468] Processing CreateTablet for tablet af4573692c104d67994dbb1bc518b568 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20250625 03:30:28.381434 1577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af4573692c104d67994dbb1bc518b568. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 03:30:28.385262 1542 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20250625 03:30:28.389995 1655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c2c045dee4b4b4faa93fa9d0ccdaa1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.391506 1726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 615cebbffcfc44e19b8f7a1e842073a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.391309 1734 tablet_service.cc:1468] Processing CreateTablet for tablet 96030b80e1f340afa81659faaaf68755 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20250625 03:30:28.393087 1734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96030b80e1f340afa81659faaaf68755. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.395076 1654 tablet_service.cc:1468] Processing CreateTablet for tablet 0e7eb287e9514c838aeed599d2703682 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20250625 03:30:28.396651 1654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e7eb287e9514c838aeed599d2703682. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.402614 1787 tablet_bootstrap.cc:492] T e4034c33d83e4a96a187eaed46416e3c P 7e9c4f2e01164f33b2e9034ed148398e: No bootstrap required, opened a new log
I20250625 03:30:28.403116 1787 ts_tablet_manager.cc:1397] T e4034c33d83e4a96a187eaed46416e3c P 7e9c4f2e01164f33b2e9034ed148398e: Time spent bootstrapping tablet: real 0.161s user 0.012s sys 0.004s
I20250625 03:30:28.405434 1735 tablet_service.cc:1468] Processing CreateTablet for tablet 9f7fbf33df3d429ab16f0ae3a2684207 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20250625 03:30:28.406030 1787 raft_consensus.cc:357] T e4034c33d83e4a96a187eaed46416e3c P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:28.407052 1787 raft_consensus.cc:383] T e4034c33d83e4a96a187eaed46416e3c P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:28.407390 1787 raft_consensus.cc:738] T e4034c33d83e4a96a187eaed46416e3c P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Initialized, Role: FOLLOWER
I20250625 03:30:28.406781 1735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f7fbf33df3d429ab16f0ae3a2684207. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.408272 1787 consensus_queue.cc:260] T e4034c33d83e4a96a187eaed46416e3c P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:28.409188 1660 tablet_service.cc:1468] Processing CreateTablet for tablet e88f79ed06514e01a9bc48261a5acfbb (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20250625 03:30:28.410445 1660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e88f79ed06514e01a9bc48261a5acfbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.414284 1733 tablet_service.cc:1468] Processing CreateTablet for tablet fd279ddcf72a40e1bf2ec42a4f35e639 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20250625 03:30:28.416253 1733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd279ddcf72a40e1bf2ec42a4f35e639. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.424855 1653 tablet_service.cc:1468] Processing CreateTablet for tablet 96030b80e1f340afa81659faaaf68755 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20250625 03:30:28.426216 1653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96030b80e1f340afa81659faaaf68755. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.430627 1785 tablet_bootstrap.cc:654] T 1fff19a38e8d4880a14da6b4c8284cc2 P 3f2aa40978064c9e9983cf3745eed206: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:28.443411 1658 tablet_service.cc:1468] Processing CreateTablet for tablet 9f7fbf33df3d429ab16f0ae3a2684207 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20250625 03:30:28.444875 1658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f7fbf33df3d429ab16f0ae3a2684207. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.462405 1621 heartbeater.cc:499] Master 127.0.106.190:39719 was elected leader, sending a full tablet report...
I20250625 03:30:28.463828 1585 tablet_service.cc:1468] Processing CreateTablet for tablet 465c15a46933411a985f29059fdb1c9f (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20250625 03:30:28.472937 1657 tablet_service.cc:1468] Processing CreateTablet for tablet fd279ddcf72a40e1bf2ec42a4f35e639 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20250625 03:30:28.473127 1732 tablet_service.cc:1468] Processing CreateTablet for tablet 9b7de80fbd7d4625aac41dea0457fd3e (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20250625 03:30:28.474262 1657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd279ddcf72a40e1bf2ec42a4f35e639. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.474610 1732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b7de80fbd7d4625aac41dea0457fd3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.475939 1661 tablet_service.cc:1468] Processing CreateTablet for tablet 7553473daeb342ceaf782ddee8e4fc4d (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20250625 03:30:28.477228 1787 ts_tablet_manager.cc:1428] T e4034c33d83e4a96a187eaed46416e3c P 7e9c4f2e01164f33b2e9034ed148398e: Time spent starting tablet: real 0.074s user 0.004s sys 0.004s
I20250625 03:30:28.448845 1578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8c715109ff0405997e1ca9952678c0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.497462 1585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 465c15a46933411a985f29059fdb1c9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.492355 1728 tablet_service.cc:1468] Processing CreateTablet for tablet 9943bb8023444f49a11df01d93738f1e (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20250625 03:30:28.500919 1728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9943bb8023444f49a11df01d93738f1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.491663 1730 tablet_service.cc:1468] Processing CreateTablet for tablet 3037be35f2054cbbabd8a47062f84244 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20250625 03:30:28.504817 1730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3037be35f2054cbbabd8a47062f84244. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.506541 1582 tablet_service.cc:1468] Processing CreateTablet for tablet 0c2b6052daaa4c57aaa55361e8d6e01c (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20250625 03:30:28.507844 1582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c2b6052daaa4c57aaa55361e8d6e01c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.508340 1583 tablet_service.cc:1468] Processing CreateTablet for tablet 3c2c045dee4b4b4faa93fa9d0ccdaa1c (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20250625 03:30:28.509990 1583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c2c045dee4b4b4faa93fa9d0ccdaa1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.510953 1787 tablet_bootstrap.cc:492] T 6e7283d035e1429f946d8ebb98978656 P 7e9c4f2e01164f33b2e9034ed148398e: Bootstrap starting.
I20250625 03:30:28.512442 1786 tablet_bootstrap.cc:492] T c4354f7ffc0e4eabbc92a141d46b7984 P ba464e89e0f044a0a0ea3e6125cbf2a1: No bootstrap required, opened a new log
I20250625 03:30:28.506650 1580 tablet_service.cc:1468] Processing CreateTablet for tablet 9f7fbf33df3d429ab16f0ae3a2684207 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20250625 03:30:28.521315 1735 tablet_service.cc:1468] Processing CreateTablet for tablet 93ecdce2da094dc9a80ac04828771fbd (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20250625 03:30:28.455895 1729 tablet_service.cc:1468] Processing CreateTablet for tablet 7553473daeb342ceaf782ddee8e4fc4d (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20250625 03:30:28.523877 1726 tablet_service.cc:1468] Processing CreateTablet for tablet 393f73bcf106475cbee7a645b0d9660c (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20250625 03:30:28.529217 1661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7553473daeb342ceaf782ddee8e4fc4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.529690 1726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 393f73bcf106475cbee7a645b0d9660c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.532671 1735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93ecdce2da094dc9a80ac04828771fbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.535225 1581 tablet_service.cc:1468] Processing CreateTablet for tablet 0e7eb287e9514c838aeed599d2703682 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20250625 03:30:28.540753 1729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7553473daeb342ceaf782ddee8e4fc4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.541672 1652 tablet_service.cc:1468] Processing CreateTablet for tablet 9b7de80fbd7d4625aac41dea0457fd3e (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20250625 03:30:28.545609 1789 raft_consensus.cc:491] T e4034c33d83e4a96a187eaed46416e3c P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:28.546100 1789 raft_consensus.cc:513] T e4034c33d83e4a96a187eaed46416e3c P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:28.547181 1584 tablet_service.cc:1468] Processing CreateTablet for tablet e88f79ed06514e01a9bc48261a5acfbb (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20250625 03:30:28.548517 1789 leader_election.cc:290] T e4034c33d83e4a96a187eaed46416e3c P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
W20250625 03:30:28.561663 1622 tablet.cc:2378] T e4034c33d83e4a96a187eaed46416e3c P 7e9c4f2e01164f33b2e9034ed148398e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20250625 03:30:28.569020 1586 tablet_service.cc:1468] Processing CreateTablet for tablet 96030b80e1f340afa81659faaaf68755 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20250625 03:30:28.572860 1786 ts_tablet_manager.cc:1397] T c4354f7ffc0e4eabbc92a141d46b7984 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent bootstrapping tablet: real 0.260s user 0.013s sys 0.010s
I20250625 03:30:28.584388 1652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b7de80fbd7d4625aac41dea0457fd3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.584704 1735 tablet_service.cc:1468] Processing CreateTablet for tablet 441042afd59544a4a04bf85fa69d7d55 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20250625 03:30:28.591060 1787 tablet_bootstrap.cc:654] T 6e7283d035e1429f946d8ebb98978656 P 7e9c4f2e01164f33b2e9034ed148398e: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:28.590566 1654 tablet_service.cc:1468] Processing CreateTablet for tablet 3037be35f2054cbbabd8a47062f84244 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20250625 03:30:28.592950 1579 tablet_service.cc:1468] Processing CreateTablet for tablet fd279ddcf72a40e1bf2ec42a4f35e639 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20250625 03:30:28.595302 1735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 441042afd59544a4a04bf85fa69d7d55. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.596045 1658 tablet_service.cc:1468] Processing CreateTablet for tablet 93ecdce2da094dc9a80ac04828771fbd (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20250625 03:30:28.600401 1654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3037be35f2054cbbabd8a47062f84244. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.609191 1658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93ecdce2da094dc9a80ac04828771fbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.604250 1656 tablet_service.cc:1468] Processing CreateTablet for tablet 9943bb8023444f49a11df01d93738f1e (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20250625 03:30:28.610394 1656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9943bb8023444f49a11df01d93738f1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.610188 1653 tablet_service.cc:1468] Processing CreateTablet for tablet 393f73bcf106475cbee7a645b0d9660c (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20250625 03:30:28.612442 1653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 393f73bcf106475cbee7a645b0d9660c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.613376 1577 tablet_service.cc:1468] Processing CreateTablet for tablet 7553473daeb342ceaf782ddee8e4fc4d (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20250625 03:30:28.615937 1583 tablet_service.cc:1468] Processing CreateTablet for tablet 9b7de80fbd7d4625aac41dea0457fd3e (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20250625 03:30:28.615944 1582 tablet_service.cc:1468] Processing CreateTablet for tablet 3037be35f2054cbbabd8a47062f84244 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20250625 03:30:28.628152 1786 raft_consensus.cc:357] T c4354f7ffc0e4eabbc92a141d46b7984 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:28.628944 1786 raft_consensus.cc:383] T c4354f7ffc0e4eabbc92a141d46b7984 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:28.629241 1786 raft_consensus.cc:738] T c4354f7ffc0e4eabbc92a141d46b7984 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Initialized, Role: FOLLOWER
I20250625 03:30:28.629940 1786 consensus_queue.cc:260] T c4354f7ffc0e4eabbc92a141d46b7984 P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:28.637476 1584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e88f79ed06514e01a9bc48261a5acfbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.648036 1785 tablet_bootstrap.cc:492] T 1fff19a38e8d4880a14da6b4c8284cc2 P 3f2aa40978064c9e9983cf3745eed206: No bootstrap required, opened a new log
I20250625 03:30:28.648569 1785 ts_tablet_manager.cc:1397] T 1fff19a38e8d4880a14da6b4c8284cc2 P 3f2aa40978064c9e9983cf3745eed206: Time spent bootstrapping tablet: real 0.336s user 0.018s sys 0.004s
I20250625 03:30:28.652820 1785 raft_consensus.cc:357] T 1fff19a38e8d4880a14da6b4c8284cc2 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } }
I20250625 03:30:28.653561 1785 raft_consensus.cc:383] T 1fff19a38e8d4880a14da6b4c8284cc2 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:28.653863 1785 raft_consensus.cc:738] T 1fff19a38e8d4880a14da6b4c8284cc2 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Initialized, Role: FOLLOWER
I20250625 03:30:28.654726 1785 consensus_queue.cc:260] T 1fff19a38e8d4880a14da6b4c8284cc2 P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } }
I20250625 03:30:28.664917 1661 tablet_service.cc:1468] Processing CreateTablet for tablet ba2ab3296190416aa07624e6d69ba09b (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20250625 03:30:28.647555 1653 tablet_service.cc:1468] Processing CreateTablet for tablet 441042afd59544a4a04bf85fa69d7d55 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20250625 03:30:28.667078 1661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba2ab3296190416aa07624e6d69ba09b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.667028 1659 tablet_service.cc:1468] Processing CreateTablet for tablet df29d87d804d44438345052a5902052f (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20250625 03:30:28.670964 1659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df29d87d804d44438345052a5902052f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.675092 1655 tablet_service.cc:1468] Processing CreateTablet for tablet a5a18934cc3f490288432ee1cb30b278 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20250625 03:30:28.676431 1655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5a18934cc3f490288432ee1cb30b278. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.680382 1580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f7fbf33df3d429ab16f0ae3a2684207. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.680668 1797 raft_consensus.cc:491] T c4354f7ffc0e4eabbc92a141d46b7984 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:28.681136 1797 raft_consensus.cc:513] T c4354f7ffc0e4eabbc92a141d46b7984 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:28.690141 1577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7553473daeb342ceaf782ddee8e4fc4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.690819 1586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96030b80e1f340afa81659faaaf68755. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.691260 1770 heartbeater.cc:499] Master 127.0.106.190:39719 was elected leader, sending a full tablet report...
I20250625 03:30:28.691433 1582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3037be35f2054cbbabd8a47062f84244. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.693960 1579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd279ddcf72a40e1bf2ec42a4f35e639. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.667198 1657 tablet_service.cc:1468] Processing CreateTablet for tablet b31026f89f1e49949acec419db9649d3 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20250625 03:30:28.696296 1583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b7de80fbd7d4625aac41dea0457fd3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.696936 1581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e7eb287e9514c838aeed599d2703682. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.700795 1786 ts_tablet_manager.cc:1428] T c4354f7ffc0e4eabbc92a141d46b7984 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent starting tablet: real 0.122s user 0.007s sys 0.001s
I20250625 03:30:28.701629 1696 heartbeater.cc:499] Master 127.0.106.190:39719 was elected leader, sending a full tablet report...
I20250625 03:30:28.708616 1653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 441042afd59544a4a04bf85fa69d7d55. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.715965 1657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b31026f89f1e49949acec419db9649d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.717311 1785 ts_tablet_manager.cc:1428] T 1fff19a38e8d4880a14da6b4c8284cc2 P 3f2aa40978064c9e9983cf3745eed206: Time spent starting tablet: real 0.068s user 0.005s sys 0.003s
I20250625 03:30:28.725843 1585 tablet_service.cc:1468] Processing CreateTablet for tablet 9943bb8023444f49a11df01d93738f1e (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20250625 03:30:28.727169 1585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9943bb8023444f49a11df01d93738f1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.728544 1745 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e4034c33d83e4a96a187eaed46416e3c" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
W20250625 03:30:28.730626 1561 leader_election.cc:343] T e4034c33d83e4a96a187eaed46416e3c P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:28.731837 1671 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e4034c33d83e4a96a187eaed46416e3c" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
W20250625 03:30:28.733654 1559 leader_election.cc:343] T e4034c33d83e4a96a187eaed46416e3c P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:28.734151 1559 leader_election.cc:304] T e4034c33d83e4a96a187eaed46416e3c P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e; no voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:28.735071 1578 tablet_service.cc:1468] Processing CreateTablet for tablet 93ecdce2da094dc9a80ac04828771fbd (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20250625 03:30:28.735536 1789 raft_consensus.cc:2747] T e4034c33d83e4a96a187eaed46416e3c P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:30:28.736409 1578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93ecdce2da094dc9a80ac04828771fbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.738382 1786 tablet_bootstrap.cc:492] T 1fff19a38e8d4880a14da6b4c8284cc2 P ba464e89e0f044a0a0ea3e6125cbf2a1: Bootstrap starting.
I20250625 03:30:28.739092 1656 tablet_service.cc:1468] Processing CreateTablet for tablet b3f18b9311894580bc336199d357df41 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20250625 03:30:28.740468 1656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3f18b9311894580bc336199d357df41. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.739214 1658 tablet_service.cc:1468] Processing CreateTablet for tablet cc3b100d6d574a68b79e6a8f23d77201 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20250625 03:30:28.762444 1579 tablet_service.cc:1468] Processing CreateTablet for tablet 441042afd59544a4a04bf85fa69d7d55 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20250625 03:30:28.763859 1579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 441042afd59544a4a04bf85fa69d7d55. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.772962 1787 tablet_bootstrap.cc:492] T 6e7283d035e1429f946d8ebb98978656 P 7e9c4f2e01164f33b2e9034ed148398e: No bootstrap required, opened a new log
I20250625 03:30:28.773638 1787 ts_tablet_manager.cc:1397] T 6e7283d035e1429f946d8ebb98978656 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent bootstrapping tablet: real 0.263s user 0.009s sys 0.017s
I20250625 03:30:28.777375 1785 tablet_bootstrap.cc:492] T 731095860aad436e9658ab3ff5010f9d P 3f2aa40978064c9e9983cf3745eed206: Bootstrap starting.
I20250625 03:30:28.778343 1787 raft_consensus.cc:357] T 6e7283d035e1429f946d8ebb98978656 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:28.778931 1787 raft_consensus.cc:383] T 6e7283d035e1429f946d8ebb98978656 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:28.779182 1787 raft_consensus.cc:738] T 6e7283d035e1429f946d8ebb98978656 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Initialized, Role: FOLLOWER
I20250625 03:30:28.779776 1787 consensus_queue.cc:260] T 6e7283d035e1429f946d8ebb98978656 P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:28.781144 1658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc3b100d6d574a68b79e6a8f23d77201. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.795477 1580 tablet_service.cc:1468] Processing CreateTablet for tablet a5a18934cc3f490288432ee1cb30b278 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20250625 03:30:28.795420 1660 tablet_service.cc:1468] Processing CreateTablet for tablet 64add559c121402aa1f7753538a50857 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20250625 03:30:28.796962 1660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64add559c121402aa1f7753538a50857. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.789103 1797 leader_election.cc:290] T c4354f7ffc0e4eabbc92a141d46b7984 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:28.800657 1799 raft_consensus.cc:491] T 1fff19a38e8d4880a14da6b4c8284cc2 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:28.804970 1799 raft_consensus.cc:513] T 1fff19a38e8d4880a14da6b4c8284cc2 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } }
I20250625 03:30:28.805953 1786 tablet_bootstrap.cc:654] T 1fff19a38e8d4880a14da6b4c8284cc2 P ba464e89e0f044a0a0ea3e6125cbf2a1: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:28.805663 1581 tablet_service.cc:1468] Processing CreateTablet for tablet df29d87d804d44438345052a5902052f (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20250625 03:30:28.807582 1799 leader_election.cc:290] T 1fff19a38e8d4880a14da6b4c8284cc2 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359), 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903)
I20250625 03:30:28.827412 1581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df29d87d804d44438345052a5902052f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.831271 1729 tablet_service.cc:1468] Processing CreateTablet for tablet df29d87d804d44438345052a5902052f (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20250625 03:30:28.833123 1729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df29d87d804d44438345052a5902052f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.832937 1657 tablet_service.cc:1468] Processing CreateTablet for tablet 31885ef6a0c64613ae6723c07f9400b0 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20250625 03:30:28.834321 1657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31885ef6a0c64613ae6723c07f9400b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.848660 1583 tablet_service.cc:1468] Processing CreateTablet for tablet 393f73bcf106475cbee7a645b0d9660c (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20250625 03:30:28.850627 1583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 393f73bcf106475cbee7a645b0d9660c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.853699 1735 tablet_service.cc:1468] Processing CreateTablet for tablet ba2ab3296190416aa07624e6d69ba09b (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20250625 03:30:28.854490 1726 tablet_service.cc:1468] Processing CreateTablet for tablet b3f18b9311894580bc336199d357df41 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20250625 03:30:28.854992 1735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba2ab3296190416aa07624e6d69ba09b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.855734 1726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3f18b9311894580bc336199d357df41. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.856128 1730 tablet_service.cc:1468] Processing CreateTablet for tablet a5a18934cc3f490288432ee1cb30b278 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20250625 03:30:28.857329 1730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5a18934cc3f490288432ee1cb30b278. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.857016 1728 tablet_service.cc:1468] Processing CreateTablet for tablet cc3b100d6d574a68b79e6a8f23d77201 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20250625 03:30:28.858208 1728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc3b100d6d574a68b79e6a8f23d77201. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.859247 1732 tablet_service.cc:1468] Processing CreateTablet for tablet b31026f89f1e49949acec419db9649d3 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20250625 03:30:28.860502 1732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b31026f89f1e49949acec419db9649d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.860978 1734 tablet_service.cc:1468] Processing CreateTablet for tablet fa68c3b7143345958f883bde3591b622 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20250625 03:30:28.862210 1734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa68c3b7143345958f883bde3591b622. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.797127 1652 tablet_service.cc:1468] Processing CreateTablet for tablet fa68c3b7143345958f883bde3591b622 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20250625 03:30:28.864925 1652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa68c3b7143345958f883bde3591b622. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.866068 1731 tablet_service.cc:1468] Processing CreateTablet for tablet 64add559c121402aa1f7753538a50857 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20250625 03:30:28.877980 1785 tablet_bootstrap.cc:654] T 731095860aad436e9658ab3ff5010f9d P 3f2aa40978064c9e9983cf3745eed206: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:28.867327 1731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64add559c121402aa1f7753538a50857. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.843071 1787 ts_tablet_manager.cc:1428] T 6e7283d035e1429f946d8ebb98978656 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent starting tablet: real 0.063s user 0.006s sys 0.000s
I20250625 03:30:28.906038 1659 tablet_service.cc:1468] Processing CreateTablet for tablet c04f7c2d00994557b1cb83234b36fceb (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20250625 03:30:28.907375 1659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c04f7c2d00994557b1cb83234b36fceb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.916675 1661 tablet_service.cc:1468] Processing CreateTablet for tablet 390aa72f98414be291f01e4e4fec77f1 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20250625 03:30:28.918079 1661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 390aa72f98414be291f01e4e4fec77f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.921032 1735 tablet_service.cc:1468] Processing CreateTablet for tablet 31885ef6a0c64613ae6723c07f9400b0 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20250625 03:30:28.922354 1735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31885ef6a0c64613ae6723c07f9400b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.923861 1733 tablet_service.cc:1468] Processing CreateTablet for tablet c04f7c2d00994557b1cb83234b36fceb (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20250625 03:30:28.925168 1671 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c4354f7ffc0e4eabbc92a141d46b7984" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:28.926138 1727 tablet_service.cc:1468] Processing CreateTablet for tablet 390aa72f98414be291f01e4e4fec77f1 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
W20250625 03:30:28.926729 1708 leader_election.cc:343] T c4354f7ffc0e4eabbc92a141d46b7984 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:28.928074 1745 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1fff19a38e8d4880a14da6b4c8284cc2" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:28.891412 1580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5a18934cc3f490288432ee1cb30b278. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.925143 1733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c04f7c2d00994557b1cb83234b36fceb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.937635 1584 tablet_service.cc:1468] Processing CreateTablet for tablet ba2ab3296190416aa07624e6d69ba09b (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20250625 03:30:28.942823 1655 tablet_service.cc:1468] Processing CreateTablet for tablet a1d83fca2b484feeaff6f350fe749b24 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20250625 03:30:28.945467 1586 tablet_service.cc:1468] Processing CreateTablet for tablet b31026f89f1e49949acec419db9649d3 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20250625 03:30:28.947597 1582 tablet_service.cc:1468] Processing CreateTablet for tablet b3f18b9311894580bc336199d357df41 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20250625 03:30:28.950568 1786 tablet_bootstrap.cc:492] T 1fff19a38e8d4880a14da6b4c8284cc2 P ba464e89e0f044a0a0ea3e6125cbf2a1: No bootstrap required, opened a new log
I20250625 03:30:28.951089 1786 ts_tablet_manager.cc:1397] T 1fff19a38e8d4880a14da6b4c8284cc2 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent bootstrapping tablet: real 0.213s user 0.019s sys 0.003s
I20250625 03:30:28.952327 1727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 390aa72f98414be291f01e4e4fec77f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.953860 1786 raft_consensus.cc:357] T 1fff19a38e8d4880a14da6b4c8284cc2 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } }
I20250625 03:30:28.954591 1786 raft_consensus.cc:383] T 1fff19a38e8d4880a14da6b4c8284cc2 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:28.954865 1786 raft_consensus.cc:738] T 1fff19a38e8d4880a14da6b4c8284cc2 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Initialized, Role: FOLLOWER
W20250625 03:30:28.956357 1636 leader_election.cc:343] T 1fff19a38e8d4880a14da6b4c8284cc2 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:28.964267 1654 tablet_service.cc:1468] Processing CreateTablet for tablet e38dc50880914156805b07aa82e30863 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20250625 03:30:28.968214 1655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1d83fca2b484feeaff6f350fe749b24. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.980362 1654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e38dc50880914156805b07aa82e30863. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.981609 1786 consensus_queue.cc:260] T 1fff19a38e8d4880a14da6b4c8284cc2 P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } }
I20250625 03:30:28.982717 1596 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c4354f7ffc0e4eabbc92a141d46b7984" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
W20250625 03:30:28.984398 1709 leader_election.cc:343] T c4354f7ffc0e4eabbc92a141d46b7984 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:28.984871 1709 leader_election.cc:304] T c4354f7ffc0e4eabbc92a141d46b7984 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:28.985677 1797 raft_consensus.cc:2747] T c4354f7ffc0e4eabbc92a141d46b7984 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:30:28.986505 1584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba2ab3296190416aa07624e6d69ba09b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.987560 1577 tablet_service.cc:1468] Processing CreateTablet for tablet cc3b100d6d574a68b79e6a8f23d77201 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20250625 03:30:28.988814 1577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc3b100d6d574a68b79e6a8f23d77201. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.992117 1583 tablet_service.cc:1468] Processing CreateTablet for tablet fa68c3b7143345958f883bde3591b622 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20250625 03:30:28.993446 1583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa68c3b7143345958f883bde3591b622. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.988364 1657 tablet_service.cc:1468] Processing CreateTablet for tablet 44f429469440455593143983452a9fe3 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20250625 03:30:28.998096 1581 tablet_service.cc:1468] Processing CreateTablet for tablet 64add559c121402aa1f7753538a50857 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20250625 03:30:28.998922 1726 tablet_service.cc:1468] Processing CreateTablet for tablet e38dc50880914156805b07aa82e30863 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20250625 03:30:29.000519 1582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3f18b9311894580bc336199d357df41. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:28.993420 1786 ts_tablet_manager.cc:1428] T 1fff19a38e8d4880a14da6b4c8284cc2 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent starting tablet: real 0.042s user 0.008s sys 0.001s
I20250625 03:30:29.006812 1586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b31026f89f1e49949acec419db9649d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:29.012739 1786 tablet_bootstrap.cc:492] T 731095860aad436e9658ab3ff5010f9d P ba464e89e0f044a0a0ea3e6125cbf2a1: Bootstrap starting.
I20250625 03:30:29.013921 1581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64add559c121402aa1f7753538a50857. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:29.014019 1734 tablet_service.cc:1468] Processing CreateTablet for tablet a1d83fca2b484feeaff6f350fe749b24 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20250625 03:30:29.015632 1726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e38dc50880914156805b07aa82e30863. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:29.020345 1734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1d83fca2b484feeaff6f350fe749b24. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:29.024561 1657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44f429469440455593143983452a9fe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:29.027004 1579 tablet_service.cc:1468] Processing CreateTablet for tablet 31885ef6a0c64613ae6723c07f9400b0 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20250625 03:30:29.028374 1579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31885ef6a0c64613ae6723c07f9400b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:29.029968 1659 tablet_service.cc:1468] Processing CreateTablet for tablet 58c56cde04014b85b662a9b4cbaa726f (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20250625 03:30:29.031277 1653 tablet_service.cc:1468] Processing CreateTablet for tablet 6d7a37b3448d468baa1b9422a6167c9a (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20250625 03:30:29.031872 1659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58c56cde04014b85b662a9b4cbaa726f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:29.032346 1658 tablet_service.cc:1468] Processing CreateTablet for tablet 188e56b819ae44f9b72baefcbc749400 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20250625 03:30:29.035449 1658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 188e56b819ae44f9b72baefcbc749400. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:29.038463 1578 tablet_service.cc:1468] Processing CreateTablet for tablet c04f7c2d00994557b1cb83234b36fceb (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20250625 03:30:29.039812 1578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c04f7c2d00994557b1cb83234b36fceb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:29.050215 1733 tablet_service.cc:1468] Processing CreateTablet for tablet 188e56b819ae44f9b72baefcbc749400 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20250625 03:30:29.051632 1733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 188e56b819ae44f9b72baefcbc749400. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:29.051367 1585 tablet_service.cc:1468] Processing CreateTablet for tablet 390aa72f98414be291f01e4e4fec77f1 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20250625 03:30:29.058167 1797 raft_consensus.cc:491] T 1fff19a38e8d4880a14da6b4c8284cc2 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:29.058669 1797 raft_consensus.cc:513] T 1fff19a38e8d4880a14da6b4c8284cc2 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } }
I20250625 03:30:29.060691 1653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d7a37b3448d468baa1b9422a6167c9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:29.060649 1797 leader_election.cc:290] T 1fff19a38e8d4880a14da6b4c8284cc2 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903)
I20250625 03:30:29.063407 1671 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1fff19a38e8d4880a14da6b4c8284cc2" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:29.064069 1671 raft_consensus.cc:2466] T 1fff19a38e8d4880a14da6b4c8284cc2 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 0.
I20250625 03:30:29.065261 1708 leader_election.cc:304] T 1fff19a38e8d4880a14da6b4c8284cc2 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters:
I20250625 03:30:29.066148 1797 raft_consensus.cc:2802] T 1fff19a38e8d4880a14da6b4c8284cc2 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:30:29.066504 1797 raft_consensus.cc:491] T 1fff19a38e8d4880a14da6b4c8284cc2 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:30:29.066912 1797 raft_consensus.cc:3058] T 1fff19a38e8d4880a14da6b4c8284cc2 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:29.067529 1785 tablet_bootstrap.cc:492] T 731095860aad436e9658ab3ff5010f9d P 3f2aa40978064c9e9983cf3745eed206: No bootstrap required, opened a new log
I20250625 03:30:29.066545 1660 tablet_service.cc:1468] Processing CreateTablet for tablet a9ae17eec3fe4ce0841d3fb17c91a8b8 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20250625 03:30:29.068979 1785 ts_tablet_manager.cc:1397] T 731095860aad436e9658ab3ff5010f9d P 3f2aa40978064c9e9983cf3745eed206: Time spent bootstrapping tablet: real 0.292s user 0.021s sys 0.012s
I20250625 03:30:29.069423 1660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9ae17eec3fe4ce0841d3fb17c91a8b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:29.073064 1785 raft_consensus.cc:357] T 731095860aad436e9658ab3ff5010f9d P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.074003 1785 raft_consensus.cc:383] T 731095860aad436e9658ab3ff5010f9d P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:29.074350 1785 raft_consensus.cc:738] T 731095860aad436e9658ab3ff5010f9d P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Initialized, Role: FOLLOWER
I20250625 03:30:29.075212 1785 consensus_queue.cc:260] T 731095860aad436e9658ab3ff5010f9d P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.078569 1785 ts_tablet_manager.cc:1428] T 731095860aad436e9658ab3ff5010f9d P 3f2aa40978064c9e9983cf3745eed206: Time spent starting tablet: real 0.009s user 0.004s sys 0.002s
I20250625 03:30:29.079586 1785 tablet_bootstrap.cc:492] T 9643cfd400804eb8b9037c5e9efddfba P 3f2aa40978064c9e9983cf3745eed206: Bootstrap starting.
I20250625 03:30:29.080240 1728 tablet_service.cc:1468] Processing CreateTablet for tablet 58c56cde04014b85b662a9b4cbaa726f (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20250625 03:30:29.081552 1728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58c56cde04014b85b662a9b4cbaa726f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:29.052919 1787 tablet_bootstrap.cc:492] T 731095860aad436e9658ab3ff5010f9d P 7e9c4f2e01164f33b2e9034ed148398e: Bootstrap starting.
I20250625 03:30:29.086161 1596 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1fff19a38e8d4880a14da6b4c8284cc2" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:29.087723 1785 tablet_bootstrap.cc:654] T 9643cfd400804eb8b9037c5e9efddfba P 3f2aa40978064c9e9983cf3745eed206: Neither blocks nor log segments found. Creating new log.
W20250625 03:30:29.087623 1709 leader_election.cc:343] T 1fff19a38e8d4880a14da6b4c8284cc2 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:29.088382 1585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 390aa72f98414be291f01e4e4fec77f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:29.093012 1652 tablet_service.cc:1468] Processing CreateTablet for tablet add8a729ea684e7eab256135c01309df (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20250625 03:30:29.094837 1652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet add8a729ea684e7eab256135c01309df. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:29.096912 1656 tablet_service.cc:1468] Processing CreateTablet for tablet e58b1ae66ee14c6f8d6f2db8dda2b842 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20250625 03:30:29.098896 1656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e58b1ae66ee14c6f8d6f2db8dda2b842. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:29.059855 1786 tablet_bootstrap.cc:654] T 731095860aad436e9658ab3ff5010f9d P ba464e89e0f044a0a0ea3e6125cbf2a1: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:29.110395 1787 tablet_bootstrap.cc:654] T 731095860aad436e9658ab3ff5010f9d P 7e9c4f2e01164f33b2e9034ed148398e: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:29.115875 1732 tablet_service.cc:1468] Processing CreateTablet for tablet 6d7a37b3448d468baa1b9422a6167c9a (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20250625 03:30:29.117175 1732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d7a37b3448d468baa1b9422a6167c9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:29.117015 1661 tablet_service.cc:1468] Processing CreateTablet for tablet 70328d972b5943009ef0c7d92cbae349 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20250625 03:30:29.118386 1661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70328d972b5943009ef0c7d92cbae349. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:29.068274 1735 tablet_service.cc:1468] Processing CreateTablet for tablet 44f429469440455593143983452a9fe3 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20250625 03:30:29.122236 1735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44f429469440455593143983452a9fe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:29.123184 1731 tablet_service.cc:1468] Processing CreateTablet for tablet e58b1ae66ee14c6f8d6f2db8dda2b842 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20250625 03:30:29.134289 1731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e58b1ae66ee14c6f8d6f2db8dda2b842. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:29.141817 1586 tablet_service.cc:1468] Processing CreateTablet for tablet a1d83fca2b484feeaff6f350fe749b24 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20250625 03:30:29.143193 1586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1d83fca2b484feeaff6f350fe749b24. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:29.124296 1580 tablet_service.cc:1468] Processing CreateTablet for tablet e38dc50880914156805b07aa82e30863 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20250625 03:30:29.170100 1734 tablet_service.cc:1468] Processing CreateTablet for tablet a9ae17eec3fe4ce0841d3fb17c91a8b8 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20250625 03:30:29.171452 1734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9ae17eec3fe4ce0841d3fb17c91a8b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:29.173261 1797 raft_consensus.cc:513] T 1fff19a38e8d4880a14da6b4c8284cc2 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } }
I20250625 03:30:29.175580 1797 leader_election.cc:290] T 1fff19a38e8d4880a14da6b4c8284cc2 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Requested vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903)
I20250625 03:30:29.176839 1596 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1fff19a38e8d4880a14da6b4c8284cc2" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
I20250625 03:30:29.177664 1671 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1fff19a38e8d4880a14da6b4c8284cc2" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:30:29.180894 1671 raft_consensus.cc:3058] T 1fff19a38e8d4880a14da6b4c8284cc2 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Advancing to term 1
W20250625 03:30:29.184576 1709 leader_election.cc:343] T 1fff19a38e8d4880a14da6b4c8284cc2 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:29.185463 1596 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1fff19a38e8d4880a14da6b4c8284cc2" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
W20250625 03:30:29.186932 1635 leader_election.cc:343] T 1fff19a38e8d4880a14da6b4c8284cc2 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:29.187373 1635 leader_election.cc:304] T 1fff19a38e8d4880a14da6b4c8284cc2 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206; no voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:29.188859 1652 tablet_service.cc:1468] Processing CreateTablet for tablet c977876716a0400a9482dd8e0ad33b86 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20250625 03:30:29.190147 1652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c977876716a0400a9482dd8e0ad33b86. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:29.191383 1583 tablet_service.cc:1468] Processing CreateTablet for tablet 188e56b819ae44f9b72baefcbc749400 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20250625 03:30:29.196888 1583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 188e56b819ae44f9b72baefcbc749400. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:29.193253 1586 tablet_service.cc:1468] Processing CreateTablet for tablet 58c56cde04014b85b662a9b4cbaa726f (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20250625 03:30:29.194110 1734 tablet_service.cc:1468] Processing CreateTablet for tablet 70328d972b5943009ef0c7d92cbae349 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20250625 03:30:29.205027 1734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70328d972b5943009ef0c7d92cbae349. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:29.191699 1671 raft_consensus.cc:2466] T 1fff19a38e8d4880a14da6b4c8284cc2 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 1.
I20250625 03:30:29.202113 1582 tablet_service.cc:1468] Processing CreateTablet for tablet 6d7a37b3448d468baa1b9422a6167c9a (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20250625 03:30:29.209036 1799 raft_consensus.cc:2747] T 1fff19a38e8d4880a14da6b4c8284cc2 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:30:29.211625 1786 tablet_bootstrap.cc:492] T 731095860aad436e9658ab3ff5010f9d P ba464e89e0f044a0a0ea3e6125cbf2a1: No bootstrap required, opened a new log
I20250625 03:30:29.212170 1786 ts_tablet_manager.cc:1397] T 731095860aad436e9658ab3ff5010f9d P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent bootstrapping tablet: real 0.200s user 0.011s sys 0.005s
I20250625 03:30:29.214599 1708 leader_election.cc:304] T 1fff19a38e8d4880a14da6b4c8284cc2 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:29.215088 1786 raft_consensus.cc:357] T 731095860aad436e9658ab3ff5010f9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.216709 1733 tablet_service.cc:1468] Processing CreateTablet for tablet add8a729ea684e7eab256135c01309df (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20250625 03:30:29.217999 1733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet add8a729ea684e7eab256135c01309df. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:29.217248 1797 raft_consensus.cc:2802] T 1fff19a38e8d4880a14da6b4c8284cc2 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:30:29.218956 1797 raft_consensus.cc:695] T 1fff19a38e8d4880a14da6b4c8284cc2 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Becoming Leader. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Running, Role: LEADER
I20250625 03:30:29.219847 1797 consensus_queue.cc:237] T 1fff19a38e8d4880a14da6b4c8284cc2 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } }
I20250625 03:30:29.226198 1726 tablet_service.cc:1468] Processing CreateTablet for tablet 59ac1803c12d43448ef566f886cc22e6 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20250625 03:30:29.227522 1726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59ac1803c12d43448ef566f886cc22e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:29.215829 1786 raft_consensus.cc:383] T 731095860aad436e9658ab3ff5010f9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:29.228619 1786 raft_consensus.cc:738] T 731095860aad436e9658ab3ff5010f9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Initialized, Role: FOLLOWER
I20250625 03:30:29.229779 1786 consensus_queue.cc:260] T 731095860aad436e9658ab3ff5010f9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.230763 1798 raft_consensus.cc:491] T 731095860aad436e9658ab3ff5010f9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:29.231210 1798 raft_consensus.cc:513] T 731095860aad436e9658ab3ff5010f9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.233615 1789 raft_consensus.cc:491] T 6e7283d035e1429f946d8ebb98978656 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:29.234108 1789 raft_consensus.cc:513] T 6e7283d035e1429f946d8ebb98978656 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.238245 1670 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6e7283d035e1429f946d8ebb98978656" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:29.239593 1798 leader_election.cc:290] T 731095860aad436e9658ab3ff5010f9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:29.239902 1745 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6e7283d035e1429f946d8ebb98978656" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:29.242830 1671 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "731095860aad436e9658ab3ff5010f9d" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:29.235899 1789 leader_election.cc:290] T 6e7283d035e1429f946d8ebb98978656 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:29.243578 1799 raft_consensus.cc:491] T 731095860aad436e9658ab3ff5010f9d P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20250625 03:30:29.240630 1559 leader_election.cc:343] T 6e7283d035e1429f946d8ebb98978656 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:29.244168 1799 raft_consensus.cc:513] T 731095860aad436e9658ab3ff5010f9d P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
W20250625 03:30:29.244735 1561 leader_election.cc:343] T 6e7283d035e1429f946d8ebb98978656 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:29.247206 1799 leader_election.cc:290] T 731095860aad436e9658ab3ff5010f9d P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:29.247800 1596 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "731095860aad436e9658ab3ff5010f9d" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:29.248289 1671 raft_consensus.cc:2466] T 731095860aad436e9658ab3ff5010f9d P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 0.
I20250625 03:30:29.250525 1785 tablet_bootstrap.cc:492] T 9643cfd400804eb8b9037c5e9efddfba P 3f2aa40978064c9e9983cf3745eed206: No bootstrap required, opened a new log
I20250625 03:30:29.251084 1785 ts_tablet_manager.cc:1397] T 9643cfd400804eb8b9037c5e9efddfba P 3f2aa40978064c9e9983cf3745eed206: Time spent bootstrapping tablet: real 0.172s user 0.009s sys 0.017s
I20250625 03:30:29.247072 1561 leader_election.cc:304] T 6e7283d035e1429f946d8ebb98978656 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e; no voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1
W20250625 03:30:29.257249 1709 leader_election.cc:343] T 731095860aad436e9658ab3ff5010f9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:29.263181 1708 leader_election.cc:304] T 731095860aad436e9658ab3ff5010f9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:29.264317 1797 raft_consensus.cc:2802] T 731095860aad436e9658ab3ff5010f9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:30:29.264674 1797 raft_consensus.cc:491] T 731095860aad436e9658ab3ff5010f9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:30:29.264973 1797 raft_consensus.cc:3058] T 731095860aad436e9658ab3ff5010f9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:29.265499 1785 raft_consensus.cc:357] T 9643cfd400804eb8b9037c5e9efddfba P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.266232 1785 raft_consensus.cc:383] T 9643cfd400804eb8b9037c5e9efddfba P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:29.266496 1785 raft_consensus.cc:738] T 9643cfd400804eb8b9037c5e9efddfba P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Initialized, Role: FOLLOWER
I20250625 03:30:29.254776 1789 raft_consensus.cc:2747] T 6e7283d035e1429f946d8ebb98978656 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:30:29.267956 1745 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "731095860aad436e9658ab3ff5010f9d" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:29.269457 1656 tablet_service.cc:1468] Processing CreateTablet for tablet 59ac1803c12d43448ef566f886cc22e6 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20250625 03:30:29.269935 1584 tablet_service.cc:1468] Processing CreateTablet for tablet e58b1ae66ee14c6f8d6f2db8dda2b842 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20250625 03:30:29.270712 1656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59ac1803c12d43448ef566f886cc22e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:29.273319 1582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d7a37b3448d468baa1b9422a6167c9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:29.279451 1797 raft_consensus.cc:513] T 731095860aad436e9658ab3ff5010f9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.277961 1596 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "731095860aad436e9658ab3ff5010f9d" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:29.286432 1745 raft_consensus.cc:2391] T 731095860aad436e9658ab3ff5010f9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f2aa40978064c9e9983cf3745eed206 in current term 1: Already voted for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in this term.
W20250625 03:30:29.287358 1635 leader_election.cc:343] T 731095860aad436e9658ab3ff5010f9d P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:29.289227 1580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e38dc50880914156805b07aa82e30863. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:29.291764 1596 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "731095860aad436e9658ab3ff5010f9d" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
W20250625 03:30:29.293102 1709 leader_election.cc:343] T 731095860aad436e9658ab3ff5010f9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:29.295862 1578 tablet_service.cc:1468] Processing CreateTablet for tablet a9ae17eec3fe4ce0841d3fb17c91a8b8 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20250625 03:30:29.297225 1578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9ae17eec3fe4ce0841d3fb17c91a8b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:29.304410 1584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e58b1ae66ee14c6f8d6f2db8dda2b842. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:29.305864 1636 leader_election.cc:304] T 731095860aad436e9658ab3ff5010f9d P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206; no voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:29.307104 1799 raft_consensus.cc:3058] T 731095860aad436e9658ab3ff5010f9d P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:29.310657 1585 tablet_service.cc:1468] Processing CreateTablet for tablet 70328d972b5943009ef0c7d92cbae349 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20250625 03:30:29.282900 1785 consensus_queue.cc:260] T 9643cfd400804eb8b9037c5e9efddfba P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.317811 1579 tablet_service.cc:1468] Processing CreateTablet for tablet add8a729ea684e7eab256135c01309df (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20250625 03:30:29.327016 1577 tablet_service.cc:1468] Processing CreateTablet for tablet 44f429469440455593143983452a9fe3 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20250625 03:30:29.312711 1727 tablet_service.cc:1468] Processing CreateTablet for tablet c977876716a0400a9482dd8e0ad33b86 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20250625 03:30:29.317639 1786 ts_tablet_manager.cc:1428] T 731095860aad436e9658ab3ff5010f9d P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent starting tablet: real 0.105s user 0.006s sys 0.021s
I20250625 03:30:29.336938 1727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c977876716a0400a9482dd8e0ad33b86. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:29.337172 1786 tablet_bootstrap.cc:492] T e4034c33d83e4a96a187eaed46416e3c P ba464e89e0f044a0a0ea3e6125cbf2a1: Bootstrap starting.
I20250625 03:30:29.340971 1787 tablet_bootstrap.cc:492] T 731095860aad436e9658ab3ff5010f9d P 7e9c4f2e01164f33b2e9034ed148398e: No bootstrap required, opened a new log
I20250625 03:30:29.312755 1494 catalog_manager.cc:5582] T 1fff19a38e8d4880a14da6b4c8284cc2 P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } }
I20250625 03:30:29.341459 1787 ts_tablet_manager.cc:1397] T 731095860aad436e9658ab3ff5010f9d P 7e9c4f2e01164f33b2e9034ed148398e: Time spent bootstrapping tablet: real 0.406s user 0.020s sys 0.000s
I20250625 03:30:29.345151 1786 tablet_bootstrap.cc:654] T e4034c33d83e4a96a187eaed46416e3c P ba464e89e0f044a0a0ea3e6125cbf2a1: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:29.311997 1585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70328d972b5943009ef0c7d92cbae349. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:29.322209 1584 tablet_service.cc:1468] Processing CreateTablet for tablet c977876716a0400a9482dd8e0ad33b86 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20250625 03:30:29.348860 1577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44f429469440455593143983452a9fe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:29.349824 1586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58c56cde04014b85b662a9b4cbaa726f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:29.356389 1797 leader_election.cc:290] T 731095860aad436e9658ab3ff5010f9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:29.357256 1579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet add8a729ea684e7eab256135c01309df. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:29.357942 1671 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "731095860aad436e9658ab3ff5010f9d" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:30:29.366351 1799 raft_consensus.cc:2747] T 731095860aad436e9658ab3ff5010f9d P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:30:29.371425 1787 raft_consensus.cc:357] T 731095860aad436e9658ab3ff5010f9d P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.372081 1787 raft_consensus.cc:383] T 731095860aad436e9658ab3ff5010f9d P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:29.372388 1787 raft_consensus.cc:738] T 731095860aad436e9658ab3ff5010f9d P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Initialized, Role: FOLLOWER
I20250625 03:30:29.373122 1787 consensus_queue.cc:260] T 731095860aad436e9658ab3ff5010f9d P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.375583 1787 ts_tablet_manager.cc:1428] T 731095860aad436e9658ab3ff5010f9d P 7e9c4f2e01164f33b2e9034ed148398e: Time spent starting tablet: real 0.034s user 0.007s sys 0.000s
W20250625 03:30:29.387580 1542 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20250625 03:30:29.401556 1785 ts_tablet_manager.cc:1428] T 9643cfd400804eb8b9037c5e9efddfba P 3f2aa40978064c9e9983cf3745eed206: Time spent starting tablet: real 0.150s user 0.029s sys 0.050s
I20250625 03:30:29.402557 1785 tablet_bootstrap.cc:492] T 6e7283d035e1429f946d8ebb98978656 P 3f2aa40978064c9e9983cf3745eed206: Bootstrap starting.
I20250625 03:30:29.404716 1584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c977876716a0400a9482dd8e0ad33b86. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:29.408798 1785 tablet_bootstrap.cc:654] T 6e7283d035e1429f946d8ebb98978656 P 3f2aa40978064c9e9983cf3745eed206: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:29.411473 1787 tablet_bootstrap.cc:492] T b15eb94b9d3d4f6987b5fa5e20193655 P 7e9c4f2e01164f33b2e9034ed148398e: Bootstrap starting.
I20250625 03:30:29.417861 1787 tablet_bootstrap.cc:654] T b15eb94b9d3d4f6987b5fa5e20193655 P 7e9c4f2e01164f33b2e9034ed148398e: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:29.418638 1671 raft_consensus.cc:2466] T 731095860aad436e9658ab3ff5010f9d P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 1.
I20250625 03:30:29.426469 1708 leader_election.cc:304] T 731095860aad436e9658ab3ff5010f9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:29.423051 1582 tablet_service.cc:1468] Processing CreateTablet for tablet 59ac1803c12d43448ef566f886cc22e6 (DEFAULT_TABLE table=test-workload [id=7f663eabec024fd1911b406c660fa838]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20250625 03:30:29.432076 1812 raft_consensus.cc:2802] T 731095860aad436e9658ab3ff5010f9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:30:29.432628 1812 raft_consensus.cc:695] T 731095860aad436e9658ab3ff5010f9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Becoming Leader. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Running, Role: LEADER
I20250625 03:30:29.433403 1582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59ac1803c12d43448ef566f886cc22e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:29.433779 1786 tablet_bootstrap.cc:492] T e4034c33d83e4a96a187eaed46416e3c P ba464e89e0f044a0a0ea3e6125cbf2a1: No bootstrap required, opened a new log
I20250625 03:30:29.438148 1786 ts_tablet_manager.cc:1397] T e4034c33d83e4a96a187eaed46416e3c P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent bootstrapping tablet: real 0.101s user 0.013s sys 0.016s
I20250625 03:30:29.433470 1812 consensus_queue.cc:237] T 731095860aad436e9658ab3ff5010f9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.440825 1786 raft_consensus.cc:357] T e4034c33d83e4a96a187eaed46416e3c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.441649 1786 raft_consensus.cc:383] T e4034c33d83e4a96a187eaed46416e3c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:29.441987 1786 raft_consensus.cc:738] T e4034c33d83e4a96a187eaed46416e3c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Initialized, Role: FOLLOWER
I20250625 03:30:29.442691 1786 consensus_queue.cc:260] T e4034c33d83e4a96a187eaed46416e3c P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.459359 1786 ts_tablet_manager.cc:1428] T e4034c33d83e4a96a187eaed46416e3c P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent starting tablet: real 0.021s user 0.005s sys 0.000s
I20250625 03:30:29.471122 1786 tablet_bootstrap.cc:492] T afe48b30a4e64a4d8faf2a5b42d5c706 P ba464e89e0f044a0a0ea3e6125cbf2a1: Bootstrap starting.
I20250625 03:30:29.473979 1787 tablet_bootstrap.cc:492] T b15eb94b9d3d4f6987b5fa5e20193655 P 7e9c4f2e01164f33b2e9034ed148398e: No bootstrap required, opened a new log
I20250625 03:30:29.474581 1787 ts_tablet_manager.cc:1397] T b15eb94b9d3d4f6987b5fa5e20193655 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent bootstrapping tablet: real 0.063s user 0.016s sys 0.005s
I20250625 03:30:29.477526 1785 tablet_bootstrap.cc:492] T 6e7283d035e1429f946d8ebb98978656 P 3f2aa40978064c9e9983cf3745eed206: No bootstrap required, opened a new log
I20250625 03:30:29.477941 1785 ts_tablet_manager.cc:1397] T 6e7283d035e1429f946d8ebb98978656 P 3f2aa40978064c9e9983cf3745eed206: Time spent bootstrapping tablet: real 0.076s user 0.013s sys 0.013s
I20250625 03:30:29.478055 1787 raft_consensus.cc:357] T b15eb94b9d3d4f6987b5fa5e20193655 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.478709 1786 tablet_bootstrap.cc:654] T afe48b30a4e64a4d8faf2a5b42d5c706 P ba464e89e0f044a0a0ea3e6125cbf2a1: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:29.478888 1787 raft_consensus.cc:383] T b15eb94b9d3d4f6987b5fa5e20193655 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:29.479215 1787 raft_consensus.cc:738] T b15eb94b9d3d4f6987b5fa5e20193655 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Initialized, Role: FOLLOWER
I20250625 03:30:29.480059 1785 raft_consensus.cc:357] T 6e7283d035e1429f946d8ebb98978656 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.480057 1787 consensus_queue.cc:260] T b15eb94b9d3d4f6987b5fa5e20193655 P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.481002 1785 raft_consensus.cc:383] T 6e7283d035e1429f946d8ebb98978656 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:29.481345 1785 raft_consensus.cc:738] T 6e7283d035e1429f946d8ebb98978656 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Initialized, Role: FOLLOWER
I20250625 03:30:29.481907 1812 raft_consensus.cc:491] T e4034c33d83e4a96a187eaed46416e3c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:29.482347 1812 raft_consensus.cc:513] T e4034c33d83e4a96a187eaed46416e3c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.482255 1785 consensus_queue.cc:260] T 6e7283d035e1429f946d8ebb98978656 P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.484544 1812 leader_election.cc:290] T e4034c33d83e4a96a187eaed46416e3c P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:29.485248 1785 ts_tablet_manager.cc:1428] T 6e7283d035e1429f946d8ebb98978656 P 3f2aa40978064c9e9983cf3745eed206: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20250625 03:30:29.485760 1671 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e4034c33d83e4a96a187eaed46416e3c" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:29.486266 1785 tablet_bootstrap.cc:492] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206: Bootstrap starting.
W20250625 03:30:29.487174 1708 leader_election.cc:343] T e4034c33d83e4a96a187eaed46416e3c P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:29.487367 1596 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e4034c33d83e4a96a187eaed46416e3c" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:29.488299 1596 raft_consensus.cc:2466] T e4034c33d83e4a96a187eaed46416e3c P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 0.
I20250625 03:30:29.490201 1709 leader_election.cc:304] T e4034c33d83e4a96a187eaed46416e3c P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 3f2aa40978064c9e9983cf3745eed206
I20250625 03:30:29.492094 1812 raft_consensus.cc:2802] T e4034c33d83e4a96a187eaed46416e3c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:30:29.492655 1812 raft_consensus.cc:491] T e4034c33d83e4a96a187eaed46416e3c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:30:29.493147 1812 raft_consensus.cc:3058] T e4034c33d83e4a96a187eaed46416e3c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:29.495249 1785 tablet_bootstrap.cc:654] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:29.506455 1787 ts_tablet_manager.cc:1428] T b15eb94b9d3d4f6987b5fa5e20193655 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent starting tablet: real 0.032s user 0.004s sys 0.003s
I20250625 03:30:29.508716 1785 tablet_bootstrap.cc:492] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206: No bootstrap required, opened a new log
I20250625 03:30:29.509394 1785 ts_tablet_manager.cc:1397] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206: Time spent bootstrapping tablet: real 0.023s user 0.014s sys 0.007s
I20250625 03:30:29.509047 1812 raft_consensus.cc:513] T e4034c33d83e4a96a187eaed46416e3c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.513234 1596 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e4034c33d83e4a96a187eaed46416e3c" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
I20250625 03:30:29.513303 1785 raft_consensus.cc:357] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.514381 1596 raft_consensus.cc:3058] T e4034c33d83e4a96a187eaed46416e3c P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:29.514392 1785 raft_consensus.cc:383] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:29.515070 1785 raft_consensus.cc:738] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Initialized, Role: FOLLOWER
I20250625 03:30:29.515977 1785 consensus_queue.cc:260] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.519127 1785 ts_tablet_manager.cc:1428] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206: Time spent starting tablet: real 0.009s user 0.005s sys 0.003s
I20250625 03:30:29.520495 1785 tablet_bootstrap.cc:492] T f957bf9749c54be48094092cb80e9055 P 3f2aa40978064c9e9983cf3745eed206: Bootstrap starting.
I20250625 03:30:29.524636 1787 tablet_bootstrap.cc:492] T 40b74a261fdd495f84ceb0690f0b30ba P 7e9c4f2e01164f33b2e9034ed148398e: Bootstrap starting.
I20250625 03:30:29.526196 1789 raft_consensus.cc:491] T b15eb94b9d3d4f6987b5fa5e20193655 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:29.526865 1789 raft_consensus.cc:513] T b15eb94b9d3d4f6987b5fa5e20193655 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.529052 1785 tablet_bootstrap.cc:654] T f957bf9749c54be48094092cb80e9055 P 3f2aa40978064c9e9983cf3745eed206: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:29.530906 1671 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b15eb94b9d3d4f6987b5fa5e20193655" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:29.532091 1789 leader_election.cc:290] T b15eb94b9d3d4f6987b5fa5e20193655 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
W20250625 03:30:29.533041 1559 leader_election.cc:343] T b15eb94b9d3d4f6987b5fa5e20193655 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:29.532506 1745 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b15eb94b9d3d4f6987b5fa5e20193655" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
W20250625 03:30:29.535928 1561 leader_election.cc:343] T b15eb94b9d3d4f6987b5fa5e20193655 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:29.536558 1561 leader_election.cc:304] T b15eb94b9d3d4f6987b5fa5e20193655 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e; no voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:29.538148 1789 raft_consensus.cc:2747] T b15eb94b9d3d4f6987b5fa5e20193655 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:30:29.541710 1596 raft_consensus.cc:2466] T e4034c33d83e4a96a187eaed46416e3c P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 1.
I20250625 03:30:29.542622 1813 raft_consensus.cc:491] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:29.543282 1813 raft_consensus.cc:513] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.544817 1671 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e4034c33d83e4a96a187eaed46416e3c" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
W20250625 03:30:29.546700 1708 leader_election.cc:343] T e4034c33d83e4a96a187eaed46416e3c P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:29.547626 1812 leader_election.cc:290] T e4034c33d83e4a96a187eaed46416e3c P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:29.549049 1709 leader_election.cc:304] T e4034c33d83e4a96a187eaed46416e3c P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 3f2aa40978064c9e9983cf3745eed206
I20250625 03:30:29.549710 1595 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c4354f7ffc0e4eabbc92a141d46b7984" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:29.550647 1812 raft_consensus.cc:2802] T e4034c33d83e4a96a187eaed46416e3c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader election won for term 1
W20250625 03:30:29.551923 1635 leader_election.cc:343] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:29.555424 1786 tablet_bootstrap.cc:492] T afe48b30a4e64a4d8faf2a5b42d5c706 P ba464e89e0f044a0a0ea3e6125cbf2a1: No bootstrap required, opened a new log
I20250625 03:30:29.551918 1812 raft_consensus.cc:695] T e4034c33d83e4a96a187eaed46416e3c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Becoming Leader. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Running, Role: LEADER
I20250625 03:30:29.555657 1745 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c4354f7ffc0e4eabbc92a141d46b7984" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:29.556070 1786 ts_tablet_manager.cc:1397] T afe48b30a4e64a4d8faf2a5b42d5c706 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent bootstrapping tablet: real 0.085s user 0.022s sys 0.056s
I20250625 03:30:29.556586 1745 raft_consensus.cc:2466] T c4354f7ffc0e4eabbc92a141d46b7984 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 0.
I20250625 03:30:29.556555 1812 consensus_queue.cc:237] T e4034c33d83e4a96a187eaed46416e3c P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.557868 1636 leader_election.cc:304] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:29.558947 1799 raft_consensus.cc:2802] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:30:29.559351 1799 raft_consensus.cc:491] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:30:29.559068 1786 raft_consensus.cc:357] T afe48b30a4e64a4d8faf2a5b42d5c706 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.559774 1799 raft_consensus.cc:3058] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:29.559963 1786 raft_consensus.cc:383] T afe48b30a4e64a4d8faf2a5b42d5c706 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:29.560367 1786 raft_consensus.cc:738] T afe48b30a4e64a4d8faf2a5b42d5c706 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Initialized, Role: FOLLOWER
I20250625 03:30:29.561144 1786 consensus_queue.cc:260] T afe48b30a4e64a4d8faf2a5b42d5c706 P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.562551 1787 tablet_bootstrap.cc:654] T 40b74a261fdd495f84ceb0690f0b30ba P 7e9c4f2e01164f33b2e9034ed148398e: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:29.563796 1786 ts_tablet_manager.cc:1428] T afe48b30a4e64a4d8faf2a5b42d5c706 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent starting tablet: real 0.007s user 0.004s sys 0.002s
I20250625 03:30:29.564837 1786 tablet_bootstrap.cc:492] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1: Bootstrap starting.
I20250625 03:30:29.559067 1813 leader_election.cc:290] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:29.567231 1799 raft_consensus.cc:513] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.571496 1799 leader_election.cc:290] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:29.571735 1745 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c4354f7ffc0e4eabbc92a141d46b7984" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:30:29.572065 1786 tablet_bootstrap.cc:654] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:29.572417 1745 raft_consensus.cc:3058] T c4354f7ffc0e4eabbc92a141d46b7984 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:29.573684 1785 tablet_bootstrap.cc:492] T f957bf9749c54be48094092cb80e9055 P 3f2aa40978064c9e9983cf3745eed206: No bootstrap required, opened a new log
I20250625 03:30:29.574242 1785 ts_tablet_manager.cc:1397] T f957bf9749c54be48094092cb80e9055 P 3f2aa40978064c9e9983cf3745eed206: Time spent bootstrapping tablet: real 0.054s user 0.022s sys 0.017s
I20250625 03:30:29.576320 1785 raft_consensus.cc:357] T f957bf9749c54be48094092cb80e9055 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.576853 1785 raft_consensus.cc:383] T f957bf9749c54be48094092cb80e9055 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:29.577080 1785 raft_consensus.cc:738] T f957bf9749c54be48094092cb80e9055 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Initialized, Role: FOLLOWER
I20250625 03:30:29.577602 1785 consensus_queue.cc:260] T f957bf9749c54be48094092cb80e9055 P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.580411 1596 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c4354f7ffc0e4eabbc92a141d46b7984" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
I20250625 03:30:29.580765 1785 ts_tablet_manager.cc:1428] T f957bf9749c54be48094092cb80e9055 P 3f2aa40978064c9e9983cf3745eed206: Time spent starting tablet: real 0.006s user 0.006s sys 0.001s
I20250625 03:30:29.582096 1785 tablet_bootstrap.cc:492] T afe48b30a4e64a4d8faf2a5b42d5c706 P 3f2aa40978064c9e9983cf3745eed206: Bootstrap starting.
W20250625 03:30:29.582242 1635 leader_election.cc:343] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:29.589188 1785 tablet_bootstrap.cc:654] T afe48b30a4e64a4d8faf2a5b42d5c706 P 3f2aa40978064c9e9983cf3745eed206: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:29.592317 1745 raft_consensus.cc:2466] T c4354f7ffc0e4eabbc92a141d46b7984 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 1.
I20250625 03:30:29.594250 1636 leader_election.cc:304] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:29.599649 1787 tablet_bootstrap.cc:492] T 40b74a261fdd495f84ceb0690f0b30ba P 7e9c4f2e01164f33b2e9034ed148398e: No bootstrap required, opened a new log
I20250625 03:30:29.600422 1787 ts_tablet_manager.cc:1397] T 40b74a261fdd495f84ceb0690f0b30ba P 7e9c4f2e01164f33b2e9034ed148398e: Time spent bootstrapping tablet: real 0.076s user 0.016s sys 0.001s
I20250625 03:30:29.603598 1493 catalog_manager.cc:5582] T 731095860aad436e9658ab3ff5010f9d P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: HEALTHY } } }
I20250625 03:30:29.606855 1786 tablet_bootstrap.cc:492] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1: No bootstrap required, opened a new log
I20250625 03:30:29.608541 1786 ts_tablet_manager.cc:1397] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent bootstrapping tablet: real 0.044s user 0.010s sys 0.030s
I20250625 03:30:29.608989 1493 catalog_manager.cc:5582] T e4034c33d83e4a96a187eaed46416e3c P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: HEALTHY } } }
I20250625 03:30:29.611374 1786 raft_consensus.cc:357] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.612140 1786 raft_consensus.cc:383] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:29.612398 1799 raft_consensus.cc:2802] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:30:29.612457 1786 raft_consensus.cc:738] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Initialized, Role: FOLLOWER
I20250625 03:30:29.606663 1787 raft_consensus.cc:357] T 40b74a261fdd495f84ceb0690f0b30ba P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.613176 1799 raft_consensus.cc:695] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Becoming Leader. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Running, Role: LEADER
I20250625 03:30:29.613255 1787 raft_consensus.cc:383] T 40b74a261fdd495f84ceb0690f0b30ba P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:29.613639 1787 raft_consensus.cc:738] T 40b74a261fdd495f84ceb0690f0b30ba P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Initialized, Role: FOLLOWER
I20250625 03:30:29.613780 1786 consensus_queue.cc:260] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.614459 1787 consensus_queue.cc:260] T 40b74a261fdd495f84ceb0690f0b30ba P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.616722 1786 ts_tablet_manager.cc:1428] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent starting tablet: real 0.008s user 0.006s sys 0.001s
I20250625 03:30:29.607770 1785 tablet_bootstrap.cc:492] T afe48b30a4e64a4d8faf2a5b42d5c706 P 3f2aa40978064c9e9983cf3745eed206: No bootstrap required, opened a new log
I20250625 03:30:29.617147 1787 ts_tablet_manager.cc:1428] T 40b74a261fdd495f84ceb0690f0b30ba P 7e9c4f2e01164f33b2e9034ed148398e: Time spent starting tablet: real 0.016s user 0.007s sys 0.000s
I20250625 03:30:29.617441 1785 ts_tablet_manager.cc:1397] T afe48b30a4e64a4d8faf2a5b42d5c706 P 3f2aa40978064c9e9983cf3745eed206: Time spent bootstrapping tablet: real 0.036s user 0.013s sys 0.008s
I20250625 03:30:29.617724 1786 tablet_bootstrap.cc:492] T 9643cfd400804eb8b9037c5e9efddfba P ba464e89e0f044a0a0ea3e6125cbf2a1: Bootstrap starting.
I20250625 03:30:29.618000 1799 consensus_queue.cc:237] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.622028 1787 tablet_bootstrap.cc:492] T fb6e83db706647e28e491a02f1641980 P 7e9c4f2e01164f33b2e9034ed148398e: Bootstrap starting.
I20250625 03:30:29.622107 1785 raft_consensus.cc:357] T afe48b30a4e64a4d8faf2a5b42d5c706 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.623160 1785 raft_consensus.cc:383] T afe48b30a4e64a4d8faf2a5b42d5c706 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:29.623523 1785 raft_consensus.cc:738] T afe48b30a4e64a4d8faf2a5b42d5c706 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Initialized, Role: FOLLOWER
I20250625 03:30:29.624558 1786 tablet_bootstrap.cc:654] T 9643cfd400804eb8b9037c5e9efddfba P ba464e89e0f044a0a0ea3e6125cbf2a1: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:29.624403 1785 consensus_queue.cc:260] T afe48b30a4e64a4d8faf2a5b42d5c706 P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.627715 1785 ts_tablet_manager.cc:1428] T afe48b30a4e64a4d8faf2a5b42d5c706 P 3f2aa40978064c9e9983cf3745eed206: Time spent starting tablet: real 0.010s user 0.007s sys 0.000s
I20250625 03:30:29.629680 1785 tablet_bootstrap.cc:492] T e4034c33d83e4a96a187eaed46416e3c P 3f2aa40978064c9e9983cf3745eed206: Bootstrap starting.
I20250625 03:30:29.632901 1787 tablet_bootstrap.cc:654] T fb6e83db706647e28e491a02f1641980 P 7e9c4f2e01164f33b2e9034ed148398e: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:29.639890 1785 tablet_bootstrap.cc:654] T e4034c33d83e4a96a187eaed46416e3c P 3f2aa40978064c9e9983cf3745eed206: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:29.644585 1786 tablet_bootstrap.cc:492] T 9643cfd400804eb8b9037c5e9efddfba P ba464e89e0f044a0a0ea3e6125cbf2a1: No bootstrap required, opened a new log
I20250625 03:30:29.645074 1786 ts_tablet_manager.cc:1397] T 9643cfd400804eb8b9037c5e9efddfba P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent bootstrapping tablet: real 0.028s user 0.015s sys 0.007s
I20250625 03:30:29.647789 1786 raft_consensus.cc:357] T 9643cfd400804eb8b9037c5e9efddfba P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.648561 1786 raft_consensus.cc:383] T 9643cfd400804eb8b9037c5e9efddfba P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:29.648854 1786 raft_consensus.cc:738] T 9643cfd400804eb8b9037c5e9efddfba P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Initialized, Role: FOLLOWER
I20250625 03:30:29.649533 1786 consensus_queue.cc:260] T 9643cfd400804eb8b9037c5e9efddfba P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.650808 1492 catalog_manager.cc:5582] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } }
I20250625 03:30:29.651938 1786 ts_tablet_manager.cc:1428] T 9643cfd400804eb8b9037c5e9efddfba P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent starting tablet: real 0.007s user 0.004s sys 0.000s
I20250625 03:30:29.659452 1785 tablet_bootstrap.cc:492] T e4034c33d83e4a96a187eaed46416e3c P 3f2aa40978064c9e9983cf3745eed206: No bootstrap required, opened a new log
I20250625 03:30:29.660104 1785 ts_tablet_manager.cc:1397] T e4034c33d83e4a96a187eaed46416e3c P 3f2aa40978064c9e9983cf3745eed206: Time spent bootstrapping tablet: real 0.031s user 0.013s sys 0.007s
I20250625 03:30:29.660317 1786 tablet_bootstrap.cc:492] T fb6e83db706647e28e491a02f1641980 P ba464e89e0f044a0a0ea3e6125cbf2a1: Bootstrap starting.
I20250625 03:30:29.663393 1785 raft_consensus.cc:357] T e4034c33d83e4a96a187eaed46416e3c P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.664858 1785 raft_consensus.cc:383] T e4034c33d83e4a96a187eaed46416e3c P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:29.665227 1785 raft_consensus.cc:738] T e4034c33d83e4a96a187eaed46416e3c P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Initialized, Role: FOLLOWER
I20250625 03:30:29.666039 1785 consensus_queue.cc:260] T e4034c33d83e4a96a187eaed46416e3c P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.667066 1799 raft_consensus.cc:491] T e4034c33d83e4a96a187eaed46416e3c P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:29.667534 1799 raft_consensus.cc:513] T e4034c33d83e4a96a187eaed46416e3c P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.668287 1786 tablet_bootstrap.cc:654] T fb6e83db706647e28e491a02f1641980 P ba464e89e0f044a0a0ea3e6125cbf2a1: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:29.669214 1785 ts_tablet_manager.cc:1428] T e4034c33d83e4a96a187eaed46416e3c P 3f2aa40978064c9e9983cf3745eed206: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
I20250625 03:30:29.670200 1785 tablet_bootstrap.cc:492] T b15eb94b9d3d4f6987b5fa5e20193655 P 3f2aa40978064c9e9983cf3745eed206: Bootstrap starting.
I20250625 03:30:29.671864 1596 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e4034c33d83e4a96a187eaed46416e3c" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:29.672327 1745 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e4034c33d83e4a96a187eaed46416e3c" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:29.673530 1787 tablet_bootstrap.cc:492] T fb6e83db706647e28e491a02f1641980 P 7e9c4f2e01164f33b2e9034ed148398e: No bootstrap required, opened a new log
I20250625 03:30:29.674026 1787 ts_tablet_manager.cc:1397] T fb6e83db706647e28e491a02f1641980 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent bootstrapping tablet: real 0.052s user 0.021s sys 0.020s
I20250625 03:30:29.672670 1596 raft_consensus.cc:2391] T e4034c33d83e4a96a187eaed46416e3c P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f2aa40978064c9e9983cf3745eed206 in current term 1: Already voted for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in this term.
I20250625 03:30:29.675604 1635 leader_election.cc:304] T e4034c33d83e4a96a187eaed46416e3c P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206; no voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:29.675697 1799 leader_election.cc:290] T e4034c33d83e4a96a187eaed46416e3c P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:29.676553 1799 raft_consensus.cc:3058] T e4034c33d83e4a96a187eaed46416e3c P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:29.677018 1785 tablet_bootstrap.cc:654] T b15eb94b9d3d4f6987b5fa5e20193655 P 3f2aa40978064c9e9983cf3745eed206: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:29.677536 1789 raft_consensus.cc:491] T 731095860aad436e9658ab3ff5010f9d P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:29.678040 1789 raft_consensus.cc:513] T 731095860aad436e9658ab3ff5010f9d P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.680246 1789 leader_election.cc:290] T 731095860aad436e9658ab3ff5010f9d P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:29.682360 1671 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "731095860aad436e9658ab3ff5010f9d" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:29.683516 1671 raft_consensus.cc:2391] T 731095860aad436e9658ab3ff5010f9d P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e9c4f2e01164f33b2e9034ed148398e in current term 1: Already voted for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in this term.
I20250625 03:30:29.687052 1745 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "731095860aad436e9658ab3ff5010f9d" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:29.689065 1561 leader_election.cc:304] T 731095860aad436e9658ab3ff5010f9d P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e; no voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:29.690258 1789 raft_consensus.cc:3058] T 731095860aad436e9658ab3ff5010f9d P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:29.702389 1799 raft_consensus.cc:2747] T e4034c33d83e4a96a187eaed46416e3c P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:30:29.702324 1787 raft_consensus.cc:357] T fb6e83db706647e28e491a02f1641980 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.703493 1787 raft_consensus.cc:383] T fb6e83db706647e28e491a02f1641980 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:29.703953 1787 raft_consensus.cc:738] T fb6e83db706647e28e491a02f1641980 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Initialized, Role: FOLLOWER
I20250625 03:30:29.705135 1789 raft_consensus.cc:2747] T 731095860aad436e9658ab3ff5010f9d P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:30:29.706255 1787 consensus_queue.cc:260] T fb6e83db706647e28e491a02f1641980 P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.709923 1787 ts_tablet_manager.cc:1428] T fb6e83db706647e28e491a02f1641980 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent starting tablet: real 0.036s user 0.006s sys 0.003s
I20250625 03:30:29.713490 1786 tablet_bootstrap.cc:492] T fb6e83db706647e28e491a02f1641980 P ba464e89e0f044a0a0ea3e6125cbf2a1: No bootstrap required, opened a new log
I20250625 03:30:29.714044 1786 ts_tablet_manager.cc:1397] T fb6e83db706647e28e491a02f1641980 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent bootstrapping tablet: real 0.054s user 0.024s sys 0.025s
I20250625 03:30:29.716169 1786 raft_consensus.cc:357] T fb6e83db706647e28e491a02f1641980 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.716904 1786 raft_consensus.cc:383] T fb6e83db706647e28e491a02f1641980 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:29.717226 1786 raft_consensus.cc:738] T fb6e83db706647e28e491a02f1641980 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Initialized, Role: FOLLOWER
I20250625 03:30:29.717350 1787 tablet_bootstrap.cc:492] T 9643cfd400804eb8b9037c5e9efddfba P 7e9c4f2e01164f33b2e9034ed148398e: Bootstrap starting.
I20250625 03:30:29.718065 1786 consensus_queue.cc:260] T fb6e83db706647e28e491a02f1641980 P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.720575 1786 ts_tablet_manager.cc:1428] T fb6e83db706647e28e491a02f1641980 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20250625 03:30:29.721799 1786 tablet_bootstrap.cc:492] T b15eb94b9d3d4f6987b5fa5e20193655 P ba464e89e0f044a0a0ea3e6125cbf2a1: Bootstrap starting.
I20250625 03:30:29.727331 1786 tablet_bootstrap.cc:654] T b15eb94b9d3d4f6987b5fa5e20193655 P ba464e89e0f044a0a0ea3e6125cbf2a1: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:29.727363 1787 tablet_bootstrap.cc:654] T 9643cfd400804eb8b9037c5e9efddfba P 7e9c4f2e01164f33b2e9034ed148398e: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:29.730006 1785 tablet_bootstrap.cc:492] T b15eb94b9d3d4f6987b5fa5e20193655 P 3f2aa40978064c9e9983cf3745eed206: No bootstrap required, opened a new log
I20250625 03:30:29.730506 1785 ts_tablet_manager.cc:1397] T b15eb94b9d3d4f6987b5fa5e20193655 P 3f2aa40978064c9e9983cf3745eed206: Time spent bootstrapping tablet: real 0.060s user 0.029s sys 0.023s
I20250625 03:30:29.734153 1785 raft_consensus.cc:357] T b15eb94b9d3d4f6987b5fa5e20193655 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.735145 1785 raft_consensus.cc:383] T b15eb94b9d3d4f6987b5fa5e20193655 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:29.735508 1785 raft_consensus.cc:738] T b15eb94b9d3d4f6987b5fa5e20193655 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Initialized, Role: FOLLOWER
I20250625 03:30:29.736521 1785 consensus_queue.cc:260] T b15eb94b9d3d4f6987b5fa5e20193655 P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.738871 1786 tablet_bootstrap.cc:492] T b15eb94b9d3d4f6987b5fa5e20193655 P ba464e89e0f044a0a0ea3e6125cbf2a1: No bootstrap required, opened a new log
I20250625 03:30:29.739166 1785 ts_tablet_manager.cc:1428] T b15eb94b9d3d4f6987b5fa5e20193655 P 3f2aa40978064c9e9983cf3745eed206: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s
I20250625 03:30:29.739451 1786 ts_tablet_manager.cc:1397] T b15eb94b9d3d4f6987b5fa5e20193655 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent bootstrapping tablet: real 0.018s user 0.013s sys 0.003s
I20250625 03:30:29.740238 1787 tablet_bootstrap.cc:492] T 9643cfd400804eb8b9037c5e9efddfba P 7e9c4f2e01164f33b2e9034ed148398e: No bootstrap required, opened a new log
I20250625 03:30:29.740700 1787 ts_tablet_manager.cc:1397] T 9643cfd400804eb8b9037c5e9efddfba P 7e9c4f2e01164f33b2e9034ed148398e: Time spent bootstrapping tablet: real 0.024s user 0.012s sys 0.009s
I20250625 03:30:29.742502 1786 raft_consensus.cc:357] T b15eb94b9d3d4f6987b5fa5e20193655 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.743453 1786 raft_consensus.cc:383] T b15eb94b9d3d4f6987b5fa5e20193655 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:29.743818 1785 tablet_bootstrap.cc:492] T 40b74a261fdd495f84ceb0690f0b30ba P 3f2aa40978064c9e9983cf3745eed206: Bootstrap starting.
I20250625 03:30:29.743511 1787 raft_consensus.cc:357] T 9643cfd400804eb8b9037c5e9efddfba P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.743846 1786 raft_consensus.cc:738] T b15eb94b9d3d4f6987b5fa5e20193655 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Initialized, Role: FOLLOWER
I20250625 03:30:29.744311 1787 raft_consensus.cc:383] T 9643cfd400804eb8b9037c5e9efddfba P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:29.744632 1787 raft_consensus.cc:738] T 9643cfd400804eb8b9037c5e9efddfba P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Initialized, Role: FOLLOWER
I20250625 03:30:29.745052 1786 consensus_queue.cc:260] T b15eb94b9d3d4f6987b5fa5e20193655 P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.745465 1787 consensus_queue.cc:260] T 9643cfd400804eb8b9037c5e9efddfba P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.746397 1812 raft_consensus.cc:491] T b15eb94b9d3d4f6987b5fa5e20193655 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:29.746881 1812 raft_consensus.cc:513] T b15eb94b9d3d4f6987b5fa5e20193655 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.748380 1787 ts_tablet_manager.cc:1428] T 9643cfd400804eb8b9037c5e9efddfba P 7e9c4f2e01164f33b2e9034ed148398e: Time spent starting tablet: real 0.007s user 0.006s sys 0.001s
I20250625 03:30:29.748935 1812 leader_election.cc:290] T b15eb94b9d3d4f6987b5fa5e20193655 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:29.749385 1787 tablet_bootstrap.cc:492] T 85e02bb33a944989ada7f600c1e802da P 7e9c4f2e01164f33b2e9034ed148398e: Bootstrap starting.
I20250625 03:30:29.750522 1785 tablet_bootstrap.cc:654] T 40b74a261fdd495f84ceb0690f0b30ba P 3f2aa40978064c9e9983cf3745eed206: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:29.751179 1596 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b15eb94b9d3d4f6987b5fa5e20193655" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:29.751395 1799 raft_consensus.cc:491] T 9643cfd400804eb8b9037c5e9efddfba P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:29.751796 1596 raft_consensus.cc:2466] T b15eb94b9d3d4f6987b5fa5e20193655 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 0.
I20250625 03:30:29.754094 1671 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b15eb94b9d3d4f6987b5fa5e20193655" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:29.755019 1671 raft_consensus.cc:2466] T b15eb94b9d3d4f6987b5fa5e20193655 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 0.
I20250625 03:30:29.754233 1709 leader_election.cc:304] T b15eb94b9d3d4f6987b5fa5e20193655 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters:
I20250625 03:30:29.757135 1812 raft_consensus.cc:2802] T b15eb94b9d3d4f6987b5fa5e20193655 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:30:29.757508 1812 raft_consensus.cc:491] T b15eb94b9d3d4f6987b5fa5e20193655 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:30:29.757874 1812 raft_consensus.cc:3058] T b15eb94b9d3d4f6987b5fa5e20193655 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:29.761072 1787 tablet_bootstrap.cc:654] T 85e02bb33a944989ada7f600c1e802da P 7e9c4f2e01164f33b2e9034ed148398e: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:29.762008 1785 tablet_bootstrap.cc:492] T 40b74a261fdd495f84ceb0690f0b30ba P 3f2aa40978064c9e9983cf3745eed206: No bootstrap required, opened a new log
I20250625 03:30:29.762457 1785 ts_tablet_manager.cc:1397] T 40b74a261fdd495f84ceb0690f0b30ba P 3f2aa40978064c9e9983cf3745eed206: Time spent bootstrapping tablet: real 0.019s user 0.008s sys 0.008s
I20250625 03:30:29.764480 1786 ts_tablet_manager.cc:1428] T b15eb94b9d3d4f6987b5fa5e20193655 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent starting tablet: real 0.025s user 0.007s sys 0.000s
I20250625 03:30:29.765697 1785 raft_consensus.cc:357] T 40b74a261fdd495f84ceb0690f0b30ba P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.751812 1799 raft_consensus.cc:513] T 9643cfd400804eb8b9037c5e9efddfba P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.766754 1785 raft_consensus.cc:383] T 40b74a261fdd495f84ceb0690f0b30ba P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:29.767329 1785 raft_consensus.cc:738] T 40b74a261fdd495f84ceb0690f0b30ba P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Initialized, Role: FOLLOWER
I20250625 03:30:29.767524 1786 tablet_bootstrap.cc:492] T d9038fc1ce0d4b528c02c68012e1277d P ba464e89e0f044a0a0ea3e6125cbf2a1: Bootstrap starting.
I20250625 03:30:29.768489 1799 leader_election.cc:290] T 9643cfd400804eb8b9037c5e9efddfba P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:29.765858 1812 raft_consensus.cc:513] T b15eb94b9d3d4f6987b5fa5e20193655 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.769279 1596 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9643cfd400804eb8b9037c5e9efddfba" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:29.769517 1745 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9643cfd400804eb8b9037c5e9efddfba" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:29.770866 1745 raft_consensus.cc:2466] T 9643cfd400804eb8b9037c5e9efddfba P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 0.
I20250625 03:30:29.770085 1596 raft_consensus.cc:2466] T 9643cfd400804eb8b9037c5e9efddfba P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 0.
I20250625 03:30:29.768304 1785 consensus_queue.cc:260] T 40b74a261fdd495f84ceb0690f0b30ba P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.774091 1635 leader_election.cc:304] T 9643cfd400804eb8b9037c5e9efddfba P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e; no voters:
I20250625 03:30:29.774749 1785 ts_tablet_manager.cc:1428] T 40b74a261fdd495f84ceb0690f0b30ba P 3f2aa40978064c9e9983cf3745eed206: Time spent starting tablet: real 0.012s user 0.007s sys 0.002s
I20250625 03:30:29.775156 1813 raft_consensus.cc:2802] T 9643cfd400804eb8b9037c5e9efddfba P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:30:29.775507 1813 raft_consensus.cc:491] T 9643cfd400804eb8b9037c5e9efddfba P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:30:29.775642 1785 tablet_bootstrap.cc:492] T 85e02bb33a944989ada7f600c1e802da P 3f2aa40978064c9e9983cf3745eed206: Bootstrap starting.
I20250625 03:30:29.775861 1813 raft_consensus.cc:3058] T 9643cfd400804eb8b9037c5e9efddfba P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:29.778187 1786 tablet_bootstrap.cc:654] T d9038fc1ce0d4b528c02c68012e1277d P ba464e89e0f044a0a0ea3e6125cbf2a1: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:29.778450 1671 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b15eb94b9d3d4f6987b5fa5e20193655" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:30:29.779048 1671 raft_consensus.cc:3058] T b15eb94b9d3d4f6987b5fa5e20193655 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:29.782451 1785 tablet_bootstrap.cc:654] T 85e02bb33a944989ada7f600c1e802da P 3f2aa40978064c9e9983cf3745eed206: Neither blocks nor log segments found. Creating new log.
W20250625 03:30:29.783401 1709 consensus_peers.cc:487] T 1fff19a38e8d4880a14da6b4c8284cc2 P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:30:29.784730 1799 raft_consensus.cc:491] T 6e7283d035e1429f946d8ebb98978656 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:29.785431 1799 raft_consensus.cc:513] T 6e7283d035e1429f946d8ebb98978656 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.786957 1596 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b15eb94b9d3d4f6987b5fa5e20193655" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
I20250625 03:30:29.787768 1797 raft_consensus.cc:491] T afe48b30a4e64a4d8faf2a5b42d5c706 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:29.792138 1786 tablet_bootstrap.cc:492] T d9038fc1ce0d4b528c02c68012e1277d P ba464e89e0f044a0a0ea3e6125cbf2a1: No bootstrap required, opened a new log
I20250625 03:30:29.793278 1596 raft_consensus.cc:3058] T b15eb94b9d3d4f6987b5fa5e20193655 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:29.794486 1786 ts_tablet_manager.cc:1397] T d9038fc1ce0d4b528c02c68012e1277d P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent bootstrapping tablet: real 0.027s user 0.010s sys 0.004s
I20250625 03:30:29.797149 1786 raft_consensus.cc:357] T d9038fc1ce0d4b528c02c68012e1277d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.797935 1786 raft_consensus.cc:383] T d9038fc1ce0d4b528c02c68012e1277d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:29.798211 1786 raft_consensus.cc:738] T d9038fc1ce0d4b528c02c68012e1277d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Initialized, Role: FOLLOWER
I20250625 03:30:29.800484 1595 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6e7283d035e1429f946d8ebb98978656" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:29.801481 1745 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6e7283d035e1429f946d8ebb98978656" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:29.807974 1595 raft_consensus.cc:2466] T 6e7283d035e1429f946d8ebb98978656 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 0.
W20250625 03:30:29.808880 1636 leader_election.cc:343] T 6e7283d035e1429f946d8ebb98978656 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:29.809487 1812 leader_election.cc:290] T b15eb94b9d3d4f6987b5fa5e20193655 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:29.802618 1797 raft_consensus.cc:513] T afe48b30a4e64a4d8faf2a5b42d5c706 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.807294 1671 raft_consensus.cc:2466] T b15eb94b9d3d4f6987b5fa5e20193655 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 1.
I20250625 03:30:29.812461 1812 consensus_queue.cc:1035] T 1fff19a38e8d4880a14da6b4c8284cc2 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:30:29.796983 1813 raft_consensus.cc:513] T 9643cfd400804eb8b9037c5e9efddfba P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.809510 1635 leader_election.cc:304] T 6e7283d035e1429f946d8ebb98978656 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e; no voters: ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:29.818531 1745 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9643cfd400804eb8b9037c5e9efddfba" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:30:29.819350 1745 raft_consensus.cc:3058] T 9643cfd400804eb8b9037c5e9efddfba P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:29.809767 1786 consensus_queue.cc:260] T d9038fc1ce0d4b528c02c68012e1277d P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.821805 1842 raft_consensus.cc:2802] T 6e7283d035e1429f946d8ebb98978656 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:30:29.822703 1842 raft_consensus.cc:491] T 6e7283d035e1429f946d8ebb98978656 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:30:29.822739 1594 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9643cfd400804eb8b9037c5e9efddfba" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
I20250625 03:30:29.823120 1842 raft_consensus.cc:3058] T 6e7283d035e1429f946d8ebb98978656 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:29.801612 1799 leader_election.cc:290] T 6e7283d035e1429f946d8ebb98978656 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:29.823534 1594 raft_consensus.cc:3058] T 9643cfd400804eb8b9037c5e9efddfba P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:29.811430 1596 raft_consensus.cc:2466] T b15eb94b9d3d4f6987b5fa5e20193655 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 1.
I20250625 03:30:29.814102 1797 leader_election.cc:290] T afe48b30a4e64a4d8faf2a5b42d5c706 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:29.803952 1787 tablet_bootstrap.cc:492] T 85e02bb33a944989ada7f600c1e802da P 7e9c4f2e01164f33b2e9034ed148398e: No bootstrap required, opened a new log
I20250625 03:30:29.828744 1787 ts_tablet_manager.cc:1397] T 85e02bb33a944989ada7f600c1e802da P 7e9c4f2e01164f33b2e9034ed148398e: Time spent bootstrapping tablet: real 0.080s user 0.008s sys 0.012s
I20250625 03:30:29.829560 1709 leader_election.cc:304] T b15eb94b9d3d4f6987b5fa5e20193655 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters:
I20250625 03:30:29.830560 1797 raft_consensus.cc:2802] T b15eb94b9d3d4f6987b5fa5e20193655 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:30:29.831013 1797 raft_consensus.cc:695] T b15eb94b9d3d4f6987b5fa5e20193655 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Becoming Leader. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Running, Role: LEADER
I20250625 03:30:29.831202 1594 raft_consensus.cc:2466] T 9643cfd400804eb8b9037c5e9efddfba P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 1.
I20250625 03:30:29.814461 1595 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "afe48b30a4e64a4d8faf2a5b42d5c706" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:29.823531 1786 ts_tablet_manager.cc:1428] T d9038fc1ce0d4b528c02c68012e1277d P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent starting tablet: real 0.029s user 0.006s sys 0.000s
I20250625 03:30:29.831846 1797 consensus_queue.cc:237] T b15eb94b9d3d4f6987b5fa5e20193655 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.834093 1786 tablet_bootstrap.cc:492] T 6cc384f27ff041c0be70bb661ae610dd P ba464e89e0f044a0a0ea3e6125cbf2a1: Bootstrap starting.
W20250625 03:30:29.834251 1709 leader_election.cc:343] T afe48b30a4e64a4d8faf2a5b42d5c706 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:29.835350 1789 raft_consensus.cc:491] T 40b74a261fdd495f84ceb0690f0b30ba P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:29.835855 1789 raft_consensus.cc:513] T 40b74a261fdd495f84ceb0690f0b30ba P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.832547 1635 leader_election.cc:304] T 9643cfd400804eb8b9037c5e9efddfba P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e; no voters:
I20250625 03:30:29.835417 1787 raft_consensus.cc:357] T 85e02bb33a944989ada7f600c1e802da P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.837024 1799 raft_consensus.cc:2802] T 9643cfd400804eb8b9037c5e9efddfba P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:30:29.837320 1787 raft_consensus.cc:383] T 85e02bb33a944989ada7f600c1e802da P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:29.837579 1787 raft_consensus.cc:738] T 85e02bb33a944989ada7f600c1e802da P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Initialized, Role: FOLLOWER
I20250625 03:30:29.837869 1789 leader_election.cc:290] T 40b74a261fdd495f84ceb0690f0b30ba P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:29.838395 1787 consensus_queue.cc:260] T 85e02bb33a944989ada7f600c1e802da P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.840464 1744 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "40b74a261fdd495f84ceb0690f0b30ba" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:29.840755 1671 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "40b74a261fdd495f84ceb0690f0b30ba" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:29.841593 1671 raft_consensus.cc:2466] T 40b74a261fdd495f84ceb0690f0b30ba P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 0.
W20250625 03:30:29.842494 1561 leader_election.cc:343] T 40b74a261fdd495f84ceb0690f0b30ba P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:29.843263 1561 leader_election.cc:304] T 40b74a261fdd495f84ceb0690f0b30ba P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e; no voters: ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:29.845638 1789 raft_consensus.cc:2802] T 40b74a261fdd495f84ceb0690f0b30ba P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:30:29.846223 1789 raft_consensus.cc:491] T 40b74a261fdd495f84ceb0690f0b30ba P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:30:29.846609 1787 ts_tablet_manager.cc:1428] T 85e02bb33a944989ada7f600c1e802da P 7e9c4f2e01164f33b2e9034ed148398e: Time spent starting tablet: real 0.017s user 0.005s sys 0.002s
I20250625 03:30:29.846904 1786 tablet_bootstrap.cc:654] T 6cc384f27ff041c0be70bb661ae610dd P ba464e89e0f044a0a0ea3e6125cbf2a1: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:29.846733 1789 raft_consensus.cc:3058] T 40b74a261fdd495f84ceb0690f0b30ba P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:29.847637 1787 tablet_bootstrap.cc:492] T d9038fc1ce0d4b528c02c68012e1277d P 7e9c4f2e01164f33b2e9034ed148398e: Bootstrap starting.
I20250625 03:30:29.856384 1745 raft_consensus.cc:2466] T 9643cfd400804eb8b9037c5e9efddfba P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 1.
I20250625 03:30:29.852840 1813 leader_election.cc:290] T 9643cfd400804eb8b9037c5e9efddfba P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:29.866590 1842 raft_consensus.cc:513] T 6e7283d035e1429f946d8ebb98978656 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
W20250625 03:30:29.860963 1708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.130:34293, user_credentials={real_user=slave}} blocked reactor thread for 72828.4us
I20250625 03:30:29.871646 1671 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "afe48b30a4e64a4d8faf2a5b42d5c706" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:29.872615 1671 raft_consensus.cc:2466] T afe48b30a4e64a4d8faf2a5b42d5c706 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 0.
I20250625 03:30:29.876578 1842 leader_election.cc:290] T 6e7283d035e1429f946d8ebb98978656 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:29.877530 1596 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6e7283d035e1429f946d8ebb98978656" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
I20250625 03:30:29.878407 1596 raft_consensus.cc:3058] T 6e7283d035e1429f946d8ebb98978656 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:29.880211 1787 tablet_bootstrap.cc:654] T d9038fc1ce0d4b528c02c68012e1277d P 7e9c4f2e01164f33b2e9034ed148398e: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:29.889734 1797 raft_consensus.cc:491] T fb6e83db706647e28e491a02f1641980 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:29.893411 1841 raft_consensus.cc:491] T d9038fc1ce0d4b528c02c68012e1277d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:29.893785 1789 raft_consensus.cc:513] T 40b74a261fdd495f84ceb0690f0b30ba P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.894058 1745 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6e7283d035e1429f946d8ebb98978656" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:30:29.895071 1786 tablet_bootstrap.cc:492] T 6cc384f27ff041c0be70bb661ae610dd P ba464e89e0f044a0a0ea3e6125cbf2a1: No bootstrap required, opened a new log
I20250625 03:30:29.891259 1799 raft_consensus.cc:695] T 9643cfd400804eb8b9037c5e9efddfba P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Becoming Leader. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Running, Role: LEADER
I20250625 03:30:29.897747 1786 ts_tablet_manager.cc:1397] T 6cc384f27ff041c0be70bb661ae610dd P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent bootstrapping tablet: real 0.064s user 0.009s sys 0.004s
I20250625 03:30:29.896859 1841 raft_consensus.cc:513] T d9038fc1ce0d4b528c02c68012e1277d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
W20250625 03:30:29.899133 1636 leader_election.cc:343] T 6e7283d035e1429f946d8ebb98978656 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:29.899603 1671 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "40b74a261fdd495f84ceb0690f0b30ba" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:30:29.900208 1671 raft_consensus.cc:3058] T 40b74a261fdd495f84ceb0690f0b30ba P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:29.900377 1789 leader_election.cc:290] T 40b74a261fdd495f84ceb0690f0b30ba P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 election: Requested vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:29.900902 1595 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d9038fc1ce0d4b528c02c68012e1277d" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
W20250625 03:30:29.902313 1709 leader_election.cc:343] T d9038fc1ce0d4b528c02c68012e1277d P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:29.903159 1841 leader_election.cc:290] T d9038fc1ce0d4b528c02c68012e1277d P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:29.903628 1786 raft_consensus.cc:357] T 6cc384f27ff041c0be70bb661ae610dd P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.904335 1786 raft_consensus.cc:383] T 6cc384f27ff041c0be70bb661ae610dd P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:29.904523 1785 tablet_bootstrap.cc:492] T 85e02bb33a944989ada7f600c1e802da P 3f2aa40978064c9e9983cf3745eed206: No bootstrap required, opened a new log
I20250625 03:30:29.904590 1786 raft_consensus.cc:738] T 6cc384f27ff041c0be70bb661ae610dd P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Initialized, Role: FOLLOWER
I20250625 03:30:29.905395 1785 ts_tablet_manager.cc:1397] T 85e02bb33a944989ada7f600c1e802da P 3f2aa40978064c9e9983cf3745eed206: Time spent bootstrapping tablet: real 0.130s user 0.038s sys 0.059s
I20250625 03:30:29.905436 1786 consensus_queue.cc:260] T 6cc384f27ff041c0be70bb661ae610dd P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.904103 1799 consensus_queue.cc:237] T 9643cfd400804eb8b9037c5e9efddfba P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.907049 1745 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "40b74a261fdd495f84ceb0690f0b30ba" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:30:29.907981 1786 ts_tablet_manager.cc:1428] T 6cc384f27ff041c0be70bb661ae610dd P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent starting tablet: real 0.010s user 0.006s sys 0.001s
I20250625 03:30:29.909873 1671 raft_consensus.cc:2466] T 40b74a261fdd495f84ceb0690f0b30ba P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 1.
I20250625 03:30:29.909786 1785 raft_consensus.cc:357] T 85e02bb33a944989ada7f600c1e802da P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.912364 1785 raft_consensus.cc:383] T 85e02bb33a944989ada7f600c1e802da P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:29.912671 1785 raft_consensus.cc:738] T 85e02bb33a944989ada7f600c1e802da P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Initialized, Role: FOLLOWER
W20250625 03:30:29.912731 1561 leader_election.cc:343] T 40b74a261fdd495f84ceb0690f0b30ba P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:29.913363 1559 leader_election.cc:304] T 40b74a261fdd495f84ceb0690f0b30ba P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e; no voters: ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:29.896090 1797 raft_consensus.cc:513] T fb6e83db706647e28e491a02f1641980 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.913451 1785 consensus_queue.cc:260] T 85e02bb33a944989ada7f600c1e802da P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.910480 1596 raft_consensus.cc:2466] T 6e7283d035e1429f946d8ebb98978656 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 1.
I20250625 03:30:29.911407 1787 tablet_bootstrap.cc:492] T d9038fc1ce0d4b528c02c68012e1277d P 7e9c4f2e01164f33b2e9034ed148398e: No bootstrap required, opened a new log
I20250625 03:30:29.917057 1785 ts_tablet_manager.cc:1428] T 85e02bb33a944989ada7f600c1e802da P 3f2aa40978064c9e9983cf3745eed206: Time spent starting tablet: real 0.011s user 0.007s sys 0.000s
I20250625 03:30:29.914539 1789 raft_consensus.cc:2802] T 40b74a261fdd495f84ceb0690f0b30ba P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:30:29.922577 1787 ts_tablet_manager.cc:1397] T d9038fc1ce0d4b528c02c68012e1277d P 7e9c4f2e01164f33b2e9034ed148398e: Time spent bootstrapping tablet: real 0.075s user 0.011s sys 0.003s
I20250625 03:30:29.917479 1595 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fb6e83db706647e28e491a02f1641980" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:29.923390 1785 tablet_bootstrap.cc:492] T fb6e83db706647e28e491a02f1641980 P 3f2aa40978064c9e9983cf3745eed206: Bootstrap starting.
I20250625 03:30:29.923715 1789 raft_consensus.cc:695] T 40b74a261fdd495f84ceb0690f0b30ba P 7e9c4f2e01164f33b2e9034ed148398e [term 1 LEADER]: Becoming Leader. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Running, Role: LEADER
I20250625 03:30:29.914436 1708 leader_election.cc:304] T afe48b30a4e64a4d8faf2a5b42d5c706 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:29.924950 1635 leader_election.cc:304] T 6e7283d035e1429f946d8ebb98978656 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e; no voters: ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:29.923439 1595 raft_consensus.cc:2466] T fb6e83db706647e28e491a02f1641980 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 0.
I20250625 03:30:29.925854 1843 raft_consensus.cc:2802] T 6e7283d035e1429f946d8ebb98978656 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:30:29.925796 1787 raft_consensus.cc:357] T d9038fc1ce0d4b528c02c68012e1277d P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.926476 1849 raft_consensus.cc:2802] T afe48b30a4e64a4d8faf2a5b42d5c706 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:30:29.926483 1843 raft_consensus.cc:695] T 6e7283d035e1429f946d8ebb98978656 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Becoming Leader. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Running, Role: LEADER
I20250625 03:30:29.926803 1709 leader_election.cc:304] T fb6e83db706647e28e491a02f1641980 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters:
I20250625 03:30:29.926784 1787 raft_consensus.cc:383] T d9038fc1ce0d4b528c02c68012e1277d P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:29.927539 1787 raft_consensus.cc:738] T d9038fc1ce0d4b528c02c68012e1277d P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Initialized, Role: FOLLOWER
I20250625 03:30:29.927964 1787 consensus_queue.cc:260] T d9038fc1ce0d4b528c02c68012e1277d P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.928460 1812 raft_consensus.cc:2802] T fb6e83db706647e28e491a02f1641980 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:30:29.928874 1812 raft_consensus.cc:491] T fb6e83db706647e28e491a02f1641980 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:30:29.928344 1843 consensus_queue.cc:237] T 6e7283d035e1429f946d8ebb98978656 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.929190 1812 raft_consensus.cc:3058] T fb6e83db706647e28e491a02f1641980 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:29.930811 1842 raft_consensus.cc:491] T f957bf9749c54be48094092cb80e9055 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:29.931327 1785 tablet_bootstrap.cc:654] T fb6e83db706647e28e491a02f1641980 P 3f2aa40978064c9e9983cf3745eed206: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:29.931309 1842 raft_consensus.cc:513] T f957bf9749c54be48094092cb80e9055 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.933107 1848 consensus_queue.cc:1035] T 731095860aad436e9658ab3ff5010f9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:30:29.933858 1842 leader_election.cc:290] T f957bf9749c54be48094092cb80e9055 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:29.925719 1841 raft_consensus.cc:491] T 6cc384f27ff041c0be70bb661ae610dd P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:29.934620 1594 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f957bf9749c54be48094092cb80e9055" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:29.935607 1841 raft_consensus.cc:513] T 6cc384f27ff041c0be70bb661ae610dd P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.937893 1841 leader_election.cc:290] T 6cc384f27ff041c0be70bb661ae610dd P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:29.938436 1787 ts_tablet_manager.cc:1428] T d9038fc1ce0d4b528c02c68012e1277d P 7e9c4f2e01164f33b2e9034ed148398e: Time spent starting tablet: real 0.015s user 0.006s sys 0.000s
I20250625 03:30:29.939386 1787 tablet_bootstrap.cc:492] T 1fff19a38e8d4880a14da6b4c8284cc2 P 7e9c4f2e01164f33b2e9034ed148398e: Bootstrap starting.
W20250625 03:30:29.939283 1635 leader_election.cc:343] T f957bf9749c54be48094092cb80e9055 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:29.939606 1594 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6cc384f27ff041c0be70bb661ae610dd" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:29.940203 1789 consensus_queue.cc:237] T 40b74a261fdd495f84ceb0690f0b30ba P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.939399 1849 raft_consensus.cc:491] T afe48b30a4e64a4d8faf2a5b42d5c706 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20250625 03:30:29.940985 1709 leader_election.cc:343] T 6cc384f27ff041c0be70bb661ae610dd P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:29.941179 1849 raft_consensus.cc:3058] T afe48b30a4e64a4d8faf2a5b42d5c706 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:29.942104 1812 raft_consensus.cc:513] T fb6e83db706647e28e491a02f1641980 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.947417 1594 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fb6e83db706647e28e491a02f1641980" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
I20250625 03:30:29.948279 1594 raft_consensus.cc:3058] T fb6e83db706647e28e491a02f1641980 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:29.948956 1745 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f957bf9749c54be48094092cb80e9055" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:29.950789 1786 tablet_bootstrap.cc:492] T 40b74a261fdd495f84ceb0690f0b30ba P ba464e89e0f044a0a0ea3e6125cbf2a1: Bootstrap starting.
W20250625 03:30:29.951995 1636 leader_election.cc:343] T f957bf9749c54be48094092cb80e9055 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:29.925241 1797 leader_election.cc:290] T fb6e83db706647e28e491a02f1641980 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:29.955006 1636 leader_election.cc:304] T f957bf9749c54be48094092cb80e9055 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206; no voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:29.956209 1670 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d9038fc1ce0d4b528c02c68012e1277d" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:29.958228 1669 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fb6e83db706647e28e491a02f1641980" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:29.958454 1492 catalog_manager.cc:5582] T b15eb94b9d3d4f6987b5fa5e20193655 P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: HEALTHY } } }
I20250625 03:30:29.967058 1843 raft_consensus.cc:2747] T f957bf9749c54be48094092cb80e9055 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:30:29.961081 1812 leader_election.cc:290] T fb6e83db706647e28e491a02f1641980 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:29.982995 1812 raft_consensus.cc:491] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:29.983502 1812 raft_consensus.cc:513] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.986846 1595 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "85e02bb33a944989ada7f600c1e802da" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:29.986378 1494 catalog_manager.cc:5582] T 9643cfd400804eb8b9037c5e9efddfba P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } }
I20250625 03:30:29.987438 1595 raft_consensus.cc:2466] T 85e02bb33a944989ada7f600c1e802da P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 0.
I20250625 03:30:29.988519 1709 leader_election.cc:304] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters:
I20250625 03:30:29.989365 1797 raft_consensus.cc:2802] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:30:29.989434 1669 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6cc384f27ff041c0be70bb661ae610dd" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:29.989723 1812 leader_election.cc:290] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:29.990001 1797 raft_consensus.cc:491] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:30:29.990502 1797 raft_consensus.cc:3058] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:29.998883 1849 raft_consensus.cc:513] T afe48b30a4e64a4d8faf2a5b42d5c706 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:30.004453 1797 raft_consensus.cc:513] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:29.965642 1594 raft_consensus.cc:2466] T fb6e83db706647e28e491a02f1641980 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 1.
I20250625 03:30:30.029038 1669 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fb6e83db706647e28e491a02f1641980" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:30:30.058423 1797 leader_election.cc:290] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:30.059298 1595 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "85e02bb33a944989ada7f600c1e802da" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
I20250625 03:30:30.065412 1595 raft_consensus.cc:3058] T 85e02bb33a944989ada7f600c1e802da P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:30.068282 1669 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "85e02bb33a944989ada7f600c1e802da" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:30.068558 1709 leader_election.cc:304] T fb6e83db706647e28e491a02f1641980 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters:
I20250625 03:30:30.068943 1669 raft_consensus.cc:2466] T 85e02bb33a944989ada7f600c1e802da P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 0.
I20250625 03:30:30.069406 1797 raft_consensus.cc:2802] T fb6e83db706647e28e491a02f1641980 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:30:30.069871 1797 raft_consensus.cc:695] T fb6e83db706647e28e491a02f1641980 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Becoming Leader. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Running, Role: LEADER
I20250625 03:30:30.070900 1797 consensus_queue.cc:237] T fb6e83db706647e28e491a02f1641980 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:30.095593 1812 consensus_queue.cc:1035] T 731095860aad436e9658ab3ff5010f9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20250625 03:30:30.097980 1708 leader_election.cc:343] T d9038fc1ce0d4b528c02c68012e1277d P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:30.100997 1594 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "afe48b30a4e64a4d8faf2a5b42d5c706" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
I20250625 03:30:30.099997 1849 leader_election.cc:290] T afe48b30a4e64a4d8faf2a5b42d5c706 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:30.113991 1595 raft_consensus.cc:2466] T 85e02bb33a944989ada7f600c1e802da P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 1.
I20250625 03:30:30.119835 1787 tablet_bootstrap.cc:654] T 1fff19a38e8d4880a14da6b4c8284cc2 P 7e9c4f2e01164f33b2e9034ed148398e: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:30.121706 1709 leader_election.cc:304] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters:
I20250625 03:30:30.123627 1785 tablet_bootstrap.cc:492] T fb6e83db706647e28e491a02f1641980 P 3f2aa40978064c9e9983cf3745eed206: No bootstrap required, opened a new log
I20250625 03:30:30.124150 1785 ts_tablet_manager.cc:1397] T fb6e83db706647e28e491a02f1641980 P 3f2aa40978064c9e9983cf3745eed206: Time spent bootstrapping tablet: real 0.201s user 0.040s sys 0.082s
I20250625 03:30:30.126708 1785 raft_consensus.cc:357] T fb6e83db706647e28e491a02f1641980 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:30.125943 1492 catalog_manager.cc:5582] T 40b74a261fdd495f84ceb0690f0b30ba P 7e9c4f2e01164f33b2e9034ed148398e reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129). New cstate: current_term: 1 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } }
I20250625 03:30:30.127379 1785 raft_consensus.cc:383] T fb6e83db706647e28e491a02f1641980 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:30.127679 1785 raft_consensus.cc:738] T fb6e83db706647e28e491a02f1641980 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Initialized, Role: FOLLOWER
I20250625 03:30:30.114629 1708 leader_election.cc:304] T d9038fc1ce0d4b528c02c68012e1277d P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:30.129823 1812 raft_consensus.cc:2747] T d9038fc1ce0d4b528c02c68012e1277d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250625 03:30:30.129963 1709 leader_election.cc:343] T afe48b30a4e64a4d8faf2a5b42d5c706 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
W20250625 03:30:30.131170 1708 leader_election.cc:343] T fb6e83db706647e28e491a02f1641980 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:30.130955 1785 consensus_queue.cc:260] T fb6e83db706647e28e491a02f1641980 P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
W20250625 03:30:30.132468 1708 leader_election.cc:343] T 6cc384f27ff041c0be70bb661ae610dd P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:30.132983 1708 leader_election.cc:304] T 6cc384f27ff041c0be70bb661ae610dd P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:30.133440 1785 ts_tablet_manager.cc:1428] T fb6e83db706647e28e491a02f1641980 P 3f2aa40978064c9e9983cf3745eed206: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
W20250625 03:30:30.134048 1708 leader_election.cc:343] T fb6e83db706647e28e491a02f1641980 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:30.134344 1785 tablet_bootstrap.cc:492] T 615cebbffcfc44e19b8f7a1e842073a3 P 3f2aa40978064c9e9983cf3745eed206: Bootstrap starting.
I20250625 03:30:30.135547 1812 raft_consensus.cc:2747] T 6cc384f27ff041c0be70bb661ae610dd P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:30:30.136145 1812 consensus_queue.cc:1035] T e4034c33d83e4a96a187eaed46416e3c P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250625 03:30:30.140084 1851 log.cc:927] Time spent T 731095860aad436e9658ab3ff5010f9d P 7e9c4f2e01164f33b2e9034ed148398e: Append to log took a long time: real 0.151s user 0.002s sys 0.000s
I20250625 03:30:30.140336 1669 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "85e02bb33a944989ada7f600c1e802da" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:30:30.140277 1494 catalog_manager.cc:5582] T 6e7283d035e1429f946d8ebb98978656 P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } }
I20250625 03:30:30.140969 1669 raft_consensus.cc:3058] T 85e02bb33a944989ada7f600c1e802da P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:30.128813 1849 raft_consensus.cc:2802] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:30:30.142201 1668 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "afe48b30a4e64a4d8faf2a5b42d5c706" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:30:30.153326 1668 raft_consensus.cc:3058] T afe48b30a4e64a4d8faf2a5b42d5c706 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:30.153510 1812 consensus_queue.cc:1035] T e4034c33d83e4a96a187eaed46416e3c P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:30:30.154798 1849 raft_consensus.cc:695] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Becoming Leader. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Running, Role: LEADER
I20250625 03:30:30.155694 1849 consensus_queue.cc:237] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:30.159408 1493 catalog_manager.cc:5582] T fb6e83db706647e28e491a02f1641980 P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: HEALTHY } } }
I20250625 03:30:30.168628 1785 tablet_bootstrap.cc:654] T 615cebbffcfc44e19b8f7a1e842073a3 P 3f2aa40978064c9e9983cf3745eed206: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:30.175792 1786 tablet_bootstrap.cc:654] T 40b74a261fdd495f84ceb0690f0b30ba P ba464e89e0f044a0a0ea3e6125cbf2a1: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:30.177111 1668 raft_consensus.cc:2466] T afe48b30a4e64a4d8faf2a5b42d5c706 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 1.
I20250625 03:30:30.179738 1787 tablet_bootstrap.cc:492] T 1fff19a38e8d4880a14da6b4c8284cc2 P 7e9c4f2e01164f33b2e9034ed148398e: No bootstrap required, opened a new log
I20250625 03:30:30.181110 1787 ts_tablet_manager.cc:1397] T 1fff19a38e8d4880a14da6b4c8284cc2 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent bootstrapping tablet: real 0.242s user 0.011s sys 0.022s
I20250625 03:30:30.191478 1708 leader_election.cc:304] T afe48b30a4e64a4d8faf2a5b42d5c706 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:30.177843 1669 raft_consensus.cc:2466] T 85e02bb33a944989ada7f600c1e802da P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 1.
I20250625 03:30:30.196305 1797 raft_consensus.cc:2802] T afe48b30a4e64a4d8faf2a5b42d5c706 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:30:30.197155 1797 raft_consensus.cc:695] T afe48b30a4e64a4d8faf2a5b42d5c706 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Becoming Leader. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Running, Role: LEADER
I20250625 03:30:30.214342 1797 consensus_queue.cc:237] T afe48b30a4e64a4d8faf2a5b42d5c706 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
W20250625 03:30:30.225710 1635 consensus_peers.cc:487] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:30:30.240737 1799 consensus_queue.cc:1035] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:30:30.246516 1787 raft_consensus.cc:357] T 1fff19a38e8d4880a14da6b4c8284cc2 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } }
I20250625 03:30:30.247555 1787 raft_consensus.cc:383] T 1fff19a38e8d4880a14da6b4c8284cc2 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:30.247900 1787 raft_consensus.cc:738] T 1fff19a38e8d4880a14da6b4c8284cc2 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Initialized, Role: FOLLOWER
I20250625 03:30:30.250993 1787 consensus_queue.cc:260] T 1fff19a38e8d4880a14da6b4c8284cc2 P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } }
I20250625 03:30:30.252804 1785 tablet_bootstrap.cc:492] T 615cebbffcfc44e19b8f7a1e842073a3 P 3f2aa40978064c9e9983cf3745eed206: No bootstrap required, opened a new log
I20250625 03:30:30.253269 1785 ts_tablet_manager.cc:1397] T 615cebbffcfc44e19b8f7a1e842073a3 P 3f2aa40978064c9e9983cf3745eed206: Time spent bootstrapping tablet: real 0.119s user 0.020s sys 0.009s
I20250625 03:30:30.268391 1785 raft_consensus.cc:357] T 615cebbffcfc44e19b8f7a1e842073a3 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:30.269079 1785 raft_consensus.cc:383] T 615cebbffcfc44e19b8f7a1e842073a3 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:30.269454 1785 raft_consensus.cc:738] T 615cebbffcfc44e19b8f7a1e842073a3 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Initialized, Role: FOLLOWER
I20250625 03:30:30.270292 1785 consensus_queue.cc:260] T 615cebbffcfc44e19b8f7a1e842073a3 P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:30.271626 1786 tablet_bootstrap.cc:492] T 40b74a261fdd495f84ceb0690f0b30ba P ba464e89e0f044a0a0ea3e6125cbf2a1: No bootstrap required, opened a new log
I20250625 03:30:30.272161 1786 ts_tablet_manager.cc:1397] T 40b74a261fdd495f84ceb0690f0b30ba P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent bootstrapping tablet: real 0.322s user 0.021s sys 0.040s
I20250625 03:30:30.272718 1787 ts_tablet_manager.cc:1428] T 1fff19a38e8d4880a14da6b4c8284cc2 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent starting tablet: real 0.091s user 0.005s sys 0.003s
I20250625 03:30:30.272953 1785 ts_tablet_manager.cc:1428] T 615cebbffcfc44e19b8f7a1e842073a3 P 3f2aa40978064c9e9983cf3745eed206: Time spent starting tablet: real 0.019s user 0.007s sys 0.000s
I20250625 03:30:30.273866 1785 tablet_bootstrap.cc:492] T 6cc384f27ff041c0be70bb661ae610dd P 3f2aa40978064c9e9983cf3745eed206: Bootstrap starting.
I20250625 03:30:30.274924 1786 raft_consensus.cc:357] T 40b74a261fdd495f84ceb0690f0b30ba P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:30.275601 1786 raft_consensus.cc:383] T 40b74a261fdd495f84ceb0690f0b30ba P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:30.275913 1786 raft_consensus.cc:738] T 40b74a261fdd495f84ceb0690f0b30ba P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Initialized, Role: FOLLOWER
I20250625 03:30:30.275918 1787 tablet_bootstrap.cc:492] T c4354f7ffc0e4eabbc92a141d46b7984 P 7e9c4f2e01164f33b2e9034ed148398e: Bootstrap starting.
I20250625 03:30:30.281091 1785 tablet_bootstrap.cc:654] T 6cc384f27ff041c0be70bb661ae610dd P 3f2aa40978064c9e9983cf3745eed206: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:30.284143 1494 catalog_manager.cc:5582] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: HEALTHY } } }
I20250625 03:30:30.286248 1494 catalog_manager.cc:5582] T afe48b30a4e64a4d8faf2a5b42d5c706 P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: HEALTHY } } }
I20250625 03:30:30.296058 1785 tablet_bootstrap.cc:492] T 6cc384f27ff041c0be70bb661ae610dd P 3f2aa40978064c9e9983cf3745eed206: No bootstrap required, opened a new log
I20250625 03:30:30.296605 1785 ts_tablet_manager.cc:1397] T 6cc384f27ff041c0be70bb661ae610dd P 3f2aa40978064c9e9983cf3745eed206: Time spent bootstrapping tablet: real 0.023s user 0.015s sys 0.006s
I20250625 03:30:30.297482 1787 tablet_bootstrap.cc:654] T c4354f7ffc0e4eabbc92a141d46b7984 P 7e9c4f2e01164f33b2e9034ed148398e: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:30.299292 1785 raft_consensus.cc:357] T 6cc384f27ff041c0be70bb661ae610dd P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:30.299983 1785 raft_consensus.cc:383] T 6cc384f27ff041c0be70bb661ae610dd P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:30.300334 1785 raft_consensus.cc:738] T 6cc384f27ff041c0be70bb661ae610dd P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Initialized, Role: FOLLOWER
I20250625 03:30:30.296175 1786 consensus_queue.cc:260] T 40b74a261fdd495f84ceb0690f0b30ba P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:30.301205 1785 consensus_queue.cc:260] T 6cc384f27ff041c0be70bb661ae610dd P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:30.304991 1785 ts_tablet_manager.cc:1428] T 6cc384f27ff041c0be70bb661ae610dd P 3f2aa40978064c9e9983cf3745eed206: Time spent starting tablet: real 0.008s user 0.003s sys 0.004s
I20250625 03:30:30.305919 1785 tablet_bootstrap.cc:492] T d9038fc1ce0d4b528c02c68012e1277d P 3f2aa40978064c9e9983cf3745eed206: Bootstrap starting.
I20250625 03:30:30.306176 1786 ts_tablet_manager.cc:1428] T 40b74a261fdd495f84ceb0690f0b30ba P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent starting tablet: real 0.034s user 0.005s sys 0.000s
I20250625 03:30:30.307578 1786 tablet_bootstrap.cc:492] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1: Bootstrap starting.
I20250625 03:30:30.313544 1786 tablet_bootstrap.cc:654] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:30.315042 1799 raft_consensus.cc:491] T fb6e83db706647e28e491a02f1641980 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:30.315560 1799 raft_consensus.cc:513] T fb6e83db706647e28e491a02f1641980 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:30.318895 1799 leader_election.cc:290] T fb6e83db706647e28e491a02f1641980 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:30.318989 1745 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fb6e83db706647e28e491a02f1641980" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:30.319370 1595 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fb6e83db706647e28e491a02f1641980" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:30.320232 1595 raft_consensus.cc:2391] T fb6e83db706647e28e491a02f1641980 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f2aa40978064c9e9983cf3745eed206 in current term 1: Already voted for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in this term.
I20250625 03:30:30.321636 1635 leader_election.cc:304] T fb6e83db706647e28e491a02f1641980 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206; no voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:30.322839 1799 raft_consensus.cc:3058] T fb6e83db706647e28e491a02f1641980 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:30.325338 1785 tablet_bootstrap.cc:654] T d9038fc1ce0d4b528c02c68012e1277d P 3f2aa40978064c9e9983cf3745eed206: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:30.330147 1799 raft_consensus.cc:2747] T fb6e83db706647e28e491a02f1641980 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:30:30.330411 1785 tablet_bootstrap.cc:492] T d9038fc1ce0d4b528c02c68012e1277d P 3f2aa40978064c9e9983cf3745eed206: No bootstrap required, opened a new log
I20250625 03:30:30.330948 1785 ts_tablet_manager.cc:1397] T d9038fc1ce0d4b528c02c68012e1277d P 3f2aa40978064c9e9983cf3745eed206: Time spent bootstrapping tablet: real 0.025s user 0.010s sys 0.001s
I20250625 03:30:30.333271 1787 tablet_bootstrap.cc:492] T c4354f7ffc0e4eabbc92a141d46b7984 P 7e9c4f2e01164f33b2e9034ed148398e: No bootstrap required, opened a new log
I20250625 03:30:30.333662 1787 ts_tablet_manager.cc:1397] T c4354f7ffc0e4eabbc92a141d46b7984 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent bootstrapping tablet: real 0.060s user 0.011s sys 0.005s
I20250625 03:30:30.334481 1786 tablet_bootstrap.cc:492] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1: No bootstrap required, opened a new log
I20250625 03:30:30.334101 1785 raft_consensus.cc:357] T d9038fc1ce0d4b528c02c68012e1277d P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:30.334836 1785 raft_consensus.cc:383] T d9038fc1ce0d4b528c02c68012e1277d P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:30.334919 1786 ts_tablet_manager.cc:1397] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent bootstrapping tablet: real 0.028s user 0.010s sys 0.000s
I20250625 03:30:30.335151 1785 raft_consensus.cc:738] T d9038fc1ce0d4b528c02c68012e1277d P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Initialized, Role: FOLLOWER
I20250625 03:30:30.335619 1787 raft_consensus.cc:357] T c4354f7ffc0e4eabbc92a141d46b7984 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:30.336218 1787 raft_consensus.cc:383] T c4354f7ffc0e4eabbc92a141d46b7984 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:30.335834 1785 consensus_queue.cc:260] T d9038fc1ce0d4b528c02c68012e1277d P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:30.336453 1787 raft_consensus.cc:738] T c4354f7ffc0e4eabbc92a141d46b7984 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Initialized, Role: FOLLOWER
I20250625 03:30:30.337136 1787 consensus_queue.cc:260] T c4354f7ffc0e4eabbc92a141d46b7984 P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:30.337972 1785 ts_tablet_manager.cc:1428] T d9038fc1ce0d4b528c02c68012e1277d P 3f2aa40978064c9e9983cf3745eed206: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20250625 03:30:30.339004 1785 tablet_bootstrap.cc:492] T d50c52b197294003b238a37da2fb55d8 P 3f2aa40978064c9e9983cf3745eed206: Bootstrap starting.
I20250625 03:30:30.340392 1787 ts_tablet_manager.cc:1428] T c4354f7ffc0e4eabbc92a141d46b7984 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20250625 03:30:30.341289 1787 tablet_bootstrap.cc:492] T afe48b30a4e64a4d8faf2a5b42d5c706 P 7e9c4f2e01164f33b2e9034ed148398e: Bootstrap starting.
I20250625 03:30:30.344763 1785 tablet_bootstrap.cc:654] T d50c52b197294003b238a37da2fb55d8 P 3f2aa40978064c9e9983cf3745eed206: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:30.347383 1813 consensus_queue.cc:1035] T 6e7283d035e1429f946d8ebb98978656 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:30:30.348122 1787 tablet_bootstrap.cc:654] T afe48b30a4e64a4d8faf2a5b42d5c706 P 7e9c4f2e01164f33b2e9034ed148398e: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:30.348176 1843 raft_consensus.cc:491] T 615cebbffcfc44e19b8f7a1e842073a3 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:30.354055 1843 raft_consensus.cc:513] T 615cebbffcfc44e19b8f7a1e842073a3 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:30.356102 1843 leader_election.cc:290] T 615cebbffcfc44e19b8f7a1e842073a3 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:30.357687 1745 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "615cebbffcfc44e19b8f7a1e842073a3" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
W20250625 03:30:30.358987 1636 leader_election.cc:343] T 615cebbffcfc44e19b8f7a1e842073a3 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:30.359925 1593 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "615cebbffcfc44e19b8f7a1e842073a3" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
W20250625 03:30:30.361138 1635 leader_election.cc:343] T 615cebbffcfc44e19b8f7a1e842073a3 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:30.361182 1786 raft_consensus.cc:357] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:30.361639 1635 leader_election.cc:304] T 615cebbffcfc44e19b8f7a1e842073a3 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206; no voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:30.362226 1786 raft_consensus.cc:383] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:30.362651 1786 raft_consensus.cc:738] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Initialized, Role: FOLLOWER
I20250625 03:30:30.363157 1843 raft_consensus.cc:2747] T 615cebbffcfc44e19b8f7a1e842073a3 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:30:30.363590 1786 consensus_queue.cc:260] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:30.375922 1786 ts_tablet_manager.cc:1428] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent starting tablet: real 0.041s user 0.006s sys 0.000s
I20250625 03:30:30.377048 1786 tablet_bootstrap.cc:492] T f9458dec7953448d8550396d67fad249 P ba464e89e0f044a0a0ea3e6125cbf2a1: Bootstrap starting.
W20250625 03:30:30.377084 1636 consensus_peers.cc:487] T 6e7283d035e1429f946d8ebb98978656 P 3f2aa40978064c9e9983cf3745eed206 -> Peer ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): Couldn't send request to peer ba464e89e0f044a0a0ea3e6125cbf2a1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:30:30.381657 1785 tablet_bootstrap.cc:492] T d50c52b197294003b238a37da2fb55d8 P 3f2aa40978064c9e9983cf3745eed206: No bootstrap required, opened a new log
I20250625 03:30:30.382170 1785 ts_tablet_manager.cc:1397] T d50c52b197294003b238a37da2fb55d8 P 3f2aa40978064c9e9983cf3745eed206: Time spent bootstrapping tablet: real 0.043s user 0.008s sys 0.029s
I20250625 03:30:30.385046 1789 raft_consensus.cc:491] T d9038fc1ce0d4b528c02c68012e1277d P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:30.385257 1785 raft_consensus.cc:357] T d50c52b197294003b238a37da2fb55d8 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:30.385569 1789 raft_consensus.cc:513] T d9038fc1ce0d4b528c02c68012e1277d P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:30.386052 1785 raft_consensus.cc:383] T d50c52b197294003b238a37da2fb55d8 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:30.386400 1785 raft_consensus.cc:738] T d50c52b197294003b238a37da2fb55d8 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Initialized, Role: FOLLOWER
I20250625 03:30:30.391299 1745 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d9038fc1ce0d4b528c02c68012e1277d" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:30.392239 1745 raft_consensus.cc:2466] T d9038fc1ce0d4b528c02c68012e1277d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 0.
I20250625 03:30:30.400466 1671 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d9038fc1ce0d4b528c02c68012e1277d" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:30.401234 1671 raft_consensus.cc:2466] T d9038fc1ce0d4b528c02c68012e1277d P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 0.
I20250625 03:30:30.402245 1561 leader_election.cc:304] T d9038fc1ce0d4b528c02c68012e1277d P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters:
I20250625 03:30:30.404310 1844 raft_consensus.cc:2802] T d9038fc1ce0d4b528c02c68012e1277d P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:30:30.404873 1844 raft_consensus.cc:491] T d9038fc1ce0d4b528c02c68012e1277d P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:30:30.405323 1844 raft_consensus.cc:3058] T d9038fc1ce0d4b528c02c68012e1277d P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:30.387741 1789 leader_election.cc:290] T d9038fc1ce0d4b528c02c68012e1277d P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:30.416199 1841 consensus_queue.cc:1035] T b15eb94b9d3d4f6987b5fa5e20193655 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:30:30.418843 1789 raft_consensus.cc:491] T c4354f7ffc0e4eabbc92a141d46b7984 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:30.419548 1789 raft_consensus.cc:513] T c4354f7ffc0e4eabbc92a141d46b7984 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:30.423491 1745 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c4354f7ffc0e4eabbc92a141d46b7984" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:30.427676 1841 consensus_queue.cc:1035] T b15eb94b9d3d4f6987b5fa5e20193655 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:30:30.429930 1789 leader_election.cc:290] T c4354f7ffc0e4eabbc92a141d46b7984 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:30.448876 1745 raft_consensus.cc:3058] T 40b74a261fdd495f84ceb0690f0b30ba P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:30.456399 1844 raft_consensus.cc:513] T d9038fc1ce0d4b528c02c68012e1277d P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:30.458506 1844 leader_election.cc:290] T d9038fc1ce0d4b528c02c68012e1277d P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 election: Requested vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:30.459460 1799 consensus_queue.cc:1035] T 9643cfd400804eb8b9037c5e9efddfba P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:30:30.475240 1743 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d9038fc1ce0d4b528c02c68012e1277d" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:30:30.476426 1743 raft_consensus.cc:3058] T d9038fc1ce0d4b528c02c68012e1277d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:30.476874 1787 tablet_bootstrap.cc:492] T afe48b30a4e64a4d8faf2a5b42d5c706 P 7e9c4f2e01164f33b2e9034ed148398e: No bootstrap required, opened a new log
I20250625 03:30:30.477485 1787 ts_tablet_manager.cc:1397] T afe48b30a4e64a4d8faf2a5b42d5c706 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent bootstrapping tablet: real 0.136s user 0.020s sys 0.003s
I20250625 03:30:30.479000 1786 tablet_bootstrap.cc:654] T f9458dec7953448d8550396d67fad249 P ba464e89e0f044a0a0ea3e6125cbf2a1: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:30.480849 1787 raft_consensus.cc:357] T afe48b30a4e64a4d8faf2a5b42d5c706 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:30.481765 1787 raft_consensus.cc:383] T afe48b30a4e64a4d8faf2a5b42d5c706 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:30.482103 1787 raft_consensus.cc:738] T afe48b30a4e64a4d8faf2a5b42d5c706 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Initialized, Role: FOLLOWER
I20250625 03:30:30.482739 1787 consensus_queue.cc:260] T afe48b30a4e64a4d8faf2a5b42d5c706 P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:30.483901 1789 consensus_queue.cc:1035] T 40b74a261fdd495f84ceb0690f0b30ba P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:30:30.485486 1787 ts_tablet_manager.cc:1428] T afe48b30a4e64a4d8faf2a5b42d5c706 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s
I20250625 03:30:30.474658 1785 consensus_queue.cc:260] T d50c52b197294003b238a37da2fb55d8 P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:30.488432 1785 ts_tablet_manager.cc:1428] T d50c52b197294003b238a37da2fb55d8 P 3f2aa40978064c9e9983cf3745eed206: Time spent starting tablet: real 0.106s user 0.043s sys 0.047s
I20250625 03:30:30.493757 1667 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c4354f7ffc0e4eabbc92a141d46b7984" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:30.494032 1785 tablet_bootstrap.cc:492] T f9458dec7953448d8550396d67fad249 P 3f2aa40978064c9e9983cf3745eed206: Bootstrap starting.
I20250625 03:30:30.495434 1559 leader_election.cc:304] T c4354f7ffc0e4eabbc92a141d46b7984 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e; no voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:30.500519 1743 raft_consensus.cc:2466] T d9038fc1ce0d4b528c02c68012e1277d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 1.
I20250625 03:30:30.501873 1785 tablet_bootstrap.cc:654] T f9458dec7953448d8550396d67fad249 P 3f2aa40978064c9e9983cf3745eed206: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:30.502005 1561 leader_election.cc:304] T d9038fc1ce0d4b528c02c68012e1277d P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters:
I20250625 03:30:30.502926 1844 raft_consensus.cc:2747] T c4354f7ffc0e4eabbc92a141d46b7984 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:30:30.503551 1789 raft_consensus.cc:491] T afe48b30a4e64a4d8faf2a5b42d5c706 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:30.504066 1789 raft_consensus.cc:513] T afe48b30a4e64a4d8faf2a5b42d5c706 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:30.507730 1878 raft_consensus.cc:2802] T d9038fc1ce0d4b528c02c68012e1277d P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:30:30.513260 1671 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "afe48b30a4e64a4d8faf2a5b42d5c706" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:30.514396 1671 raft_consensus.cc:2391] T afe48b30a4e64a4d8faf2a5b42d5c706 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e9c4f2e01164f33b2e9034ed148398e in current term 1: Already voted for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in this term.
I20250625 03:30:30.515951 1789 leader_election.cc:290] T afe48b30a4e64a4d8faf2a5b42d5c706 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:30.519985 1745 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "afe48b30a4e64a4d8faf2a5b42d5c706" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:30.524627 1785 tablet_bootstrap.cc:492] T f9458dec7953448d8550396d67fad249 P 3f2aa40978064c9e9983cf3745eed206: No bootstrap required, opened a new log
I20250625 03:30:30.490465 1799 raft_consensus.cc:491] T 6cc384f27ff041c0be70bb661ae610dd P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:30.525200 1785 ts_tablet_manager.cc:1397] T f9458dec7953448d8550396d67fad249 P 3f2aa40978064c9e9983cf3745eed206: Time spent bootstrapping tablet: real 0.031s user 0.018s sys 0.011s
W20250625 03:30:30.489737 1542 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20250625 03:30:30.525511 1799 raft_consensus.cc:513] T 6cc384f27ff041c0be70bb661ae610dd P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:30.527688 1799 leader_election.cc:290] T 6cc384f27ff041c0be70bb661ae610dd P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:30.493103 1787 tablet_bootstrap.cc:492] T d50c52b197294003b238a37da2fb55d8 P 7e9c4f2e01164f33b2e9034ed148398e: Bootstrap starting.
I20250625 03:30:30.528824 1785 raft_consensus.cc:357] T f9458dec7953448d8550396d67fad249 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:30.530607 1785 raft_consensus.cc:383] T f9458dec7953448d8550396d67fad249 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:30.530700 1878 raft_consensus.cc:695] T d9038fc1ce0d4b528c02c68012e1277d P 7e9c4f2e01164f33b2e9034ed148398e [term 1 LEADER]: Becoming Leader. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Running, Role: LEADER
I20250625 03:30:30.530973 1785 raft_consensus.cc:738] T f9458dec7953448d8550396d67fad249 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Initialized, Role: FOLLOWER
I20250625 03:30:30.531536 1785 consensus_queue.cc:260] T f9458dec7953448d8550396d67fad249 P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:30.492895 1670 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d9038fc1ce0d4b528c02c68012e1277d" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:30:30.531719 1878 consensus_queue.cc:237] T d9038fc1ce0d4b528c02c68012e1277d P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:30.532693 1670 raft_consensus.cc:3058] T d9038fc1ce0d4b528c02c68012e1277d P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:30.533505 1786 tablet_bootstrap.cc:492] T f9458dec7953448d8550396d67fad249 P ba464e89e0f044a0a0ea3e6125cbf2a1: No bootstrap required, opened a new log
I20250625 03:30:30.533989 1786 ts_tablet_manager.cc:1397] T f9458dec7953448d8550396d67fad249 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent bootstrapping tablet: real 0.157s user 0.006s sys 0.005s
I20250625 03:30:30.536563 1789 consensus_queue.cc:1035] T 40b74a261fdd495f84ceb0690f0b30ba P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:30:30.539610 1785 ts_tablet_manager.cc:1428] T f9458dec7953448d8550396d67fad249 P 3f2aa40978064c9e9983cf3745eed206: Time spent starting tablet: real 0.014s user 0.005s sys 0.000s
I20250625 03:30:30.540621 1785 tablet_bootstrap.cc:492] T dea2dcc26f144802a16f0884fdd99063 P 3f2aa40978064c9e9983cf3745eed206: Bootstrap starting.
I20250625 03:30:30.524418 1561 leader_election.cc:304] T afe48b30a4e64a4d8faf2a5b42d5c706 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e; no voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:30.541734 1742 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6cc384f27ff041c0be70bb661ae610dd" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:30.536536 1786 raft_consensus.cc:357] T f9458dec7953448d8550396d67fad249 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:30.543824 1786 raft_consensus.cc:383] T f9458dec7953448d8550396d67fad249 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:30.544306 1786 raft_consensus.cc:738] T f9458dec7953448d8550396d67fad249 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Initialized, Role: FOLLOWER
I20250625 03:30:30.544100 1742 raft_consensus.cc:2466] T 6cc384f27ff041c0be70bb661ae610dd P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 0.
I20250625 03:30:30.547070 1789 raft_consensus.cc:3058] T afe48b30a4e64a4d8faf2a5b42d5c706 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:30.548617 1593 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6cc384f27ff041c0be70bb661ae610dd" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:30.549423 1636 leader_election.cc:304] T 6cc384f27ff041c0be70bb661ae610dd P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters:
W20250625 03:30:30.549971 1635 leader_election.cc:343] T 6cc384f27ff041c0be70bb661ae610dd P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:30.550535 1842 raft_consensus.cc:2802] T 6cc384f27ff041c0be70bb661ae610dd P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:30:30.550984 1842 raft_consensus.cc:491] T 6cc384f27ff041c0be70bb661ae610dd P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:30:30.551429 1842 raft_consensus.cc:3058] T 6cc384f27ff041c0be70bb661ae610dd P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:30.556272 1789 raft_consensus.cc:2747] T afe48b30a4e64a4d8faf2a5b42d5c706 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:30:30.557814 1843 consensus_queue.cc:1035] T 9643cfd400804eb8b9037c5e9efddfba P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:30:30.565333 1842 raft_consensus.cc:513] T 6cc384f27ff041c0be70bb661ae610dd P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:30.570385 1786 consensus_queue.cc:260] T f9458dec7953448d8550396d67fad249 P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:30.571194 1593 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6cc384f27ff041c0be70bb661ae610dd" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
W20250625 03:30:30.572528 1635 leader_election.cc:343] T 6cc384f27ff041c0be70bb661ae610dd P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:30.572678 1786 ts_tablet_manager.cc:1428] T f9458dec7953448d8550396d67fad249 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent starting tablet: real 0.038s user 0.010s sys 0.013s
I20250625 03:30:30.573321 1848 consensus_queue.cc:1035] T fb6e83db706647e28e491a02f1641980 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:30:30.573688 1786 tablet_bootstrap.cc:492] T 0c2b6052daaa4c57aaa55361e8d6e01c P ba464e89e0f044a0a0ea3e6125cbf2a1: Bootstrap starting.
I20250625 03:30:30.576642 1785 tablet_bootstrap.cc:654] T dea2dcc26f144802a16f0884fdd99063 P 3f2aa40978064c9e9983cf3745eed206: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:30.578953 1742 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6cc384f27ff041c0be70bb661ae610dd" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:30:30.579556 1742 raft_consensus.cc:3058] T 6cc384f27ff041c0be70bb661ae610dd P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:30.579830 1786 tablet_bootstrap.cc:654] T 0c2b6052daaa4c57aaa55361e8d6e01c P ba464e89e0f044a0a0ea3e6125cbf2a1: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:30.574394 1670 raft_consensus.cc:2466] T d9038fc1ce0d4b528c02c68012e1277d P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 1.
I20250625 03:30:30.584762 1787 tablet_bootstrap.cc:654] T d50c52b197294003b238a37da2fb55d8 P 7e9c4f2e01164f33b2e9034ed148398e: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:30.587240 1742 raft_consensus.cc:2466] T 6cc384f27ff041c0be70bb661ae610dd P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 1.
I20250625 03:30:30.592980 1842 leader_election.cc:290] T 6cc384f27ff041c0be70bb661ae610dd P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:30.595062 1786 tablet_bootstrap.cc:492] T 0c2b6052daaa4c57aaa55361e8d6e01c P ba464e89e0f044a0a0ea3e6125cbf2a1: No bootstrap required, opened a new log
I20250625 03:30:30.594700 1636 leader_election.cc:304] T 6cc384f27ff041c0be70bb661ae610dd P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:30.595520 1786 ts_tablet_manager.cc:1397] T 0c2b6052daaa4c57aaa55361e8d6e01c P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent bootstrapping tablet: real 0.022s user 0.008s sys 0.009s
I20250625 03:30:30.596976 1842 raft_consensus.cc:2802] T 6cc384f27ff041c0be70bb661ae610dd P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:30:30.597990 1842 raft_consensus.cc:695] T 6cc384f27ff041c0be70bb661ae610dd P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Becoming Leader. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Running, Role: LEADER
I20250625 03:30:30.599100 1842 consensus_queue.cc:237] T 6cc384f27ff041c0be70bb661ae610dd P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:30.599334 1786 raft_consensus.cc:357] T 0c2b6052daaa4c57aaa55361e8d6e01c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:30.603456 1786 raft_consensus.cc:383] T 0c2b6052daaa4c57aaa55361e8d6e01c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:30.603766 1786 raft_consensus.cc:738] T 0c2b6052daaa4c57aaa55361e8d6e01c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Initialized, Role: FOLLOWER
I20250625 03:30:30.604966 1786 consensus_queue.cc:260] T 0c2b6052daaa4c57aaa55361e8d6e01c P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:30.607517 1786 ts_tablet_manager.cc:1428] T 0c2b6052daaa4c57aaa55361e8d6e01c P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent starting tablet: real 0.012s user 0.009s sys 0.000s
I20250625 03:30:30.608578 1786 tablet_bootstrap.cc:492] T 465c15a46933411a985f29059fdb1c9f P ba464e89e0f044a0a0ea3e6125cbf2a1: Bootstrap starting.
I20250625 03:30:30.615469 1786 tablet_bootstrap.cc:654] T 465c15a46933411a985f29059fdb1c9f P ba464e89e0f044a0a0ea3e6125cbf2a1: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:30.620185 1812 raft_consensus.cc:491] T 0c2b6052daaa4c57aaa55361e8d6e01c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:30.620764 1812 raft_consensus.cc:513] T 0c2b6052daaa4c57aaa55361e8d6e01c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:30.624408 1812 leader_election.cc:290] T 0c2b6052daaa4c57aaa55361e8d6e01c P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:30.624190 1670 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0c2b6052daaa4c57aaa55361e8d6e01c" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:30.626096 1594 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0c2b6052daaa4c57aaa55361e8d6e01c" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
W20250625 03:30:30.626536 1708 leader_election.cc:343] T 0c2b6052daaa4c57aaa55361e8d6e01c P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Illegal state: must be running to vote when last-logged opid is not known
W20250625 03:30:30.627563 1709 leader_election.cc:343] T 0c2b6052daaa4c57aaa55361e8d6e01c P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:30.628086 1709 leader_election.cc:304] T 0c2b6052daaa4c57aaa55361e8d6e01c P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:30.629168 1787 tablet_bootstrap.cc:492] T d50c52b197294003b238a37da2fb55d8 P 7e9c4f2e01164f33b2e9034ed148398e: No bootstrap required, opened a new log
I20250625 03:30:30.629628 1787 ts_tablet_manager.cc:1397] T d50c52b197294003b238a37da2fb55d8 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent bootstrapping tablet: real 0.137s user 0.014s sys 0.011s
I20250625 03:30:30.630831 1848 consensus_queue.cc:1035] T fb6e83db706647e28e491a02f1641980 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:30:30.629724 1812 raft_consensus.cc:2747] T 0c2b6052daaa4c57aaa55361e8d6e01c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:30:30.642023 1594 raft_consensus.cc:3058] T c4354f7ffc0e4eabbc92a141d46b7984 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:30.644554 1878 raft_consensus.cc:491] T 1fff19a38e8d4880a14da6b4c8284cc2 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:30.645298 1878 raft_consensus.cc:513] T 1fff19a38e8d4880a14da6b4c8284cc2 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } }
I20250625 03:30:30.649387 1742 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1fff19a38e8d4880a14da6b4c8284cc2" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:30.654975 1787 raft_consensus.cc:357] T d50c52b197294003b238a37da2fb55d8 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:30.647796 1494 catalog_manager.cc:5582] T d9038fc1ce0d4b528c02c68012e1277d P 7e9c4f2e01164f33b2e9034ed148398e reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129). New cstate: current_term: 1 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } }
I20250625 03:30:30.664271 1787 raft_consensus.cc:383] T d50c52b197294003b238a37da2fb55d8 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:30.664832 1787 raft_consensus.cc:738] T d50c52b197294003b238a37da2fb55d8 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Initialized, Role: FOLLOWER
I20250625 03:30:30.667356 1878 leader_election.cc:290] T 1fff19a38e8d4880a14da6b4c8284cc2 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:30.671696 1667 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1fff19a38e8d4880a14da6b4c8284cc2" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:30.669397 1843 raft_consensus.cc:491] T f9458dec7953448d8550396d67fad249 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:30.673063 1843 raft_consensus.cc:513] T f9458dec7953448d8550396d67fad249 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:30.674556 1559 leader_election.cc:304] T 1fff19a38e8d4880a14da6b4c8284cc2 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e; no voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:30.678946 1789 raft_consensus.cc:2747] T 1fff19a38e8d4880a14da6b4c8284cc2 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:30:30.679448 1742 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f9458dec7953448d8550396d67fad249" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:30.675917 1843 leader_election.cc:290] T f9458dec7953448d8550396d67fad249 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:30.680124 1742 raft_consensus.cc:2466] T f9458dec7953448d8550396d67fad249 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 0.
I20250625 03:30:30.681192 1596 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f9458dec7953448d8550396d67fad249" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:30.670085 1787 consensus_queue.cc:260] T d50c52b197294003b238a37da2fb55d8 P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
W20250625 03:30:30.683211 1635 leader_election.cc:343] T f9458dec7953448d8550396d67fad249 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:30.691992 1848 consensus_queue.cc:1035] T afe48b30a4e64a4d8faf2a5b42d5c706 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:30:30.695348 1786 tablet_bootstrap.cc:492] T 465c15a46933411a985f29059fdb1c9f P ba464e89e0f044a0a0ea3e6125cbf2a1: No bootstrap required, opened a new log
I20250625 03:30:30.692200 1636 leader_election.cc:304] T f9458dec7953448d8550396d67fad249 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:30.695849 1786 ts_tablet_manager.cc:1397] T 465c15a46933411a985f29059fdb1c9f P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent bootstrapping tablet: real 0.088s user 0.036s sys 0.019s
I20250625 03:30:30.699571 1596 raft_consensus.cc:3058] T 1fff19a38e8d4880a14da6b4c8284cc2 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:30.697271 1812 consensus_queue.cc:1035] T afe48b30a4e64a4d8faf2a5b42d5c706 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20250625 03:30:30.707021 1787 ts_tablet_manager.cc:1428] T d50c52b197294003b238a37da2fb55d8 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent starting tablet: real 0.077s user 0.006s sys 0.004s
I20250625 03:30:30.708135 1787 tablet_bootstrap.cc:492] T 542f85d76df8432593ee963669155a9d P 7e9c4f2e01164f33b2e9034ed148398e: Bootstrap starting.
I20250625 03:30:30.696811 1842 raft_consensus.cc:2802] T f9458dec7953448d8550396d67fad249 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:30:30.711530 1842 raft_consensus.cc:491] T f9458dec7953448d8550396d67fad249 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:30:30.726173 1785 tablet_bootstrap.cc:492] T dea2dcc26f144802a16f0884fdd99063 P 3f2aa40978064c9e9983cf3745eed206: No bootstrap required, opened a new log
I20250625 03:30:30.726624 1785 ts_tablet_manager.cc:1397] T dea2dcc26f144802a16f0884fdd99063 P 3f2aa40978064c9e9983cf3745eed206: Time spent bootstrapping tablet: real 0.186s user 0.013s sys 0.006s
I20250625 03:30:30.720558 1842 raft_consensus.cc:3058] T f9458dec7953448d8550396d67fad249 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:30.732822 1787 tablet_bootstrap.cc:654] T 542f85d76df8432593ee963669155a9d P 7e9c4f2e01164f33b2e9034ed148398e: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:30.765120 1493 catalog_manager.cc:5582] T 6cc384f27ff041c0be70bb661ae610dd P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } }
I20250625 03:30:30.769857 1786 raft_consensus.cc:357] T 465c15a46933411a985f29059fdb1c9f P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:30.771412 1786 raft_consensus.cc:383] T 465c15a46933411a985f29059fdb1c9f P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:30.771793 1786 raft_consensus.cc:738] T 465c15a46933411a985f29059fdb1c9f P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Initialized, Role: FOLLOWER
I20250625 03:30:30.772665 1786 consensus_queue.cc:260] T 465c15a46933411a985f29059fdb1c9f P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:30.775038 1786 ts_tablet_manager.cc:1428] T 465c15a46933411a985f29059fdb1c9f P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent starting tablet: real 0.079s user 0.009s sys 0.001s
I20250625 03:30:30.776142 1785 raft_consensus.cc:357] T dea2dcc26f144802a16f0884fdd99063 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:30.776656 1785 raft_consensus.cc:383] T dea2dcc26f144802a16f0884fdd99063 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:30.776814 1785 raft_consensus.cc:738] T dea2dcc26f144802a16f0884fdd99063 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Initialized, Role: FOLLOWER
I20250625 03:30:30.777288 1785 consensus_queue.cc:260] T dea2dcc26f144802a16f0884fdd99063 P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:30.776032 1786 tablet_bootstrap.cc:492] T 542f85d76df8432593ee963669155a9d P ba464e89e0f044a0a0ea3e6125cbf2a1: Bootstrap starting.
I20250625 03:30:30.779068 1848 consensus_queue.cc:1035] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:30:30.780594 1848 consensus_queue.cc:1035] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:30:30.787220 1785 ts_tablet_manager.cc:1428] T dea2dcc26f144802a16f0884fdd99063 P 3f2aa40978064c9e9983cf3745eed206: Time spent starting tablet: real 0.060s user 0.009s sys 0.008s
I20250625 03:30:30.790956 1842 raft_consensus.cc:513] T f9458dec7953448d8550396d67fad249 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:30.793978 1595 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f9458dec7953448d8550396d67fad249" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
I20250625 03:30:30.797490 1785 tablet_bootstrap.cc:492] T 542f85d76df8432593ee963669155a9d P 3f2aa40978064c9e9983cf3745eed206: Bootstrap starting.
I20250625 03:30:30.807212 1848 raft_consensus.cc:491] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20250625 03:30:30.812204 1635 leader_election.cc:343] T f9458dec7953448d8550396d67fad249 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:30.818897 1742 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f9458dec7953448d8550396d67fad249" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:30:30.819429 1742 raft_consensus.cc:3058] T f9458dec7953448d8550396d67fad249 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:30.815223 1848 raft_consensus.cc:513] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:30.825611 1848 leader_election.cc:290] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:30.826140 1813 raft_consensus.cc:491] T d50c52b197294003b238a37da2fb55d8 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:30.826627 1813 raft_consensus.cc:513] T d50c52b197294003b238a37da2fb55d8 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:30.827999 1742 raft_consensus.cc:2466] T f9458dec7953448d8550396d67fad249 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 1.
I20250625 03:30:30.828244 1592 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dea2dcc26f144802a16f0884fdd99063" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:30.816120 1842 leader_election.cc:290] T f9458dec7953448d8550396d67fad249 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:30.830451 1813 leader_election.cc:290] T d50c52b197294003b238a37da2fb55d8 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:30.831224 1636 leader_election.cc:304] T f9458dec7953448d8550396d67fad249 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:30.832914 1592 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d50c52b197294003b238a37da2fb55d8" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:30.834733 1671 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dea2dcc26f144802a16f0884fdd99063" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:30.837143 1787 tablet_bootstrap.cc:492] T 542f85d76df8432593ee963669155a9d P 7e9c4f2e01164f33b2e9034ed148398e: No bootstrap required, opened a new log
I20250625 03:30:30.837596 1787 ts_tablet_manager.cc:1397] T 542f85d76df8432593ee963669155a9d P 7e9c4f2e01164f33b2e9034ed148398e: Time spent bootstrapping tablet: real 0.130s user 0.025s sys 0.000s
I20250625 03:30:30.837877 1671 raft_consensus.cc:2466] T dea2dcc26f144802a16f0884fdd99063 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 0.
W20250625 03:30:30.838269 1709 leader_election.cc:343] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:30.841300 1708 leader_election.cc:304] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:30.840176 1592 raft_consensus.cc:2466] T d50c52b197294003b238a37da2fb55d8 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 0.
I20250625 03:30:30.839396 1813 raft_consensus.cc:2802] T f9458dec7953448d8550396d67fad249 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:30:30.842823 1797 raft_consensus.cc:2802] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:30:30.843307 1797 raft_consensus.cc:491] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:30:30.843900 1797 raft_consensus.cc:3058] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:30.842803 1813 raft_consensus.cc:695] T f9458dec7953448d8550396d67fad249 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Becoming Leader. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Running, Role: LEADER
I20250625 03:30:30.861205 1785 tablet_bootstrap.cc:654] T 542f85d76df8432593ee963669155a9d P 3f2aa40978064c9e9983cf3745eed206: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:30.861037 1813 consensus_queue.cc:237] T f9458dec7953448d8550396d67fad249 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:30.843263 1635 leader_election.cc:304] T d50c52b197294003b238a37da2fb55d8 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e; no voters:
I20250625 03:30:30.858875 1786 tablet_bootstrap.cc:654] T 542f85d76df8432593ee963669155a9d P ba464e89e0f044a0a0ea3e6125cbf2a1: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:30.859619 1787 raft_consensus.cc:357] T 542f85d76df8432593ee963669155a9d P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:30.863456 1842 raft_consensus.cc:2802] T d50c52b197294003b238a37da2fb55d8 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:30:30.878810 1842 raft_consensus.cc:491] T d50c52b197294003b238a37da2fb55d8 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:30:30.879335 1842 raft_consensus.cc:3058] T d50c52b197294003b238a37da2fb55d8 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:30.880268 1742 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d50c52b197294003b238a37da2fb55d8" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
W20250625 03:30:30.884608 1636 leader_election.cc:343] T d50c52b197294003b238a37da2fb55d8 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:30.886515 1797 raft_consensus.cc:513] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:30.887600 1842 raft_consensus.cc:513] T d50c52b197294003b238a37da2fb55d8 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:30.890506 1787 raft_consensus.cc:383] T 542f85d76df8432593ee963669155a9d P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:30.890827 1787 raft_consensus.cc:738] T 542f85d76df8432593ee963669155a9d P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Initialized, Role: FOLLOWER
I20250625 03:30:30.891460 1593 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d50c52b197294003b238a37da2fb55d8" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
I20250625 03:30:30.892181 1593 raft_consensus.cc:3058] T d50c52b197294003b238a37da2fb55d8 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:30.892843 1785 tablet_bootstrap.cc:492] T 542f85d76df8432593ee963669155a9d P 3f2aa40978064c9e9983cf3745eed206: No bootstrap required, opened a new log
I20250625 03:30:30.893322 1785 ts_tablet_manager.cc:1397] T 542f85d76df8432593ee963669155a9d P 3f2aa40978064c9e9983cf3745eed206: Time spent bootstrapping tablet: real 0.096s user 0.009s sys 0.007s
I20250625 03:30:30.896682 1787 consensus_queue.cc:260] T 542f85d76df8432593ee963669155a9d P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:30.901544 1742 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d50c52b197294003b238a37da2fb55d8" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
W20250625 03:30:30.903017 1636 leader_election.cc:343] T d50c52b197294003b238a37da2fb55d8 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:30.903688 1842 leader_election.cc:290] T d50c52b197294003b238a37da2fb55d8 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:30.905920 1787 ts_tablet_manager.cc:1428] T 542f85d76df8432593ee963669155a9d P 7e9c4f2e01164f33b2e9034ed148398e: Time spent starting tablet: real 0.068s user 0.012s sys 0.000s
I20250625 03:30:30.908215 1787 tablet_bootstrap.cc:492] T f9458dec7953448d8550396d67fad249 P 7e9c4f2e01164f33b2e9034ed148398e: Bootstrap starting.
I20250625 03:30:30.911424 1670 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dea2dcc26f144802a16f0884fdd99063" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:30:30.912422 1670 raft_consensus.cc:3058] T dea2dcc26f144802a16f0884fdd99063 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:30.912883 1797 leader_election.cc:290] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:30.914065 1785 raft_consensus.cc:357] T 542f85d76df8432593ee963669155a9d P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:30.914958 1785 raft_consensus.cc:383] T 542f85d76df8432593ee963669155a9d P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:30.915215 1593 raft_consensus.cc:2466] T d50c52b197294003b238a37da2fb55d8 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 1.
I20250625 03:30:30.915390 1785 raft_consensus.cc:738] T 542f85d76df8432593ee963669155a9d P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Initialized, Role: FOLLOWER
I20250625 03:30:30.916328 1635 leader_election.cc:304] T d50c52b197294003b238a37da2fb55d8 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e; no voters: ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:30.918673 1785 consensus_queue.cc:260] T 542f85d76df8432593ee963669155a9d P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:30.921617 1786 tablet_bootstrap.cc:492] T 542f85d76df8432593ee963669155a9d P ba464e89e0f044a0a0ea3e6125cbf2a1: No bootstrap required, opened a new log
I20250625 03:30:30.922262 1786 ts_tablet_manager.cc:1397] T 542f85d76df8432593ee963669155a9d P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent bootstrapping tablet: real 0.146s user 0.013s sys 0.008s
I20250625 03:30:30.924870 1593 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dea2dcc26f144802a16f0884fdd99063" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
W20250625 03:30:30.926795 1709 leader_election.cc:343] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:30.927279 1493 catalog_manager.cc:5582] T f9458dec7953448d8550396d67fad249 P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } }
I20250625 03:30:30.934527 1786 raft_consensus.cc:357] T 542f85d76df8432593ee963669155a9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:30.935205 1786 raft_consensus.cc:383] T 542f85d76df8432593ee963669155a9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:30.931272 1670 raft_consensus.cc:2466] T dea2dcc26f144802a16f0884fdd99063 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 1.
I20250625 03:30:30.935485 1786 raft_consensus.cc:738] T 542f85d76df8432593ee963669155a9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Initialized, Role: FOLLOWER
I20250625 03:30:30.923432 1813 raft_consensus.cc:2802] T d50c52b197294003b238a37da2fb55d8 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:30:30.936257 1813 raft_consensus.cc:695] T d50c52b197294003b238a37da2fb55d8 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Becoming Leader. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Running, Role: LEADER
I20250625 03:30:30.936180 1786 consensus_queue.cc:260] T 542f85d76df8432593ee963669155a9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:30.937160 1813 consensus_queue.cc:237] T d50c52b197294003b238a37da2fb55d8 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:30.933297 1785 ts_tablet_manager.cc:1428] T 542f85d76df8432593ee963669155a9d P 3f2aa40978064c9e9983cf3745eed206: Time spent starting tablet: real 0.040s user 0.005s sys 0.002s
I20250625 03:30:30.938905 1785 tablet_bootstrap.cc:492] T af4573692c104d67994dbb1bc518b568 P 3f2aa40978064c9e9983cf3745eed206: Bootstrap starting.
I20250625 03:30:30.939311 1786 ts_tablet_manager.cc:1428] T 542f85d76df8432593ee963669155a9d P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent starting tablet: real 0.017s user 0.007s sys 0.000s
I20250625 03:30:30.941762 1708 leader_election.cc:304] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:30.942548 1797 raft_consensus.cc:2802] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:30:30.943248 1797 raft_consensus.cc:695] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Becoming Leader. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Running, Role: LEADER
I20250625 03:30:30.944402 1797 consensus_queue.cc:237] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:30.961256 1786 tablet_bootstrap.cc:492] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P ba464e89e0f044a0a0ea3e6125cbf2a1: Bootstrap starting.
I20250625 03:30:30.965507 1785 tablet_bootstrap.cc:654] T af4573692c104d67994dbb1bc518b568 P 3f2aa40978064c9e9983cf3745eed206: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:30.965660 1787 tablet_bootstrap.cc:654] T f9458dec7953448d8550396d67fad249 P 7e9c4f2e01164f33b2e9034ed148398e: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:30.973536 1786 tablet_bootstrap.cc:654] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P ba464e89e0f044a0a0ea3e6125cbf2a1: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:30.978551 1787 tablet_bootstrap.cc:492] T f9458dec7953448d8550396d67fad249 P 7e9c4f2e01164f33b2e9034ed148398e: No bootstrap required, opened a new log
I20250625 03:30:30.979043 1787 ts_tablet_manager.cc:1397] T f9458dec7953448d8550396d67fad249 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent bootstrapping tablet: real 0.071s user 0.007s sys 0.007s
I20250625 03:30:30.979382 1786 tablet_bootstrap.cc:492] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P ba464e89e0f044a0a0ea3e6125cbf2a1: No bootstrap required, opened a new log
I20250625 03:30:30.979946 1786 ts_tablet_manager.cc:1397] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent bootstrapping tablet: real 0.019s user 0.007s sys 0.003s
I20250625 03:30:30.979477 1491 catalog_manager.cc:5582] T d50c52b197294003b238a37da2fb55d8 P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } }
I20250625 03:30:30.982007 1787 raft_consensus.cc:357] T f9458dec7953448d8550396d67fad249 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:30.982349 1786 raft_consensus.cc:357] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:30.982699 1787 raft_consensus.cc:383] T f9458dec7953448d8550396d67fad249 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:30.982992 1786 raft_consensus.cc:383] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:30.983101 1787 raft_consensus.cc:738] T f9458dec7953448d8550396d67fad249 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Initialized, Role: FOLLOWER
I20250625 03:30:30.983294 1786 raft_consensus.cc:738] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Initialized, Role: FOLLOWER
I20250625 03:30:30.983969 1787 consensus_queue.cc:260] T f9458dec7953448d8550396d67fad249 P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:30.983963 1786 consensus_queue.cc:260] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:30.986857 1786 ts_tablet_manager.cc:1428] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20250625 03:30:30.989270 1787 ts_tablet_manager.cc:1428] T f9458dec7953448d8550396d67fad249 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent starting tablet: real 0.010s user 0.001s sys 0.007s
I20250625 03:30:30.990260 1787 tablet_bootstrap.cc:492] T 615cebbffcfc44e19b8f7a1e842073a3 P 7e9c4f2e01164f33b2e9034ed148398e: Bootstrap starting.
I20250625 03:30:30.994894 1493 catalog_manager.cc:5582] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: HEALTHY } } }
I20250625 03:30:30.999552 1786 tablet_bootstrap.cc:492] T 0e7eb287e9514c838aeed599d2703682 P ba464e89e0f044a0a0ea3e6125cbf2a1: Bootstrap starting.
I20250625 03:30:31.008457 1878 consensus_queue.cc:1035] T d9038fc1ce0d4b528c02c68012e1277d P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:30:31.009711 1787 tablet_bootstrap.cc:654] T 615cebbffcfc44e19b8f7a1e842073a3 P 7e9c4f2e01164f33b2e9034ed148398e: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:31.013860 1785 tablet_bootstrap.cc:492] T af4573692c104d67994dbb1bc518b568 P 3f2aa40978064c9e9983cf3745eed206: No bootstrap required, opened a new log
I20250625 03:30:31.014592 1785 ts_tablet_manager.cc:1397] T af4573692c104d67994dbb1bc518b568 P 3f2aa40978064c9e9983cf3745eed206: Time spent bootstrapping tablet: real 0.076s user 0.024s sys 0.026s
I20250625 03:30:31.018725 1878 consensus_queue.cc:1035] T d9038fc1ce0d4b528c02c68012e1277d P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:30:31.023310 1785 raft_consensus.cc:357] T af4573692c104d67994dbb1bc518b568 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:31.024444 1785 raft_consensus.cc:383] T af4573692c104d67994dbb1bc518b568 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:31.024662 1785 raft_consensus.cc:738] T af4573692c104d67994dbb1bc518b568 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Initialized, Role: FOLLOWER
I20250625 03:30:31.026855 1785 consensus_queue.cc:260] T af4573692c104d67994dbb1bc518b568 P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:31.028949 1785 ts_tablet_manager.cc:1428] T af4573692c104d67994dbb1bc518b568 P 3f2aa40978064c9e9983cf3745eed206: Time spent starting tablet: real 0.014s user 0.005s sys 0.001s
I20250625 03:30:31.030460 1785 tablet_bootstrap.cc:492] T 465c15a46933411a985f29059fdb1c9f P 3f2aa40978064c9e9983cf3745eed206: Bootstrap starting.
I20250625 03:30:31.025676 1786 tablet_bootstrap.cc:654] T 0e7eb287e9514c838aeed599d2703682 P ba464e89e0f044a0a0ea3e6125cbf2a1: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:31.048751 1787 tablet_bootstrap.cc:492] T 615cebbffcfc44e19b8f7a1e842073a3 P 7e9c4f2e01164f33b2e9034ed148398e: No bootstrap required, opened a new log
I20250625 03:30:31.049317 1787 ts_tablet_manager.cc:1397] T 615cebbffcfc44e19b8f7a1e842073a3 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent bootstrapping tablet: real 0.059s user 0.009s sys 0.006s
I20250625 03:30:31.052384 1843 consensus_queue.cc:1035] T 6cc384f27ff041c0be70bb661ae610dd P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:30:31.060536 1785 tablet_bootstrap.cc:654] T 465c15a46933411a985f29059fdb1c9f P 3f2aa40978064c9e9983cf3745eed206: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:31.090965 1786 tablet_bootstrap.cc:492] T 0e7eb287e9514c838aeed599d2703682 P ba464e89e0f044a0a0ea3e6125cbf2a1: No bootstrap required, opened a new log
I20250625 03:30:31.091499 1786 ts_tablet_manager.cc:1397] T 0e7eb287e9514c838aeed599d2703682 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent bootstrapping tablet: real 0.104s user 0.012s sys 0.009s
I20250625 03:30:31.063277 1787 raft_consensus.cc:357] T 615cebbffcfc44e19b8f7a1e842073a3 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:31.095774 1787 raft_consensus.cc:383] T 615cebbffcfc44e19b8f7a1e842073a3 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:31.096645 1787 raft_consensus.cc:738] T 615cebbffcfc44e19b8f7a1e842073a3 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Initialized, Role: FOLLOWER
I20250625 03:30:31.097491 1787 consensus_queue.cc:260] T 615cebbffcfc44e19b8f7a1e842073a3 P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:31.099761 1786 raft_consensus.cc:357] T 0e7eb287e9514c838aeed599d2703682 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:31.100399 1787 ts_tablet_manager.cc:1428] T 615cebbffcfc44e19b8f7a1e842073a3 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent starting tablet: real 0.051s user 0.006s sys 0.003s
I20250625 03:30:31.100541 1786 raft_consensus.cc:383] T 0e7eb287e9514c838aeed599d2703682 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:31.101495 1786 raft_consensus.cc:738] T 0e7eb287e9514c838aeed599d2703682 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Initialized, Role: FOLLOWER
I20250625 03:30:31.102385 1787 tablet_bootstrap.cc:492] T f957bf9749c54be48094092cb80e9055 P 7e9c4f2e01164f33b2e9034ed148398e: Bootstrap starting.
I20250625 03:30:31.103756 1786 consensus_queue.cc:260] T 0e7eb287e9514c838aeed599d2703682 P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:31.107586 1786 ts_tablet_manager.cc:1428] T 0e7eb287e9514c838aeed599d2703682 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent starting tablet: real 0.016s user 0.009s sys 0.000s
I20250625 03:30:31.323598 1878 raft_consensus.cc:491] T 542f85d76df8432593ee963669155a9d P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:31.328537 1878 raft_consensus.cc:513] T 542f85d76df8432593ee963669155a9d P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:31.331082 1878 leader_election.cc:290] T 542f85d76df8432593ee963669155a9d P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:31.333770 1812 raft_consensus.cc:491] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:31.334414 1812 raft_consensus.cc:513] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:31.337913 1841 raft_consensus.cc:491] T 465c15a46933411a985f29059fdb1c9f P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:31.338578 1841 raft_consensus.cc:513] T 465c15a46933411a985f29059fdb1c9f P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:31.378914 1904 raft_consensus.cc:491] T 542f85d76df8432593ee963669155a9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:31.379660 1904 raft_consensus.cc:513] T 542f85d76df8432593ee963669155a9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:31.395745 1904 leader_election.cc:290] T 542f85d76df8432593ee963669155a9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:31.528448 1904 raft_consensus.cc:491] T 0e7eb287e9514c838aeed599d2703682 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:31.529230 1904 raft_consensus.cc:513] T 0e7eb287e9514c838aeed599d2703682 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:32.000828 1786 tablet_bootstrap.cc:492] T 6e7283d035e1429f946d8ebb98978656 P ba464e89e0f044a0a0ea3e6125cbf2a1: Bootstrap starting.
I20250625 03:30:32.017683 1785 tablet_bootstrap.cc:492] T 465c15a46933411a985f29059fdb1c9f P 3f2aa40978064c9e9983cf3745eed206: No bootstrap required, opened a new log
I20250625 03:30:32.018082 1785 ts_tablet_manager.cc:1397] T 465c15a46933411a985f29059fdb1c9f P 3f2aa40978064c9e9983cf3745eed206: Time spent bootstrapping tablet: real 0.988s user 0.011s sys 0.007s
I20250625 03:30:32.019389 1841 leader_election.cc:290] T 465c15a46933411a985f29059fdb1c9f P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:32.020318 1904 leader_election.cc:290] T 0e7eb287e9514c838aeed599d2703682 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:32.024905 1785 raft_consensus.cc:357] T 465c15a46933411a985f29059fdb1c9f P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:32.025678 1785 raft_consensus.cc:383] T 465c15a46933411a985f29059fdb1c9f P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:32.025956 1785 raft_consensus.cc:738] T 465c15a46933411a985f29059fdb1c9f P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Initialized, Role: FOLLOWER
I20250625 03:30:32.026569 1785 consensus_queue.cc:260] T 465c15a46933411a985f29059fdb1c9f P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:32.028647 1787 tablet_bootstrap.cc:654] T f957bf9749c54be48094092cb80e9055 P 7e9c4f2e01164f33b2e9034ed148398e: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:32.034339 1786 tablet_bootstrap.cc:654] T 6e7283d035e1429f946d8ebb98978656 P ba464e89e0f044a0a0ea3e6125cbf2a1: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:32.035997 1785 ts_tablet_manager.cc:1428] T 465c15a46933411a985f29059fdb1c9f P 3f2aa40978064c9e9983cf3745eed206: Time spent starting tablet: real 0.018s user 0.007s sys 0.000s
I20250625 03:30:32.037861 1785 tablet_bootstrap.cc:492] T 0e7eb287e9514c838aeed599d2703682 P 3f2aa40978064c9e9983cf3745eed206: Bootstrap starting.
I20250625 03:30:32.042889 1786 tablet_bootstrap.cc:492] T 6e7283d035e1429f946d8ebb98978656 P ba464e89e0f044a0a0ea3e6125cbf2a1: No bootstrap required, opened a new log
I20250625 03:30:32.043486 1786 ts_tablet_manager.cc:1397] T 6e7283d035e1429f946d8ebb98978656 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent bootstrapping tablet: real 0.047s user 0.011s sys 0.004s
I20250625 03:30:32.045862 1785 tablet_bootstrap.cc:654] T 0e7eb287e9514c838aeed599d2703682 P 3f2aa40978064c9e9983cf3745eed206: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:32.046970 1921 raft_consensus.cc:491] T f9458dec7953448d8550396d67fad249 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:32.047595 1786 raft_consensus.cc:357] T 6e7283d035e1429f946d8ebb98978656 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:32.049232 1786 raft_consensus.cc:383] T 6e7283d035e1429f946d8ebb98978656 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:32.049602 1786 raft_consensus.cc:738] T 6e7283d035e1429f946d8ebb98978656 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Initialized, Role: FOLLOWER
I20250625 03:30:32.050635 1787 tablet_bootstrap.cc:492] T f957bf9749c54be48094092cb80e9055 P 7e9c4f2e01164f33b2e9034ed148398e: No bootstrap required, opened a new log
I20250625 03:30:32.056643 1786 consensus_queue.cc:260] T 6e7283d035e1429f946d8ebb98978656 P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:32.059376 1786 ts_tablet_manager.cc:1428] T 6e7283d035e1429f946d8ebb98978656 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent starting tablet: real 0.016s user 0.002s sys 0.002s
I20250625 03:30:32.060492 1786 tablet_bootstrap.cc:492] T f8c715109ff0405997e1ca9952678c0d P ba464e89e0f044a0a0ea3e6125cbf2a1: Bootstrap starting.
I20250625 03:30:32.057355 1787 ts_tablet_manager.cc:1397] T f957bf9749c54be48094092cb80e9055 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent bootstrapping tablet: real 0.956s user 0.010s sys 0.002s
I20250625 03:30:32.048478 1921 raft_consensus.cc:513] T f9458dec7953448d8550396d67fad249 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:32.063491 1787 raft_consensus.cc:357] T f957bf9749c54be48094092cb80e9055 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:32.064355 1787 raft_consensus.cc:383] T f957bf9749c54be48094092cb80e9055 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:32.064664 1787 raft_consensus.cc:738] T f957bf9749c54be48094092cb80e9055 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Initialized, Role: FOLLOWER
I20250625 03:30:32.066072 1921 leader_election.cc:290] T f9458dec7953448d8550396d67fad249 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:32.066728 1787 consensus_queue.cc:260] T f957bf9749c54be48094092cb80e9055 P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:32.069110 1787 ts_tablet_manager.cc:1428] T f957bf9749c54be48094092cb80e9055 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20250625 03:30:32.070165 1787 tablet_bootstrap.cc:492] T dea2dcc26f144802a16f0884fdd99063 P 7e9c4f2e01164f33b2e9034ed148398e: Bootstrap starting.
I20250625 03:30:32.070523 1786 tablet_bootstrap.cc:654] T f8c715109ff0405997e1ca9952678c0d P ba464e89e0f044a0a0ea3e6125cbf2a1: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:32.072801 1744 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f9458dec7953448d8550396d67fad249" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:32.072990 1745 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "542f85d76df8432593ee963669155a9d" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:32.055708 1785 tablet_bootstrap.cc:492] T 0e7eb287e9514c838aeed599d2703682 P 3f2aa40978064c9e9983cf3745eed206: No bootstrap required, opened a new log
I20250625 03:30:32.073639 1745 raft_consensus.cc:2466] T 542f85d76df8432593ee963669155a9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 0.
I20250625 03:30:32.073935 1785 ts_tablet_manager.cc:1397] T 0e7eb287e9514c838aeed599d2703682 P 3f2aa40978064c9e9983cf3745eed206: Time spent bootstrapping tablet: real 0.036s user 0.009s sys 0.006s
I20250625 03:30:32.073882 1744 raft_consensus.cc:2391] T f9458dec7953448d8550396d67fad249 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e9c4f2e01164f33b2e9034ed148398e in current term 1: Already voted for candidate 3f2aa40978064c9e9983cf3745eed206 in this term.
I20250625 03:30:32.076989 1592 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3c2c045dee4b4b4faa93fa9d0ccdaa1c" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:32.080971 1594 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "465c15a46933411a985f29059fdb1c9f" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:32.090467 1787 tablet_bootstrap.cc:654] T dea2dcc26f144802a16f0884fdd99063 P 7e9c4f2e01164f33b2e9034ed148398e: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:32.077255 1561 leader_election.cc:304] T 542f85d76df8432593ee963669155a9d P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters:
I20250625 03:30:32.079592 1785 raft_consensus.cc:357] T 0e7eb287e9514c838aeed599d2703682 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:32.092662 1785 raft_consensus.cc:383] T 0e7eb287e9514c838aeed599d2703682 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:32.093005 1785 raft_consensus.cc:738] T 0e7eb287e9514c838aeed599d2703682 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Initialized, Role: FOLLOWER
I20250625 03:30:32.093670 1785 consensus_queue.cc:260] T 0e7eb287e9514c838aeed599d2703682 P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:32.095131 1592 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0e7eb287e9514c838aeed599d2703682" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:32.096239 1785 ts_tablet_manager.cc:1428] T 0e7eb287e9514c838aeed599d2703682 P 3f2aa40978064c9e9983cf3745eed206: Time spent starting tablet: real 0.019s user 0.006s sys 0.000s
I20250625 03:30:32.097304 1785 tablet_bootstrap.cc:492] T f8c715109ff0405997e1ca9952678c0d P 3f2aa40978064c9e9983cf3745eed206: Bootstrap starting.
W20250625 03:30:32.098826 1709 consensus_peers.cc:487] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20250625 03:30:32.100033 1709 leader_election.cc:343] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:32.110291 1785 tablet_bootstrap.cc:654] T f8c715109ff0405997e1ca9952678c0d P 3f2aa40978064c9e9983cf3745eed206: Neither blocks nor log segments found. Creating new log.
W20250625 03:30:32.238982 1561 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.131:39359, user_credentials={real_user=slave}} blocked reactor thread for 161796us
I20250625 03:30:32.426326 1924 raft_consensus.cc:491] T 615cebbffcfc44e19b8f7a1e842073a3 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:32.427093 1924 raft_consensus.cc:513] T 615cebbffcfc44e19b8f7a1e842073a3 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:32.429802 1924 leader_election.cc:290] T 615cebbffcfc44e19b8f7a1e842073a3 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:32.430503 1924 raft_consensus.cc:491] T 1fff19a38e8d4880a14da6b4c8284cc2 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba464e89e0f044a0a0ea3e6125cbf2a1)
I20250625 03:30:32.431056 1924 raft_consensus.cc:513] T 1fff19a38e8d4880a14da6b4c8284cc2 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } }
I20250625 03:30:32.434818 1924 leader_election.cc:290] T 1fff19a38e8d4880a14da6b4c8284cc2 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:32.443208 1921 raft_consensus.cc:2802] T 542f85d76df8432593ee963669155a9d P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:30:32.443910 1921 raft_consensus.cc:491] T 542f85d76df8432593ee963669155a9d P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:30:32.444463 1921 raft_consensus.cc:3058] T 542f85d76df8432593ee963669155a9d P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:32.532382 1924 raft_consensus.cc:491] T 6e7283d035e1429f946d8ebb98978656 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f2aa40978064c9e9983cf3745eed206)
I20250625 03:30:32.533264 1924 raft_consensus.cc:513] T 6e7283d035e1429f946d8ebb98978656 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:32.743324 1932 raft_consensus.cc:491] T f957bf9749c54be48094092cb80e9055 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:32.744032 1932 raft_consensus.cc:513] T f957bf9749c54be48094092cb80e9055 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:32.853984 1934 raft_consensus.cc:491] T afe48b30a4e64a4d8faf2a5b42d5c706 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba464e89e0f044a0a0ea3e6125cbf2a1)
I20250625 03:30:32.854586 1934 raft_consensus.cc:513] T afe48b30a4e64a4d8faf2a5b42d5c706 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:32.858340 1934 leader_election.cc:290] T afe48b30a4e64a4d8faf2a5b42d5c706 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:32.858765 1936 raft_consensus.cc:491] T 542f85d76df8432593ee963669155a9d P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:32.859417 1936 raft_consensus.cc:513] T 542f85d76df8432593ee963669155a9d P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
W20250625 03:30:32.861459 1786 thread.cc:640] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.787s user 0.029s sys 0.039s
W20250625 03:30:32.861837 1786 thread.cc:606] log-alloc [worker] (thread pool) Time spent starting thread: real 0.787s user 0.029s sys 0.040s
I20250625 03:30:32.862680 1936 leader_election.cc:290] T 542f85d76df8432593ee963669155a9d P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:32.863204 1936 raft_consensus.cc:491] T fb6e83db706647e28e491a02f1641980 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba464e89e0f044a0a0ea3e6125cbf2a1)
I20250625 03:30:32.863669 1937 raft_consensus.cc:491] T d9038fc1ce0d4b528c02c68012e1277d P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e9c4f2e01164f33b2e9034ed148398e)
I20250625 03:30:32.863714 1936 raft_consensus.cc:513] T fb6e83db706647e28e491a02f1641980 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:32.864384 1786 tablet_bootstrap.cc:492] T f8c715109ff0405997e1ca9952678c0d P ba464e89e0f044a0a0ea3e6125cbf2a1: No bootstrap required, opened a new log
I20250625 03:30:32.865058 1786 ts_tablet_manager.cc:1397] T f8c715109ff0405997e1ca9952678c0d P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent bootstrapping tablet: real 0.805s user 0.040s sys 0.040s
I20250625 03:30:32.865247 1938 raft_consensus.cc:491] T 40b74a261fdd495f84ceb0690f0b30ba P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e9c4f2e01164f33b2e9034ed148398e)
I20250625 03:30:32.858871 1934 raft_consensus.cc:491] T f957bf9749c54be48094092cb80e9055 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:32.866716 1934 raft_consensus.cc:513] T f957bf9749c54be48094092cb80e9055 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:32.864392 1937 raft_consensus.cc:513] T d9038fc1ce0d4b528c02c68012e1277d P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:32.867911 1786 raft_consensus.cc:357] T f8c715109ff0405997e1ca9952678c0d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:32.868741 1786 raft_consensus.cc:383] T f8c715109ff0405997e1ca9952678c0d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:32.869060 1786 raft_consensus.cc:738] T f8c715109ff0405997e1ca9952678c0d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Initialized, Role: FOLLOWER
I20250625 03:30:32.865900 1938 raft_consensus.cc:513] T 40b74a261fdd495f84ceb0690f0b30ba P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:32.869617 1937 leader_election.cc:290] T d9038fc1ce0d4b528c02c68012e1277d P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:32.869796 1786 consensus_queue.cc:260] T f8c715109ff0405997e1ca9952678c0d P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:32.870931 1938 leader_election.cc:290] T 40b74a261fdd495f84ceb0690f0b30ba P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:32.872133 1934 leader_election.cc:290] T f957bf9749c54be48094092cb80e9055 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:32.872236 1786 ts_tablet_manager.cc:1428] T f8c715109ff0405997e1ca9952678c0d P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20250625 03:30:32.873345 1786 tablet_bootstrap.cc:492] T 615cebbffcfc44e19b8f7a1e842073a3 P ba464e89e0f044a0a0ea3e6125cbf2a1: Bootstrap starting.
I20250625 03:30:32.873363 1936 leader_election.cc:290] T fb6e83db706647e28e491a02f1641980 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:32.877562 1493 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38160 (request call id 35) took 1906 ms. Trace:
I20250625 03:30:32.883399 1786 tablet_bootstrap.cc:654] T 615cebbffcfc44e19b8f7a1e842073a3 P ba464e89e0f044a0a0ea3e6125cbf2a1: Neither blocks nor log segments found. Creating new log.
W20250625 03:30:32.886628 1542 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20250625 03:30:32.878043 1493 rpcz_store.cc:276] 0625 03:30:30.971530 (+ 0us) service_pool.cc:168] Inserting onto call queue
0625 03:30:30.976121 (+ 4591us) service_pool.cc:225] Handling call
0625 03:30:32.877503 (+1901382us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0625 03:30:31.002997 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0625 03:30:31.003507 (+ 510us) write_op.cc:432] Acquiring schema lock in shared mode
0625 03:30:31.003539 (+ 32us) write_op.cc:435] Acquired schema lock
0625 03:30:31.003555 (+ 16us) tablet.cc:660] Decoding operations
0625 03:30:31.003858 (+ 303us) write_op.cc:620] Acquiring the partition lock for write op
0625 03:30:31.003912 (+ 54us) write_op.cc:641] Partition lock acquired for write op
0625 03:30:31.003940 (+ 28us) tablet.cc:683] Acquiring locks for 1 operations
0625 03:30:31.004167 (+ 227us) tablet.cc:699] Row locks acquired
0625 03:30:31.004185 (+ 18us) write_op.cc:260] PREPARE: finished
0625 03:30:31.004320 (+ 135us) write_op.cc:270] Start()
0625 03:30:31.004415 (+ 95us) write_op.cc:276] Timestamp: P: 1750822231004272 usec, L: 0
0625 03:30:31.004430 (+ 15us) op_driver.cc:348] REPLICATION: starting
0625 03:30:31.005040 (+ 610us) log.cc:844] Serialized 540 byte log entry
0625 03:30:31.007042 (+ 2002us) op_driver.cc:464] REPLICATION: finished
0625 03:30:31.008040 (+ 998us) write_op.cc:301] APPLY: starting
0625 03:30:31.008119 (+ 79us) tablet.cc:1365] starting BulkCheckPresence
0625 03:30:31.008212 (+ 93us) tablet.cc:1368] finished BulkCheckPresence
0625 03:30:31.008328 (+ 116us) tablet.cc:1370] starting ApplyRowOperation cycle
0625 03:30:31.008500 (+ 172us) tablet.cc:1381] finished ApplyRowOperation cycle
0625 03:30:31.008656 (+ 156us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0625 03:30:31.008705 (+ 49us) write_op.cc:312] APPLY: finished
0625 03:30:31.008913 (+ 208us) log.cc:844] Serialized 22 byte log entry
0625 03:30:31.009102 (+ 189us) write_op.cc:489] Releasing partition, row and schema locks
0625 03:30:31.009189 (+ 87us) write_op.cc:454] Released schema lock
0625 03:30:31.009233 (+ 44us) write_op.cc:341] FINISH: Updating metrics
0625 03:30:31.009518 (+ 285us) write_op.cc:489] Releasing partition, row and schema locks
0625 03:30:31.009544 (+ 26us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":790,"apply.run_cpu_time_us":1476,"apply.run_wall_time_us":1476,"num_ops":1,"prepare.queue_time_us":141,"prepare.run_cpu_time_us":2303,"prepare.run_wall_time_us":2612,"replication_time_us":2348}]]}
I20250625 03:30:32.888772 1938 raft_consensus.cc:491] T e4034c33d83e4a96a187eaed46416e3c P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba464e89e0f044a0a0ea3e6125cbf2a1)
I20250625 03:30:32.889019 1921 raft_consensus.cc:513] T 542f85d76df8432593ee963669155a9d P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:32.889344 1938 raft_consensus.cc:513] T e4034c33d83e4a96a187eaed46416e3c P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:32.891084 1938 leader_election.cc:290] T e4034c33d83e4a96a187eaed46416e3c P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:32.893640 1943 raft_consensus.cc:491] T d50c52b197294003b238a37da2fb55d8 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:32.894287 1943 raft_consensus.cc:513] T d50c52b197294003b238a37da2fb55d8 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:32.896991 1943 leader_election.cc:290] T d50c52b197294003b238a37da2fb55d8 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:32.909298 1786 tablet_bootstrap.cc:492] T 615cebbffcfc44e19b8f7a1e842073a3 P ba464e89e0f044a0a0ea3e6125cbf2a1: No bootstrap required, opened a new log
I20250625 03:30:32.909725 1786 ts_tablet_manager.cc:1397] T 615cebbffcfc44e19b8f7a1e842073a3 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent bootstrapping tablet: real 0.037s user 0.013s sys 0.000s
I20250625 03:30:32.910728 1785 tablet_bootstrap.cc:492] T f8c715109ff0405997e1ca9952678c0d P 3f2aa40978064c9e9983cf3745eed206: No bootstrap required, opened a new log
I20250625 03:30:32.911207 1785 ts_tablet_manager.cc:1397] T f8c715109ff0405997e1ca9952678c0d P 3f2aa40978064c9e9983cf3745eed206: Time spent bootstrapping tablet: real 0.814s user 0.017s sys 0.000s
I20250625 03:30:32.912662 1595 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "542f85d76df8432593ee963669155a9d" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:32.912694 1786 raft_consensus.cc:357] T 615cebbffcfc44e19b8f7a1e842073a3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:32.913612 1595 raft_consensus.cc:2391] T 542f85d76df8432593ee963669155a9d P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in current term 1: Already voted for candidate 7e9c4f2e01164f33b2e9034ed148398e in this term.
I20250625 03:30:32.913712 1785 raft_consensus.cc:357] T f8c715109ff0405997e1ca9952678c0d P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:32.914381 1785 raft_consensus.cc:383] T f8c715109ff0405997e1ca9952678c0d P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:32.913612 1786 raft_consensus.cc:383] T 615cebbffcfc44e19b8f7a1e842073a3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:32.914624 1785 raft_consensus.cc:738] T f8c715109ff0405997e1ca9952678c0d P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Initialized, Role: FOLLOWER
I20250625 03:30:32.915014 1786 raft_consensus.cc:738] T 615cebbffcfc44e19b8f7a1e842073a3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Initialized, Role: FOLLOWER
I20250625 03:30:32.915366 1785 consensus_queue.cc:260] T f8c715109ff0405997e1ca9952678c0d P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:32.915704 1786 consensus_queue.cc:260] T 615cebbffcfc44e19b8f7a1e842073a3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:32.917764 1785 ts_tablet_manager.cc:1428] T f8c715109ff0405997e1ca9952678c0d P 3f2aa40978064c9e9983cf3745eed206: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20250625 03:30:32.918069 1786 ts_tablet_manager.cc:1428] T 615cebbffcfc44e19b8f7a1e842073a3 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20250625 03:30:32.918738 1938 raft_consensus.cc:491] T af4573692c104d67994dbb1bc518b568 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:32.919049 1786 tablet_bootstrap.cc:492] T d50c52b197294003b238a37da2fb55d8 P ba464e89e0f044a0a0ea3e6125cbf2a1: Bootstrap starting.
I20250625 03:30:32.919205 1938 raft_consensus.cc:513] T af4573692c104d67994dbb1bc518b568 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:32.920173 1936 raft_consensus.cc:491] T 1fff19a38e8d4880a14da6b4c8284cc2 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba464e89e0f044a0a0ea3e6125cbf2a1)
I20250625 03:30:32.920689 1936 raft_consensus.cc:513] T 1fff19a38e8d4880a14da6b4c8284cc2 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } }
I20250625 03:30:32.921099 1938 leader_election.cc:290] T af4573692c104d67994dbb1bc518b568 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:32.922683 1936 leader_election.cc:290] T 1fff19a38e8d4880a14da6b4c8284cc2 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359), 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903)
I20250625 03:30:32.925400 1595 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "afe48b30a4e64a4d8faf2a5b42d5c706" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:32.928925 1934 raft_consensus.cc:491] T 615cebbffcfc44e19b8f7a1e842073a3 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:32.929613 1934 raft_consensus.cc:513] T 615cebbffcfc44e19b8f7a1e842073a3 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:32.932036 1937 raft_consensus.cc:491] T 731095860aad436e9658ab3ff5010f9d P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba464e89e0f044a0a0ea3e6125cbf2a1)
I20250625 03:30:32.932586 1937 raft_consensus.cc:513] T 731095860aad436e9658ab3ff5010f9d P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:32.933529 1670 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "542f85d76df8432593ee963669155a9d" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:32.934154 1670 raft_consensus.cc:2466] T 542f85d76df8432593ee963669155a9d P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 0.
I20250625 03:30:32.934293 1494 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38140 (request call id 33) took 1828 ms. Trace:
I20250625 03:30:32.934706 1494 rpcz_store.cc:276] 0625 03:30:31.106279 (+ 0us) service_pool.cc:168] Inserting onto call queue
0625 03:30:32.098179 (+991900us) service_pool.cc:225] Handling call
0625 03:30:32.934233 (+836054us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":772407,"reported_tablets":1}
I20250625 03:30:32.936394 1934 leader_election.cc:290] T 615cebbffcfc44e19b8f7a1e842073a3 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:32.943449 1671 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f9458dec7953448d8550396d67fad249" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:32.946260 1671 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "615cebbffcfc44e19b8f7a1e842073a3" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:32.947050 1671 raft_consensus.cc:2466] T 615cebbffcfc44e19b8f7a1e842073a3 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 0.
I20250625 03:30:32.948485 1937 leader_election.cc:290] T 731095860aad436e9658ab3ff5010f9d P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:32.949059 1937 raft_consensus.cc:491] T b15eb94b9d3d4f6987b5fa5e20193655 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba464e89e0f044a0a0ea3e6125cbf2a1)
I20250625 03:30:32.949941 1596 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "542f85d76df8432593ee963669155a9d" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:32.949565 1937 raft_consensus.cc:513] T b15eb94b9d3d4f6987b5fa5e20193655 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:32.950747 1596 raft_consensus.cc:2391] T 542f85d76df8432593ee963669155a9d P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f2aa40978064c9e9983cf3745eed206 in current term 1: Already voted for candidate 7e9c4f2e01164f33b2e9034ed148398e in this term.
I20250625 03:30:32.952059 1596 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f957bf9749c54be48094092cb80e9055" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:32.952219 1937 leader_election.cc:290] T b15eb94b9d3d4f6987b5fa5e20193655 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:32.952673 1596 raft_consensus.cc:2466] T f957bf9749c54be48094092cb80e9055 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 0.
I20250625 03:30:32.953178 1670 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1fff19a38e8d4880a14da6b4c8284cc2" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:32.953799 1670 raft_consensus.cc:2466] T 1fff19a38e8d4880a14da6b4c8284cc2 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 1.
I20250625 03:30:32.954471 1596 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d9038fc1ce0d4b528c02c68012e1277d" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:32.955454 1670 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f957bf9749c54be48094092cb80e9055" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:32.955670 1595 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "40b74a261fdd495f84ceb0690f0b30ba" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:32.956118 1670 raft_consensus.cc:2466] T f957bf9749c54be48094092cb80e9055 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 0.
I20250625 03:30:32.956815 1945 raft_consensus.cc:491] T 85e02bb33a944989ada7f600c1e802da P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba464e89e0f044a0a0ea3e6125cbf2a1)
I20250625 03:30:32.957190 1595 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fb6e83db706647e28e491a02f1641980" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:32.959025 1671 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6e7283d035e1429f946d8ebb98978656" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:32.960331 1595 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e4034c33d83e4a96a187eaed46416e3c" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:32.960639 1671 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "542f85d76df8432593ee963669155a9d" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:30:32.961143 1671 raft_consensus.cc:3058] T 542f85d76df8432593ee963669155a9d P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:32.963385 1595 raft_consensus.cc:3058] T f9458dec7953448d8550396d67fad249 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Advancing to term 1
W20250625 03:30:32.965652 1787 thread.cc:640] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.865s user 0.009s sys 0.007s
W20250625 03:30:32.969075 1787 thread.cc:606] log-alloc [worker] (thread pool) Time spent starting thread: real 0.868s user 0.010s sys 0.007s
I20250625 03:30:32.968396 1921 leader_election.cc:290] T 542f85d76df8432593ee963669155a9d P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 election: Requested vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:32.971086 1670 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d50c52b197294003b238a37da2fb55d8" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:32.957329 1945 raft_consensus.cc:513] T 85e02bb33a944989ada7f600c1e802da P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
W20250625 03:30:32.973634 1709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:39903, user_credentials={real_user=slave}} blocked reactor thread for 872592us
I20250625 03:30:32.953819 1785 tablet_bootstrap.cc:492] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206: Bootstrap starting.
W20250625 03:30:32.974440 1709 leader_election.cc:343] T 0e7eb287e9514c838aeed599d2703682 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
W20250625 03:30:32.976765 1709 leader_election.cc:343] T 465c15a46933411a985f29059fdb1c9f P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:32.982848 1945 leader_election.cc:290] T 85e02bb33a944989ada7f600c1e802da P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:32.984544 1841 raft_consensus.cc:491] T c4354f7ffc0e4eabbc92a141d46b7984 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f2aa40978064c9e9983cf3745eed206)
I20250625 03:30:32.985081 1841 raft_consensus.cc:513] T c4354f7ffc0e4eabbc92a141d46b7984 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:32.986658 1841 leader_election.cc:290] T c4354f7ffc0e4eabbc92a141d46b7984 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:32.987015 1668 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "542f85d76df8432593ee963669155a9d" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:32.988649 1787 tablet_bootstrap.cc:492] T dea2dcc26f144802a16f0884fdd99063 P 7e9c4f2e01164f33b2e9034ed148398e: No bootstrap required, opened a new log
I20250625 03:30:32.989096 1787 ts_tablet_manager.cc:1397] T dea2dcc26f144802a16f0884fdd99063 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent bootstrapping tablet: real 0.919s user 0.019s sys 0.011s
I20250625 03:30:32.991829 1787 raft_consensus.cc:357] T dea2dcc26f144802a16f0884fdd99063 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:32.992581 1787 raft_consensus.cc:383] T dea2dcc26f144802a16f0884fdd99063 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:32.992734 1593 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "af4573692c104d67994dbb1bc518b568" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:32.993000 1668 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "465c15a46933411a985f29059fdb1c9f" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:32.993602 1668 raft_consensus.cc:2466] T 465c15a46933411a985f29059fdb1c9f P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 0.
I20250625 03:30:32.994354 1593 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1fff19a38e8d4880a14da6b4c8284cc2" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:32.994875 1668 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0e7eb287e9514c838aeed599d2703682" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:32.995452 1668 raft_consensus.cc:2466] T 0e7eb287e9514c838aeed599d2703682 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 0.
I20250625 03:30:32.969135 1671 raft_consensus.cc:2466] T 542f85d76df8432593ee963669155a9d P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 1.
I20250625 03:30:33.001619 1932 leader_election.cc:290] T f957bf9749c54be48094092cb80e9055 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:32.992874 1787 raft_consensus.cc:738] T dea2dcc26f144802a16f0884fdd99063 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Initialized, Role: FOLLOWER
I20250625 03:30:32.997398 1559 leader_election.cc:304] T f9458dec7953448d8550396d67fad249 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e; no voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:33.002650 1924 leader_election.cc:290] T 6e7283d035e1429f946d8ebb98978656 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:33.004685 1785 tablet_bootstrap.cc:654] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:32.995802 1596 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c4354f7ffc0e4eabbc92a141d46b7984" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:33.006316 1787 consensus_queue.cc:260] T dea2dcc26f144802a16f0884fdd99063 P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.008710 1786 tablet_bootstrap.cc:654] T d50c52b197294003b238a37da2fb55d8 P ba464e89e0f044a0a0ea3e6125cbf2a1: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:33.011197 1559 leader_election.cc:304] T 615cebbffcfc44e19b8f7a1e842073a3 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e; no voters:
I20250625 03:30:33.017735 1596 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "615cebbffcfc44e19b8f7a1e842073a3" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:33.017875 1593 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "731095860aad436e9658ab3ff5010f9d" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:33.018419 1596 raft_consensus.cc:2466] T 615cebbffcfc44e19b8f7a1e842073a3 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 0.
I20250625 03:30:33.022595 1787 ts_tablet_manager.cc:1428] T dea2dcc26f144802a16f0884fdd99063 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent starting tablet: real 0.033s user 0.004s sys 0.004s
I20250625 03:30:33.022456 1949 raft_consensus.cc:491] T 6cc384f27ff041c0be70bb661ae610dd P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f2aa40978064c9e9983cf3745eed206)
I20250625 03:30:33.022862 1559 leader_election.cc:304] T 1fff19a38e8d4880a14da6b4c8284cc2 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e; no voters:
I20250625 03:30:33.023851 1787 tablet_bootstrap.cc:492] T 6cc384f27ff041c0be70bb661ae610dd P 7e9c4f2e01164f33b2e9034ed148398e: Bootstrap starting.
I20250625 03:30:33.023375 1949 raft_consensus.cc:513] T 6cc384f27ff041c0be70bb661ae610dd P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.023747 1559 leader_election.cc:304] T f957bf9749c54be48094092cb80e9055 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e; no voters:
I20250625 03:30:33.025331 1926 raft_consensus.cc:2802] T 1fff19a38e8d4880a14da6b4c8284cc2 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250625 03:30:33.025765 1926 raft_consensus.cc:491] T 1fff19a38e8d4880a14da6b4c8284cc2 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Starting leader election (detected failure of leader ba464e89e0f044a0a0ea3e6125cbf2a1)
I20250625 03:30:33.026880 1926 raft_consensus.cc:3058] T 1fff19a38e8d4880a14da6b4c8284cc2 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:30:33.027710 1921 raft_consensus.cc:2802] T f957bf9749c54be48094092cb80e9055 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:30:33.028119 1921 raft_consensus.cc:491] T f957bf9749c54be48094092cb80e9055 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:30:33.028450 1921 raft_consensus.cc:3058] T f957bf9749c54be48094092cb80e9055 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:33.028621 1559 leader_election.cc:304] T 542f85d76df8432593ee963669155a9d P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e; no voters:
I20250625 03:30:33.021174 1932 raft_consensus.cc:2802] T 615cebbffcfc44e19b8f7a1e842073a3 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:30:33.037093 1593 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b15eb94b9d3d4f6987b5fa5e20193655" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:33.039261 1593 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "85e02bb33a944989ada7f600c1e802da" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:33.040807 1671 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c4354f7ffc0e4eabbc92a141d46b7984" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
W20250625 03:30:33.040866 1635 consensus_peers.cc:487] T 6cc384f27ff041c0be70bb661ae610dd P 3f2aa40978064c9e9983cf3745eed206 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:30:33.041952 1635 leader_election.cc:304] T f957bf9749c54be48094092cb80e9055 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e; no voters:
I20250625 03:30:33.044191 1938 raft_consensus.cc:2802] T f957bf9749c54be48094092cb80e9055 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:30:33.044564 1938 raft_consensus.cc:491] T f957bf9749c54be48094092cb80e9055 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:30:33.044879 1938 raft_consensus.cc:3058] T f957bf9749c54be48094092cb80e9055 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:33.045646 1812 leader_election.cc:290] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:33.030391 1943 raft_consensus.cc:2802] T 542f85d76df8432593ee963669155a9d P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:30:33.046460 1943 raft_consensus.cc:695] T 542f85d76df8432593ee963669155a9d P 7e9c4f2e01164f33b2e9034ed148398e [term 1 LEADER]: Becoming Leader. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Running, Role: LEADER
I20250625 03:30:33.047397 1943 consensus_queue.cc:237] T 542f85d76df8432593ee963669155a9d P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.034662 1932 raft_consensus.cc:491] T 615cebbffcfc44e19b8f7a1e842073a3 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:30:33.052052 1812 raft_consensus.cc:491] T f9458dec7953448d8550396d67fad249 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:33.052623 1932 raft_consensus.cc:3058] T 615cebbffcfc44e19b8f7a1e842073a3 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:33.053409 1949 leader_election.cc:290] T 6cc384f27ff041c0be70bb661ae610dd P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:33.056221 1744 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1fff19a38e8d4880a14da6b4c8284cc2" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:33.057042 1924 raft_consensus.cc:2747] T f9458dec7953448d8550396d67fad249 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:30:33.056337 1812 raft_consensus.cc:513] T f9458dec7953448d8550396d67fad249 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.057482 1745 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "615cebbffcfc44e19b8f7a1e842073a3" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:33.058071 1745 raft_consensus.cc:2466] T 615cebbffcfc44e19b8f7a1e842073a3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 0.
I20250625 03:30:33.058918 1949 raft_consensus.cc:491] T 6e7283d035e1429f946d8ebb98978656 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:33.059398 1949 raft_consensus.cc:513] T 6e7283d035e1429f946d8ebb98978656 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.060632 1594 raft_consensus.cc:3058] T dea2dcc26f144802a16f0884fdd99063 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:33.061338 1949 leader_election.cc:290] T 6e7283d035e1429f946d8ebb98978656 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:33.050112 1921 raft_consensus.cc:513] T f957bf9749c54be48094092cb80e9055 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.047601 1926 raft_consensus.cc:513] T 1fff19a38e8d4880a14da6b4c8284cc2 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } }
I20250625 03:30:33.066912 1591 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f9458dec7953448d8550396d67fad249" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:33.068462 1591 raft_consensus.cc:2466] T f9458dec7953448d8550396d67fad249 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 1.
I20250625 03:30:33.069237 1926 leader_election.cc:290] T 1fff19a38e8d4880a14da6b4c8284cc2 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 2 election: Requested vote from peers ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
W20250625 03:30:33.069895 1635 leader_election.cc:343] T af4573692c104d67994dbb1bc518b568 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:33.070261 1671 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1fff19a38e8d4880a14da6b4c8284cc2" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:30:33.072580 1945 consensus_queue.cc:1035] T d50c52b197294003b238a37da2fb55d8 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:30:33.074942 1595 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6e7283d035e1429f946d8ebb98978656" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:33.076179 1741 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d50c52b197294003b238a37da2fb55d8" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:33.077446 1742 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "542f85d76df8432593ee963669155a9d" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:30:33.078217 1742 raft_consensus.cc:3058] T 542f85d76df8432593ee963669155a9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:33.080648 1743 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f957bf9749c54be48094092cb80e9055" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:33.062050 1812 leader_election.cc:290] T f9458dec7953448d8550396d67fad249 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:33.071524 1635 leader_election.cc:304] T 615cebbffcfc44e19b8f7a1e842073a3 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e; no voters:
W20250625 03:30:33.089882 1561 leader_election.cc:343] T d50c52b197294003b238a37da2fb55d8 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:33.090516 1561 leader_election.cc:304] T d50c52b197294003b238a37da2fb55d8 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e; no voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:33.084534 1744 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6e7283d035e1429f946d8ebb98978656" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:33.091686 1744 raft_consensus.cc:2466] T 6e7283d035e1429f946d8ebb98978656 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 0.
I20250625 03:30:33.081954 1937 raft_consensus.cc:491] T dea2dcc26f144802a16f0884fdd99063 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:33.088227 1740 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1fff19a38e8d4880a14da6b4c8284cc2" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:30:33.094985 1946 raft_consensus.cc:2802] T 615cebbffcfc44e19b8f7a1e842073a3 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:30:33.094957 1937 raft_consensus.cc:513] T dea2dcc26f144802a16f0884fdd99063 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.095510 1946 raft_consensus.cc:491] T 615cebbffcfc44e19b8f7a1e842073a3 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:30:33.095889 1946 raft_consensus.cc:3058] T 615cebbffcfc44e19b8f7a1e842073a3 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:33.097182 1937 leader_election.cc:290] T dea2dcc26f144802a16f0884fdd99063 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:33.092165 1926 raft_consensus.cc:2747] T d50c52b197294003b238a37da2fb55d8 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250625 03:30:33.093859 1945 consensus_queue.cc:1035] T f9458dec7953448d8550396d67fad249 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20250625 03:30:33.103176 1592 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6cc384f27ff041c0be70bb661ae610dd" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
W20250625 03:30:33.091926 1561 leader_election.cc:343] T f957bf9749c54be48094092cb80e9055 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:33.115908 1709 leader_election.cc:304] T f9458dec7953448d8550396d67fad249 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters:
I20250625 03:30:33.121460 1953 raft_consensus.cc:491] T 0c2b6052daaa4c57aaa55361e8d6e01c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:33.122155 1744 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "afe48b30a4e64a4d8faf2a5b42d5c706" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:33.122413 1953 raft_consensus.cc:513] T 0c2b6052daaa4c57aaa55361e8d6e01c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.132485 1919 raft_consensus.cc:2802] T f9458dec7953448d8550396d67fad249 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250625 03:30:33.137840 1919 raft_consensus.cc:491] T f9458dec7953448d8550396d67fad249 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:30:33.138057 1785 tablet_bootstrap.cc:492] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206: No bootstrap required, opened a new log
I20250625 03:30:33.138213 1919 raft_consensus.cc:3058] T f9458dec7953448d8550396d67fad249 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:30:33.138515 1785 ts_tablet_manager.cc:1397] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206: Time spent bootstrapping tablet: real 0.220s user 0.016s sys 0.003s
I20250625 03:30:33.124179 1744 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "542f85d76df8432593ee963669155a9d" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:33.130738 1812 raft_consensus.cc:491] T 9643cfd400804eb8b9037c5e9efddfba P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f2aa40978064c9e9983cf3745eed206)
I20250625 03:30:33.141463 1812 raft_consensus.cc:513] T 9643cfd400804eb8b9037c5e9efddfba P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.142728 1785 raft_consensus.cc:357] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.143543 1785 raft_consensus.cc:383] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:33.143894 1785 raft_consensus.cc:738] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Initialized, Role: FOLLOWER
I20250625 03:30:33.144707 1785 consensus_queue.cc:260] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.146780 1945 raft_consensus.cc:491] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:33.149240 1945 raft_consensus.cc:513] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.149822 1812 leader_election.cc:290] T 9643cfd400804eb8b9037c5e9efddfba P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:33.151271 1945 leader_election.cc:290] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
W20250625 03:30:33.134038 1709 leader_election.cc:343] T 6cc384f27ff041c0be70bb661ae610dd P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:33.153062 1785 ts_tablet_manager.cc:1428] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206: Time spent starting tablet: real 0.014s user 0.003s sys 0.006s
I20250625 03:30:33.152173 1743 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "40b74a261fdd495f84ceb0690f0b30ba" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:33.154269 1740 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f957bf9749c54be48094092cb80e9055" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
W20250625 03:30:33.136516 1561 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.131:39359, user_credentials={real_user=slave}} blocked reactor thread for 44640us
I20250625 03:30:33.155104 1785 tablet_bootstrap.cc:492] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 3f2aa40978064c9e9983cf3745eed206: Bootstrap starting.
I20250625 03:30:33.157423 1743 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fb6e83db706647e28e491a02f1641980" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:33.157835 1786 tablet_bootstrap.cc:492] T d50c52b197294003b238a37da2fb55d8 P ba464e89e0f044a0a0ea3e6125cbf2a1: No bootstrap required, opened a new log
I20250625 03:30:33.158244 1786 ts_tablet_manager.cc:1397] T d50c52b197294003b238a37da2fb55d8 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent bootstrapping tablet: real 0.239s user 0.011s sys 0.008s
I20250625 03:30:33.160326 1945 raft_consensus.cc:491] T f8c715109ff0405997e1ca9952678c0d P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:33.161116 1945 raft_consensus.cc:513] T f8c715109ff0405997e1ca9952678c0d P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.161947 1953 leader_election.cc:290] T 0c2b6052daaa4c57aaa55361e8d6e01c P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:33.145203 1938 raft_consensus.cc:513] T f957bf9749c54be48094092cb80e9055 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.164155 1744 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d9038fc1ce0d4b528c02c68012e1277d" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:33.165162 1938 leader_election.cc:290] T f957bf9749c54be48094092cb80e9055 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:33.165974 1945 leader_election.cc:290] T f8c715109ff0405997e1ca9952678c0d P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:33.148401 1708 leader_election.cc:304] T 542f85d76df8432593ee963669155a9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:33.169288 1708 leader_election.cc:304] T 465c15a46933411a985f29059fdb1c9f P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:33.170609 1596 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0c2b6052daaa4c57aaa55361e8d6e01c" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:33.169340 1592 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9643cfd400804eb8b9037c5e9efddfba" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:33.171334 1708 leader_election.cc:304] T 0e7eb287e9514c838aeed599d2703682 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:33.170020 1812 consensus_queue.cc:1035] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:30:33.173728 1745 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "af4573692c104d67994dbb1bc518b568" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:33.177587 1951 raft_consensus.cc:491] T f8c715109ff0405997e1ca9952678c0d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:33.172175 1841 raft_consensus.cc:2802] T 465c15a46933411a985f29059fdb1c9f P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:30:33.178133 1951 raft_consensus.cc:513] T f8c715109ff0405997e1ca9952678c0d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.181002 1671 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f957bf9749c54be48094092cb80e9055" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:30:33.173255 1812 raft_consensus.cc:2802] T 0e7eb287e9514c838aeed599d2703682 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:30:33.181677 1951 leader_election.cc:290] T f8c715109ff0405997e1ca9952678c0d P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:33.181797 1671 raft_consensus.cc:2391] T f957bf9749c54be48094092cb80e9055 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e9c4f2e01164f33b2e9034ed148398e in current term 1: Already voted for candidate 3f2aa40978064c9e9983cf3745eed206 in this term.
I20250625 03:30:33.181913 1812 raft_consensus.cc:491] T 0e7eb287e9514c838aeed599d2703682 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:30:33.179746 1841 raft_consensus.cc:491] T 465c15a46933411a985f29059fdb1c9f P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:30:33.183324 1738 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "615cebbffcfc44e19b8f7a1e842073a3" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:33.184392 1596 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dea2dcc26f144802a16f0884fdd99063" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:33.185207 1841 raft_consensus.cc:3058] T 465c15a46933411a985f29059fdb1c9f P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:33.173840 1743 raft_consensus.cc:3058] T 6e7283d035e1429f946d8ebb98978656 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:33.185516 1738 raft_consensus.cc:2466] T 615cebbffcfc44e19b8f7a1e842073a3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 0.
I20250625 03:30:33.182608 1739 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1fff19a38e8d4880a14da6b4c8284cc2" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:33.190413 1595 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f957bf9749c54be48094092cb80e9055" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
I20250625 03:30:33.186219 1812 raft_consensus.cc:3058] T 0e7eb287e9514c838aeed599d2703682 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:33.192943 1595 raft_consensus.cc:2391] T f957bf9749c54be48094092cb80e9055 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f2aa40978064c9e9983cf3745eed206 in current term 1: Already voted for candidate 7e9c4f2e01164f33b2e9034ed148398e in this term.
I20250625 03:30:33.172695 1708 leader_election.cc:304] T c4354f7ffc0e4eabbc92a141d46b7984 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:33.191757 1740 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e4034c33d83e4a96a187eaed46416e3c" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:33.194404 1596 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0c2b6052daaa4c57aaa55361e8d6e01c" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:33.204759 1951 raft_consensus.cc:2747] T c4354f7ffc0e4eabbc92a141d46b7984 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250625 03:30:33.210566 1595 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f8c715109ff0405997e1ca9952678c0d" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:33.213824 1812 raft_consensus.cc:513] T 0e7eb287e9514c838aeed599d2703682 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.191702 1921 leader_election.cc:290] T f957bf9749c54be48094092cb80e9055 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 election: Requested vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
W20250625 03:30:33.223765 1692 debug-util.cc:398] Leaking SignalData structure 0x7b0800164140 after lost signal to thread 429
I20250625 03:30:33.171975 1919 raft_consensus.cc:513] T f9458dec7953448d8550396d67fad249 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.231887 1596 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f8c715109ff0405997e1ca9952678c0d" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
W20250625 03:30:33.219118 1709 leader_election.cc:343] T 0c2b6052daaa4c57aaa55361e8d6e01c P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
W20250625 03:30:33.219972 1708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:34293, user_credentials={real_user=slave}} blocked reactor thread for 47329.9us
I20250625 03:30:33.247486 1745 raft_consensus.cc:1238] T f9458dec7953448d8550396d67fad249 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Rejecting Update request from peer 3f2aa40978064c9e9983cf3745eed206 for earlier term 1. Current term is 2. Ops: []
I20250625 03:30:33.248095 1740 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "731095860aad436e9658ab3ff5010f9d" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:33.250638 1739 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "85e02bb33a944989ada7f600c1e802da" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:33.251678 1787 tablet_bootstrap.cc:654] T 6cc384f27ff041c0be70bb661ae610dd P 7e9c4f2e01164f33b2e9034ed148398e: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:33.248898 1738 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b15eb94b9d3d4f6987b5fa5e20193655" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:33.228238 1561 leader_election.cc:304] T 6e7283d035e1429f946d8ebb98978656 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 3f2aa40978064c9e9983cf3745eed206
I20250625 03:30:33.248483 1946 raft_consensus.cc:513] T 615cebbffcfc44e19b8f7a1e842073a3 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.255759 1921 raft_consensus.cc:2802] T 6e7283d035e1429f946d8ebb98978656 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250625 03:30:33.254885 1812 leader_election.cc:290] T 0e7eb287e9514c838aeed599d2703682 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:33.258618 1785 tablet_bootstrap.cc:654] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 3f2aa40978064c9e9983cf3745eed206: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:33.255965 1561 leader_election.cc:304] T 1fff19a38e8d4880a14da6b4c8284cc2 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e; no voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:33.257462 1921 raft_consensus.cc:491] T 6e7283d035e1429f946d8ebb98978656 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3f2aa40978064c9e9983cf3745eed206)
W20250625 03:30:33.253659 1692 debug-util.cc:398] Leaking SignalData structure 0x7b0800165860 after lost signal to thread 1528
I20250625 03:30:33.257334 1737 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dea2dcc26f144802a16f0884fdd99063" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:33.257372 1736 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0c2b6052daaa4c57aaa55361e8d6e01c" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:33.259660 1921 raft_consensus.cc:3058] T 6e7283d035e1429f946d8ebb98978656 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:30:33.260711 1926 raft_consensus.cc:2747] T 1fff19a38e8d4880a14da6b4c8284cc2 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20250625 03:30:33.262717 1636 leader_election.cc:304] T afe48b30a4e64a4d8faf2a5b42d5c706 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206; no voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:33.263329 1745 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f957bf9749c54be48094092cb80e9055" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:30:33.263406 1739 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f8c715109ff0405997e1ca9952678c0d" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:33.264096 1739 raft_consensus.cc:2466] T f8c715109ff0405997e1ca9952678c0d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 0.
I20250625 03:30:33.264197 1636 leader_election.cc:304] T 542f85d76df8432593ee963669155a9d P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206; no voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:33.264886 1736 raft_consensus.cc:2466] T 0c2b6052daaa4c57aaa55361e8d6e01c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 0.
I20250625 03:30:33.265970 1945 raft_consensus.cc:2747] T afe48b30a4e64a4d8faf2a5b42d5c706 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250625 03:30:33.265982 1841 raft_consensus.cc:513] T 465c15a46933411a985f29059fdb1c9f P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.266937 1938 raft_consensus.cc:2747] T 542f85d76df8432593ee963669155a9d P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:30:33.267184 1742 raft_consensus.cc:2466] T 542f85d76df8432593ee963669155a9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 1.
I20250625 03:30:33.268905 1953 raft_consensus.cc:2747] T 542f85d76df8432593ee963669155a9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:30:33.260988 1932 raft_consensus.cc:513] T 615cebbffcfc44e19b8f7a1e842073a3 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.261730 1671 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3c2c045dee4b4b4faa93fa9d0ccdaa1c" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:33.270783 1841 leader_election.cc:290] T 465c15a46933411a985f29059fdb1c9f P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
W20250625 03:30:33.272143 1635 leader_election.cc:343] T f8c715109ff0405997e1ca9952678c0d P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:33.274865 1739 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f957bf9749c54be48094092cb80e9055" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
W20250625 03:30:33.275496 1635 leader_election.cc:343] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:33.275779 1919 leader_election.cc:290] T f9458dec7953448d8550396d67fad249 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 2 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:33.274447 1596 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "615cebbffcfc44e19b8f7a1e842073a3" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
I20250625 03:30:33.271384 1946 leader_election.cc:290] T 615cebbffcfc44e19b8f7a1e842073a3 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:33.277796 1932 leader_election.cc:290] T 615cebbffcfc44e19b8f7a1e842073a3 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 election: Requested vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:33.278676 1671 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "615cebbffcfc44e19b8f7a1e842073a3" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:30:33.279490 1671 raft_consensus.cc:2391] T 615cebbffcfc44e19b8f7a1e842073a3 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e9c4f2e01164f33b2e9034ed148398e in current term 1: Already voted for candidate 3f2aa40978064c9e9983cf3745eed206 in this term.
I20250625 03:30:33.280718 1596 raft_consensus.cc:2391] T 615cebbffcfc44e19b8f7a1e842073a3 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f2aa40978064c9e9983cf3745eed206 in current term 1: Already voted for candidate 7e9c4f2e01164f33b2e9034ed148398e in this term.
W20250625 03:30:33.281196 1692 debug-util.cc:398] Leaking SignalData structure 0x7b080022f5a0 after lost signal to thread 1620
W20250625 03:30:33.282557 1692 debug-util.cc:398] Leaking SignalData structure 0x7b080022fde0 after lost signal to thread 1695
W20250625 03:30:33.283730 1692 debug-util.cc:398] Leaking SignalData structure 0x7b08002253c0 after lost signal to thread 1769
W20250625 03:30:33.284034 1561 leader_election.cc:343] T f957bf9749c54be48094092cb80e9055 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:33.284974 1561 leader_election.cc:304] T f957bf9749c54be48094092cb80e9055 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e; no voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:33.288002 1932 raft_consensus.cc:2747] T f957bf9749c54be48094092cb80e9055 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20250625 03:30:33.292639 1636 leader_election.cc:304] T 40b74a261fdd495f84ceb0690f0b30ba P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206; no voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:33.294011 1636 leader_election.cc:304] T fb6e83db706647e28e491a02f1641980 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206; no voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:33.286074 1739 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "615cebbffcfc44e19b8f7a1e842073a3" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:30:33.295223 1739 raft_consensus.cc:3058] T 615cebbffcfc44e19b8f7a1e842073a3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:33.295183 1945 raft_consensus.cc:2747] T 40b74a261fdd495f84ceb0690f0b30ba P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250625 03:30:33.300843 1786 raft_consensus.cc:357] T d50c52b197294003b238a37da2fb55d8 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.301362 1786 raft_consensus.cc:383] T d50c52b197294003b238a37da2fb55d8 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:33.301599 1786 raft_consensus.cc:738] T d50c52b197294003b238a37da2fb55d8 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Initialized, Role: FOLLOWER
I20250625 03:30:33.303066 1671 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6cc384f27ff041c0be70bb661ae610dd" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:33.296684 1946 raft_consensus.cc:2747] T fb6e83db706647e28e491a02f1641980 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250625 03:30:33.304855 1636 leader_election.cc:304] T d9038fc1ce0d4b528c02c68012e1277d P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206; no voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1
W20250625 03:30:33.289244 1709 leader_election.cc:343] T f8c715109ff0405997e1ca9952678c0d P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:33.302079 1786 consensus_queue.cc:260] T d50c52b197294003b238a37da2fb55d8 P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.311586 1671 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6e7283d035e1429f946d8ebb98978656" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:33.307904 1946 raft_consensus.cc:2747] T d9038fc1ce0d4b528c02c68012e1277d P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20250625 03:30:33.306340 1636 leader_election.cc:343] T f957bf9749c54be48094092cb80e9055 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:33.323895 1921 raft_consensus.cc:513] T 6e7283d035e1429f946d8ebb98978656 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
W20250625 03:30:33.322218 1636 leader_election.cc:343] T af4573692c104d67994dbb1bc518b568 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:33.325201 1636 leader_election.cc:304] T af4573692c104d67994dbb1bc518b568 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206; no voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:33.326085 1946 raft_consensus.cc:2747] T af4573692c104d67994dbb1bc518b568 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:30:33.326457 1636 leader_election.cc:304] T 1fff19a38e8d4880a14da6b4c8284cc2 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206; no voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:33.326830 1671 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6e7283d035e1429f946d8ebb98978656" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:30:33.327492 1946 raft_consensus.cc:2747] T 1fff19a38e8d4880a14da6b4c8284cc2 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250625 03:30:33.328475 1636 leader_election.cc:304] T e4034c33d83e4a96a187eaed46416e3c P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206; no voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:33.329629 1744 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "615cebbffcfc44e19b8f7a1e842073a3" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:30:33.330724 1921 leader_election.cc:290] T 6e7283d035e1429f946d8ebb98978656 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 2 election: Requested vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:33.332110 1742 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6e7283d035e1429f946d8ebb98978656" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:30:33.333257 1668 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9643cfd400804eb8b9037c5e9efddfba" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:33.333628 1667 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0c2b6052daaa4c57aaa55361e8d6e01c" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
W20250625 03:30:33.334199 1708 leader_election.cc:343] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:33.335834 1596 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "465c15a46933411a985f29059fdb1c9f" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
I20250625 03:30:33.360699 1708 leader_election.cc:304] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:33.336567 1595 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f9458dec7953448d8550396d67fad249" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
I20250625 03:30:33.362736 1708 leader_election.cc:304] T 6cc384f27ff041c0be70bb661ae610dd P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e
W20250625 03:30:33.363729 1709 leader_election.cc:343] T 465c15a46933411a985f29059fdb1c9f P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:33.363983 1953 raft_consensus.cc:2747] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:30:33.337941 1670 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f8c715109ff0405997e1ca9952678c0d" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:33.337913 1671 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f9458dec7953448d8550396d67fad249" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:33.325861 1786 ts_tablet_manager.cc:1428] T d50c52b197294003b238a37da2fb55d8 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent starting tablet: real 0.167s user 0.007s sys 0.001s
I20250625 03:30:33.364167 1812 raft_consensus.cc:2747] T 6cc384f27ff041c0be70bb661ae610dd P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250625 03:30:33.364881 1670 raft_consensus.cc:2466] T f8c715109ff0405997e1ca9952678c0d P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 0.
I20250625 03:30:33.350212 1494 catalog_manager.cc:5582] T 542f85d76df8432593ee963669155a9d P 7e9c4f2e01164f33b2e9034ed148398e reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129). New cstate: current_term: 1 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } }
I20250625 03:30:33.364161 1708 leader_election.cc:304] T 6e7283d035e1429f946d8ebb98978656 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:33.365592 1786 tablet_bootstrap.cc:492] T e88f79ed06514e01a9bc48261a5acfbb P ba464e89e0f044a0a0ea3e6125cbf2a1: Bootstrap starting.
I20250625 03:30:33.341648 1594 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0e7eb287e9514c838aeed599d2703682" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
I20250625 03:30:33.340902 1666 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0e7eb287e9514c838aeed599d2703682" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:30:33.367792 1667 raft_consensus.cc:2466] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 0.
I20250625 03:30:33.376286 1739 raft_consensus.cc:2466] T 615cebbffcfc44e19b8f7a1e842073a3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 1.
W20250625 03:30:33.376634 1709 leader_election.cc:343] T 0e7eb287e9514c838aeed599d2703682 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:33.377971 1670 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f9458dec7953448d8550396d67fad249" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:30:33.368868 1937 raft_consensus.cc:2747] T e4034c33d83e4a96a187eaed46416e3c P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250625 03:30:33.372634 1636 leader_election.cc:304] T 731095860aad436e9658ab3ff5010f9d P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206; no voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:33.381678 1946 raft_consensus.cc:2747] T 731095860aad436e9658ab3ff5010f9d P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250625 03:30:33.382440 1636 leader_election.cc:304] T b15eb94b9d3d4f6987b5fa5e20193655 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206; no voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:33.384172 1938 raft_consensus.cc:2747] T b15eb94b9d3d4f6987b5fa5e20193655 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250625 03:30:33.386037 1561 leader_election.cc:304] T 6e7283d035e1429f946d8ebb98978656 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e; no voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:33.387255 1561 leader_election.cc:304] T 615cebbffcfc44e19b8f7a1e842073a3 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 3f2aa40978064c9e9983cf3745eed206
I20250625 03:30:33.387641 1932 raft_consensus.cc:2747] T 6e7283d035e1429f946d8ebb98978656 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20250625 03:30:33.387908 1785 tablet_bootstrap.cc:492] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 3f2aa40978064c9e9983cf3745eed206: No bootstrap required, opened a new log
I20250625 03:30:33.388060 1926 raft_consensus.cc:2802] T 615cebbffcfc44e19b8f7a1e842073a3 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:30:33.388888 1665 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "465c15a46933411a985f29059fdb1c9f" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:30:33.392702 1665 raft_consensus.cc:3058] T 465c15a46933411a985f29059fdb1c9f P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:33.382444 1946 consensus_queue.cc:1046] T f9458dec7953448d8550396d67fad249 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20250625 03:30:33.388427 1666 raft_consensus.cc:3058] T 0e7eb287e9514c838aeed599d2703682 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:33.391808 1785 ts_tablet_manager.cc:1397] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 3f2aa40978064c9e9983cf3745eed206: Time spent bootstrapping tablet: real 0.238s user 0.009s sys 0.022s
I20250625 03:30:33.397250 1708 leader_election.cc:304] T f8c715109ff0405997e1ca9952678c0d P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:33.398190 1919 raft_consensus.cc:2802] T f8c715109ff0405997e1ca9952678c0d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:30:33.398589 1919 raft_consensus.cc:491] T f8c715109ff0405997e1ca9952678c0d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:30:33.392724 1926 raft_consensus.cc:695] T 615cebbffcfc44e19b8f7a1e842073a3 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 LEADER]: Becoming Leader. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Running, Role: LEADER
I20250625 03:30:33.398973 1919 raft_consensus.cc:3058] T f8c715109ff0405997e1ca9952678c0d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:33.399605 1926 consensus_queue.cc:237] T 615cebbffcfc44e19b8f7a1e842073a3 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.398674 1708 leader_election.cc:304] T 9643cfd400804eb8b9037c5e9efddfba P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:33.393236 1592 raft_consensus.cc:1238] T 1fff19a38e8d4880a14da6b4c8284cc2 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Rejecting Update request from peer ba464e89e0f044a0a0ea3e6125cbf2a1 for earlier term 1. Current term is 2. Ops: []
I20250625 03:30:33.406010 1787 tablet_bootstrap.cc:492] T 6cc384f27ff041c0be70bb661ae610dd P 7e9c4f2e01164f33b2e9034ed148398e: No bootstrap required, opened a new log
I20250625 03:30:33.406685 1787 ts_tablet_manager.cc:1397] T 6cc384f27ff041c0be70bb661ae610dd P 7e9c4f2e01164f33b2e9034ed148398e: Time spent bootstrapping tablet: real 0.383s user 0.024s sys 0.031s
I20250625 03:30:33.383796 1636 leader_election.cc:304] T 85e02bb33a944989ada7f600c1e802da P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206; no voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:33.408977 1951 raft_consensus.cc:2747] T 9643cfd400804eb8b9037c5e9efddfba P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250625 03:30:33.412937 1951 consensus_queue.cc:1046] T 1fff19a38e8d4880a14da6b4c8284cc2 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20250625 03:30:33.415119 1951 raft_consensus.cc:3053] T 1fff19a38e8d4880a14da6b4c8284cc2 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:30:33.415453 1951 raft_consensus.cc:738] T 1fff19a38e8d4880a14da6b4c8284cc2 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Running, Role: LEADER
I20250625 03:30:33.416358 1937 raft_consensus.cc:2747] T 85e02bb33a944989ada7f600c1e802da P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250625 03:30:33.417279 1938 raft_consensus.cc:3053] T f9458dec7953448d8550396d67fad249 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:30:33.417668 1938 raft_consensus.cc:738] T f9458dec7953448d8550396d67fad249 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Running, Role: LEADER
I20250625 03:30:33.417747 1951 consensus_queue.cc:260] T 1fff19a38e8d4880a14da6b4c8284cc2 P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } }
I20250625 03:30:33.420586 1951 raft_consensus.cc:3058] T 1fff19a38e8d4880a14da6b4c8284cc2 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:30:33.418514 1938 consensus_queue.cc:260] T f9458dec7953448d8550396d67fad249 P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.426802 1812 raft_consensus.cc:2747] T 6e7283d035e1429f946d8ebb98978656 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:30:33.427219 1636 leader_election.cc:304] T dea2dcc26f144802a16f0884fdd99063 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206; no voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:33.425642 1785 raft_consensus.cc:357] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.431393 1785 raft_consensus.cc:383] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:33.431658 1785 raft_consensus.cc:738] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Initialized, Role: FOLLOWER
I20250625 03:30:33.432152 1785 consensus_queue.cc:260] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.436961 1786 tablet_bootstrap.cc:654] T e88f79ed06514e01a9bc48261a5acfbb P ba464e89e0f044a0a0ea3e6125cbf2a1: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:33.436043 1708 leader_election.cc:304] T f9458dec7953448d8550396d67fad249 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:33.438433 1953 raft_consensus.cc:2747] T f9458dec7953448d8550396d67fad249 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20250625 03:30:33.427800 1666 raft_consensus.cc:2466] T 0e7eb287e9514c838aeed599d2703682 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 1.
I20250625 03:30:33.438478 1938 raft_consensus.cc:3058] T f9458dec7953448d8550396d67fad249 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:30:33.439425 1787 raft_consensus.cc:357] T 6cc384f27ff041c0be70bb661ae610dd P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.440119 1787 raft_consensus.cc:383] T 6cc384f27ff041c0be70bb661ae610dd P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:33.440407 1787 raft_consensus.cc:738] T 6cc384f27ff041c0be70bb661ae610dd P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Initialized, Role: FOLLOWER
W20250625 03:30:33.441565 1636 leader_election.cc:343] T f957bf9749c54be48094092cb80e9055 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:33.442432 1946 raft_consensus.cc:2747] T dea2dcc26f144802a16f0884fdd99063 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250625 03:30:33.442063 1636 leader_election.cc:304] T f957bf9749c54be48094092cb80e9055 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206; no voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:33.443692 1946 raft_consensus.cc:2747] T f957bf9749c54be48094092cb80e9055 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20250625 03:30:33.444779 1636 leader_election.cc:304] T f8c715109ff0405997e1ca9952678c0d P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:33.445574 1946 raft_consensus.cc:2802] T f8c715109ff0405997e1ca9952678c0d P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:30:33.445927 1946 raft_consensus.cc:491] T f8c715109ff0405997e1ca9952678c0d P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:30:33.446331 1946 raft_consensus.cc:3058] T f8c715109ff0405997e1ca9952678c0d P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:33.448419 1953 raft_consensus.cc:491] T d50c52b197294003b238a37da2fb55d8 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:33.445991 1708 leader_election.cc:304] T 0c2b6052daaa4c57aaa55361e8d6e01c P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:33.448720 1636 leader_election.cc:304] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:33.449359 1812 raft_consensus.cc:2802] T 0c2b6052daaa4c57aaa55361e8d6e01c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:30:33.448913 1953 raft_consensus.cc:513] T d50c52b197294003b238a37da2fb55d8 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.450726 1708 leader_election.cc:304] T 0e7eb287e9514c838aeed599d2703682 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:33.451365 1953 leader_election.cc:290] T d50c52b197294003b238a37da2fb55d8 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:33.451634 1841 raft_consensus.cc:2802] T 0e7eb287e9514c838aeed599d2703682 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:30:33.452251 1841 raft_consensus.cc:695] T 0e7eb287e9514c838aeed599d2703682 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Becoming Leader. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Running, Role: LEADER
I20250625 03:30:33.449790 1812 raft_consensus.cc:491] T 0c2b6052daaa4c57aaa55361e8d6e01c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:30:33.452827 1812 raft_consensus.cc:3058] T 0c2b6052daaa4c57aaa55361e8d6e01c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:33.453145 1841 consensus_queue.cc:237] T 0e7eb287e9514c838aeed599d2703682 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.456776 1593 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d50c52b197294003b238a37da2fb55d8" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:33.457351 1945 raft_consensus.cc:2802] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:30:33.457276 1787 consensus_queue.cc:260] T 6cc384f27ff041c0be70bb661ae610dd P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.457830 1945 raft_consensus.cc:491] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:30:33.458223 1945 raft_consensus.cc:3058] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:33.459728 1785 ts_tablet_manager.cc:1428] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 3f2aa40978064c9e9983cf3745eed206: Time spent starting tablet: real 0.065s user 0.006s sys 0.000s
I20250625 03:30:33.460810 1785 tablet_bootstrap.cc:492] T 9f7fbf33df3d429ab16f0ae3a2684207 P 3f2aa40978064c9e9983cf3745eed206: Bootstrap starting.
I20250625 03:30:33.460827 1787 ts_tablet_manager.cc:1428] T 6cc384f27ff041c0be70bb661ae610dd P 7e9c4f2e01164f33b2e9034ed148398e: Time spent starting tablet: real 0.054s user 0.004s sys 0.004s
I20250625 03:30:33.462229 1787 tablet_bootstrap.cc:492] T 0c2b6052daaa4c57aaa55361e8d6e01c P 7e9c4f2e01164f33b2e9034ed148398e: Bootstrap starting.
I20250625 03:30:33.469110 1593 raft_consensus.cc:1238] T 6e7283d035e1429f946d8ebb98978656 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Rejecting Update request from peer 3f2aa40978064c9e9983cf3745eed206 for earlier term 1. Current term is 2. Ops: []
I20250625 03:30:33.470906 1937 consensus_queue.cc:1046] T 6e7283d035e1429f946d8ebb98978656 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:30:33.473517 1665 raft_consensus.cc:2466] T 465c15a46933411a985f29059fdb1c9f P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 1.
I20250625 03:30:33.488322 1972 raft_consensus.cc:3053] T 6e7283d035e1429f946d8ebb98978656 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:30:33.488873 1972 raft_consensus.cc:738] T 6e7283d035e1429f946d8ebb98978656 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Running, Role: LEADER
W20250625 03:30:33.489229 1636 consensus_peers.cc:487] T d50c52b197294003b238a37da2fb55d8 P 3f2aa40978064c9e9983cf3745eed206 -> Peer ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): Couldn't send request to peer ba464e89e0f044a0a0ea3e6125cbf2a1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:30:33.489755 1972 consensus_queue.cc:260] T 6e7283d035e1429f946d8ebb98978656 P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.490234 1636 leader_election.cc:304] T 615cebbffcfc44e19b8f7a1e842073a3 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206; no voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:33.490911 1972 raft_consensus.cc:3058] T 6e7283d035e1429f946d8ebb98978656 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:30:33.490967 1974 raft_consensus.cc:2747] T 615cebbffcfc44e19b8f7a1e842073a3 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20250625 03:30:33.493511 1592 raft_consensus.cc:3058] T 6cc384f27ff041c0be70bb661ae610dd P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:33.464601 1919 raft_consensus.cc:513] T f8c715109ff0405997e1ca9952678c0d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.501776 1665 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d50c52b197294003b238a37da2fb55d8" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:33.471792 1812 raft_consensus.cc:513] T 0c2b6052daaa4c57aaa55361e8d6e01c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.521729 1593 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0c2b6052daaa4c57aaa55361e8d6e01c" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
I20250625 03:30:33.523797 1787 tablet_bootstrap.cc:654] T 0c2b6052daaa4c57aaa55361e8d6e01c P 7e9c4f2e01164f33b2e9034ed148398e: Neither blocks nor log segments found. Creating new log.
W20250625 03:30:33.527045 1709 leader_election.cc:343] T 0c2b6052daaa4c57aaa55361e8d6e01c P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:33.528589 1812 leader_election.cc:290] T 0c2b6052daaa4c57aaa55361e8d6e01c P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:33.543552 1786 tablet_bootstrap.cc:492] T e88f79ed06514e01a9bc48261a5acfbb P ba464e89e0f044a0a0ea3e6125cbf2a1: No bootstrap required, opened a new log
I20250625 03:30:33.544275 1786 ts_tablet_manager.cc:1397] T e88f79ed06514e01a9bc48261a5acfbb P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent bootstrapping tablet: real 0.179s user 0.017s sys 0.009s
I20250625 03:30:33.545819 1593 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f8c715109ff0405997e1ca9952678c0d" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
I20250625 03:30:33.546380 1945 raft_consensus.cc:513] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.547408 1786 raft_consensus.cc:357] T e88f79ed06514e01a9bc48261a5acfbb P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.548233 1786 raft_consensus.cc:383] T e88f79ed06514e01a9bc48261a5acfbb P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:33.548058 1946 raft_consensus.cc:513] T f8c715109ff0405997e1ca9952678c0d P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.548561 1786 raft_consensus.cc:738] T e88f79ed06514e01a9bc48261a5acfbb P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Initialized, Role: FOLLOWER
I20250625 03:30:33.548401 1945 leader_election.cc:290] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:33.549968 1946 leader_election.cc:290] T f8c715109ff0405997e1ca9952678c0d P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:33.550196 1786 consensus_queue.cc:260] T e88f79ed06514e01a9bc48261a5acfbb P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.550668 1919 leader_election.cc:290] T f8c715109ff0405997e1ca9952678c0d P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:33.551151 1594 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f8c715109ff0405997e1ca9952678c0d" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
W20250625 03:30:33.553068 1635 leader_election.cc:343] T f8c715109ff0405997e1ca9952678c0d P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:33.554428 1786 ts_tablet_manager.cc:1428] T e88f79ed06514e01a9bc48261a5acfbb P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent starting tablet: real 0.010s user 0.006s sys 0.000s
I20250625 03:30:33.554893 1926 consensus_queue.cc:1035] T 542f85d76df8432593ee963669155a9d P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:30:33.555521 1786 tablet_bootstrap.cc:492] T f957bf9749c54be48094092cb80e9055 P ba464e89e0f044a0a0ea3e6125cbf2a1: Bootstrap starting.
I20250625 03:30:33.554539 1785 tablet_bootstrap.cc:654] T 9f7fbf33df3d429ab16f0ae3a2684207 P 3f2aa40978064c9e9983cf3745eed206: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:33.557262 1708 leader_election.cc:304] T 465c15a46933411a985f29059fdb1c9f P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:33.560698 1593 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0c2b6052daaa4c57aaa55361e8d6e01c" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
W20250625 03:30:33.562009 1709 leader_election.cc:343] T f8c715109ff0405997e1ca9952678c0d P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
W20250625 03:30:33.562743 1635 leader_election.cc:343] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:33.562908 1665 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0c2b6052daaa4c57aaa55361e8d6e01c" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:30:33.563815 1665 raft_consensus.cc:2391] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in current term 1: Already voted for candidate 3f2aa40978064c9e9983cf3745eed206 in this term.
I20250625 03:30:33.567775 1841 raft_consensus.cc:2802] T 465c15a46933411a985f29059fdb1c9f P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:30:33.568379 1708 leader_election.cc:304] T d50c52b197294003b238a37da2fb55d8 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:33.568552 1841 raft_consensus.cc:695] T 465c15a46933411a985f29059fdb1c9f P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Becoming Leader. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Running, Role: LEADER
I20250625 03:30:33.571553 1950 raft_consensus.cc:2747] T d50c52b197294003b238a37da2fb55d8 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:30:33.570529 1841 consensus_queue.cc:237] T 465c15a46933411a985f29059fdb1c9f P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.580142 1743 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0c2b6052daaa4c57aaa55361e8d6e01c" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:30:33.582482 1743 raft_consensus.cc:2391] T 0c2b6052daaa4c57aaa55361e8d6e01c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f2aa40978064c9e9983cf3745eed206 in current term 1: Already voted for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in this term.
I20250625 03:30:33.586166 1743 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f8c715109ff0405997e1ca9952678c0d" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:30:33.586998 1743 raft_consensus.cc:2391] T f8c715109ff0405997e1ca9952678c0d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f2aa40978064c9e9983cf3745eed206 in current term 1: Already voted for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in this term.
I20250625 03:30:33.588258 1708 leader_election.cc:304] T 0c2b6052daaa4c57aaa55361e8d6e01c P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:33.589174 1950 raft_consensus.cc:2747] T 0c2b6052daaa4c57aaa55361e8d6e01c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20250625 03:30:33.591404 1665 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f8c715109ff0405997e1ca9952678c0d" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:30:33.592356 1665 raft_consensus.cc:2391] T f8c715109ff0405997e1ca9952678c0d P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in current term 1: Already voted for candidate 3f2aa40978064c9e9983cf3745eed206 in this term.
I20250625 03:30:33.592576 1636 leader_election.cc:304] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206; no voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:33.602263 1787 tablet_bootstrap.cc:492] T 0c2b6052daaa4c57aaa55361e8d6e01c P 7e9c4f2e01164f33b2e9034ed148398e: No bootstrap required, opened a new log
I20250625 03:30:33.602833 1787 ts_tablet_manager.cc:1397] T 0c2b6052daaa4c57aaa55361e8d6e01c P 7e9c4f2e01164f33b2e9034ed148398e: Time spent bootstrapping tablet: real 0.141s user 0.012s sys 0.010s
I20250625 03:30:33.603616 1786 tablet_bootstrap.cc:654] T f957bf9749c54be48094092cb80e9055 P ba464e89e0f044a0a0ea3e6125cbf2a1: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:33.607429 1945 raft_consensus.cc:2747] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20250625 03:30:33.610100 1491 catalog_manager.cc:5582] T 0e7eb287e9514c838aeed599d2703682 P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: HEALTHY } } }
I20250625 03:30:33.614507 1943 consensus_queue.cc:1035] T 542f85d76df8432593ee963669155a9d P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:30:33.622768 1787 raft_consensus.cc:357] T 0c2b6052daaa4c57aaa55361e8d6e01c P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.623706 1785 tablet_bootstrap.cc:492] T 9f7fbf33df3d429ab16f0ae3a2684207 P 3f2aa40978064c9e9983cf3745eed206: No bootstrap required, opened a new log
I20250625 03:30:33.623976 1787 raft_consensus.cc:383] T 0c2b6052daaa4c57aaa55361e8d6e01c P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:33.624720 1787 raft_consensus.cc:738] T 0c2b6052daaa4c57aaa55361e8d6e01c P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Initialized, Role: FOLLOWER
I20250625 03:30:33.624966 1785 ts_tablet_manager.cc:1397] T 9f7fbf33df3d429ab16f0ae3a2684207 P 3f2aa40978064c9e9983cf3745eed206: Time spent bootstrapping tablet: real 0.164s user 0.019s sys 0.002s
I20250625 03:30:33.625505 1787 consensus_queue.cc:260] T 0c2b6052daaa4c57aaa55361e8d6e01c P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.634346 1785 raft_consensus.cc:357] T 9f7fbf33df3d429ab16f0ae3a2684207 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.635094 1785 raft_consensus.cc:383] T 9f7fbf33df3d429ab16f0ae3a2684207 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:33.635365 1785 raft_consensus.cc:738] T 9f7fbf33df3d429ab16f0ae3a2684207 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Initialized, Role: FOLLOWER
I20250625 03:30:33.632092 1787 ts_tablet_manager.cc:1428] T 0c2b6052daaa4c57aaa55361e8d6e01c P 7e9c4f2e01164f33b2e9034ed148398e: Time spent starting tablet: real 0.029s user 0.003s sys 0.005s
I20250625 03:30:33.635958 1785 consensus_queue.cc:260] T 9f7fbf33df3d429ab16f0ae3a2684207 P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.627871 1636 leader_election.cc:304] T f8c715109ff0405997e1ca9952678c0d P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206; no voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:33.638994 1787 tablet_bootstrap.cc:492] T af4573692c104d67994dbb1bc518b568 P 7e9c4f2e01164f33b2e9034ed148398e: Bootstrap starting.
I20250625 03:30:33.602289 1708 leader_election.cc:304] T f8c715109ff0405997e1ca9952678c0d P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:33.649591 1946 raft_consensus.cc:2747] T f8c715109ff0405997e1ca9952678c0d P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20250625 03:30:33.655246 1493 catalog_manager.cc:5582] T 465c15a46933411a985f29059fdb1c9f P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: HEALTHY } } }
I20250625 03:30:33.664322 1494 catalog_manager.cc:5582] T 615cebbffcfc44e19b8f7a1e842073a3 P 7e9c4f2e01164f33b2e9034ed148398e reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129). New cstate: current_term: 1 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } }
I20250625 03:30:33.665529 1785 ts_tablet_manager.cc:1428] T 9f7fbf33df3d429ab16f0ae3a2684207 P 3f2aa40978064c9e9983cf3745eed206: Time spent starting tablet: real 0.039s user 0.003s sys 0.003s
I20250625 03:30:33.677439 1786 tablet_bootstrap.cc:492] T f957bf9749c54be48094092cb80e9055 P ba464e89e0f044a0a0ea3e6125cbf2a1: No bootstrap required, opened a new log
I20250625 03:30:33.677691 1785 tablet_bootstrap.cc:492] T 96030b80e1f340afa81659faaaf68755 P 3f2aa40978064c9e9983cf3745eed206: Bootstrap starting.
I20250625 03:30:33.677909 1786 ts_tablet_manager.cc:1397] T f957bf9749c54be48094092cb80e9055 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent bootstrapping tablet: real 0.123s user 0.024s sys 0.016s
I20250625 03:30:33.683247 1786 raft_consensus.cc:357] T f957bf9749c54be48094092cb80e9055 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.683983 1786 raft_consensus.cc:383] T f957bf9749c54be48094092cb80e9055 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:33.684281 1786 raft_consensus.cc:738] T f957bf9749c54be48094092cb80e9055 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Initialized, Role: FOLLOWER
I20250625 03:30:33.685029 1786 consensus_queue.cc:260] T f957bf9749c54be48094092cb80e9055 P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.671059 1787 tablet_bootstrap.cc:654] T af4573692c104d67994dbb1bc518b568 P 7e9c4f2e01164f33b2e9034ed148398e: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:33.671388 1841 raft_consensus.cc:2747] T f8c715109ff0405997e1ca9952678c0d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20250625 03:30:33.687469 1786 ts_tablet_manager.cc:1428] T f957bf9749c54be48094092cb80e9055 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent starting tablet: real 0.009s user 0.000s sys 0.006s
I20250625 03:30:33.698100 1786 tablet_bootstrap.cc:492] T 9f7fbf33df3d429ab16f0ae3a2684207 P ba464e89e0f044a0a0ea3e6125cbf2a1: Bootstrap starting.
I20250625 03:30:33.701617 1785 tablet_bootstrap.cc:654] T 96030b80e1f340afa81659faaaf68755 P 3f2aa40978064c9e9983cf3745eed206: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:33.709086 1786 tablet_bootstrap.cc:654] T 9f7fbf33df3d429ab16f0ae3a2684207 P ba464e89e0f044a0a0ea3e6125cbf2a1: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:33.722522 1785 tablet_bootstrap.cc:492] T 96030b80e1f340afa81659faaaf68755 P 3f2aa40978064c9e9983cf3745eed206: No bootstrap required, opened a new log
I20250625 03:30:33.722632 1787 tablet_bootstrap.cc:492] T af4573692c104d67994dbb1bc518b568 P 7e9c4f2e01164f33b2e9034ed148398e: No bootstrap required, opened a new log
I20250625 03:30:33.723088 1785 ts_tablet_manager.cc:1397] T 96030b80e1f340afa81659faaaf68755 P 3f2aa40978064c9e9983cf3745eed206: Time spent bootstrapping tablet: real 0.046s user 0.004s sys 0.008s
I20250625 03:30:33.723270 1787 ts_tablet_manager.cc:1397] T af4573692c104d67994dbb1bc518b568 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent bootstrapping tablet: real 0.086s user 0.008s sys 0.005s
I20250625 03:30:33.725982 1785 raft_consensus.cc:357] T 96030b80e1f340afa81659faaaf68755 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.726738 1785 raft_consensus.cc:383] T 96030b80e1f340afa81659faaaf68755 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:33.727010 1785 raft_consensus.cc:738] T 96030b80e1f340afa81659faaaf68755 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Initialized, Role: FOLLOWER
I20250625 03:30:33.727372 1787 raft_consensus.cc:357] T af4573692c104d67994dbb1bc518b568 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.727890 1841 raft_consensus.cc:491] T e88f79ed06514e01a9bc48261a5acfbb P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:33.728140 1787 raft_consensus.cc:383] T af4573692c104d67994dbb1bc518b568 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:33.728909 1787 raft_consensus.cc:738] T af4573692c104d67994dbb1bc518b568 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Initialized, Role: FOLLOWER
I20250625 03:30:33.728401 1841 raft_consensus.cc:513] T e88f79ed06514e01a9bc48261a5acfbb P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.728204 1785 consensus_queue.cc:260] T 96030b80e1f340afa81659faaaf68755 P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.729676 1787 consensus_queue.cc:260] T af4573692c104d67994dbb1bc518b568 P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.732044 1666 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e88f79ed06514e01a9bc48261a5acfbb" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:33.732421 1787 ts_tablet_manager.cc:1428] T af4573692c104d67994dbb1bc518b568 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent starting tablet: real 0.009s user 0.002s sys 0.009s
I20250625 03:30:33.732825 1593 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e88f79ed06514e01a9bc48261a5acfbb" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
W20250625 03:30:33.733438 1708 leader_election.cc:343] T e88f79ed06514e01a9bc48261a5acfbb P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:33.734041 1787 tablet_bootstrap.cc:492] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 7e9c4f2e01164f33b2e9034ed148398e: Bootstrap starting.
I20250625 03:30:33.733987 1841 leader_election.cc:290] T e88f79ed06514e01a9bc48261a5acfbb P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
W20250625 03:30:33.734256 1709 leader_election.cc:343] T e88f79ed06514e01a9bc48261a5acfbb P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:33.734752 1709 leader_election.cc:304] T e88f79ed06514e01a9bc48261a5acfbb P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:33.737543 1841 raft_consensus.cc:2747] T e88f79ed06514e01a9bc48261a5acfbb P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:30:33.740338 1785 ts_tablet_manager.cc:1428] T 96030b80e1f340afa81659faaaf68755 P 3f2aa40978064c9e9983cf3745eed206: Time spent starting tablet: real 0.017s user 0.007s sys 0.000s
I20250625 03:30:33.741585 1785 tablet_bootstrap.cc:492] T 7553473daeb342ceaf782ddee8e4fc4d P 3f2aa40978064c9e9983cf3745eed206: Bootstrap starting.
I20250625 03:30:33.742019 1787 tablet_bootstrap.cc:654] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 7e9c4f2e01164f33b2e9034ed148398e: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:33.748132 1785 tablet_bootstrap.cc:654] T 7553473daeb342ceaf782ddee8e4fc4d P 3f2aa40978064c9e9983cf3745eed206: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:33.750272 1946 raft_consensus.cc:491] T 9f7fbf33df3d429ab16f0ae3a2684207 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:33.750770 1946 raft_consensus.cc:513] T 9f7fbf33df3d429ab16f0ae3a2684207 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.752705 1946 leader_election.cc:290] T 9f7fbf33df3d429ab16f0ae3a2684207 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:33.755282 1593 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9f7fbf33df3d429ab16f0ae3a2684207" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:33.756572 1739 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9f7fbf33df3d429ab16f0ae3a2684207" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
W20250625 03:30:33.758306 1635 leader_election.cc:343] T 9f7fbf33df3d429ab16f0ae3a2684207 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
W20250625 03:30:33.759197 1636 leader_election.cc:343] T 9f7fbf33df3d429ab16f0ae3a2684207 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:33.759809 1636 leader_election.cc:304] T 9f7fbf33df3d429ab16f0ae3a2684207 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206; no voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:33.761261 1946 raft_consensus.cc:2747] T 9f7fbf33df3d429ab16f0ae3a2684207 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:30:33.761859 1786 tablet_bootstrap.cc:492] T 9f7fbf33df3d429ab16f0ae3a2684207 P ba464e89e0f044a0a0ea3e6125cbf2a1: No bootstrap required, opened a new log
I20250625 03:30:33.762329 1786 ts_tablet_manager.cc:1397] T 9f7fbf33df3d429ab16f0ae3a2684207 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent bootstrapping tablet: real 0.064s user 0.017s sys 0.026s
I20250625 03:30:33.768090 1785 tablet_bootstrap.cc:492] T 7553473daeb342ceaf782ddee8e4fc4d P 3f2aa40978064c9e9983cf3745eed206: No bootstrap required, opened a new log
I20250625 03:30:33.768700 1785 ts_tablet_manager.cc:1397] T 7553473daeb342ceaf782ddee8e4fc4d P 3f2aa40978064c9e9983cf3745eed206: Time spent bootstrapping tablet: real 0.027s user 0.010s sys 0.006s
I20250625 03:30:33.768944 1786 raft_consensus.cc:357] T 9f7fbf33df3d429ab16f0ae3a2684207 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.769721 1786 raft_consensus.cc:383] T 9f7fbf33df3d429ab16f0ae3a2684207 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:33.770005 1786 raft_consensus.cc:738] T 9f7fbf33df3d429ab16f0ae3a2684207 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Initialized, Role: FOLLOWER
I20250625 03:30:33.770838 1786 consensus_queue.cc:260] T 9f7fbf33df3d429ab16f0ae3a2684207 P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.771912 1785 raft_consensus.cc:357] T 7553473daeb342ceaf782ddee8e4fc4d P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.772665 1785 raft_consensus.cc:383] T 7553473daeb342ceaf782ddee8e4fc4d P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:33.774148 1785 raft_consensus.cc:738] T 7553473daeb342ceaf782ddee8e4fc4d P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Initialized, Role: FOLLOWER
I20250625 03:30:33.775180 1787 tablet_bootstrap.cc:492] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 7e9c4f2e01164f33b2e9034ed148398e: No bootstrap required, opened a new log
I20250625 03:30:33.775652 1787 ts_tablet_manager.cc:1397] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 7e9c4f2e01164f33b2e9034ed148398e: Time spent bootstrapping tablet: real 0.042s user 0.010s sys 0.008s
I20250625 03:30:33.774835 1785 consensus_queue.cc:260] T 7553473daeb342ceaf782ddee8e4fc4d P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.777987 1785 ts_tablet_manager.cc:1428] T 7553473daeb342ceaf782ddee8e4fc4d P 3f2aa40978064c9e9983cf3745eed206: Time spent starting tablet: real 0.009s user 0.006s sys 0.000s
I20250625 03:30:33.779345 1787 raft_consensus.cc:357] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.779999 1787 raft_consensus.cc:383] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:33.780283 1787 raft_consensus.cc:738] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Initialized, Role: FOLLOWER
I20250625 03:30:33.780864 1787 consensus_queue.cc:260] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.782843 1787 ts_tablet_manager.cc:1428] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 7e9c4f2e01164f33b2e9034ed148398e: Time spent starting tablet: real 0.007s user 0.001s sys 0.002s
I20250625 03:30:33.782951 1786 ts_tablet_manager.cc:1428] T 9f7fbf33df3d429ab16f0ae3a2684207 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent starting tablet: real 0.020s user 0.006s sys 0.002s
I20250625 03:30:33.784929 1787 tablet_bootstrap.cc:492] T 9b7de80fbd7d4625aac41dea0457fd3e P 7e9c4f2e01164f33b2e9034ed148398e: Bootstrap starting.
I20250625 03:30:33.789866 1785 tablet_bootstrap.cc:492] T 393f73bcf106475cbee7a645b0d9660c P 3f2aa40978064c9e9983cf3745eed206: Bootstrap starting.
I20250625 03:30:33.791256 1787 tablet_bootstrap.cc:654] T 9b7de80fbd7d4625aac41dea0457fd3e P 7e9c4f2e01164f33b2e9034ed148398e: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:33.793385 1786 tablet_bootstrap.cc:492] T fd279ddcf72a40e1bf2ec42a4f35e639 P ba464e89e0f044a0a0ea3e6125cbf2a1: Bootstrap starting.
I20250625 03:30:33.797214 1785 tablet_bootstrap.cc:654] T 393f73bcf106475cbee7a645b0d9660c P 3f2aa40978064c9e9983cf3745eed206: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:33.811630 1786 tablet_bootstrap.cc:654] T fd279ddcf72a40e1bf2ec42a4f35e639 P ba464e89e0f044a0a0ea3e6125cbf2a1: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:33.820163 1787 tablet_bootstrap.cc:492] T 9b7de80fbd7d4625aac41dea0457fd3e P 7e9c4f2e01164f33b2e9034ed148398e: No bootstrap required, opened a new log
I20250625 03:30:33.820583 1787 ts_tablet_manager.cc:1397] T 9b7de80fbd7d4625aac41dea0457fd3e P 7e9c4f2e01164f33b2e9034ed148398e: Time spent bootstrapping tablet: real 0.036s user 0.002s sys 0.009s
I20250625 03:30:33.823783 1785 tablet_bootstrap.cc:492] T 393f73bcf106475cbee7a645b0d9660c P 3f2aa40978064c9e9983cf3745eed206: No bootstrap required, opened a new log
I20250625 03:30:33.824378 1785 ts_tablet_manager.cc:1397] T 393f73bcf106475cbee7a645b0d9660c P 3f2aa40978064c9e9983cf3745eed206: Time spent bootstrapping tablet: real 0.035s user 0.007s sys 0.005s
I20250625 03:30:33.824512 1787 raft_consensus.cc:357] T 9b7de80fbd7d4625aac41dea0457fd3e P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.825241 1787 raft_consensus.cc:383] T 9b7de80fbd7d4625aac41dea0457fd3e P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:33.825454 1787 raft_consensus.cc:738] T 9b7de80fbd7d4625aac41dea0457fd3e P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Initialized, Role: FOLLOWER
I20250625 03:30:33.825950 1787 consensus_queue.cc:260] T 9b7de80fbd7d4625aac41dea0457fd3e P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.828786 1785 raft_consensus.cc:357] T 393f73bcf106475cbee7a645b0d9660c P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.830353 1785 raft_consensus.cc:383] T 393f73bcf106475cbee7a645b0d9660c P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:33.830691 1785 raft_consensus.cc:738] T 393f73bcf106475cbee7a645b0d9660c P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Initialized, Role: FOLLOWER
I20250625 03:30:33.832842 1787 ts_tablet_manager.cc:1428] T 9b7de80fbd7d4625aac41dea0457fd3e P 7e9c4f2e01164f33b2e9034ed148398e: Time spent starting tablet: real 0.012s user 0.006s sys 0.000s
I20250625 03:30:33.836844 1787 tablet_bootstrap.cc:492] T 465c15a46933411a985f29059fdb1c9f P 7e9c4f2e01164f33b2e9034ed148398e: Bootstrap starting.
I20250625 03:30:33.831364 1785 consensus_queue.cc:260] T 393f73bcf106475cbee7a645b0d9660c P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.851014 1785 ts_tablet_manager.cc:1428] T 393f73bcf106475cbee7a645b0d9660c P 3f2aa40978064c9e9983cf3745eed206: Time spent starting tablet: real 0.026s user 0.004s sys 0.002s
I20250625 03:30:33.857326 1785 tablet_bootstrap.cc:492] T fd279ddcf72a40e1bf2ec42a4f35e639 P 3f2aa40978064c9e9983cf3745eed206: Bootstrap starting.
I20250625 03:30:33.860817 1786 tablet_bootstrap.cc:492] T fd279ddcf72a40e1bf2ec42a4f35e639 P ba464e89e0f044a0a0ea3e6125cbf2a1: No bootstrap required, opened a new log
I20250625 03:30:33.861287 1786 ts_tablet_manager.cc:1397] T fd279ddcf72a40e1bf2ec42a4f35e639 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent bootstrapping tablet: real 0.068s user 0.005s sys 0.011s
I20250625 03:30:33.863883 1786 raft_consensus.cc:357] T fd279ddcf72a40e1bf2ec42a4f35e639 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.864619 1786 raft_consensus.cc:383] T fd279ddcf72a40e1bf2ec42a4f35e639 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:33.864905 1786 raft_consensus.cc:738] T fd279ddcf72a40e1bf2ec42a4f35e639 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Initialized, Role: FOLLOWER
I20250625 03:30:33.865571 1786 consensus_queue.cc:260] T fd279ddcf72a40e1bf2ec42a4f35e639 P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.867841 1786 ts_tablet_manager.cc:1428] T fd279ddcf72a40e1bf2ec42a4f35e639 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20250625 03:30:33.869203 1787 tablet_bootstrap.cc:654] T 465c15a46933411a985f29059fdb1c9f P 7e9c4f2e01164f33b2e9034ed148398e: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:33.869282 1786 tablet_bootstrap.cc:492] T 93ecdce2da094dc9a80ac04828771fbd P ba464e89e0f044a0a0ea3e6125cbf2a1: Bootstrap starting.
I20250625 03:30:33.869895 1785 tablet_bootstrap.cc:654] T fd279ddcf72a40e1bf2ec42a4f35e639 P 3f2aa40978064c9e9983cf3745eed206: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:33.875864 1786 tablet_bootstrap.cc:654] T 93ecdce2da094dc9a80ac04828771fbd P ba464e89e0f044a0a0ea3e6125cbf2a1: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:33.887777 1787 tablet_bootstrap.cc:492] T 465c15a46933411a985f29059fdb1c9f P 7e9c4f2e01164f33b2e9034ed148398e: No bootstrap required, opened a new log
I20250625 03:30:33.889024 1787 ts_tablet_manager.cc:1397] T 465c15a46933411a985f29059fdb1c9f P 7e9c4f2e01164f33b2e9034ed148398e: Time spent bootstrapping tablet: real 0.052s user 0.013s sys 0.003s
I20250625 03:30:33.891414 1785 tablet_bootstrap.cc:492] T fd279ddcf72a40e1bf2ec42a4f35e639 P 3f2aa40978064c9e9983cf3745eed206: No bootstrap required, opened a new log
I20250625 03:30:33.892163 1785 ts_tablet_manager.cc:1397] T fd279ddcf72a40e1bf2ec42a4f35e639 P 3f2aa40978064c9e9983cf3745eed206: Time spent bootstrapping tablet: real 0.035s user 0.006s sys 0.008s
I20250625 03:30:33.894547 1943 consensus_queue.cc:1035] T 615cebbffcfc44e19b8f7a1e842073a3 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:30:33.898908 1787 raft_consensus.cc:357] T 465c15a46933411a985f29059fdb1c9f P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.901991 1787 raft_consensus.cc:383] T 465c15a46933411a985f29059fdb1c9f P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:33.902386 1787 raft_consensus.cc:738] T 465c15a46933411a985f29059fdb1c9f P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Initialized, Role: FOLLOWER
I20250625 03:30:33.901265 1785 raft_consensus.cc:357] T fd279ddcf72a40e1bf2ec42a4f35e639 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.902873 1785 raft_consensus.cc:383] T fd279ddcf72a40e1bf2ec42a4f35e639 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:33.903208 1785 raft_consensus.cc:738] T fd279ddcf72a40e1bf2ec42a4f35e639 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Initialized, Role: FOLLOWER
I20250625 03:30:33.904026 1785 consensus_queue.cc:260] T fd279ddcf72a40e1bf2ec42a4f35e639 P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.904549 1943 consensus_queue.cc:1035] T 615cebbffcfc44e19b8f7a1e842073a3 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:30:33.912643 1785 ts_tablet_manager.cc:1428] T fd279ddcf72a40e1bf2ec42a4f35e639 P 3f2aa40978064c9e9983cf3745eed206: Time spent starting tablet: real 0.020s user 0.006s sys 0.000s
I20250625 03:30:33.915546 1785 tablet_bootstrap.cc:492] T 9943bb8023444f49a11df01d93738f1e P 3f2aa40978064c9e9983cf3745eed206: Bootstrap starting.
I20250625 03:30:33.922097 1785 tablet_bootstrap.cc:654] T 9943bb8023444f49a11df01d93738f1e P 3f2aa40978064c9e9983cf3745eed206: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:33.913558 1787 consensus_queue.cc:260] T 465c15a46933411a985f29059fdb1c9f P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.923861 1787 ts_tablet_manager.cc:1428] T 465c15a46933411a985f29059fdb1c9f P 7e9c4f2e01164f33b2e9034ed148398e: Time spent starting tablet: real 0.029s user 0.002s sys 0.005s
I20250625 03:30:33.924918 1787 tablet_bootstrap.cc:492] T f8c715109ff0405997e1ca9952678c0d P 7e9c4f2e01164f33b2e9034ed148398e: Bootstrap starting.
I20250625 03:30:33.931180 1787 tablet_bootstrap.cc:654] T f8c715109ff0405997e1ca9952678c0d P 7e9c4f2e01164f33b2e9034ed148398e: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:33.945329 1787 tablet_bootstrap.cc:492] T f8c715109ff0405997e1ca9952678c0d P 7e9c4f2e01164f33b2e9034ed148398e: No bootstrap required, opened a new log
I20250625 03:30:33.948863 1787 ts_tablet_manager.cc:1397] T f8c715109ff0405997e1ca9952678c0d P 7e9c4f2e01164f33b2e9034ed148398e: Time spent bootstrapping tablet: real 0.024s user 0.010s sys 0.004s
I20250625 03:30:33.948144 1785 tablet_bootstrap.cc:492] T 9943bb8023444f49a11df01d93738f1e P 3f2aa40978064c9e9983cf3745eed206: No bootstrap required, opened a new log
I20250625 03:30:33.952611 1946 raft_consensus.cc:491] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:33.953194 1946 raft_consensus.cc:513] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.957954 1593 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3c2c045dee4b4b4faa93fa9d0ccdaa1c" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:33.958719 1593 raft_consensus.cc:2466] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 0.
I20250625 03:30:33.960687 1743 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3c2c045dee4b4b4faa93fa9d0ccdaa1c" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
W20250625 03:30:33.960958 1542 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20250625 03:30:33.961385 1743 raft_consensus.cc:2466] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 0.
I20250625 03:30:33.963621 1636 leader_election.cc:304] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters:
I20250625 03:30:33.964203 1786 tablet_bootstrap.cc:492] T 93ecdce2da094dc9a80ac04828771fbd P ba464e89e0f044a0a0ea3e6125cbf2a1: No bootstrap required, opened a new log
I20250625 03:30:33.964660 1786 ts_tablet_manager.cc:1397] T 93ecdce2da094dc9a80ac04828771fbd P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent bootstrapping tablet: real 0.096s user 0.017s sys 0.000s
I20250625 03:30:33.965407 1945 raft_consensus.cc:2802] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:30:33.965790 1945 raft_consensus.cc:491] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:30:33.966125 1945 raft_consensus.cc:3058] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:33.966253 1943 raft_consensus.cc:491] T 9b7de80fbd7d4625aac41dea0457fd3e P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:33.966921 1943 raft_consensus.cc:513] T 9b7de80fbd7d4625aac41dea0457fd3e P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.974715 1943 leader_election.cc:290] T 9b7de80fbd7d4625aac41dea0457fd3e P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:33.955276 1946 leader_election.cc:290] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:33.976250 1665 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9b7de80fbd7d4625aac41dea0457fd3e" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:33.977494 1743 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9b7de80fbd7d4625aac41dea0457fd3e" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
W20250625 03:30:33.987466 1561 leader_election.cc:343] T 9b7de80fbd7d4625aac41dea0457fd3e P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): Illegal state: must be running to vote when last-logged opid is not known
W20250625 03:30:33.988296 1559 leader_election.cc:343] T 9b7de80fbd7d4625aac41dea0457fd3e P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:33.988730 1559 leader_election.cc:304] T 9b7de80fbd7d4625aac41dea0457fd3e P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e; no voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:33.988318 1785 ts_tablet_manager.cc:1397] T 9943bb8023444f49a11df01d93738f1e P 3f2aa40978064c9e9983cf3745eed206: Time spent bootstrapping tablet: real 0.073s user 0.011s sys 0.003s
I20250625 03:30:33.990712 1943 raft_consensus.cc:2747] T 9b7de80fbd7d4625aac41dea0457fd3e P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:30:33.991895 1974 raft_consensus.cc:491] T 96030b80e1f340afa81659faaaf68755 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:33.989408 1945 raft_consensus.cc:513] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.992413 1974 raft_consensus.cc:513] T 96030b80e1f340afa81659faaaf68755 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:33.995088 1593 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3c2c045dee4b4b4faa93fa9d0ccdaa1c" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
I20250625 03:30:33.995652 1593 raft_consensus.cc:3058] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:33.995718 1974 leader_election.cc:290] T 96030b80e1f340afa81659faaaf68755 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:33.998987 1594 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "96030b80e1f340afa81659faaaf68755" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
W20250625 03:30:34.000460 1635 leader_election.cc:343] T 96030b80e1f340afa81659faaaf68755 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:33.991838 1743 raft_consensus.cc:3058] T d50c52b197294003b238a37da2fb55d8 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:34.004525 1945 leader_election.cc:290] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:34.005132 1739 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "96030b80e1f340afa81659faaaf68755" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:34.005652 1787 raft_consensus.cc:357] T f8c715109ff0405997e1ca9952678c0d P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.006119 1744 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3c2c045dee4b4b4faa93fa9d0ccdaa1c" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:30:34.006326 1787 raft_consensus.cc:383] T f8c715109ff0405997e1ca9952678c0d P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:34.006747 1787 raft_consensus.cc:738] T f8c715109ff0405997e1ca9952678c0d P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Initialized, Role: FOLLOWER
I20250625 03:30:34.006775 1744 raft_consensus.cc:3058] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:34.007498 1786 raft_consensus.cc:357] T 93ecdce2da094dc9a80ac04828771fbd P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.008699 1786 raft_consensus.cc:383] T 93ecdce2da094dc9a80ac04828771fbd P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:34.009764 1786 raft_consensus.cc:738] T 93ecdce2da094dc9a80ac04828771fbd P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Initialized, Role: FOLLOWER
I20250625 03:30:34.009920 1951 consensus_queue.cc:1035] T 0e7eb287e9514c838aeed599d2703682 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:30:34.009291 1593 raft_consensus.cc:2466] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 1.
I20250625 03:30:34.011268 1635 leader_election.cc:304] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e; no voters:
I20250625 03:30:34.007354 1785 raft_consensus.cc:357] T 9943bb8023444f49a11df01d93738f1e P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.012205 1785 raft_consensus.cc:383] T 9943bb8023444f49a11df01d93738f1e P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:34.012526 1785 raft_consensus.cc:738] T 9943bb8023444f49a11df01d93738f1e P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Initialized, Role: FOLLOWER
I20250625 03:30:34.013273 1785 consensus_queue.cc:260] T 9943bb8023444f49a11df01d93738f1e P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
W20250625 03:30:34.014832 1636 leader_election.cc:343] T 96030b80e1f340afa81659faaaf68755 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:34.014019 1744 raft_consensus.cc:2466] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 1.
I20250625 03:30:34.024183 1636 leader_election.cc:304] T 96030b80e1f340afa81659faaaf68755 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206; no voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:34.026099 1945 raft_consensus.cc:2747] T 96030b80e1f340afa81659faaaf68755 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250625 03:30:34.033059 1709 consensus_peers.cc:487] T 0e7eb287e9514c838aeed599d2703682 P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:30:34.035995 1945 raft_consensus.cc:491] T 7553473daeb342ceaf782ddee8e4fc4d P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:34.036787 1945 raft_consensus.cc:513] T 7553473daeb342ceaf782ddee8e4fc4d P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.039003 1945 leader_election.cc:290] T 7553473daeb342ceaf782ddee8e4fc4d P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:34.040494 1592 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7553473daeb342ceaf782ddee8e4fc4d" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
W20250625 03:30:34.042376 1635 leader_election.cc:343] T 7553473daeb342ceaf782ddee8e4fc4d P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:34.043273 1744 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7553473daeb342ceaf782ddee8e4fc4d" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
W20250625 03:30:34.044595 1636 leader_election.cc:343] T 7553473daeb342ceaf782ddee8e4fc4d P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:34.045120 1636 leader_election.cc:304] T 7553473daeb342ceaf782ddee8e4fc4d P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206; no voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:34.051627 1975 raft_consensus.cc:2747] T 7553473daeb342ceaf782ddee8e4fc4d P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:30:34.014108 1786 consensus_queue.cc:260] T 93ecdce2da094dc9a80ac04828771fbd P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.055939 1785 ts_tablet_manager.cc:1428] T 9943bb8023444f49a11df01d93738f1e P 3f2aa40978064c9e9983cf3745eed206: Time spent starting tablet: real 0.066s user 0.005s sys 0.000s
I20250625 03:30:34.007681 1787 consensus_queue.cc:260] T f8c715109ff0405997e1ca9952678c0d P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.058183 1787 ts_tablet_manager.cc:1428] T f8c715109ff0405997e1ca9952678c0d P 7e9c4f2e01164f33b2e9034ed148398e: Time spent starting tablet: real 0.109s user 0.006s sys 0.000s
I20250625 03:30:34.013779 1974 raft_consensus.cc:2802] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:30:34.058863 1974 raft_consensus.cc:695] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Becoming Leader. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Running, Role: LEADER
I20250625 03:30:34.059736 1974 consensus_queue.cc:237] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.060487 1786 ts_tablet_manager.cc:1428] T 93ecdce2da094dc9a80ac04828771fbd P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent starting tablet: real 0.096s user 0.007s sys 0.000s
I20250625 03:30:34.061764 1785 tablet_bootstrap.cc:492] T 93ecdce2da094dc9a80ac04828771fbd P 3f2aa40978064c9e9983cf3745eed206: Bootstrap starting.
I20250625 03:30:34.061601 1921 raft_consensus.cc:491] T 0c2b6052daaa4c57aaa55361e8d6e01c P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:34.062969 1786 tablet_bootstrap.cc:492] T af4573692c104d67994dbb1bc518b568 P ba464e89e0f044a0a0ea3e6125cbf2a1: Bootstrap starting.
I20250625 03:30:34.062722 1921 raft_consensus.cc:513] T 0c2b6052daaa4c57aaa55361e8d6e01c P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.064666 1921 leader_election.cc:290] T 0c2b6052daaa4c57aaa55361e8d6e01c P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:34.067059 1665 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0c2b6052daaa4c57aaa55361e8d6e01c" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:34.067912 1743 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0c2b6052daaa4c57aaa55361e8d6e01c" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:34.068728 1743 raft_consensus.cc:2391] T 0c2b6052daaa4c57aaa55361e8d6e01c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e9c4f2e01164f33b2e9034ed148398e in current term 1: Already voted for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in this term.
I20250625 03:30:34.069550 1787 tablet_bootstrap.cc:492] T fd279ddcf72a40e1bf2ec42a4f35e639 P 7e9c4f2e01164f33b2e9034ed148398e: Bootstrap starting.
I20250625 03:30:34.067847 1665 raft_consensus.cc:2391] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e9c4f2e01164f33b2e9034ed148398e in current term 1: Already voted for candidate 3f2aa40978064c9e9983cf3745eed206 in this term.
I20250625 03:30:34.074848 1592 raft_consensus.cc:3058] T 465c15a46933411a985f29059fdb1c9f P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:34.096256 1786 tablet_bootstrap.cc:654] T af4573692c104d67994dbb1bc518b568 P ba464e89e0f044a0a0ea3e6125cbf2a1: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:34.102304 1559 leader_election.cc:304] T 0c2b6052daaa4c57aaa55361e8d6e01c P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e; no voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:34.103629 1921 raft_consensus.cc:3058] T 0c2b6052daaa4c57aaa55361e8d6e01c P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:34.103806 1786 tablet_bootstrap.cc:492] T af4573692c104d67994dbb1bc518b568 P ba464e89e0f044a0a0ea3e6125cbf2a1: No bootstrap required, opened a new log
I20250625 03:30:34.104283 1786 ts_tablet_manager.cc:1397] T af4573692c104d67994dbb1bc518b568 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent bootstrapping tablet: real 0.043s user 0.006s sys 0.008s
I20250625 03:30:34.106810 1786 raft_consensus.cc:357] T af4573692c104d67994dbb1bc518b568 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.107553 1786 raft_consensus.cc:383] T af4573692c104d67994dbb1bc518b568 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:34.107949 1786 raft_consensus.cc:738] T af4573692c104d67994dbb1bc518b568 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Initialized, Role: FOLLOWER
I20250625 03:30:34.108575 1786 consensus_queue.cc:260] T af4573692c104d67994dbb1bc518b568 P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.111116 1950 consensus_queue.cc:1035] T 465c15a46933411a985f29059fdb1c9f P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:30:34.111171 1974 raft_consensus.cc:491] T 393f73bcf106475cbee7a645b0d9660c P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:34.112682 1786 ts_tablet_manager.cc:1428] T af4573692c104d67994dbb1bc518b568 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20250625 03:30:34.112413 1974 raft_consensus.cc:513] T 393f73bcf106475cbee7a645b0d9660c P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.115142 1974 leader_election.cc:290] T 393f73bcf106475cbee7a645b0d9660c P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:34.115876 1593 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "393f73bcf106475cbee7a645b0d9660c" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:34.116427 1786 tablet_bootstrap.cc:492] T 96030b80e1f340afa81659faaaf68755 P ba464e89e0f044a0a0ea3e6125cbf2a1: Bootstrap starting.
I20250625 03:30:34.121476 1951 raft_consensus.cc:491] T f957bf9749c54be48094092cb80e9055 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:34.128489 1951 raft_consensus.cc:513] T f957bf9749c54be48094092cb80e9055 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.128993 1785 tablet_bootstrap.cc:654] T 93ecdce2da094dc9a80ac04828771fbd P 3f2aa40978064c9e9983cf3745eed206: Neither blocks nor log segments found. Creating new log.
W20250625 03:30:34.129177 1635 leader_election.cc:343] T 393f73bcf106475cbee7a645b0d9660c P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:34.130998 1951 leader_election.cc:290] T f957bf9749c54be48094092cb80e9055 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
W20250625 03:30:34.121618 1636 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.131:39359, user_credentials={real_user=slave}} blocked reactor thread for 70193.6us
I20250625 03:30:34.132355 1593 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f957bf9749c54be48094092cb80e9055" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:34.133205 1593 raft_consensus.cc:2391] T f957bf9749c54be48094092cb80e9055 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in current term 1: Already voted for candidate 7e9c4f2e01164f33b2e9034ed148398e in this term.
I20250625 03:30:34.133441 1743 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "393f73bcf106475cbee7a645b0d9660c" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:34.134292 1786 tablet_bootstrap.cc:654] T 96030b80e1f340afa81659faaaf68755 P ba464e89e0f044a0a0ea3e6125cbf2a1: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:34.134748 1665 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f957bf9749c54be48094092cb80e9055" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:34.135572 1665 raft_consensus.cc:2391] T f957bf9749c54be48094092cb80e9055 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in current term 1: Already voted for candidate 3f2aa40978064c9e9983cf3745eed206 in this term.
I20250625 03:30:34.136894 1708 leader_election.cc:304] T f957bf9749c54be48094092cb80e9055 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:34.137667 1951 raft_consensus.cc:3058] T f957bf9749c54be48094092cb80e9055 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:34.137879 1921 raft_consensus.cc:2747] T 0c2b6052daaa4c57aaa55361e8d6e01c P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250625 03:30:34.135597 1636 leader_election.cc:343] T 393f73bcf106475cbee7a645b0d9660c P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:34.138943 1636 leader_election.cc:304] T 393f73bcf106475cbee7a645b0d9660c P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206; no voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:34.141822 1785 tablet_bootstrap.cc:492] T 93ecdce2da094dc9a80ac04828771fbd P 3f2aa40978064c9e9983cf3745eed206: No bootstrap required, opened a new log
I20250625 03:30:34.142293 1785 ts_tablet_manager.cc:1397] T 93ecdce2da094dc9a80ac04828771fbd P 3f2aa40978064c9e9983cf3745eed206: Time spent bootstrapping tablet: real 0.081s user 0.008s sys 0.005s
I20250625 03:30:34.142707 1974 raft_consensus.cc:2747] T 393f73bcf106475cbee7a645b0d9660c P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:30:34.126672 1950 consensus_queue.cc:1035] T 465c15a46933411a985f29059fdb1c9f P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:30:34.148370 1786 tablet_bootstrap.cc:492] T 96030b80e1f340afa81659faaaf68755 P ba464e89e0f044a0a0ea3e6125cbf2a1: No bootstrap required, opened a new log
I20250625 03:30:34.148828 1786 ts_tablet_manager.cc:1397] T 96030b80e1f340afa81659faaaf68755 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent bootstrapping tablet: real 0.034s user 0.010s sys 0.008s
I20250625 03:30:34.151158 1786 raft_consensus.cc:357] T 96030b80e1f340afa81659faaaf68755 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.151816 1786 raft_consensus.cc:383] T 96030b80e1f340afa81659faaaf68755 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:34.152088 1786 raft_consensus.cc:738] T 96030b80e1f340afa81659faaaf68755 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Initialized, Role: FOLLOWER
I20250625 03:30:34.126857 1787 tablet_bootstrap.cc:654] T fd279ddcf72a40e1bf2ec42a4f35e639 P 7e9c4f2e01164f33b2e9034ed148398e: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:34.145243 1785 raft_consensus.cc:357] T 93ecdce2da094dc9a80ac04828771fbd P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.152935 1785 raft_consensus.cc:383] T 93ecdce2da094dc9a80ac04828771fbd P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:34.152684 1786 consensus_queue.cc:260] T 96030b80e1f340afa81659faaaf68755 P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.153209 1785 raft_consensus.cc:738] T 93ecdce2da094dc9a80ac04828771fbd P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Initialized, Role: FOLLOWER
I20250625 03:30:34.153998 1785 consensus_queue.cc:260] T 93ecdce2da094dc9a80ac04828771fbd P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.144806 1951 raft_consensus.cc:2747] T f957bf9749c54be48094092cb80e9055 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:30:34.155025 1786 ts_tablet_manager.cc:1428] T 96030b80e1f340afa81659faaaf68755 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20250625 03:30:34.158603 1841 raft_consensus.cc:491] T 9f7fbf33df3d429ab16f0ae3a2684207 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:34.169535 1786 tablet_bootstrap.cc:492] T 9943bb8023444f49a11df01d93738f1e P ba464e89e0f044a0a0ea3e6125cbf2a1: Bootstrap starting.
I20250625 03:30:34.169800 1841 raft_consensus.cc:513] T 9f7fbf33df3d429ab16f0ae3a2684207 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.170226 1785 ts_tablet_manager.cc:1428] T 93ecdce2da094dc9a80ac04828771fbd P 3f2aa40978064c9e9983cf3745eed206: Time spent starting tablet: real 0.028s user 0.007s sys 0.001s
I20250625 03:30:34.171134 1785 tablet_bootstrap.cc:492] T ba2ab3296190416aa07624e6d69ba09b P 3f2aa40978064c9e9983cf3745eed206: Bootstrap starting.
I20250625 03:30:34.171670 1841 leader_election.cc:290] T 9f7fbf33df3d429ab16f0ae3a2684207 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:34.155310 1493 catalog_manager.cc:5582] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } }
I20250625 03:30:34.164155 1950 raft_consensus.cc:491] T fd279ddcf72a40e1bf2ec42a4f35e639 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:34.162870 1921 raft_consensus.cc:491] T af4573692c104d67994dbb1bc518b568 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:34.173833 1594 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9f7fbf33df3d429ab16f0ae3a2684207" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:34.175822 1950 raft_consensus.cc:513] T fd279ddcf72a40e1bf2ec42a4f35e639 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.178341 1786 tablet_bootstrap.cc:654] T 9943bb8023444f49a11df01d93738f1e P ba464e89e0f044a0a0ea3e6125cbf2a1: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:34.180361 1921 raft_consensus.cc:513] T af4573692c104d67994dbb1bc518b568 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.179970 1950 leader_election.cc:290] T fd279ddcf72a40e1bf2ec42a4f35e639 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:34.186163 1594 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fd279ddcf72a40e1bf2ec42a4f35e639" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
W20250625 03:30:34.186570 1709 leader_election.cc:343] T 9f7fbf33df3d429ab16f0ae3a2684207 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
W20250625 03:30:34.188781 1709 leader_election.cc:343] T fd279ddcf72a40e1bf2ec42a4f35e639 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:34.191370 1921 leader_election.cc:290] T af4573692c104d67994dbb1bc518b568 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:34.192355 1743 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "af4573692c104d67994dbb1bc518b568" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:34.193020 1743 raft_consensus.cc:2466] T af4573692c104d67994dbb1bc518b568 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 0.
I20250625 03:30:34.194243 1667 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fd279ddcf72a40e1bf2ec42a4f35e639" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:34.194869 1561 leader_election.cc:304] T af4573692c104d67994dbb1bc518b568 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters:
I20250625 03:30:34.195305 1667 raft_consensus.cc:2466] T fd279ddcf72a40e1bf2ec42a4f35e639 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 0.
I20250625 03:30:34.195701 1921 raft_consensus.cc:2802] T af4573692c104d67994dbb1bc518b568 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:30:34.196087 1921 raft_consensus.cc:491] T af4573692c104d67994dbb1bc518b568 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:30:34.196588 1921 raft_consensus.cc:3058] T af4573692c104d67994dbb1bc518b568 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:34.196512 1708 leader_election.cc:304] T fd279ddcf72a40e1bf2ec42a4f35e639 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:34.197382 1950 raft_consensus.cc:2802] T fd279ddcf72a40e1bf2ec42a4f35e639 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:30:34.197750 1950 raft_consensus.cc:491] T fd279ddcf72a40e1bf2ec42a4f35e639 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:30:34.198010 1950 raft_consensus.cc:3058] T fd279ddcf72a40e1bf2ec42a4f35e639 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:34.198199 1943 raft_consensus.cc:491] T f8c715109ff0405997e1ca9952678c0d P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:34.198670 1943 raft_consensus.cc:513] T f8c715109ff0405997e1ca9952678c0d P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.197960 1665 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9f7fbf33df3d429ab16f0ae3a2684207" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:34.201169 1943 leader_election.cc:290] T f8c715109ff0405997e1ca9952678c0d P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:34.201170 1665 raft_consensus.cc:2466] T 9f7fbf33df3d429ab16f0ae3a2684207 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 0.
I20250625 03:30:34.202486 1666 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "af4573692c104d67994dbb1bc518b568" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:34.202491 1743 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f8c715109ff0405997e1ca9952678c0d" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:34.203262 1666 raft_consensus.cc:2466] T af4573692c104d67994dbb1bc518b568 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 0.
I20250625 03:30:34.203485 1665 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f8c715109ff0405997e1ca9952678c0d" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:34.204071 1743 raft_consensus.cc:2391] T f8c715109ff0405997e1ca9952678c0d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e9c4f2e01164f33b2e9034ed148398e in current term 1: Already voted for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in this term.
I20250625 03:30:34.204556 1665 raft_consensus.cc:2391] T f8c715109ff0405997e1ca9952678c0d P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e9c4f2e01164f33b2e9034ed148398e in current term 1: Already voted for candidate 3f2aa40978064c9e9983cf3745eed206 in this term.
I20250625 03:30:34.205622 1786 tablet_bootstrap.cc:492] T 9943bb8023444f49a11df01d93738f1e P ba464e89e0f044a0a0ea3e6125cbf2a1: No bootstrap required, opened a new log
I20250625 03:30:34.205590 1708 leader_election.cc:304] T 9f7fbf33df3d429ab16f0ae3a2684207 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:34.207945 1559 leader_election.cc:304] T f8c715109ff0405997e1ca9952678c0d P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e; no voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:34.209197 1943 raft_consensus.cc:3058] T f8c715109ff0405997e1ca9952678c0d P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:34.210395 1921 raft_consensus.cc:513] T af4573692c104d67994dbb1bc518b568 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.206252 1786 ts_tablet_manager.cc:1397] T 9943bb8023444f49a11df01d93738f1e P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent bootstrapping tablet: real 0.037s user 0.008s sys 0.004s
I20250625 03:30:34.213819 1841 raft_consensus.cc:2802] T 9f7fbf33df3d429ab16f0ae3a2684207 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:30:34.214349 1951 raft_consensus.cc:491] T 93ecdce2da094dc9a80ac04828771fbd P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:34.218626 1951 raft_consensus.cc:513] T 93ecdce2da094dc9a80ac04828771fbd P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.220723 1665 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "af4573692c104d67994dbb1bc518b568" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:30:34.221144 1951 leader_election.cc:290] T 93ecdce2da094dc9a80ac04828771fbd P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:34.221307 1665 raft_consensus.cc:3058] T af4573692c104d67994dbb1bc518b568 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:34.217097 1841 raft_consensus.cc:491] T 9f7fbf33df3d429ab16f0ae3a2684207 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:30:34.221913 1841 raft_consensus.cc:3058] T 9f7fbf33df3d429ab16f0ae3a2684207 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:34.221861 1743 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "af4573692c104d67994dbb1bc518b568" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:30:34.222486 1743 raft_consensus.cc:3058] T af4573692c104d67994dbb1bc518b568 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:34.225358 1594 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "93ecdce2da094dc9a80ac04828771fbd" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:34.226229 1666 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "93ecdce2da094dc9a80ac04828771fbd" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:34.226871 1666 raft_consensus.cc:2466] T 93ecdce2da094dc9a80ac04828771fbd P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 0.
I20250625 03:30:34.228410 1974 raft_consensus.cc:491] T 9943bb8023444f49a11df01d93738f1e P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:34.228322 1708 leader_election.cc:304] T 93ecdce2da094dc9a80ac04828771fbd P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters:
I20250625 03:30:34.229418 1974 raft_consensus.cc:513] T 9943bb8023444f49a11df01d93738f1e P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
W20250625 03:30:34.230455 1709 leader_election.cc:343] T 93ecdce2da094dc9a80ac04828771fbd P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:34.230470 1812 raft_consensus.cc:2802] T 93ecdce2da094dc9a80ac04828771fbd P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:30:34.231014 1812 raft_consensus.cc:491] T 93ecdce2da094dc9a80ac04828771fbd P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:30:34.231329 1812 raft_consensus.cc:3058] T 93ecdce2da094dc9a80ac04828771fbd P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:34.231953 1974 leader_election.cc:290] T 9943bb8023444f49a11df01d93738f1e P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:34.232322 1943 raft_consensus.cc:2747] T f8c715109ff0405997e1ca9952678c0d P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:30:34.235261 1785 tablet_bootstrap.cc:654] T ba2ab3296190416aa07624e6d69ba09b P 3f2aa40978064c9e9983cf3745eed206: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:34.235852 1744 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9943bb8023444f49a11df01d93738f1e" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:34.237131 1593 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9943bb8023444f49a11df01d93738f1e" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
W20250625 03:30:34.239226 1635 leader_election.cc:343] T 9943bb8023444f49a11df01d93738f1e P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:34.229136 1921 leader_election.cc:290] T af4573692c104d67994dbb1bc518b568 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 election: Requested vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:34.241706 1812 raft_consensus.cc:513] T 93ecdce2da094dc9a80ac04828771fbd P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.243520 1743 raft_consensus.cc:2466] T af4573692c104d67994dbb1bc518b568 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 1.
I20250625 03:30:34.244801 1593 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "93ecdce2da094dc9a80ac04828771fbd" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
I20250625 03:30:34.245704 1666 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "93ecdce2da094dc9a80ac04828771fbd" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:30:34.246129 1812 leader_election.cc:290] T 93ecdce2da094dc9a80ac04828771fbd P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:34.248605 1666 raft_consensus.cc:3058] T 93ecdce2da094dc9a80ac04828771fbd P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Advancing to term 1
W20250625 03:30:34.249629 1709 leader_election.cc:343] T 93ecdce2da094dc9a80ac04828771fbd P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:34.251111 1786 raft_consensus.cc:357] T 9943bb8023444f49a11df01d93738f1e P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.252789 1786 raft_consensus.cc:383] T 9943bb8023444f49a11df01d93738f1e P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:34.254091 1561 leader_election.cc:304] T af4573692c104d67994dbb1bc518b568 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters:
I20250625 03:30:34.254925 1943 raft_consensus.cc:2802] T af4573692c104d67994dbb1bc518b568 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:30:34.255515 1943 raft_consensus.cc:695] T af4573692c104d67994dbb1bc518b568 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 LEADER]: Becoming Leader. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Running, Role: LEADER
I20250625 03:30:34.253471 1786 raft_consensus.cc:738] T 9943bb8023444f49a11df01d93738f1e P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Initialized, Role: FOLLOWER
I20250625 03:30:34.256875 1786 consensus_queue.cc:260] T 9943bb8023444f49a11df01d93738f1e P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.256682 1943 consensus_queue.cc:237] T af4573692c104d67994dbb1bc518b568 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.258708 1744 raft_consensus.cc:2466] T 9943bb8023444f49a11df01d93738f1e P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 0.
I20250625 03:30:34.260697 1636 leader_election.cc:304] T 9943bb8023444f49a11df01d93738f1e P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:34.264216 1974 raft_consensus.cc:2802] T 9943bb8023444f49a11df01d93738f1e P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:30:34.264597 1974 raft_consensus.cc:491] T 9943bb8023444f49a11df01d93738f1e P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:30:34.264976 1974 raft_consensus.cc:3058] T 9943bb8023444f49a11df01d93738f1e P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:34.267716 1666 raft_consensus.cc:2466] T 93ecdce2da094dc9a80ac04828771fbd P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 1.
I20250625 03:30:34.269722 1708 leader_election.cc:304] T 93ecdce2da094dc9a80ac04828771fbd P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:34.267715 1841 raft_consensus.cc:513] T 9f7fbf33df3d429ab16f0ae3a2684207 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.270264 1786 ts_tablet_manager.cc:1428] T 9943bb8023444f49a11df01d93738f1e P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent starting tablet: real 0.054s user 0.004s sys 0.003s
I20250625 03:30:34.271147 1812 raft_consensus.cc:2802] T 93ecdce2da094dc9a80ac04828771fbd P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:30:34.271569 1786 tablet_bootstrap.cc:492] T 393f73bcf106475cbee7a645b0d9660c P ba464e89e0f044a0a0ea3e6125cbf2a1: Bootstrap starting.
I20250625 03:30:34.271818 1812 raft_consensus.cc:695] T 93ecdce2da094dc9a80ac04828771fbd P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Becoming Leader. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Running, Role: LEADER
I20250625 03:30:34.275168 1593 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9f7fbf33df3d429ab16f0ae3a2684207" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
I20250625 03:30:34.277958 1812 consensus_queue.cc:237] T 93ecdce2da094dc9a80ac04828771fbd P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.275049 1950 raft_consensus.cc:513] T fd279ddcf72a40e1bf2ec42a4f35e639 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.282092 1950 leader_election.cc:290] T fd279ddcf72a40e1bf2ec42a4f35e639 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:34.281652 1787 tablet_bootstrap.cc:492] T fd279ddcf72a40e1bf2ec42a4f35e639 P 7e9c4f2e01164f33b2e9034ed148398e: No bootstrap required, opened a new log
I20250625 03:30:34.283195 1787 ts_tablet_manager.cc:1397] T fd279ddcf72a40e1bf2ec42a4f35e639 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent bootstrapping tablet: real 0.214s user 0.025s sys 0.017s
W20250625 03:30:34.282989 1709 leader_election.cc:343] T 9f7fbf33df3d429ab16f0ae3a2684207 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:34.284960 1665 raft_consensus.cc:2466] T af4573692c104d67994dbb1bc518b568 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 1.
I20250625 03:30:34.283615 1974 raft_consensus.cc:513] T 9943bb8023444f49a11df01d93738f1e P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.285822 1667 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fd279ddcf72a40e1bf2ec42a4f35e639" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:30:34.286522 1667 raft_consensus.cc:3058] T fd279ddcf72a40e1bf2ec42a4f35e639 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:34.285840 1785 tablet_bootstrap.cc:492] T ba2ab3296190416aa07624e6d69ba09b P 3f2aa40978064c9e9983cf3745eed206: No bootstrap required, opened a new log
I20250625 03:30:34.289040 1785 ts_tablet_manager.cc:1397] T ba2ab3296190416aa07624e6d69ba09b P 3f2aa40978064c9e9983cf3745eed206: Time spent bootstrapping tablet: real 0.118s user 0.009s sys 0.003s
I20250625 03:30:34.288275 1594 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9943bb8023444f49a11df01d93738f1e" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
W20250625 03:30:34.292419 1635 leader_election.cc:343] T 9943bb8023444f49a11df01d93738f1e P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:34.293329 1974 leader_election.cc:290] T 9943bb8023444f49a11df01d93738f1e P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:34.293373 1785 raft_consensus.cc:357] T ba2ab3296190416aa07624e6d69ba09b P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.294346 1785 raft_consensus.cc:383] T ba2ab3296190416aa07624e6d69ba09b P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:34.294690 1785 raft_consensus.cc:738] T ba2ab3296190416aa07624e6d69ba09b P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Initialized, Role: FOLLOWER
I20250625 03:30:34.277057 1666 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9f7fbf33df3d429ab16f0ae3a2684207" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:30:34.296066 1666 raft_consensus.cc:3058] T 9f7fbf33df3d429ab16f0ae3a2684207 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:34.287000 1593 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fd279ddcf72a40e1bf2ec42a4f35e639" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
W20250625 03:30:34.300539 1709 leader_election.cc:343] T fd279ddcf72a40e1bf2ec42a4f35e639 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:34.309314 1785 consensus_queue.cc:260] T ba2ab3296190416aa07624e6d69ba09b P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.275564 1841 leader_election.cc:290] T 9f7fbf33df3d429ab16f0ae3a2684207 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:34.300752 1744 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9943bb8023444f49a11df01d93738f1e" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:30:34.322777 1787 raft_consensus.cc:357] T fd279ddcf72a40e1bf2ec42a4f35e639 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.324281 1787 raft_consensus.cc:383] T fd279ddcf72a40e1bf2ec42a4f35e639 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:34.324851 1787 raft_consensus.cc:738] T fd279ddcf72a40e1bf2ec42a4f35e639 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Initialized, Role: FOLLOWER
I20250625 03:30:34.326519 1785 ts_tablet_manager.cc:1428] T ba2ab3296190416aa07624e6d69ba09b P 3f2aa40978064c9e9983cf3745eed206: Time spent starting tablet: real 0.037s user 0.009s sys 0.000s
I20250625 03:30:34.327749 1785 tablet_bootstrap.cc:492] T df29d87d804d44438345052a5902052f P 3f2aa40978064c9e9983cf3745eed206: Bootstrap starting.
I20250625 03:30:34.323529 1744 raft_consensus.cc:3058] T 9943bb8023444f49a11df01d93738f1e P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:34.325766 1787 consensus_queue.cc:260] T fd279ddcf72a40e1bf2ec42a4f35e639 P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.324723 1667 raft_consensus.cc:2466] T fd279ddcf72a40e1bf2ec42a4f35e639 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 1.
I20250625 03:30:34.340729 1786 tablet_bootstrap.cc:654] T 393f73bcf106475cbee7a645b0d9660c P ba464e89e0f044a0a0ea3e6125cbf2a1: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:34.341216 1708 leader_election.cc:304] T fd279ddcf72a40e1bf2ec42a4f35e639 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:34.343225 1492 catalog_manager.cc:5582] T af4573692c104d67994dbb1bc518b568 P 7e9c4f2e01164f33b2e9034ed148398e reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129). New cstate: current_term: 1 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } }
I20250625 03:30:34.349406 1812 raft_consensus.cc:2802] T fd279ddcf72a40e1bf2ec42a4f35e639 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:30:34.349789 1666 raft_consensus.cc:2466] T 9f7fbf33df3d429ab16f0ae3a2684207 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 1.
I20250625 03:30:34.349925 1812 raft_consensus.cc:695] T fd279ddcf72a40e1bf2ec42a4f35e639 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Becoming Leader. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Running, Role: LEADER
I20250625 03:30:34.350821 1812 consensus_queue.cc:237] T fd279ddcf72a40e1bf2ec42a4f35e639 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.351971 1787 ts_tablet_manager.cc:1428] T fd279ddcf72a40e1bf2ec42a4f35e639 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent starting tablet: real 0.068s user 0.007s sys 0.001s
I20250625 03:30:34.353247 1787 tablet_bootstrap.cc:492] T 0e7eb287e9514c838aeed599d2703682 P 7e9c4f2e01164f33b2e9034ed148398e: Bootstrap starting.
I20250625 03:30:34.356118 1975 raft_consensus.cc:491] T ba2ab3296190416aa07624e6d69ba09b P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:34.356925 1975 raft_consensus.cc:513] T ba2ab3296190416aa07624e6d69ba09b P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.361739 1975 leader_election.cc:290] T ba2ab3296190416aa07624e6d69ba09b P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:34.358649 1708 leader_election.cc:304] T 9f7fbf33df3d429ab16f0ae3a2684207 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:34.362915 1743 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ba2ab3296190416aa07624e6d69ba09b" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:34.363415 1593 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ba2ab3296190416aa07624e6d69ba09b" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:34.364125 1841 raft_consensus.cc:2802] T 9f7fbf33df3d429ab16f0ae3a2684207 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:30:34.364657 1841 raft_consensus.cc:695] T 9f7fbf33df3d429ab16f0ae3a2684207 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Becoming Leader. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Running, Role: LEADER
W20250625 03:30:34.364728 1635 leader_election.cc:343] T ba2ab3296190416aa07624e6d69ba09b P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:34.365291 1744 raft_consensus.cc:2466] T 9943bb8023444f49a11df01d93738f1e P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 1.
I20250625 03:30:34.365576 1841 consensus_queue.cc:237] T 9f7fbf33df3d429ab16f0ae3a2684207 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.368031 1785 tablet_bootstrap.cc:654] T df29d87d804d44438345052a5902052f P 3f2aa40978064c9e9983cf3745eed206: Neither blocks nor log segments found. Creating new log.
W20250625 03:30:34.369033 1636 leader_election.cc:343] T ba2ab3296190416aa07624e6d69ba09b P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:34.369467 1636 leader_election.cc:304] T ba2ab3296190416aa07624e6d69ba09b P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206; no voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:34.371393 1636 leader_election.cc:304] T 9943bb8023444f49a11df01d93738f1e P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:34.372439 1974 raft_consensus.cc:2747] T ba2ab3296190416aa07624e6d69ba09b P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:30:34.373078 1974 raft_consensus.cc:2802] T 9943bb8023444f49a11df01d93738f1e P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:30:34.373494 1974 raft_consensus.cc:695] T 9943bb8023444f49a11df01d93738f1e P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Becoming Leader. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Running, Role: LEADER
I20250625 03:30:34.374470 1974 consensus_queue.cc:237] T 9943bb8023444f49a11df01d93738f1e P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.394789 1787 tablet_bootstrap.cc:654] T 0e7eb287e9514c838aeed599d2703682 P 7e9c4f2e01164f33b2e9034ed148398e: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:34.415272 1786 tablet_bootstrap.cc:492] T 393f73bcf106475cbee7a645b0d9660c P ba464e89e0f044a0a0ea3e6125cbf2a1: No bootstrap required, opened a new log
I20250625 03:30:34.415757 1786 ts_tablet_manager.cc:1397] T 393f73bcf106475cbee7a645b0d9660c P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent bootstrapping tablet: real 0.145s user 0.011s sys 0.007s
I20250625 03:30:34.394842 1494 catalog_manager.cc:5582] T 93ecdce2da094dc9a80ac04828771fbd P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: HEALTHY } } }
I20250625 03:30:34.418183 1786 raft_consensus.cc:357] T 393f73bcf106475cbee7a645b0d9660c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.418866 1786 raft_consensus.cc:383] T 393f73bcf106475cbee7a645b0d9660c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:34.419567 1787 tablet_bootstrap.cc:492] T 0e7eb287e9514c838aeed599d2703682 P 7e9c4f2e01164f33b2e9034ed148398e: No bootstrap required, opened a new log
I20250625 03:30:34.419718 1786 raft_consensus.cc:738] T 393f73bcf106475cbee7a645b0d9660c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Initialized, Role: FOLLOWER
I20250625 03:30:34.420037 1787 ts_tablet_manager.cc:1397] T 0e7eb287e9514c838aeed599d2703682 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent bootstrapping tablet: real 0.067s user 0.012s sys 0.000s
I20250625 03:30:34.420360 1786 consensus_queue.cc:260] T 393f73bcf106475cbee7a645b0d9660c P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.422876 1786 ts_tablet_manager.cc:1428] T 393f73bcf106475cbee7a645b0d9660c P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20250625 03:30:34.423844 1786 tablet_bootstrap.cc:492] T 9b7de80fbd7d4625aac41dea0457fd3e P ba464e89e0f044a0a0ea3e6125cbf2a1: Bootstrap starting.
I20250625 03:30:34.430235 1786 tablet_bootstrap.cc:654] T 9b7de80fbd7d4625aac41dea0457fd3e P ba464e89e0f044a0a0ea3e6125cbf2a1: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:34.422549 1787 raft_consensus.cc:357] T 0e7eb287e9514c838aeed599d2703682 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.432658 1787 raft_consensus.cc:383] T 0e7eb287e9514c838aeed599d2703682 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:34.432996 1787 raft_consensus.cc:738] T 0e7eb287e9514c838aeed599d2703682 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Initialized, Role: FOLLOWER
I20250625 03:30:34.433856 1787 consensus_queue.cc:260] T 0e7eb287e9514c838aeed599d2703682 P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.436280 1787 ts_tablet_manager.cc:1428] T 0e7eb287e9514c838aeed599d2703682 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent starting tablet: real 0.016s user 0.006s sys 0.000s
I20250625 03:30:34.437233 1787 tablet_bootstrap.cc:492] T 9f7fbf33df3d429ab16f0ae3a2684207 P 7e9c4f2e01164f33b2e9034ed148398e: Bootstrap starting.
I20250625 03:30:34.443503 1787 tablet_bootstrap.cc:654] T 9f7fbf33df3d429ab16f0ae3a2684207 P 7e9c4f2e01164f33b2e9034ed148398e: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:34.447906 1812 raft_consensus.cc:491] T 96030b80e1f340afa81659faaaf68755 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:34.448762 1812 raft_consensus.cc:513] T 96030b80e1f340afa81659faaaf68755 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.453153 1666 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "96030b80e1f340afa81659faaaf68755" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:34.454013 1666 raft_consensus.cc:2466] T 96030b80e1f340afa81659faaaf68755 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 0.
I20250625 03:30:34.454617 1786 tablet_bootstrap.cc:492] T 9b7de80fbd7d4625aac41dea0457fd3e P ba464e89e0f044a0a0ea3e6125cbf2a1: No bootstrap required, opened a new log
I20250625 03:30:34.455116 1786 ts_tablet_manager.cc:1397] T 9b7de80fbd7d4625aac41dea0457fd3e P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent bootstrapping tablet: real 0.031s user 0.002s sys 0.010s
I20250625 03:30:34.457823 1786 raft_consensus.cc:357] T 9b7de80fbd7d4625aac41dea0457fd3e P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.458603 1786 raft_consensus.cc:383] T 9b7de80fbd7d4625aac41dea0457fd3e P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:34.455749 1708 leader_election.cc:304] T 96030b80e1f340afa81659faaaf68755 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters:
I20250625 03:30:34.458886 1786 raft_consensus.cc:738] T 9b7de80fbd7d4625aac41dea0457fd3e P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Initialized, Role: FOLLOWER
I20250625 03:30:34.459591 1786 consensus_queue.cc:260] T 9b7de80fbd7d4625aac41dea0457fd3e P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.460619 1950 raft_consensus.cc:2802] T 96030b80e1f340afa81659faaaf68755 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:30:34.460985 1950 raft_consensus.cc:491] T 96030b80e1f340afa81659faaaf68755 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:30:34.461318 1950 raft_consensus.cc:3058] T 96030b80e1f340afa81659faaaf68755 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:34.466347 1812 leader_election.cc:290] T 96030b80e1f340afa81659faaaf68755 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:34.468779 1950 raft_consensus.cc:513] T 96030b80e1f340afa81659faaaf68755 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.471913 1594 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "96030b80e1f340afa81659faaaf68755" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
W20250625 03:30:34.473484 1709 leader_election.cc:343] T 96030b80e1f340afa81659faaaf68755 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:34.476347 1666 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "96030b80e1f340afa81659faaaf68755" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:30:34.477094 1666 raft_consensus.cc:3058] T 96030b80e1f340afa81659faaaf68755 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:34.485138 1593 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "96030b80e1f340afa81659faaaf68755" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
W20250625 03:30:34.488456 1709 leader_election.cc:343] T 96030b80e1f340afa81659faaaf68755 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:34.494632 1950 leader_election.cc:290] T 96030b80e1f340afa81659faaaf68755 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:34.497589 1786 ts_tablet_manager.cc:1428] T 9b7de80fbd7d4625aac41dea0457fd3e P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent starting tablet: real 0.042s user 0.007s sys 0.001s
I20250625 03:30:34.506656 1786 tablet_bootstrap.cc:492] T 441042afd59544a4a04bf85fa69d7d55 P ba464e89e0f044a0a0ea3e6125cbf2a1: Bootstrap starting.
I20250625 03:30:34.505383 1666 raft_consensus.cc:2466] T 96030b80e1f340afa81659faaaf68755 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 1.
I20250625 03:30:34.513767 1708 leader_election.cc:304] T 96030b80e1f340afa81659faaaf68755 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:34.515229 1812 raft_consensus.cc:2802] T 96030b80e1f340afa81659faaaf68755 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:30:34.515789 1812 raft_consensus.cc:695] T 96030b80e1f340afa81659faaaf68755 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Becoming Leader. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Running, Role: LEADER
I20250625 03:30:34.516644 1812 consensus_queue.cc:237] T 96030b80e1f340afa81659faaaf68755 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.522295 1786 tablet_bootstrap.cc:654] T 441042afd59544a4a04bf85fa69d7d55 P ba464e89e0f044a0a0ea3e6125cbf2a1: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:34.535027 1786 tablet_bootstrap.cc:492] T 441042afd59544a4a04bf85fa69d7d55 P ba464e89e0f044a0a0ea3e6125cbf2a1: No bootstrap required, opened a new log
I20250625 03:30:34.535547 1786 ts_tablet_manager.cc:1397] T 441042afd59544a4a04bf85fa69d7d55 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent bootstrapping tablet: real 0.029s user 0.007s sys 0.010s
I20250625 03:30:34.534615 1494 catalog_manager.cc:5582] T 9943bb8023444f49a11df01d93738f1e P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } }
I20250625 03:30:34.542796 1950 raft_consensus.cc:491] T 9b7de80fbd7d4625aac41dea0457fd3e P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:34.543530 1950 raft_consensus.cc:513] T 9b7de80fbd7d4625aac41dea0457fd3e P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.540738 1493 catalog_manager.cc:5582] T fd279ddcf72a40e1bf2ec42a4f35e639 P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: HEALTHY } } }
I20250625 03:30:34.549198 1593 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9b7de80fbd7d4625aac41dea0457fd3e" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:34.548483 1493 catalog_manager.cc:5582] T 9f7fbf33df3d429ab16f0ae3a2684207 P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: HEALTHY } } }
I20250625 03:30:34.549927 1593 raft_consensus.cc:2466] T 9b7de80fbd7d4625aac41dea0457fd3e P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 0.
I20250625 03:30:34.551537 1666 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9b7de80fbd7d4625aac41dea0457fd3e" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:34.552235 1709 leader_election.cc:304] T 9b7de80fbd7d4625aac41dea0457fd3e P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters:
W20250625 03:30:34.553474 1708 leader_election.cc:343] T 9b7de80fbd7d4625aac41dea0457fd3e P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:34.553591 1841 raft_consensus.cc:2802] T 9b7de80fbd7d4625aac41dea0457fd3e P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:30:34.554006 1841 raft_consensus.cc:491] T 9b7de80fbd7d4625aac41dea0457fd3e P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:30:34.554344 1841 raft_consensus.cc:3058] T 9b7de80fbd7d4625aac41dea0457fd3e P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:34.560227 1786 raft_consensus.cc:357] T 441042afd59544a4a04bf85fa69d7d55 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.561229 1786 raft_consensus.cc:383] T 441042afd59544a4a04bf85fa69d7d55 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:34.561591 1786 raft_consensus.cc:738] T 441042afd59544a4a04bf85fa69d7d55 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Initialized, Role: FOLLOWER
I20250625 03:30:34.562492 1786 consensus_queue.cc:260] T 441042afd59544a4a04bf85fa69d7d55 P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.546569 1950 leader_election.cc:290] T 9b7de80fbd7d4625aac41dea0457fd3e P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:34.568307 1786 ts_tablet_manager.cc:1428] T 441042afd59544a4a04bf85fa69d7d55 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent starting tablet: real 0.032s user 0.007s sys 0.003s
I20250625 03:30:34.569326 1786 tablet_bootstrap.cc:492] T 3037be35f2054cbbabd8a47062f84244 P ba464e89e0f044a0a0ea3e6125cbf2a1: Bootstrap starting.
I20250625 03:30:34.565555 1841 raft_consensus.cc:513] T 9b7de80fbd7d4625aac41dea0457fd3e P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.574625 1785 tablet_bootstrap.cc:492] T df29d87d804d44438345052a5902052f P 3f2aa40978064c9e9983cf3745eed206: No bootstrap required, opened a new log
I20250625 03:30:34.575145 1785 ts_tablet_manager.cc:1397] T df29d87d804d44438345052a5902052f P 3f2aa40978064c9e9983cf3745eed206: Time spent bootstrapping tablet: real 0.248s user 0.036s sys 0.083s
I20250625 03:30:34.578140 1841 leader_election.cc:290] T 9b7de80fbd7d4625aac41dea0457fd3e P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:34.579689 1666 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9b7de80fbd7d4625aac41dea0457fd3e" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:30:34.583485 1785 raft_consensus.cc:357] T df29d87d804d44438345052a5902052f P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.584246 1785 raft_consensus.cc:383] T df29d87d804d44438345052a5902052f P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:34.584509 1785 raft_consensus.cc:738] T df29d87d804d44438345052a5902052f P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Initialized, Role: FOLLOWER
I20250625 03:30:34.580283 1787 tablet_bootstrap.cc:492] T 9f7fbf33df3d429ab16f0ae3a2684207 P 7e9c4f2e01164f33b2e9034ed148398e: No bootstrap required, opened a new log
I20250625 03:30:34.585289 1787 ts_tablet_manager.cc:1397] T 9f7fbf33df3d429ab16f0ae3a2684207 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent bootstrapping tablet: real 0.148s user 0.023s sys 0.036s
W20250625 03:30:34.586854 1708 leader_election.cc:343] T 9b7de80fbd7d4625aac41dea0457fd3e P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:34.578510 1593 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9b7de80fbd7d4625aac41dea0457fd3e" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
I20250625 03:30:34.587955 1593 raft_consensus.cc:3058] T 9b7de80fbd7d4625aac41dea0457fd3e P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:34.588241 1841 raft_consensus.cc:491] T 441042afd59544a4a04bf85fa69d7d55 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:34.588694 1841 raft_consensus.cc:513] T 441042afd59544a4a04bf85fa69d7d55 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.591127 1841 leader_election.cc:290] T 441042afd59544a4a04bf85fa69d7d55 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:34.591967 1594 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "441042afd59544a4a04bf85fa69d7d55" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:34.587679 1787 raft_consensus.cc:357] T 9f7fbf33df3d429ab16f0ae3a2684207 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.592607 1787 raft_consensus.cc:383] T 9f7fbf33df3d429ab16f0ae3a2684207 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:34.592895 1787 raft_consensus.cc:738] T 9f7fbf33df3d429ab16f0ae3a2684207 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Initialized, Role: FOLLOWER
I20250625 03:30:34.593529 1787 consensus_queue.cc:260] T 9f7fbf33df3d429ab16f0ae3a2684207 P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.594063 1786 tablet_bootstrap.cc:654] T 3037be35f2054cbbabd8a47062f84244 P ba464e89e0f044a0a0ea3e6125cbf2a1: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:34.595661 1787 ts_tablet_manager.cc:1428] T 9f7fbf33df3d429ab16f0ae3a2684207 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent starting tablet: real 0.010s user 0.002s sys 0.001s
I20250625 03:30:34.596612 1787 tablet_bootstrap.cc:492] T df29d87d804d44438345052a5902052f P 7e9c4f2e01164f33b2e9034ed148398e: Bootstrap starting.
I20250625 03:30:34.597440 1785 consensus_queue.cc:260] T df29d87d804d44438345052a5902052f P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.600447 1785 ts_tablet_manager.cc:1428] T df29d87d804d44438345052a5902052f P 3f2aa40978064c9e9983cf3745eed206: Time spent starting tablet: real 0.025s user 0.009s sys 0.000s
W20250625 03:30:34.593545 1709 leader_election.cc:343] T 441042afd59544a4a04bf85fa69d7d55 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:34.601385 1785 tablet_bootstrap.cc:492] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206: Bootstrap starting.
I20250625 03:30:34.603173 1666 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "441042afd59544a4a04bf85fa69d7d55" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:34.611691 1787 tablet_bootstrap.cc:654] T df29d87d804d44438345052a5902052f P 7e9c4f2e01164f33b2e9034ed148398e: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:34.612562 1786 tablet_bootstrap.cc:492] T 3037be35f2054cbbabd8a47062f84244 P ba464e89e0f044a0a0ea3e6125cbf2a1: No bootstrap required, opened a new log
I20250625 03:30:34.613071 1786 ts_tablet_manager.cc:1397] T 3037be35f2054cbbabd8a47062f84244 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent bootstrapping tablet: real 0.044s user 0.012s sys 0.012s
W20250625 03:30:34.614912 1708 leader_election.cc:343] T 441042afd59544a4a04bf85fa69d7d55 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:34.617954 1785 tablet_bootstrap.cc:654] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:34.617765 1708 leader_election.cc:304] T 441042afd59544a4a04bf85fa69d7d55 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:34.618693 1841 raft_consensus.cc:2747] T 441042afd59544a4a04bf85fa69d7d55 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:30:34.623996 1494 catalog_manager.cc:5582] T 96030b80e1f340afa81659faaaf68755 P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: HEALTHY } } }
I20250625 03:30:34.641219 1974 consensus_queue.cc:1035] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:30:34.640976 1786 raft_consensus.cc:357] T 3037be35f2054cbbabd8a47062f84244 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.641983 1786 raft_consensus.cc:383] T 3037be35f2054cbbabd8a47062f84244 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:34.642308 1786 raft_consensus.cc:738] T 3037be35f2054cbbabd8a47062f84244 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Initialized, Role: FOLLOWER
I20250625 03:30:34.642807 1593 raft_consensus.cc:2466] T 9b7de80fbd7d4625aac41dea0457fd3e P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 1.
I20250625 03:30:34.644917 1709 leader_election.cc:304] T 9b7de80fbd7d4625aac41dea0457fd3e P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 3f2aa40978064c9e9983cf3745eed206
I20250625 03:30:34.645951 1841 raft_consensus.cc:2802] T 9b7de80fbd7d4625aac41dea0457fd3e P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:30:34.643075 1786 consensus_queue.cc:260] T 3037be35f2054cbbabd8a47062f84244 P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.649544 1786 ts_tablet_manager.cc:1428] T 3037be35f2054cbbabd8a47062f84244 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent starting tablet: real 0.036s user 0.007s sys 0.000s
I20250625 03:30:34.651234 1786 tablet_bootstrap.cc:492] T 7553473daeb342ceaf782ddee8e4fc4d P ba464e89e0f044a0a0ea3e6125cbf2a1: Bootstrap starting.
I20250625 03:30:34.646502 1841 raft_consensus.cc:695] T 9b7de80fbd7d4625aac41dea0457fd3e P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Becoming Leader. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Running, Role: LEADER
I20250625 03:30:34.652532 1841 consensus_queue.cc:237] T 9b7de80fbd7d4625aac41dea0457fd3e P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.658721 1786 tablet_bootstrap.cc:654] T 7553473daeb342ceaf782ddee8e4fc4d P ba464e89e0f044a0a0ea3e6125cbf2a1: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:34.675989 1785 tablet_bootstrap.cc:492] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206: No bootstrap required, opened a new log
I20250625 03:30:34.676481 1785 ts_tablet_manager.cc:1397] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206: Time spent bootstrapping tablet: real 0.075s user 0.013s sys 0.010s
I20250625 03:30:34.676591 1786 tablet_bootstrap.cc:492] T 7553473daeb342ceaf782ddee8e4fc4d P ba464e89e0f044a0a0ea3e6125cbf2a1: No bootstrap required, opened a new log
I20250625 03:30:34.677119 1786 ts_tablet_manager.cc:1397] T 7553473daeb342ceaf782ddee8e4fc4d P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent bootstrapping tablet: real 0.026s user 0.013s sys 0.002s
I20250625 03:30:34.676777 1950 raft_consensus.cc:491] T 3037be35f2054cbbabd8a47062f84244 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:34.678618 1950 raft_consensus.cc:513] T 3037be35f2054cbbabd8a47062f84244 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.680734 1950 leader_election.cc:290] T 3037be35f2054cbbabd8a47062f84244 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:34.682597 1592 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3037be35f2054cbbabd8a47062f84244" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
W20250625 03:30:34.683993 1709 leader_election.cc:343] T 3037be35f2054cbbabd8a47062f84244 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:34.684257 1493 catalog_manager.cc:5582] T 9b7de80fbd7d4625aac41dea0457fd3e P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: HEALTHY } } }
I20250625 03:30:34.685956 1785 raft_consensus.cc:357] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.686583 1785 raft_consensus.cc:383] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:34.686501 1974 consensus_queue.cc:1035] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:30:34.686849 1785 raft_consensus.cc:738] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Initialized, Role: FOLLOWER
I20250625 03:30:34.687485 1785 consensus_queue.cc:260] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.692544 1921 raft_consensus.cc:491] T f9458dec7953448d8550396d67fad249 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f2aa40978064c9e9983cf3745eed206)
I20250625 03:30:34.693308 1921 raft_consensus.cc:513] T f9458dec7953448d8550396d67fad249 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.701244 1787 tablet_bootstrap.cc:492] T df29d87d804d44438345052a5902052f P 7e9c4f2e01164f33b2e9034ed148398e: No bootstrap required, opened a new log
I20250625 03:30:34.701735 1787 ts_tablet_manager.cc:1397] T df29d87d804d44438345052a5902052f P 7e9c4f2e01164f33b2e9034ed148398e: Time spent bootstrapping tablet: real 0.105s user 0.013s sys 0.009s
I20250625 03:30:34.704566 1943 raft_consensus.cc:491] T 0e7eb287e9514c838aeed599d2703682 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:34.705060 1943 raft_consensus.cc:513] T 0e7eb287e9514c838aeed599d2703682 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.705476 1921 leader_election.cc:290] T f9458dec7953448d8550396d67fad249 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:34.707052 1666 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f9458dec7953448d8550396d67fad249" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:34.707885 1666 raft_consensus.cc:2466] T f9458dec7953448d8550396d67fad249 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 2.
I20250625 03:30:34.708446 1667 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0e7eb287e9514c838aeed599d2703682" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:34.707052 1743 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f9458dec7953448d8550396d67fad249" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:34.709796 1743 raft_consensus.cc:2391] T f9458dec7953448d8550396d67fad249 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e9c4f2e01164f33b2e9034ed148398e in current term 2: Already voted for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in this term.
I20250625 03:30:34.711028 1559 leader_election.cc:304] T f9458dec7953448d8550396d67fad249 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e; no voters:
I20250625 03:30:34.711180 1739 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0e7eb287e9514c838aeed599d2703682" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:34.711869 1787 raft_consensus.cc:357] T df29d87d804d44438345052a5902052f P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.712555 1787 raft_consensus.cc:383] T df29d87d804d44438345052a5902052f P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:34.712847 1787 raft_consensus.cc:738] T df29d87d804d44438345052a5902052f P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Initialized, Role: FOLLOWER
I20250625 03:30:34.707221 1943 leader_election.cc:290] T 0e7eb287e9514c838aeed599d2703682 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:34.713435 1561 leader_election.cc:304] T 0e7eb287e9514c838aeed599d2703682 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e; no voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:34.714058 1943 raft_consensus.cc:2802] T f9458dec7953448d8550396d67fad249 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250625 03:30:34.714418 1943 raft_consensus.cc:491] T f9458dec7953448d8550396d67fad249 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3f2aa40978064c9e9983cf3745eed206)
I20250625 03:30:34.714792 1943 raft_consensus.cc:3058] T f9458dec7953448d8550396d67fad249 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:30:34.715052 1786 raft_consensus.cc:357] T 7553473daeb342ceaf782ddee8e4fc4d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.715732 1786 raft_consensus.cc:383] T 7553473daeb342ceaf782ddee8e4fc4d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:34.716033 1786 raft_consensus.cc:738] T 7553473daeb342ceaf782ddee8e4fc4d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Initialized, Role: FOLLOWER
I20250625 03:30:34.716135 1667 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3037be35f2054cbbabd8a47062f84244" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:34.716688 1786 consensus_queue.cc:260] T 7553473daeb342ceaf782ddee8e4fc4d P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.718811 1786 ts_tablet_manager.cc:1428] T 7553473daeb342ceaf782ddee8e4fc4d P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent starting tablet: real 0.041s user 0.005s sys 0.000s
I20250625 03:30:34.719811 1786 tablet_bootstrap.cc:492] T ba2ab3296190416aa07624e6d69ba09b P ba464e89e0f044a0a0ea3e6125cbf2a1: Bootstrap starting.
I20250625 03:30:34.721647 1785 ts_tablet_manager.cc:1428] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206: Time spent starting tablet: real 0.045s user 0.010s sys 0.004s
I20250625 03:30:34.722173 1921 raft_consensus.cc:2747] T 0e7eb287e9514c838aeed599d2703682 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:30:34.722738 1785 tablet_bootstrap.cc:492] T 9b7de80fbd7d4625aac41dea0457fd3e P 3f2aa40978064c9e9983cf3745eed206: Bootstrap starting.
I20250625 03:30:34.728581 1785 tablet_bootstrap.cc:654] T 9b7de80fbd7d4625aac41dea0457fd3e P 3f2aa40978064c9e9983cf3745eed206: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:34.713464 1787 consensus_queue.cc:260] T df29d87d804d44438345052a5902052f P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
W20250625 03:30:34.732558 1708 leader_election.cc:343] T 3037be35f2054cbbabd8a47062f84244 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:34.733722 1708 leader_election.cc:304] T 3037be35f2054cbbabd8a47062f84244 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:34.736680 1950 raft_consensus.cc:2747] T 3037be35f2054cbbabd8a47062f84244 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:30:34.747339 2036 raft_consensus.cc:491] T fd279ddcf72a40e1bf2ec42a4f35e639 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:34.748142 2036 raft_consensus.cc:513] T fd279ddcf72a40e1bf2ec42a4f35e639 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.750630 1943 raft_consensus.cc:513] T f9458dec7953448d8550396d67fad249 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.750679 1786 tablet_bootstrap.cc:654] T ba2ab3296190416aa07624e6d69ba09b P ba464e89e0f044a0a0ea3e6125cbf2a1: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:34.755620 1787 ts_tablet_manager.cc:1428] T df29d87d804d44438345052a5902052f P 7e9c4f2e01164f33b2e9034ed148398e: Time spent starting tablet: real 0.054s user 0.009s sys 0.006s
I20250625 03:30:34.758834 1787 tablet_bootstrap.cc:492] T e88f79ed06514e01a9bc48261a5acfbb P 7e9c4f2e01164f33b2e9034ed148398e: Bootstrap starting.
I20250625 03:30:34.767241 1943 leader_election.cc:290] T f9458dec7953448d8550396d67fad249 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 2 election: Requested vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:34.767480 1739 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f9458dec7953448d8550396d67fad249" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:30:34.768432 1739 raft_consensus.cc:2391] T f9458dec7953448d8550396d67fad249 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e9c4f2e01164f33b2e9034ed148398e in current term 2: Already voted for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in this term.
I20250625 03:30:34.774631 1666 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f9458dec7953448d8550396d67fad249" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:30:34.782688 1785 tablet_bootstrap.cc:492] T 9b7de80fbd7d4625aac41dea0457fd3e P 3f2aa40978064c9e9983cf3745eed206: No bootstrap required, opened a new log
I20250625 03:30:34.783177 1785 ts_tablet_manager.cc:1397] T 9b7de80fbd7d4625aac41dea0457fd3e P 3f2aa40978064c9e9983cf3745eed206: Time spent bootstrapping tablet: real 0.061s user 0.011s sys 0.002s
I20250625 03:30:34.785791 1785 raft_consensus.cc:357] T 9b7de80fbd7d4625aac41dea0457fd3e P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.786474 1785 raft_consensus.cc:383] T 9b7de80fbd7d4625aac41dea0457fd3e P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:34.786759 1785 raft_consensus.cc:738] T 9b7de80fbd7d4625aac41dea0457fd3e P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Initialized, Role: FOLLOWER
I20250625 03:30:34.787366 1785 consensus_queue.cc:260] T 9b7de80fbd7d4625aac41dea0457fd3e P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.790103 1785 ts_tablet_manager.cc:1428] T 9b7de80fbd7d4625aac41dea0457fd3e P 3f2aa40978064c9e9983cf3745eed206: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20250625 03:30:34.790264 1950 consensus_queue.cc:1035] T fd279ddcf72a40e1bf2ec42a4f35e639 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:30:34.791148 1785 tablet_bootstrap.cc:492] T b31026f89f1e49949acec419db9649d3 P 3f2aa40978064c9e9983cf3745eed206: Bootstrap starting.
I20250625 03:30:34.796554 2036 leader_election.cc:290] T fd279ddcf72a40e1bf2ec42a4f35e639 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:34.797745 1592 raft_consensus.cc:3058] T fd279ddcf72a40e1bf2ec42a4f35e639 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:34.797883 1739 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fd279ddcf72a40e1bf2ec42a4f35e639" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:34.793257 1665 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fd279ddcf72a40e1bf2ec42a4f35e639" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:34.812937 1559 leader_election.cc:304] T fd279ddcf72a40e1bf2ec42a4f35e639 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e; no voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:34.828773 2036 raft_consensus.cc:2747] T fd279ddcf72a40e1bf2ec42a4f35e639 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:30:34.829012 1950 consensus_queue.cc:1035] T fd279ddcf72a40e1bf2ec42a4f35e639 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20250625 03:30:34.840454 1921 consensus_queue.cc:1035] T af4573692c104d67994dbb1bc518b568 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20250625 03:30:34.843367 1841 consensus_queue.cc:1035] T 93ecdce2da094dc9a80ac04828771fbd P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:30:34.830659 1787 tablet_bootstrap.cc:654] T e88f79ed06514e01a9bc48261a5acfbb P 7e9c4f2e01164f33b2e9034ed148398e: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:34.854818 1950 raft_consensus.cc:491] T 393f73bcf106475cbee7a645b0d9660c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:34.856125 1950 raft_consensus.cc:513] T 393f73bcf106475cbee7a645b0d9660c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.859499 1594 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "393f73bcf106475cbee7a645b0d9660c" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:34.852967 1786 tablet_bootstrap.cc:492] T ba2ab3296190416aa07624e6d69ba09b P ba464e89e0f044a0a0ea3e6125cbf2a1: No bootstrap required, opened a new log
I20250625 03:30:34.870353 1786 ts_tablet_manager.cc:1397] T ba2ab3296190416aa07624e6d69ba09b P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent bootstrapping tablet: real 0.151s user 0.014s sys 0.007s
I20250625 03:30:34.860061 1666 raft_consensus.cc:2466] T f9458dec7953448d8550396d67fad249 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 2.
I20250625 03:30:34.860585 1951 consensus_queue.cc:1035] T 9f7fbf33df3d429ab16f0ae3a2684207 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:30:34.861171 1812 raft_consensus.cc:491] T 1fff19a38e8d4880a14da6b4c8284cc2 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:34.871841 1812 raft_consensus.cc:513] T 1fff19a38e8d4880a14da6b4c8284cc2 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } }
I20250625 03:30:34.873579 1812 leader_election.cc:290] T 1fff19a38e8d4880a14da6b4c8284cc2 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903)
W20250625 03:30:34.861868 1709 leader_election.cc:343] T 393f73bcf106475cbee7a645b0d9660c P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:34.862953 1785 tablet_bootstrap.cc:654] T b31026f89f1e49949acec419db9649d3 P 3f2aa40978064c9e9983cf3745eed206: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:34.876356 1594 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1fff19a38e8d4880a14da6b4c8284cc2" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:34.877707 1594 raft_consensus.cc:2466] T 1fff19a38e8d4880a14da6b4c8284cc2 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 2.
I20250625 03:30:34.878616 1559 leader_election.cc:304] T f9458dec7953448d8550396d67fad249 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e; no voters: ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:34.860106 1950 leader_election.cc:290] T 393f73bcf106475cbee7a645b0d9660c P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:34.863423 1945 consensus_queue.cc:1035] T 9943bb8023444f49a11df01d93738f1e P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:30:34.863942 2036 consensus_queue.cc:1035] T af4573692c104d67994dbb1bc518b568 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:30:34.865860 1667 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "393f73bcf106475cbee7a645b0d9660c" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:34.879004 1668 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1fff19a38e8d4880a14da6b4c8284cc2" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:34.880153 2036 raft_consensus.cc:2802] T f9458dec7953448d8550396d67fad249 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:30:34.880187 1667 raft_consensus.cc:2466] T 393f73bcf106475cbee7a645b0d9660c P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 0.
I20250625 03:30:34.879807 1668 raft_consensus.cc:2466] T 1fff19a38e8d4880a14da6b4c8284cc2 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 1.
I20250625 03:30:34.880787 2036 raft_consensus.cc:695] T f9458dec7953448d8550396d67fad249 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 LEADER]: Becoming Leader. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Running, Role: LEADER
I20250625 03:30:34.881397 1593 raft_consensus.cc:3058] T 9f7fbf33df3d429ab16f0ae3a2684207 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:34.882048 2036 consensus_queue.cc:237] T f9458dec7953448d8550396d67fad249 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.913372 1787 tablet_bootstrap.cc:492] T e88f79ed06514e01a9bc48261a5acfbb P 7e9c4f2e01164f33b2e9034ed148398e: No bootstrap required, opened a new log
I20250625 03:30:34.913038 1786 raft_consensus.cc:357] T ba2ab3296190416aa07624e6d69ba09b P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.914062 1786 raft_consensus.cc:383] T ba2ab3296190416aa07624e6d69ba09b P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:34.914431 1786 raft_consensus.cc:738] T ba2ab3296190416aa07624e6d69ba09b P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Initialized, Role: FOLLOWER
I20250625 03:30:34.913779 1787 ts_tablet_manager.cc:1397] T e88f79ed06514e01a9bc48261a5acfbb P 7e9c4f2e01164f33b2e9034ed148398e: Time spent bootstrapping tablet: real 0.155s user 0.005s sys 0.013s
I20250625 03:30:34.915284 1786 consensus_queue.cc:260] T ba2ab3296190416aa07624e6d69ba09b P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.883525 1709 leader_election.cc:304] T 1fff19a38e8d4880a14da6b4c8284cc2 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters:
I20250625 03:30:34.882041 1708 leader_election.cc:304] T 393f73bcf106475cbee7a645b0d9660c P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:34.915061 1943 raft_consensus.cc:491] T f957bf9749c54be48094092cb80e9055 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20250625 03:30:34.925434 1708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:34293, user_credentials={real_user=slave}} blocked reactor thread for 43489.6us
I20250625 03:30:34.925374 1943 raft_consensus.cc:513] T f957bf9749c54be48094092cb80e9055 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.926518 1951 raft_consensus.cc:2802] T 393f73bcf106475cbee7a645b0d9660c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:30:34.926913 1951 raft_consensus.cc:491] T 393f73bcf106475cbee7a645b0d9660c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:30:34.927255 1951 raft_consensus.cc:3058] T 393f73bcf106475cbee7a645b0d9660c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:34.927520 1943 leader_election.cc:290] T f957bf9749c54be48094092cb80e9055 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:34.929188 1744 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f957bf9749c54be48094092cb80e9055" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:34.929863 1744 raft_consensus.cc:2466] T f957bf9749c54be48094092cb80e9055 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 1.
I20250625 03:30:34.924321 1812 raft_consensus.cc:2802] T 1fff19a38e8d4880a14da6b4c8284cc2 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20250625 03:30:34.930577 1812 raft_consensus.cc:491] T 1fff19a38e8d4880a14da6b4c8284cc2 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:30:34.930913 1812 raft_consensus.cc:3058] T 1fff19a38e8d4880a14da6b4c8284cc2 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:30:34.931236 1561 leader_election.cc:304] T f957bf9749c54be48094092cb80e9055 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters:
I20250625 03:30:34.932389 1943 raft_consensus.cc:2802] T f957bf9749c54be48094092cb80e9055 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250625 03:30:34.932837 1943 raft_consensus.cc:491] T f957bf9749c54be48094092cb80e9055 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:30:34.933216 1943 raft_consensus.cc:3058] T f957bf9749c54be48094092cb80e9055 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:30:34.934796 1951 raft_consensus.cc:513] T 393f73bcf106475cbee7a645b0d9660c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.937253 1665 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f957bf9749c54be48094092cb80e9055" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:34.968307 1946 raft_consensus.cc:491] T df29d87d804d44438345052a5902052f P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:34.968863 1946 raft_consensus.cc:513] T df29d87d804d44438345052a5902052f P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:34.938036 1665 raft_consensus.cc:2466] T f957bf9749c54be48094092cb80e9055 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 1.
I20250625 03:30:34.976372 1786 ts_tablet_manager.cc:1428] T ba2ab3296190416aa07624e6d69ba09b P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent starting tablet: real 0.106s user 0.007s sys 0.001s
I20250625 03:30:35.080716 1812 raft_consensus.cc:513] T 1fff19a38e8d4880a14da6b4c8284cc2 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } }
I20250625 03:30:35.122892 1786 tablet_bootstrap.cc:492] T b3f18b9311894580bc336199d357df41 P ba464e89e0f044a0a0ea3e6125cbf2a1: Bootstrap starting.
I20250625 03:30:35.128876 1812 leader_election.cc:290] T 1fff19a38e8d4880a14da6b4c8284cc2 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 3 election: Requested vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903)
I20250625 03:30:35.129324 1787 raft_consensus.cc:357] T e88f79ed06514e01a9bc48261a5acfbb P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:35.130028 1787 raft_consensus.cc:383] T e88f79ed06514e01a9bc48261a5acfbb P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:34.965767 1841 raft_consensus.cc:491] T 7553473daeb342ceaf782ddee8e4fc4d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:35.131304 1841 raft_consensus.cc:513] T 7553473daeb342ceaf782ddee8e4fc4d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
W20250625 03:30:35.072163 1559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:34293, user_credentials={real_user=slave}} blocked reactor thread for 101415us
I20250625 03:30:35.133224 1841 leader_election.cc:290] T 7553473daeb342ceaf782ddee8e4fc4d P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:35.133710 2032 raft_consensus.cc:491] T 6e7283d035e1429f946d8ebb98978656 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:35.087381 1946 leader_election.cc:290] T df29d87d804d44438345052a5902052f P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:35.134196 2032 raft_consensus.cc:513] T 6e7283d035e1429f946d8ebb98978656 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:35.136235 2032 leader_election.cc:290] T 6e7283d035e1429f946d8ebb98978656 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:35.139886 1665 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6e7283d035e1429f946d8ebb98978656" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:35.141141 1665 raft_consensus.cc:2466] T 6e7283d035e1429f946d8ebb98978656 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 2.
I20250625 03:30:35.141652 1921 raft_consensus.cc:491] T 9f7fbf33df3d429ab16f0ae3a2684207 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:35.142166 1921 raft_consensus.cc:513] T 9f7fbf33df3d429ab16f0ae3a2684207 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:35.147778 1921 leader_election.cc:290] T 9f7fbf33df3d429ab16f0ae3a2684207 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:35.148444 1667 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1fff19a38e8d4880a14da6b4c8284cc2" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:30:35.149133 1667 raft_consensus.cc:3058] T 1fff19a38e8d4880a14da6b4c8284cc2 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Advancing to term 3
I20250625 03:30:35.152667 1670 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7553473daeb342ceaf782ddee8e4fc4d" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:35.152789 1950 consensus_queue.cc:1035] T 9f7fbf33df3d429ab16f0ae3a2684207 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:30:35.153466 1670 raft_consensus.cc:2466] T 7553473daeb342ceaf782ddee8e4fc4d P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 0.
I20250625 03:30:35.154433 1787 raft_consensus.cc:738] T e88f79ed06514e01a9bc48261a5acfbb P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Initialized, Role: FOLLOWER
I20250625 03:30:35.155993 1787 consensus_queue.cc:260] T e88f79ed06514e01a9bc48261a5acfbb P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:35.108371 1744 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "df29d87d804d44438345052a5902052f" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:35.098402 1943 raft_consensus.cc:513] T f957bf9749c54be48094092cb80e9055 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:35.163803 1559 leader_election.cc:304] T 6e7283d035e1429f946d8ebb98978656 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e; no voters:
I20250625 03:30:35.167474 1921 raft_consensus.cc:2802] T 6e7283d035e1429f946d8ebb98978656 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20250625 03:30:35.168159 1921 raft_consensus.cc:491] T 6e7283d035e1429f946d8ebb98978656 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:30:35.168622 1921 raft_consensus.cc:3058] T 6e7283d035e1429f946d8ebb98978656 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:30:35.171391 1787 ts_tablet_manager.cc:1428] T e88f79ed06514e01a9bc48261a5acfbb P 7e9c4f2e01164f33b2e9034ed148398e: Time spent starting tablet: real 0.256s user 0.012s sys 0.002s
I20250625 03:30:35.167559 1667 raft_consensus.cc:2466] T 1fff19a38e8d4880a14da6b4c8284cc2 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 3.
I20250625 03:30:35.174388 1787 tablet_bootstrap.cc:492] T 96030b80e1f340afa81659faaaf68755 P 7e9c4f2e01164f33b2e9034ed148398e: Bootstrap starting.
I20250625 03:30:35.183367 1785 tablet_bootstrap.cc:492] T b31026f89f1e49949acec419db9649d3 P 3f2aa40978064c9e9983cf3745eed206: No bootstrap required, opened a new log
I20250625 03:30:35.183867 1785 ts_tablet_manager.cc:1397] T b31026f89f1e49949acec419db9649d3 P 3f2aa40978064c9e9983cf3745eed206: Time spent bootstrapping tablet: real 0.393s user 0.044s sys 0.024s
I20250625 03:30:35.183000 1494 catalog_manager.cc:5582] T f9458dec7953448d8550396d67fad249 P 7e9c4f2e01164f33b2e9034ed148398e reported cstate change: term changed from 1 to 2, leader changed from 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) to 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129). New cstate: current_term: 2 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } }
W20250625 03:30:35.186726 1636 leader_election.cc:343] T df29d87d804d44438345052a5902052f P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:35.187637 1785 raft_consensus.cc:357] T b31026f89f1e49949acec419db9649d3 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:35.188930 1785 raft_consensus.cc:383] T b31026f89f1e49949acec419db9649d3 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:35.189163 1785 raft_consensus.cc:738] T b31026f89f1e49949acec419db9649d3 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Initialized, Role: FOLLOWER
I20250625 03:30:35.189697 1785 consensus_queue.cc:260] T b31026f89f1e49949acec419db9649d3 P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:35.188215 1975 raft_consensus.cc:491] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:35.191815 1975 raft_consensus.cc:513] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:35.183852 1951 leader_election.cc:290] T 393f73bcf106475cbee7a645b0d9660c P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:35.193774 1975 leader_election.cc:290] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:35.194839 1943 leader_election.cc:290] T f957bf9749c54be48094092cb80e9055 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 2 election: Requested vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:35.195364 1943 raft_consensus.cc:491] T df29d87d804d44438345052a5902052f P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:35.195812 1943 raft_consensus.cc:513] T df29d87d804d44438345052a5902052f P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:35.197691 1943 leader_election.cc:290] T df29d87d804d44438345052a5902052f P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:35.200471 1665 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f957bf9749c54be48094092cb80e9055" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:30:35.201115 1665 raft_consensus.cc:3058] T f957bf9749c54be48094092cb80e9055 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:30:35.198112 1921 raft_consensus.cc:513] T 6e7283d035e1429f946d8ebb98978656 P 7e9c4f2e01164f33b2e9034ed148398e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
W20250625 03:30:35.202888 1542 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20250625 03:30:35.204159 1921 leader_election.cc:290] T 6e7283d035e1429f946d8ebb98978656 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 3 election: Requested vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
W20250625 03:30:35.208096 1709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:39903, user_credentials={real_user=slave}} blocked reactor thread for 58419.7us
I20250625 03:30:35.211597 1742 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9f7fbf33df3d429ab16f0ae3a2684207" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:35.211630 1743 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6e7283d035e1429f946d8ebb98978656" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:35.218799 1743 raft_consensus.cc:2466] T 6e7283d035e1429f946d8ebb98978656 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 1.
I20250625 03:30:35.218997 1592 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7553473daeb342ceaf782ddee8e4fc4d" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:35.221167 1670 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "df29d87d804d44438345052a5902052f" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:35.221817 1670 raft_consensus.cc:2466] T df29d87d804d44438345052a5902052f P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 0.
I20250625 03:30:35.225055 1785 ts_tablet_manager.cc:1428] T b31026f89f1e49949acec419db9649d3 P 3f2aa40978064c9e9983cf3745eed206: Time spent starting tablet: real 0.041s user 0.005s sys 0.000s
I20250625 03:30:35.226038 1785 tablet_bootstrap.cc:492] T 3037be35f2054cbbabd8a47062f84244 P 3f2aa40978064c9e9983cf3745eed206: Bootstrap starting.
I20250625 03:30:35.230881 1559 leader_election.cc:304] T df29d87d804d44438345052a5902052f P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e; no voters:
I20250625 03:30:35.231654 1739 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e88f79ed06514e01a9bc48261a5acfbb" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:35.232319 1593 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1fff19a38e8d4880a14da6b4c8284cc2" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
I20250625 03:30:35.217070 1666 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9f7fbf33df3d429ab16f0ae3a2684207" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:35.232395 1739 raft_consensus.cc:2466] T e88f79ed06514e01a9bc48261a5acfbb P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 0.
I20250625 03:30:35.237545 1593 raft_consensus.cc:3058] T 1fff19a38e8d4880a14da6b4c8284cc2 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:30:35.249416 1974 raft_consensus.cc:491] T 9b7de80fbd7d4625aac41dea0457fd3e P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:35.250002 1974 raft_consensus.cc:513] T 9b7de80fbd7d4625aac41dea0457fd3e P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:35.263360 1974 leader_election.cc:290] T 9b7de80fbd7d4625aac41dea0457fd3e P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:35.268412 1636 leader_election.cc:304] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters:
I20250625 03:30:35.269445 1974 raft_consensus.cc:2802] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:30:35.269943 1974 raft_consensus.cc:491] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:30:35.270407 1974 raft_consensus.cc:3058] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:35.272966 1666 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6e7283d035e1429f946d8ebb98978656" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:30:35.264243 1841 raft_consensus.cc:491] T ba2ab3296190416aa07624e6d69ba09b P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:35.236595 1943 raft_consensus.cc:2802] T df29d87d804d44438345052a5902052f P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:30:35.274130 1943 raft_consensus.cc:491] T df29d87d804d44438345052a5902052f P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:30:35.274467 1708 leader_election.cc:304] T 7553473daeb342ceaf782ddee8e4fc4d P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters:
I20250625 03:30:35.275230 1665 raft_consensus.cc:2466] T f957bf9749c54be48094092cb80e9055 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 2.
I20250625 03:30:35.274151 1841 raft_consensus.cc:513] T ba2ab3296190416aa07624e6d69ba09b P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:35.276165 1951 consensus_queue.cc:1035] T 96030b80e1f340afa81659faaaf68755 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:30:35.278193 1785 tablet_bootstrap.cc:654] T 3037be35f2054cbbabd8a47062f84244 P 3f2aa40978064c9e9983cf3745eed206: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:35.278937 1812 raft_consensus.cc:2802] T 7553473daeb342ceaf782ddee8e4fc4d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:30:35.279310 1812 raft_consensus.cc:491] T 7553473daeb342ceaf782ddee8e4fc4d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:30:35.273589 1666 raft_consensus.cc:3058] T 6e7283d035e1429f946d8ebb98978656 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:30:35.279633 1812 raft_consensus.cc:3058] T 7553473daeb342ceaf782ddee8e4fc4d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:35.277956 1841 leader_election.cc:290] T ba2ab3296190416aa07624e6d69ba09b P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:35.275662 1708 leader_election.cc:304] T 1fff19a38e8d4880a14da6b4c8284cc2 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters:
I20250625 03:30:35.284605 1786 tablet_bootstrap.cc:654] T b3f18b9311894580bc336199d357df41 P ba464e89e0f044a0a0ea3e6125cbf2a1: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:35.299599 1812 raft_consensus.cc:513] T 7553473daeb342ceaf782ddee8e4fc4d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:35.300834 1665 raft_consensus.cc:3058] T 9b7de80fbd7d4625aac41dea0457fd3e P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:35.302971 1841 raft_consensus.cc:2802] T 1fff19a38e8d4880a14da6b4c8284cc2 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Leader election won for term 3
I20250625 03:30:35.303144 1593 raft_consensus.cc:2466] T 1fff19a38e8d4880a14da6b4c8284cc2 P 7e9c4f2e01164f33b2e9034ed148398e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 3.
I20250625 03:30:35.303642 1841 raft_consensus.cc:695] T 1fff19a38e8d4880a14da6b4c8284cc2 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 LEADER]: Becoming Leader. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Running, Role: LEADER
I20250625 03:30:35.304785 1841 consensus_queue.cc:237] T 1fff19a38e8d4880a14da6b4c8284cc2 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } }
I20250625 03:30:35.274526 1943 raft_consensus.cc:3058] T df29d87d804d44438345052a5902052f P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:35.312922 2053 raft_consensus.cc:491] T e88f79ed06514e01a9bc48261a5acfbb P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:35.313486 2053 raft_consensus.cc:513] T e88f79ed06514e01a9bc48261a5acfbb P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:35.314323 1667 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "393f73bcf106475cbee7a645b0d9660c" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:30:35.314908 1667 raft_consensus.cc:3058] T 393f73bcf106475cbee7a645b0d9660c P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:35.315461 2053 leader_election.cc:290] T e88f79ed06514e01a9bc48261a5acfbb P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
W20250625 03:30:35.313041 1709 consensus_peers.cc:487] T 96030b80e1f340afa81659faaaf68755 P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20250625 03:30:35.317062 1709 consensus_peers.cc:487] T 93ecdce2da094dc9a80ac04828771fbd P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20250625 03:30:35.319947 1709 leader_election.cc:343] T 7553473daeb342ceaf782ddee8e4fc4d P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:35.321419 1812 leader_election.cc:290] T 7553473daeb342ceaf782ddee8e4fc4d P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:35.331887 1943 raft_consensus.cc:513] T df29d87d804d44438345052a5902052f P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:35.335600 1943 leader_election.cc:290] T df29d87d804d44438345052a5902052f P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 election: Requested vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:35.328344 1593 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "393f73bcf106475cbee7a645b0d9660c" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
I20250625 03:30:35.330045 1559 leader_election.cc:304] T f957bf9749c54be48094092cb80e9055 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e; no voters:
I20250625 03:30:35.336318 1665 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ba2ab3296190416aa07624e6d69ba09b" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:35.336974 1665 raft_consensus.cc:2466] T ba2ab3296190416aa07624e6d69ba09b P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 0.
I20250625 03:30:35.333361 1744 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9b7de80fbd7d4625aac41dea0457fd3e" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:35.335484 1812 consensus_queue.cc:1035] T 9b7de80fbd7d4625aac41dea0457fd3e P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:30:35.322060 1667 raft_consensus.cc:2466] T 393f73bcf106475cbee7a645b0d9660c P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 1.
I20250625 03:30:35.321343 1974 raft_consensus.cc:513] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:35.348075 1950 raft_consensus.cc:491] T f9458dec7953448d8550396d67fad249 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:35.348232 1592 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "df29d87d804d44438345052a5902052f" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:35.350621 1595 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ba2ab3296190416aa07624e6d69ba09b" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:35.351315 1592 raft_consensus.cc:2391] T df29d87d804d44438345052a5902052f P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f2aa40978064c9e9983cf3745eed206 in current term 1: Already voted for candidate 7e9c4f2e01164f33b2e9034ed148398e in this term.
I20250625 03:30:35.341602 1943 raft_consensus.cc:2802] T f957bf9749c54be48094092cb80e9055 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:30:35.358362 1590 raft_consensus.cc:3058] T 0e7eb287e9514c838aeed599d2703682 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:35.358726 1670 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "df29d87d804d44438345052a5902052f" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:30:35.361611 1670 raft_consensus.cc:3058] T df29d87d804d44438345052a5902052f P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:35.362298 1812 consensus_queue.cc:1035] T 9b7de80fbd7d4625aac41dea0457fd3e P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:30:35.356496 1596 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7553473daeb342ceaf782ddee8e4fc4d" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
I20250625 03:30:35.358393 1943 raft_consensus.cc:695] T f957bf9749c54be48094092cb80e9055 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 LEADER]: Becoming Leader. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Running, Role: LEADER
I20250625 03:30:35.368638 1943 consensus_queue.cc:237] T f957bf9749c54be48094092cb80e9055 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:35.369989 1708 leader_election.cc:304] T ba2ab3296190416aa07624e6d69ba09b P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters:
I20250625 03:30:35.373390 1708 leader_election.cc:304] T 393f73bcf106475cbee7a645b0d9660c P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters:
I20250625 03:30:35.374104 2047 raft_consensus.cc:2802] T ba2ab3296190416aa07624e6d69ba09b P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:30:35.374540 2047 raft_consensus.cc:491] T ba2ab3296190416aa07624e6d69ba09b P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:30:35.374881 2047 raft_consensus.cc:3058] T ba2ab3296190416aa07624e6d69ba09b P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:35.376098 1667 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e88f79ed06514e01a9bc48261a5acfbb" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:35.376930 1667 raft_consensus.cc:2391] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e9c4f2e01164f33b2e9034ed148398e in current term 1: Already voted for candidate 3f2aa40978064c9e9983cf3745eed206 in this term.
I20250625 03:30:35.379410 2056 raft_consensus.cc:2802] T 393f73bcf106475cbee7a645b0d9660c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:30:35.379911 2056 raft_consensus.cc:695] T 393f73bcf106475cbee7a645b0d9660c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Becoming Leader. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Running, Role: LEADER
I20250625 03:30:35.381079 2056 consensus_queue.cc:237] T 393f73bcf106475cbee7a645b0d9660c P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:35.386762 1786 tablet_bootstrap.cc:492] T b3f18b9311894580bc336199d357df41 P ba464e89e0f044a0a0ea3e6125cbf2a1: No bootstrap required, opened a new log
I20250625 03:30:35.387256 1786 ts_tablet_manager.cc:1397] T b3f18b9311894580bc336199d357df41 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent bootstrapping tablet: real 0.265s user 0.012s sys 0.025s
I20250625 03:30:35.388725 1974 leader_election.cc:290] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:35.352149 1950 raft_consensus.cc:513] T f9458dec7953448d8550396d67fad249 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:35.391489 1744 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e88f79ed06514e01a9bc48261a5acfbb" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:30:35.392124 1744 raft_consensus.cc:3058] T e88f79ed06514e01a9bc48261a5acfbb P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:35.396397 1591 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e88f79ed06514e01a9bc48261a5acfbb" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:35.397073 1591 raft_consensus.cc:2466] T e88f79ed06514e01a9bc48261a5acfbb P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 0.
I20250625 03:30:35.398087 1785 tablet_bootstrap.cc:492] T 3037be35f2054cbbabd8a47062f84244 P 3f2aa40978064c9e9983cf3745eed206: No bootstrap required, opened a new log
I20250625 03:30:35.399116 1785 ts_tablet_manager.cc:1397] T 3037be35f2054cbbabd8a47062f84244 P 3f2aa40978064c9e9983cf3745eed206: Time spent bootstrapping tablet: real 0.173s user 0.038s sys 0.050s
I20250625 03:30:35.393680 1670 raft_consensus.cc:2466] T df29d87d804d44438345052a5902052f P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 1.
I20250625 03:30:35.400799 1559 leader_election.cc:304] T df29d87d804d44438345052a5902052f P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e; no voters:
I20250625 03:30:35.401628 2053 raft_consensus.cc:2802] T df29d87d804d44438345052a5902052f P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:30:35.402108 2053 raft_consensus.cc:695] T df29d87d804d44438345052a5902052f P 7e9c4f2e01164f33b2e9034ed148398e [term 1 LEADER]: Becoming Leader. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Running, Role: LEADER
I20250625 03:30:35.402910 2053 consensus_queue.cc:237] T df29d87d804d44438345052a5902052f P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:35.405123 2047 raft_consensus.cc:513] T ba2ab3296190416aa07624e6d69ba09b P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:35.409421 1950 leader_election.cc:290] T f9458dec7953448d8550396d67fad249 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:35.411773 1592 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e88f79ed06514e01a9bc48261a5acfbb" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
I20250625 03:30:35.412580 1592 raft_consensus.cc:3058] T e88f79ed06514e01a9bc48261a5acfbb P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:35.415246 1974 raft_consensus.cc:491] T f8c715109ff0405997e1ca9952678c0d P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:35.416913 1595 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f9458dec7953448d8550396d67fad249" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:35.418022 1787 tablet_bootstrap.cc:654] T 96030b80e1f340afa81659faaaf68755 P 7e9c4f2e01164f33b2e9034ed148398e: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:35.413780 1594 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9b7de80fbd7d4625aac41dea0457fd3e" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:35.422608 1595 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ba2ab3296190416aa07624e6d69ba09b" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
I20250625 03:30:35.423907 1668 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7553473daeb342ceaf782ddee8e4fc4d" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:30:35.424510 1668 raft_consensus.cc:3058] T 7553473daeb342ceaf782ddee8e4fc4d P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:35.414909 1744 raft_consensus.cc:2466] T e88f79ed06514e01a9bc48261a5acfbb P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 1.
I20250625 03:30:35.420953 2047 leader_election.cc:290] T ba2ab3296190416aa07624e6d69ba09b P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:35.450695 1946 raft_consensus.cc:491] T b31026f89f1e49949acec419db9649d3 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:35.458276 1946 raft_consensus.cc:513] T b31026f89f1e49949acec419db9649d3 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
W20250625 03:30:35.468591 1635 consensus_peers.cc:487] T 9943bb8023444f49a11df01d93738f1e P 3f2aa40978064c9e9983cf3745eed206 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:30:35.470360 1739 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f957bf9749c54be48094092cb80e9055" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:30:35.419095 1974 raft_consensus.cc:513] T f8c715109ff0405997e1ca9952678c0d P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:35.471189 1739 raft_consensus.cc:3058] T f957bf9749c54be48094092cb80e9055 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Advancing to term 2
W20250625 03:30:35.471714 1709 leader_election.cc:343] T 393f73bcf106475cbee7a645b0d9660c P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:35.472810 1743 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "df29d87d804d44438345052a5902052f" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:35.479982 1636 leader_election.cc:304] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters:
I20250625 03:30:35.481268 2052 raft_consensus.cc:2802] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:30:35.481824 2052 raft_consensus.cc:695] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Becoming Leader. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Running, Role: LEADER
I20250625 03:30:35.483107 2052 consensus_queue.cc:237] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:35.493180 1635 leader_election.cc:304] T df29d87d804d44438345052a5902052f P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206; no voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:35.494750 2057 raft_consensus.cc:2747] T df29d87d804d44438345052a5902052f P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250625 03:30:35.500633 1709 leader_election.cc:343] T ba2ab3296190416aa07624e6d69ba09b P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:35.500370 1786 raft_consensus.cc:357] T b3f18b9311894580bc336199d357df41 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:35.501269 1786 raft_consensus.cc:383] T b3f18b9311894580bc336199d357df41 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:35.501560 1786 raft_consensus.cc:738] T b3f18b9311894580bc336199d357df41 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Initialized, Role: FOLLOWER
W20250625 03:30:35.501628 1709 leader_election.cc:343] T 7553473daeb342ceaf782ddee8e4fc4d P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:35.502249 1786 consensus_queue.cc:260] T b3f18b9311894580bc336199d357df41 P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:35.503966 1743 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6e7283d035e1429f946d8ebb98978656" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:30:35.504539 1743 raft_consensus.cc:3058] T 6e7283d035e1429f946d8ebb98978656 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Advancing to term 3
I20250625 03:30:35.505580 1592 raft_consensus.cc:2466] T e88f79ed06514e01a9bc48261a5acfbb P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 1.
I20250625 03:30:35.506744 1974 leader_election.cc:290] T f8c715109ff0405997e1ca9952678c0d P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:35.508285 1742 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e88f79ed06514e01a9bc48261a5acfbb" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:35.508404 1785 raft_consensus.cc:357] T 3037be35f2054cbbabd8a47062f84244 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:35.509081 1785 raft_consensus.cc:383] T 3037be35f2054cbbabd8a47062f84244 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:35.509112 1742 raft_consensus.cc:2391] T e88f79ed06514e01a9bc48261a5acfbb P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e9c4f2e01164f33b2e9034ed148398e in current term 1: Already voted for candidate 3f2aa40978064c9e9983cf3745eed206 in this term.
I20250625 03:30:35.509418 1785 raft_consensus.cc:738] T 3037be35f2054cbbabd8a47062f84244 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Initialized, Role: FOLLOWER
I20250625 03:30:35.511041 1785 consensus_queue.cc:260] T 3037be35f2054cbbabd8a47062f84244 P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:35.512776 1742 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "df29d87d804d44438345052a5902052f" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
W20250625 03:30:35.515650 1709 leader_election.cc:343] T ba2ab3296190416aa07624e6d69ba09b P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:35.517066 1786 ts_tablet_manager.cc:1428] T b3f18b9311894580bc336199d357df41 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent starting tablet: real 0.130s user 0.002s sys 0.010s
I20250625 03:30:35.518040 1786 tablet_bootstrap.cc:492] T fa68c3b7143345958f883bde3591b622 P ba464e89e0f044a0a0ea3e6125cbf2a1: Bootstrap starting.
I20250625 03:30:35.518617 1561 leader_election.cc:304] T 9f7fbf33df3d429ab16f0ae3a2684207 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e; no voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:35.520303 1943 raft_consensus.cc:2747] T 9f7fbf33df3d429ab16f0ae3a2684207 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250625 03:30:35.521329 1742 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f8c715109ff0405997e1ca9952678c0d" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:35.529002 1785 ts_tablet_manager.cc:1428] T 3037be35f2054cbbabd8a47062f84244 P 3f2aa40978064c9e9983cf3745eed206: Time spent starting tablet: real 0.130s user 0.007s sys 0.000s
I20250625 03:30:35.529796 1785 tablet_bootstrap.cc:492] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206: Bootstrap starting.
I20250625 03:30:35.533622 1743 raft_consensus.cc:2466] T 6e7283d035e1429f946d8ebb98978656 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 3.
I20250625 03:30:35.536198 1668 raft_consensus.cc:2466] T 7553473daeb342ceaf782ddee8e4fc4d P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 1.
I20250625 03:30:35.515537 1666 raft_consensus.cc:2466] T 6e7283d035e1429f946d8ebb98978656 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 3.
W20250625 03:30:35.526966 1561 leader_election.cc:343] T df29d87d804d44438345052a5902052f P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:35.543886 1946 leader_election.cc:290] T b31026f89f1e49949acec419db9649d3 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:35.526300 1742 raft_consensus.cc:2466] T f8c715109ff0405997e1ca9952678c0d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 1.
I20250625 03:30:35.542870 1665 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ba2ab3296190416aa07624e6d69ba09b" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:30:35.549285 1671 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f9458dec7953448d8550396d67fad249" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:35.549952 1665 raft_consensus.cc:3058] T ba2ab3296190416aa07624e6d69ba09b P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:35.550899 1671 raft_consensus.cc:2408] T f9458dec7953448d8550396d67fad249 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba464e89e0f044a0a0ea3e6125cbf2a1 for term 3 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20250625 03:30:35.552315 1559 leader_election.cc:304] T 6e7283d035e1429f946d8ebb98978656 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e; no voters:
I20250625 03:30:35.552623 1708 leader_election.cc:304] T 7553473daeb342ceaf782ddee8e4fc4d P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:35.557399 1636 leader_election.cc:304] T f8c715109ff0405997e1ca9952678c0d P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters:
I20250625 03:30:35.558537 1946 raft_consensus.cc:2802] T f8c715109ff0405997e1ca9952678c0d P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250625 03:30:35.558949 1946 raft_consensus.cc:491] T f8c715109ff0405997e1ca9952678c0d P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:30:35.559295 1946 raft_consensus.cc:3058] T f8c715109ff0405997e1ca9952678c0d P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:30:35.562343 1635 leader_election.cc:304] T 9b7de80fbd7d4625aac41dea0457fd3e P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206; no voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:35.563706 1975 raft_consensus.cc:2747] T 9b7de80fbd7d4625aac41dea0457fd3e P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:30:35.564565 2056 raft_consensus.cc:2802] T 7553473daeb342ceaf782ddee8e4fc4d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:30:35.565121 2056 raft_consensus.cc:695] T 7553473daeb342ceaf782ddee8e4fc4d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Becoming Leader. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Running, Role: LEADER
I20250625 03:30:35.565968 2056 consensus_queue.cc:237] T 7553473daeb342ceaf782ddee8e4fc4d P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:35.570284 1593 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b31026f89f1e49949acec419db9649d3" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:35.570528 1561 leader_election.cc:304] T e88f79ed06514e01a9bc48261a5acfbb P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e; no voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:35.573997 2053 raft_consensus.cc:2802] T 6e7283d035e1429f946d8ebb98978656 P 7e9c4f2e01164f33b2e9034ed148398e [term 3 FOLLOWER]: Leader election won for term 3
I20250625 03:30:35.577018 2053 raft_consensus.cc:695] T 6e7283d035e1429f946d8ebb98978656 P 7e9c4f2e01164f33b2e9034ed148398e [term 3 LEADER]: Becoming Leader. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Running, Role: LEADER
I20250625 03:30:35.577857 2053 consensus_queue.cc:237] T 6e7283d035e1429f946d8ebb98978656 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:35.572157 1743 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b31026f89f1e49949acec419db9649d3" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:35.576546 2051 raft_consensus.cc:2747] T e88f79ed06514e01a9bc48261a5acfbb P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:30:35.581323 1708 leader_election.cc:304] T f9458dec7953448d8550396d67fad249 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e
W20250625 03:30:35.581743 1561 leader_election.cc:343] T df29d87d804d44438345052a5902052f P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:35.576427 1596 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f8c715109ff0405997e1ca9952678c0d" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:35.583209 1950 raft_consensus.cc:2747] T f9458dec7953448d8550396d67fad249 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20250625 03:30:35.583757 1635 leader_election.cc:343] T b31026f89f1e49949acec419db9649d3 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:35.584937 1668 raft_consensus.cc:1273] T f9458dec7953448d8550396d67fad249 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20250625 03:30:35.585122 1636 leader_election.cc:343] T b31026f89f1e49949acec419db9649d3 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:35.576305 1739 raft_consensus.cc:2466] T f957bf9749c54be48094092cb80e9055 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 2.
I20250625 03:30:35.585601 1636 leader_election.cc:304] T b31026f89f1e49949acec419db9649d3 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206; no voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:35.587240 2051 consensus_queue.cc:1035] T f9458dec7953448d8550396d67fad249 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:30:35.583232 1596 raft_consensus.cc:2466] T f8c715109ff0405997e1ca9952678c0d P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 1.
I20250625 03:30:35.590574 1787 tablet_bootstrap.cc:492] T 96030b80e1f340afa81659faaaf68755 P 7e9c4f2e01164f33b2e9034ed148398e: No bootstrap required, opened a new log
I20250625 03:30:35.588588 2052 raft_consensus.cc:2747] T b31026f89f1e49949acec419db9649d3 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:30:35.591106 1787 ts_tablet_manager.cc:1397] T 96030b80e1f340afa81659faaaf68755 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent bootstrapping tablet: real 0.417s user 0.035s sys 0.045s
I20250625 03:30:35.597993 1493 catalog_manager.cc:5582] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } }
I20250625 03:30:35.614197 1946 raft_consensus.cc:513] T f8c715109ff0405997e1ca9952678c0d P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:35.618119 1946 leader_election.cc:290] T f8c715109ff0405997e1ca9952678c0d P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 2 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:35.619220 1739 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f8c715109ff0405997e1ca9952678c0d" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:30:35.623718 1743 raft_consensus.cc:1273] T f9458dec7953448d8550396d67fad249 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:30:35.619879 1739 raft_consensus.cc:3058] T f8c715109ff0405997e1ca9952678c0d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:30:35.618731 1787 raft_consensus.cc:357] T 96030b80e1f340afa81659faaaf68755 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:35.628625 1787 raft_consensus.cc:383] T 96030b80e1f340afa81659faaaf68755 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:35.628978 1787 raft_consensus.cc:738] T 96030b80e1f340afa81659faaaf68755 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Initialized, Role: FOLLOWER
W20250625 03:30:35.633325 2066 log.cc:927] Time spent T 1fff19a38e8d4880a14da6b4c8284cc2 P ba464e89e0f044a0a0ea3e6125cbf2a1: Append to log took a long time: real 0.121s user 0.004s sys 0.000s
I20250625 03:30:35.637126 1593 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f8c715109ff0405997e1ca9952678c0d" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
I20250625 03:30:35.637818 1593 raft_consensus.cc:3058] T f8c715109ff0405997e1ca9952678c0d P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:30:35.639003 1943 consensus_queue.cc:1035] T f9458dec7953448d8550396d67fad249 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:30:35.644817 1785 tablet_bootstrap.cc:654] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:35.645882 1787 consensus_queue.cc:260] T 96030b80e1f340afa81659faaaf68755 P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:35.661275 1786 tablet_bootstrap.cc:654] T fa68c3b7143345958f883bde3591b622 P ba464e89e0f044a0a0ea3e6125cbf2a1: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:35.651729 2047 raft_consensus.cc:491] T b3f18b9311894580bc336199d357df41 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:35.679009 1787 ts_tablet_manager.cc:1428] T 96030b80e1f340afa81659faaaf68755 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent starting tablet: real 0.071s user 0.006s sys 0.005s
I20250625 03:30:35.682358 1787 tablet_bootstrap.cc:492] T 3037be35f2054cbbabd8a47062f84244 P 7e9c4f2e01164f33b2e9034ed148398e: Bootstrap starting.
I20250625 03:30:35.695667 1665 raft_consensus.cc:2466] T ba2ab3296190416aa07624e6d69ba09b P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 1.
I20250625 03:30:35.698357 1708 leader_election.cc:304] T ba2ab3296190416aa07624e6d69ba09b P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:35.699975 1739 raft_consensus.cc:2466] T f8c715109ff0405997e1ca9952678c0d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 2.
I20250625 03:30:35.700198 1841 raft_consensus.cc:2802] T ba2ab3296190416aa07624e6d69ba09b P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:30:35.680918 1593 raft_consensus.cc:2466] T f8c715109ff0405997e1ca9952678c0d P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 2.
I20250625 03:30:35.701058 1841 raft_consensus.cc:695] T ba2ab3296190416aa07624e6d69ba09b P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Becoming Leader. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Running, Role: LEADER
I20250625 03:30:35.702272 1841 consensus_queue.cc:237] T ba2ab3296190416aa07624e6d69ba09b P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:35.704293 1635 leader_election.cc:304] T f8c715109ff0405997e1ca9952678c0d P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e; no voters:
I20250625 03:30:35.705579 1974 raft_consensus.cc:2802] T f8c715109ff0405997e1ca9952678c0d P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:30:35.706218 1974 raft_consensus.cc:695] T f8c715109ff0405997e1ca9952678c0d P 3f2aa40978064c9e9983cf3745eed206 [term 2 LEADER]: Becoming Leader. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Running, Role: LEADER
I20250625 03:30:35.708329 1974 consensus_queue.cc:237] T f8c715109ff0405997e1ca9952678c0d P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:35.679399 1494 catalog_manager.cc:5582] T 1fff19a38e8d4880a14da6b4c8284cc2 P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } }
I20250625 03:30:35.680272 2047 raft_consensus.cc:513] T b3f18b9311894580bc336199d357df41 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:35.734452 1493 catalog_manager.cc:5582] T f957bf9749c54be48094092cb80e9055 P 7e9c4f2e01164f33b2e9034ed148398e reported cstate change: term changed from 0 to 2, leader changed from <none> to 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129). New cstate: current_term: 2 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } }
I20250625 03:30:35.738689 1493 catalog_manager.cc:5582] T df29d87d804d44438345052a5902052f P 7e9c4f2e01164f33b2e9034ed148398e reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129). New cstate: current_term: 1 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } }
I20250625 03:30:35.737877 1665 raft_consensus.cc:1273] T 1fff19a38e8d4880a14da6b4c8284cc2 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20250625 03:30:35.745926 2047 leader_election.cc:290] T b3f18b9311894580bc336199d357df41 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:35.746515 2047 consensus_queue.cc:1035] T 1fff19a38e8d4880a14da6b4c8284cc2 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:30:35.750597 1590 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b3f18b9311894580bc336199d357df41" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:35.751580 1666 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b3f18b9311894580bc336199d357df41" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
W20250625 03:30:35.752602 1709 leader_election.cc:343] T b3f18b9311894580bc336199d357df41 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
W20250625 03:30:35.753527 1708 leader_election.cc:343] T b3f18b9311894580bc336199d357df41 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:35.753980 1708 leader_election.cc:304] T b3f18b9311894580bc336199d357df41 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:35.756346 2055 raft_consensus.cc:2747] T b3f18b9311894580bc336199d357df41 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:30:35.777596 1785 tablet_bootstrap.cc:492] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206: No bootstrap required, opened a new log
I20250625 03:30:35.778190 1785 ts_tablet_manager.cc:1397] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206: Time spent bootstrapping tablet: real 0.249s user 0.024s sys 0.046s
I20250625 03:30:35.792091 1785 raft_consensus.cc:357] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
W20250625 03:30:35.792697 1561 consensus_peers.cc:487] T df29d87d804d44438345052a5902052f P 7e9c4f2e01164f33b2e9034ed148398e -> Peer ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): Couldn't send request to peer ba464e89e0f044a0a0ea3e6125cbf2a1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:30:35.794445 1787 tablet_bootstrap.cc:654] T 3037be35f2054cbbabd8a47062f84244 P 7e9c4f2e01164f33b2e9034ed148398e: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:35.792816 1785 raft_consensus.cc:383] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:35.799496 1785 raft_consensus.cc:738] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Initialized, Role: FOLLOWER
I20250625 03:30:35.803906 1974 raft_consensus.cc:491] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:35.804522 1974 raft_consensus.cc:513] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:35.805536 1786 tablet_bootstrap.cc:492] T fa68c3b7143345958f883bde3591b622 P ba464e89e0f044a0a0ea3e6125cbf2a1: No bootstrap required, opened a new log
I20250625 03:30:35.805990 1786 ts_tablet_manager.cc:1397] T fa68c3b7143345958f883bde3591b622 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent bootstrapping tablet: real 0.288s user 0.015s sys 0.001s
I20250625 03:30:35.806578 1974 leader_election.cc:290] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:35.808485 1786 raft_consensus.cc:357] T fa68c3b7143345958f883bde3591b622 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:35.809125 1739 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0c2b6052daaa4c57aaa55361e8d6e01c" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:35.800284 1785 consensus_queue.cc:260] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:35.809156 1786 raft_consensus.cc:383] T fa68c3b7143345958f883bde3591b622 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:35.810696 1786 raft_consensus.cc:738] T fa68c3b7143345958f883bde3591b622 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Initialized, Role: FOLLOWER
I20250625 03:30:35.812222 1590 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0c2b6052daaa4c57aaa55361e8d6e01c" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:35.813017 1590 raft_consensus.cc:2466] T 0c2b6052daaa4c57aaa55361e8d6e01c P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 1.
I20250625 03:30:35.812207 2051 consensus_queue.cc:1035] T df29d87d804d44438345052a5902052f P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:30:35.811344 1786 consensus_queue.cc:260] T fa68c3b7143345958f883bde3591b622 P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:35.809826 1739 raft_consensus.cc:2466] T 0c2b6052daaa4c57aaa55361e8d6e01c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 1.
I20250625 03:30:35.818686 1635 leader_election.cc:304] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e; no voters:
I20250625 03:30:35.820128 1946 raft_consensus.cc:2802] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250625 03:30:35.820477 1946 raft_consensus.cc:491] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:30:35.820787 1946 raft_consensus.cc:3058] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:30:35.834918 1785 ts_tablet_manager.cc:1428] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206: Time spent starting tablet: real 0.056s user 0.007s sys 0.000s
I20250625 03:30:35.838606 1492 catalog_manager.cc:5582] T 7553473daeb342ceaf782ddee8e4fc4d P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: HEALTHY } } }
I20250625 03:30:35.839193 1946 raft_consensus.cc:513] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:35.841444 1785 tablet_bootstrap.cc:492] T cc3b100d6d574a68b79e6a8f23d77201 P 3f2aa40978064c9e9983cf3745eed206: Bootstrap starting.
I20250625 03:30:35.841066 1492 catalog_manager.cc:5582] T 393f73bcf106475cbee7a645b0d9660c P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: HEALTHY } } }
I20250625 03:30:35.842868 1492 catalog_manager.cc:5582] T ba2ab3296190416aa07624e6d69ba09b P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: HEALTHY } } }
I20250625 03:30:35.840178 1494 catalog_manager.cc:5582] T f8c715109ff0405997e1ca9952678c0d P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: term changed from 0 to 2, leader changed from <none> to 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130). New cstate: current_term: 2 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } }
I20250625 03:30:35.851486 1786 ts_tablet_manager.cc:1428] T fa68c3b7143345958f883bde3591b622 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent starting tablet: real 0.045s user 0.006s sys 0.001s
I20250625 03:30:35.854113 1786 tablet_bootstrap.cc:492] T 31885ef6a0c64613ae6723c07f9400b0 P ba464e89e0f044a0a0ea3e6125cbf2a1: Bootstrap starting.
I20250625 03:30:35.856233 1787 tablet_bootstrap.cc:492] T 3037be35f2054cbbabd8a47062f84244 P 7e9c4f2e01164f33b2e9034ed148398e: No bootstrap required, opened a new log
I20250625 03:30:35.856699 1787 ts_tablet_manager.cc:1397] T 3037be35f2054cbbabd8a47062f84244 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent bootstrapping tablet: real 0.175s user 0.017s sys 0.012s
I20250625 03:30:35.860476 1787 raft_consensus.cc:357] T 3037be35f2054cbbabd8a47062f84244 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:35.861171 1787 raft_consensus.cc:383] T 3037be35f2054cbbabd8a47062f84244 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:35.861440 1787 raft_consensus.cc:738] T 3037be35f2054cbbabd8a47062f84244 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Initialized, Role: FOLLOWER
I20250625 03:30:35.865267 1787 consensus_queue.cc:260] T 3037be35f2054cbbabd8a47062f84244 P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:35.866736 1493 catalog_manager.cc:5582] T 6e7283d035e1429f946d8ebb98978656 P 7e9c4f2e01164f33b2e9034ed148398e reported cstate change: term changed from 1 to 3, leader changed from 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) to 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129). New cstate: current_term: 3 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } }
I20250625 03:30:35.871294 1787 ts_tablet_manager.cc:1428] T 3037be35f2054cbbabd8a47062f84244 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent starting tablet: real 0.014s user 0.007s sys 0.000s
I20250625 03:30:35.871124 1590 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0c2b6052daaa4c57aaa55361e8d6e01c" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
I20250625 03:30:35.871781 1590 raft_consensus.cc:3058] T 0c2b6052daaa4c57aaa55361e8d6e01c P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:30:35.872248 1787 tablet_bootstrap.cc:492] T 7553473daeb342ceaf782ddee8e4fc4d P 7e9c4f2e01164f33b2e9034ed148398e: Bootstrap starting.
W20250625 03:30:35.874070 1709 consensus_peers.cc:487] T 393f73bcf106475cbee7a645b0d9660c P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:30:35.879829 1596 raft_consensus.cc:1273] T 1fff19a38e8d4880a14da6b4c8284cc2 P 7e9c4f2e01164f33b2e9034ed148398e [term 3 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20250625 03:30:35.883570 1951 consensus_queue.cc:1035] T 1fff19a38e8d4880a14da6b4c8284cc2 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:30:35.884438 1739 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0c2b6052daaa4c57aaa55361e8d6e01c" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:30:35.885010 1739 raft_consensus.cc:3058] T 0c2b6052daaa4c57aaa55361e8d6e01c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:30:35.885147 1742 raft_consensus.cc:1273] T f957bf9749c54be48094092cb80e9055 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20250625 03:30:35.881561 1590 raft_consensus.cc:2466] T 0c2b6052daaa4c57aaa55361e8d6e01c P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 2.
I20250625 03:30:35.886257 1946 leader_election.cc:290] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 2 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:35.905884 2053 raft_consensus.cc:491] T 96030b80e1f340afa81659faaaf68755 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:35.906867 2053 raft_consensus.cc:513] T 96030b80e1f340afa81659faaaf68755 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:35.905889 1943 consensus_queue.cc:1035] T f957bf9749c54be48094092cb80e9055 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20250625 03:30:35.909807 2053 leader_election.cc:290] T 96030b80e1f340afa81659faaaf68755 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:35.912734 1671 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "96030b80e1f340afa81659faaaf68755" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:35.913677 1742 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "96030b80e1f340afa81659faaaf68755" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:35.913832 1739 raft_consensus.cc:2466] T 0c2b6052daaa4c57aaa55361e8d6e01c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 2.
I20250625 03:30:35.917250 2052 raft_consensus.cc:491] T 3037be35f2054cbbabd8a47062f84244 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:35.915243 1635 leader_election.cc:304] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e; no voters:
I20250625 03:30:35.917732 2052 raft_consensus.cc:513] T 3037be35f2054cbbabd8a47062f84244 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:35.919591 2052 leader_election.cc:290] T 3037be35f2054cbbabd8a47062f84244 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:35.920529 1787 tablet_bootstrap.cc:654] T 7553473daeb342ceaf782ddee8e4fc4d P 7e9c4f2e01164f33b2e9034ed148398e: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:35.920764 1559 leader_election.cc:304] T 96030b80e1f340afa81659faaaf68755 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e; no voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:35.921082 1742 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3037be35f2054cbbabd8a47062f84244" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:35.923373 1592 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3037be35f2054cbbabd8a47062f84244" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:35.924036 2052 raft_consensus.cc:2802] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:30:35.924149 1592 raft_consensus.cc:2466] T 3037be35f2054cbbabd8a47062f84244 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 0.
I20250625 03:30:35.924248 1943 raft_consensus.cc:2747] T 96030b80e1f340afa81659faaaf68755 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:30:35.924585 2052 raft_consensus.cc:695] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206 [term 2 LEADER]: Becoming Leader. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Running, Role: LEADER
I20250625 03:30:35.925400 2052 consensus_queue.cc:237] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:35.925745 1975 consensus_queue.cc:1035] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:30:35.923656 1742 raft_consensus.cc:2466] T 3037be35f2054cbbabd8a47062f84244 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 0.
I20250625 03:30:35.927536 1635 leader_election.cc:304] T 3037be35f2054cbbabd8a47062f84244 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e; no voters:
I20250625 03:30:35.929947 2047 consensus_queue.cc:1035] T 393f73bcf106475cbee7a645b0d9660c P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:30:35.931958 1946 raft_consensus.cc:2802] T 3037be35f2054cbbabd8a47062f84244 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:30:35.932860 1785 tablet_bootstrap.cc:654] T cc3b100d6d574a68b79e6a8f23d77201 P 3f2aa40978064c9e9983cf3745eed206: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:35.933352 1975 raft_consensus.cc:491] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:35.933838 1975 raft_consensus.cc:513] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:35.937388 1786 tablet_bootstrap.cc:654] T 31885ef6a0c64613ae6723c07f9400b0 P ba464e89e0f044a0a0ea3e6125cbf2a1: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:35.933010 1946 raft_consensus.cc:491] T 3037be35f2054cbbabd8a47062f84244 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:30:35.938583 1946 raft_consensus.cc:3058] T 3037be35f2054cbbabd8a47062f84244 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:35.935786 1975 leader_election.cc:290] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:35.942925 1739 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a5a18934cc3f490288432ee1cb30b278" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
W20250625 03:30:35.944279 1636 leader_election.cc:343] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:35.956908 1590 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a5a18934cc3f490288432ee1cb30b278" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
W20250625 03:30:35.966662 1635 leader_election.cc:343] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:35.968704 1668 raft_consensus.cc:1273] T f957bf9749c54be48094092cb80e9055 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20250625 03:30:35.971091 1943 consensus_queue.cc:1035] T f957bf9749c54be48094092cb80e9055 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20250625 03:30:35.984974 1709 consensus_peers.cc:487] T 7553473daeb342ceaf782ddee8e4fc4d P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:30:35.971536 1635 leader_election.cc:304] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206; no voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:35.991616 1975 raft_consensus.cc:2747] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:30:35.986780 1946 raft_consensus.cc:513] T 3037be35f2054cbbabd8a47062f84244 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.000041 1946 leader_election.cc:290] T 3037be35f2054cbbabd8a47062f84244 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:36.004279 1743 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3037be35f2054cbbabd8a47062f84244" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:30:36.004343 1590 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3037be35f2054cbbabd8a47062f84244" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
I20250625 03:30:36.005081 1743 raft_consensus.cc:3058] T 3037be35f2054cbbabd8a47062f84244 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:36.005165 1590 raft_consensus.cc:3058] T 3037be35f2054cbbabd8a47062f84244 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:36.005785 1785 tablet_bootstrap.cc:492] T cc3b100d6d574a68b79e6a8f23d77201 P 3f2aa40978064c9e9983cf3745eed206: No bootstrap required, opened a new log
I20250625 03:30:36.013399 1743 raft_consensus.cc:2466] T 3037be35f2054cbbabd8a47062f84244 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 1.
I20250625 03:30:36.014689 1636 leader_election.cc:304] T 3037be35f2054cbbabd8a47062f84244 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters:
I20250625 03:30:36.019625 1785 ts_tablet_manager.cc:1397] T cc3b100d6d574a68b79e6a8f23d77201 P 3f2aa40978064c9e9983cf3745eed206: Time spent bootstrapping tablet: real 0.184s user 0.018s sys 0.009s
I20250625 03:30:36.019865 1786 tablet_bootstrap.cc:492] T 31885ef6a0c64613ae6723c07f9400b0 P ba464e89e0f044a0a0ea3e6125cbf2a1: No bootstrap required, opened a new log
I20250625 03:30:36.020350 1786 ts_tablet_manager.cc:1397] T 31885ef6a0c64613ae6723c07f9400b0 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent bootstrapping tablet: real 0.168s user 0.017s sys 0.006s
I20250625 03:30:36.018299 1946 raft_consensus.cc:2802] T 3037be35f2054cbbabd8a47062f84244 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:30:36.025231 1946 raft_consensus.cc:695] T 3037be35f2054cbbabd8a47062f84244 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Becoming Leader. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Running, Role: LEADER
I20250625 03:30:36.025429 1787 tablet_bootstrap.cc:492] T 7553473daeb342ceaf782ddee8e4fc4d P 7e9c4f2e01164f33b2e9034ed148398e: No bootstrap required, opened a new log
I20250625 03:30:36.025862 1787 ts_tablet_manager.cc:1397] T 7553473daeb342ceaf782ddee8e4fc4d P 7e9c4f2e01164f33b2e9034ed148398e: Time spent bootstrapping tablet: real 0.154s user 0.011s sys 0.005s
I20250625 03:30:36.025633 1785 raft_consensus.cc:357] T cc3b100d6d574a68b79e6a8f23d77201 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.026365 1785 raft_consensus.cc:383] T cc3b100d6d574a68b79e6a8f23d77201 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:36.026083 1946 consensus_queue.cc:237] T 3037be35f2054cbbabd8a47062f84244 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.026656 1785 raft_consensus.cc:738] T cc3b100d6d574a68b79e6a8f23d77201 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Initialized, Role: FOLLOWER
I20250625 03:30:36.027310 1785 consensus_queue.cc:260] T cc3b100d6d574a68b79e6a8f23d77201 P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.027552 1493 catalog_manager.cc:5582] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: term changed from 0 to 2, leader changed from <none> to 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130). New cstate: current_term: 2 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } }
I20250625 03:30:36.028318 1787 raft_consensus.cc:357] T 7553473daeb342ceaf782ddee8e4fc4d P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.029016 1787 raft_consensus.cc:383] T 7553473daeb342ceaf782ddee8e4fc4d P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:36.029399 1787 raft_consensus.cc:738] T 7553473daeb342ceaf782ddee8e4fc4d P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Initialized, Role: FOLLOWER
I20250625 03:30:36.030459 1787 consensus_queue.cc:260] T 7553473daeb342ceaf782ddee8e4fc4d P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.029450 1785 ts_tablet_manager.cc:1428] T cc3b100d6d574a68b79e6a8f23d77201 P 3f2aa40978064c9e9983cf3745eed206: Time spent starting tablet: real 0.009s user 0.004s sys 0.001s
I20250625 03:30:36.033277 1787 ts_tablet_manager.cc:1428] T 7553473daeb342ceaf782ddee8e4fc4d P 7e9c4f2e01164f33b2e9034ed148398e: Time spent starting tablet: real 0.007s user 0.006s sys 0.001s
I20250625 03:30:36.034363 1785 tablet_bootstrap.cc:492] T 31885ef6a0c64613ae6723c07f9400b0 P 3f2aa40978064c9e9983cf3745eed206: Bootstrap starting.
I20250625 03:30:36.035749 1787 tablet_bootstrap.cc:492] T 393f73bcf106475cbee7a645b0d9660c P 7e9c4f2e01164f33b2e9034ed148398e: Bootstrap starting.
I20250625 03:30:36.056682 1744 raft_consensus.cc:1273] T 6e7283d035e1429f946d8ebb98978656 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20250625 03:30:36.061123 1786 raft_consensus.cc:357] T 31885ef6a0c64613ae6723c07f9400b0 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.062067 1786 raft_consensus.cc:383] T 31885ef6a0c64613ae6723c07f9400b0 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:36.062402 1786 raft_consensus.cc:738] T 31885ef6a0c64613ae6723c07f9400b0 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Initialized, Role: FOLLOWER
I20250625 03:30:36.062703 1943 consensus_queue.cc:1035] T 6e7283d035e1429f946d8ebb98978656 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20250625 03:30:36.063210 1786 consensus_queue.cc:260] T 31885ef6a0c64613ae6723c07f9400b0 P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.070478 2052 consensus_queue.cc:1035] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:30:36.082563 1668 raft_consensus.cc:1273] T 6e7283d035e1429f946d8ebb98978656 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20250625 03:30:36.082378 1493 catalog_manager.cc:5582] T 3037be35f2054cbbabd8a47062f84244 P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } }
I20250625 03:30:36.092828 1841 raft_consensus.cc:491] T 31885ef6a0c64613ae6723c07f9400b0 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:36.094338 1786 ts_tablet_manager.cc:1428] T 31885ef6a0c64613ae6723c07f9400b0 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent starting tablet: real 0.074s user 0.008s sys 0.000s
I20250625 03:30:36.095099 1786 tablet_bootstrap.cc:492] T c04f7c2d00994557b1cb83234b36fceb P ba464e89e0f044a0a0ea3e6125cbf2a1: Bootstrap starting.
I20250625 03:30:36.093372 1841 raft_consensus.cc:513] T 31885ef6a0c64613ae6723c07f9400b0 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.096781 1787 tablet_bootstrap.cc:654] T 393f73bcf106475cbee7a645b0d9660c P 7e9c4f2e01164f33b2e9034ed148398e: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:36.100751 1943 consensus_queue.cc:1035] T 6e7283d035e1429f946d8ebb98978656 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:30:36.106151 1592 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "31885ef6a0c64613ae6723c07f9400b0" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:36.101513 1841 leader_election.cc:290] T 31885ef6a0c64613ae6723c07f9400b0 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:36.109405 1668 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "31885ef6a0c64613ae6723c07f9400b0" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
W20250625 03:30:36.110545 1709 leader_election.cc:343] T 31885ef6a0c64613ae6723c07f9400b0 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
W20250625 03:30:36.111054 1708 leader_election.cc:343] T 31885ef6a0c64613ae6723c07f9400b0 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:36.111477 1708 leader_election.cc:304] T 31885ef6a0c64613ae6723c07f9400b0 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:36.118011 1590 raft_consensus.cc:2466] T 3037be35f2054cbbabd8a47062f84244 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 1.
I20250625 03:30:36.118913 1951 raft_consensus.cc:2747] T 31885ef6a0c64613ae6723c07f9400b0 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:30:36.131944 1943 raft_consensus.cc:491] T 7553473daeb342ceaf782ddee8e4fc4d P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:36.132450 1943 raft_consensus.cc:513] T 7553473daeb342ceaf782ddee8e4fc4d P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.135358 1787 tablet_bootstrap.cc:492] T 393f73bcf106475cbee7a645b0d9660c P 7e9c4f2e01164f33b2e9034ed148398e: No bootstrap required, opened a new log
I20250625 03:30:36.135468 1671 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7553473daeb342ceaf782ddee8e4fc4d" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:36.135699 1943 leader_election.cc:290] T 7553473daeb342ceaf782ddee8e4fc4d P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:36.135905 1787 ts_tablet_manager.cc:1397] T 393f73bcf106475cbee7a645b0d9660c P 7e9c4f2e01164f33b2e9034ed148398e: Time spent bootstrapping tablet: real 0.100s user 0.013s sys 0.003s
I20250625 03:30:36.136299 1671 raft_consensus.cc:2391] T 7553473daeb342ceaf782ddee8e4fc4d P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e9c4f2e01164f33b2e9034ed148398e in current term 1: Already voted for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in this term.
I20250625 03:30:36.137312 1743 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7553473daeb342ceaf782ddee8e4fc4d" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:36.139459 1561 leader_election.cc:304] T 7553473daeb342ceaf782ddee8e4fc4d P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e; no voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:36.140712 2053 raft_consensus.cc:3058] T 7553473daeb342ceaf782ddee8e4fc4d P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:36.111678 1785 tablet_bootstrap.cc:654] T 31885ef6a0c64613ae6723c07f9400b0 P 3f2aa40978064c9e9983cf3745eed206: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:36.160876 2053 raft_consensus.cc:2747] T 7553473daeb342ceaf782ddee8e4fc4d P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:30:36.162447 1787 raft_consensus.cc:357] T 393f73bcf106475cbee7a645b0d9660c P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.163328 1787 raft_consensus.cc:383] T 393f73bcf106475cbee7a645b0d9660c P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:36.163736 1787 raft_consensus.cc:738] T 393f73bcf106475cbee7a645b0d9660c P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Initialized, Role: FOLLOWER
I20250625 03:30:36.164443 1951 consensus_queue.cc:1035] T ba2ab3296190416aa07624e6d69ba09b P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:30:36.170610 1950 consensus_queue.cc:1035] T 7553473daeb342ceaf782ddee8e4fc4d P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:30:36.164638 1787 consensus_queue.cc:260] T 393f73bcf106475cbee7a645b0d9660c P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.189143 1787 ts_tablet_manager.cc:1428] T 393f73bcf106475cbee7a645b0d9660c P 7e9c4f2e01164f33b2e9034ed148398e: Time spent starting tablet: real 0.053s user 0.007s sys 0.000s
I20250625 03:30:36.190640 1787 tablet_bootstrap.cc:492] T 441042afd59544a4a04bf85fa69d7d55 P 7e9c4f2e01164f33b2e9034ed148398e: Bootstrap starting.
I20250625 03:30:36.185940 1786 tablet_bootstrap.cc:654] T c04f7c2d00994557b1cb83234b36fceb P ba464e89e0f044a0a0ea3e6125cbf2a1: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:36.207082 1592 raft_consensus.cc:1273] T f8c715109ff0405997e1ca9952678c0d P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20250625 03:30:36.210929 2093 consensus_queue.cc:1035] T f8c715109ff0405997e1ca9952678c0d P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:30:36.216444 1951 raft_consensus.cc:491] T fa68c3b7143345958f883bde3591b622 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:36.216966 1951 raft_consensus.cc:513] T fa68c3b7143345958f883bde3591b622 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.218377 1974 raft_consensus.cc:491] T cc3b100d6d574a68b79e6a8f23d77201 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:36.218868 1974 raft_consensus.cc:513] T cc3b100d6d574a68b79e6a8f23d77201 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.220778 1974 leader_election.cc:290] T cc3b100d6d574a68b79e6a8f23d77201 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:36.220909 1590 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fa68c3b7143345958f883bde3591b622" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:36.222167 1596 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cc3b100d6d574a68b79e6a8f23d77201" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
W20250625 03:30:36.222479 1709 leader_election.cc:343] T fa68c3b7143345958f883bde3591b622 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:36.223488 1951 leader_election.cc:290] T fa68c3b7143345958f883bde3591b622 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
W20250625 03:30:36.223591 1635 leader_election.cc:343] T cc3b100d6d574a68b79e6a8f23d77201 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:36.224534 1743 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cc3b100d6d574a68b79e6a8f23d77201" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
W20250625 03:30:36.226426 1636 leader_election.cc:343] T cc3b100d6d574a68b79e6a8f23d77201 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:36.226595 1596 raft_consensus.cc:3058] T 96030b80e1f340afa81659faaaf68755 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:36.230615 1636 leader_election.cc:304] T cc3b100d6d574a68b79e6a8f23d77201 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206; no voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:36.232299 2093 raft_consensus.cc:2747] T cc3b100d6d574a68b79e6a8f23d77201 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:30:36.243093 1787 tablet_bootstrap.cc:654] T 441042afd59544a4a04bf85fa69d7d55 P 7e9c4f2e01164f33b2e9034ed148398e: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:36.249670 1668 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fa68c3b7143345958f883bde3591b622" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:36.260766 1786 tablet_bootstrap.cc:492] T c04f7c2d00994557b1cb83234b36fceb P ba464e89e0f044a0a0ea3e6125cbf2a1: No bootstrap required, opened a new log
I20250625 03:30:36.286770 1786 ts_tablet_manager.cc:1397] T c04f7c2d00994557b1cb83234b36fceb P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent bootstrapping tablet: real 0.192s user 0.010s sys 0.006s
I20250625 03:30:36.269071 1743 raft_consensus.cc:1273] T f8c715109ff0405997e1ca9952678c0d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
W20250625 03:30:36.288661 1708 leader_election.cc:343] T fa68c3b7143345958f883bde3591b622 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:36.289119 1708 leader_election.cc:304] T fa68c3b7143345958f883bde3591b622 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:36.291500 2093 consensus_queue.cc:1035] T f8c715109ff0405997e1ca9952678c0d P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:30:36.292610 1786 raft_consensus.cc:357] T c04f7c2d00994557b1cb83234b36fceb P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.293236 1786 raft_consensus.cc:383] T c04f7c2d00994557b1cb83234b36fceb P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:36.293471 1786 raft_consensus.cc:738] T c04f7c2d00994557b1cb83234b36fceb P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Initialized, Role: FOLLOWER
I20250625 03:30:36.294044 1786 consensus_queue.cc:260] T c04f7c2d00994557b1cb83234b36fceb P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.294713 2054 raft_consensus.cc:2747] T fa68c3b7143345958f883bde3591b622 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:30:36.296653 1786 ts_tablet_manager.cc:1428] T c04f7c2d00994557b1cb83234b36fceb P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent starting tablet: real 0.010s user 0.005s sys 0.000s
I20250625 03:30:36.297497 1786 tablet_bootstrap.cc:492] T cc3b100d6d574a68b79e6a8f23d77201 P ba464e89e0f044a0a0ea3e6125cbf2a1: Bootstrap starting.
I20250625 03:30:36.304904 1785 tablet_bootstrap.cc:492] T 31885ef6a0c64613ae6723c07f9400b0 P 3f2aa40978064c9e9983cf3745eed206: No bootstrap required, opened a new log
I20250625 03:30:36.306213 1785 ts_tablet_manager.cc:1397] T 31885ef6a0c64613ae6723c07f9400b0 P 3f2aa40978064c9e9983cf3745eed206: Time spent bootstrapping tablet: real 0.272s user 0.048s sys 0.058s
I20250625 03:30:36.313524 1785 raft_consensus.cc:357] T 31885ef6a0c64613ae6723c07f9400b0 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.314267 1785 raft_consensus.cc:383] T 31885ef6a0c64613ae6723c07f9400b0 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:36.314548 1785 raft_consensus.cc:738] T 31885ef6a0c64613ae6723c07f9400b0 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Initialized, Role: FOLLOWER
I20250625 03:30:36.315186 1785 consensus_queue.cc:260] T 31885ef6a0c64613ae6723c07f9400b0 P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.319396 1786 tablet_bootstrap.cc:654] T cc3b100d6d574a68b79e6a8f23d77201 P ba464e89e0f044a0a0ea3e6125cbf2a1: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:36.328132 1785 ts_tablet_manager.cc:1428] T 31885ef6a0c64613ae6723c07f9400b0 P 3f2aa40978064c9e9983cf3745eed206: Time spent starting tablet: real 0.022s user 0.002s sys 0.006s
I20250625 03:30:36.328951 2093 raft_consensus.cc:491] T 31885ef6a0c64613ae6723c07f9400b0 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:36.332293 2093 raft_consensus.cc:513] T 31885ef6a0c64613ae6723c07f9400b0 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.334339 2093 leader_election.cc:290] T 31885ef6a0c64613ae6723c07f9400b0 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:36.335525 1596 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "31885ef6a0c64613ae6723c07f9400b0" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:36.336344 1744 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "31885ef6a0c64613ae6723c07f9400b0" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:36.337270 1744 raft_consensus.cc:2466] T 31885ef6a0c64613ae6723c07f9400b0 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 0.
W20250625 03:30:36.337445 1635 leader_election.cc:343] T 31885ef6a0c64613ae6723c07f9400b0 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
W20250625 03:30:36.338955 1709 consensus_peers.cc:487] T ba2ab3296190416aa07624e6d69ba09b P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:30:36.343564 1636 leader_election.cc:304] T 31885ef6a0c64613ae6723c07f9400b0 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:36.344481 1974 raft_consensus.cc:2802] T 31885ef6a0c64613ae6723c07f9400b0 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:30:36.344859 1974 raft_consensus.cc:491] T 31885ef6a0c64613ae6723c07f9400b0 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:30:36.345207 1974 raft_consensus.cc:3058] T 31885ef6a0c64613ae6723c07f9400b0 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Advancing to term 1
W20250625 03:30:36.350979 1542 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20250625 03:30:36.358686 1785 tablet_bootstrap.cc:492] T c04f7c2d00994557b1cb83234b36fceb P 3f2aa40978064c9e9983cf3745eed206: Bootstrap starting.
I20250625 03:30:36.364990 2054 raft_consensus.cc:491] T 441042afd59544a4a04bf85fa69d7d55 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:36.365165 1785 tablet_bootstrap.cc:654] T c04f7c2d00994557b1cb83234b36fceb P 3f2aa40978064c9e9983cf3745eed206: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:36.365520 2054 raft_consensus.cc:513] T 441042afd59544a4a04bf85fa69d7d55 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.367554 2054 leader_election.cc:290] T 441042afd59544a4a04bf85fa69d7d55 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:36.364419 1974 raft_consensus.cc:513] T 31885ef6a0c64613ae6723c07f9400b0 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.367825 1787 tablet_bootstrap.cc:492] T 441042afd59544a4a04bf85fa69d7d55 P 7e9c4f2e01164f33b2e9034ed148398e: No bootstrap required, opened a new log
I20250625 03:30:36.370576 1787 ts_tablet_manager.cc:1397] T 441042afd59544a4a04bf85fa69d7d55 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent bootstrapping tablet: real 0.180s user 0.021s sys 0.019s
I20250625 03:30:36.371867 1667 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "441042afd59544a4a04bf85fa69d7d55" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:36.372607 1974 leader_election.cc:290] T 31885ef6a0c64613ae6723c07f9400b0 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:36.374775 1596 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "441042afd59544a4a04bf85fa69d7d55" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
W20250625 03:30:36.373472 1708 leader_election.cc:343] T 441042afd59544a4a04bf85fa69d7d55 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:36.374042 1787 raft_consensus.cc:357] T 441042afd59544a4a04bf85fa69d7d55 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.375802 1787 raft_consensus.cc:383] T 441042afd59544a4a04bf85fa69d7d55 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:36.376102 1787 raft_consensus.cc:738] T 441042afd59544a4a04bf85fa69d7d55 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Initialized, Role: FOLLOWER
I20250625 03:30:36.376663 1592 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "31885ef6a0c64613ae6723c07f9400b0" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
I20250625 03:30:36.376730 1787 consensus_queue.cc:260] T 441042afd59544a4a04bf85fa69d7d55 P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
W20250625 03:30:36.378697 1635 leader_election.cc:343] T 31885ef6a0c64613ae6723c07f9400b0 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:36.379505 1596 raft_consensus.cc:2466] T 441042afd59544a4a04bf85fa69d7d55 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 0.
I20250625 03:30:36.382977 1787 ts_tablet_manager.cc:1428] T 441042afd59544a4a04bf85fa69d7d55 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent starting tablet: real 0.012s user 0.006s sys 0.000s
I20250625 03:30:36.383870 1787 tablet_bootstrap.cc:492] T 93ecdce2da094dc9a80ac04828771fbd P 7e9c4f2e01164f33b2e9034ed148398e: Bootstrap starting.
I20250625 03:30:36.388932 1709 leader_election.cc:304] T 441042afd59544a4a04bf85fa69d7d55 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 3f2aa40978064c9e9983cf3745eed206
I20250625 03:30:36.389822 1841 raft_consensus.cc:2802] T 441042afd59544a4a04bf85fa69d7d55 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:30:36.390169 1841 raft_consensus.cc:491] T 441042afd59544a4a04bf85fa69d7d55 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:30:36.390468 1841 raft_consensus.cc:3058] T 441042afd59544a4a04bf85fa69d7d55 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:36.392277 1744 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "31885ef6a0c64613ae6723c07f9400b0" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:30:36.392992 1744 raft_consensus.cc:3058] T 31885ef6a0c64613ae6723c07f9400b0 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:36.408627 1744 raft_consensus.cc:2466] T 31885ef6a0c64613ae6723c07f9400b0 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 1.
I20250625 03:30:36.408676 1841 raft_consensus.cc:513] T 441042afd59544a4a04bf85fa69d7d55 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.409981 1636 leader_election.cc:304] T 31885ef6a0c64613ae6723c07f9400b0 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:36.413183 1974 raft_consensus.cc:2802] T 31885ef6a0c64613ae6723c07f9400b0 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:30:36.414863 1974 raft_consensus.cc:695] T 31885ef6a0c64613ae6723c07f9400b0 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Becoming Leader. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Running, Role: LEADER
I20250625 03:30:36.415680 1974 consensus_queue.cc:237] T 31885ef6a0c64613ae6723c07f9400b0 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.417819 1841 leader_election.cc:290] T 441042afd59544a4a04bf85fa69d7d55 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:36.418249 1596 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "441042afd59544a4a04bf85fa69d7d55" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
I20250625 03:30:36.418838 1596 raft_consensus.cc:3058] T 441042afd59544a4a04bf85fa69d7d55 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:36.422075 1667 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "441042afd59544a4a04bf85fa69d7d55" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:30:36.422767 1787 tablet_bootstrap.cc:654] T 93ecdce2da094dc9a80ac04828771fbd P 7e9c4f2e01164f33b2e9034ed148398e: Neither blocks nor log segments found. Creating new log.
W20250625 03:30:36.423264 1708 leader_election.cc:343] T 441042afd59544a4a04bf85fa69d7d55 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:36.429776 1785 tablet_bootstrap.cc:492] T c04f7c2d00994557b1cb83234b36fceb P 3f2aa40978064c9e9983cf3745eed206: No bootstrap required, opened a new log
I20250625 03:30:36.430148 1785 ts_tablet_manager.cc:1397] T c04f7c2d00994557b1cb83234b36fceb P 3f2aa40978064c9e9983cf3745eed206: Time spent bootstrapping tablet: real 0.072s user 0.022s sys 0.035s
I20250625 03:30:36.431902 1785 raft_consensus.cc:357] T c04f7c2d00994557b1cb83234b36fceb P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.432603 1785 raft_consensus.cc:383] T c04f7c2d00994557b1cb83234b36fceb P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:36.432880 1785 raft_consensus.cc:738] T c04f7c2d00994557b1cb83234b36fceb P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Initialized, Role: FOLLOWER
I20250625 03:30:36.433494 1785 consensus_queue.cc:260] T c04f7c2d00994557b1cb83234b36fceb P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.435914 1785 ts_tablet_manager.cc:1428] T c04f7c2d00994557b1cb83234b36fceb P 3f2aa40978064c9e9983cf3745eed206: Time spent starting tablet: real 0.006s user 0.005s sys 0.001s
I20250625 03:30:36.436812 1785 tablet_bootstrap.cc:492] T 441042afd59544a4a04bf85fa69d7d55 P 3f2aa40978064c9e9983cf3745eed206: Bootstrap starting.
I20250625 03:30:36.443178 1492 catalog_manager.cc:5582] T 31885ef6a0c64613ae6723c07f9400b0 P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } }
I20250625 03:30:36.444319 1786 tablet_bootstrap.cc:492] T cc3b100d6d574a68b79e6a8f23d77201 P ba464e89e0f044a0a0ea3e6125cbf2a1: No bootstrap required, opened a new log
I20250625 03:30:36.444765 1786 ts_tablet_manager.cc:1397] T cc3b100d6d574a68b79e6a8f23d77201 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent bootstrapping tablet: real 0.147s user 0.013s sys 0.001s
I20250625 03:30:36.445240 1596 raft_consensus.cc:2466] T 441042afd59544a4a04bf85fa69d7d55 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 1.
I20250625 03:30:36.446910 1709 leader_election.cc:304] T 441042afd59544a4a04bf85fa69d7d55 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 3f2aa40978064c9e9983cf3745eed206
I20250625 03:30:36.450023 1786 raft_consensus.cc:357] T cc3b100d6d574a68b79e6a8f23d77201 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.450714 1786 raft_consensus.cc:383] T cc3b100d6d574a68b79e6a8f23d77201 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:36.450990 1786 raft_consensus.cc:738] T cc3b100d6d574a68b79e6a8f23d77201 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Initialized, Role: FOLLOWER
I20250625 03:30:36.451644 1786 consensus_queue.cc:260] T cc3b100d6d574a68b79e6a8f23d77201 P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.453766 1786 ts_tablet_manager.cc:1428] T cc3b100d6d574a68b79e6a8f23d77201 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent starting tablet: real 0.009s user 0.006s sys 0.000s
I20250625 03:30:36.455747 1786 tablet_bootstrap.cc:492] T 64add559c121402aa1f7753538a50857 P ba464e89e0f044a0a0ea3e6125cbf2a1: Bootstrap starting.
I20250625 03:30:36.449240 2054 raft_consensus.cc:2802] T 441042afd59544a4a04bf85fa69d7d55 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:30:36.467659 1787 tablet_bootstrap.cc:492] T 93ecdce2da094dc9a80ac04828771fbd P 7e9c4f2e01164f33b2e9034ed148398e: No bootstrap required, opened a new log
I20250625 03:30:36.468231 1787 ts_tablet_manager.cc:1397] T 93ecdce2da094dc9a80ac04828771fbd P 7e9c4f2e01164f33b2e9034ed148398e: Time spent bootstrapping tablet: real 0.085s user 0.021s sys 0.008s
I20250625 03:30:36.471271 1593 raft_consensus.cc:1273] T 0c2b6052daaa4c57aaa55361e8d6e01c P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20250625 03:30:36.472363 2054 raft_consensus.cc:695] T 441042afd59544a4a04bf85fa69d7d55 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Becoming Leader. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Running, Role: LEADER
I20250625 03:30:36.472980 1787 raft_consensus.cc:357] T 93ecdce2da094dc9a80ac04828771fbd P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.473308 2054 consensus_queue.cc:237] T 441042afd59544a4a04bf85fa69d7d55 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.473891 1787 raft_consensus.cc:383] T 93ecdce2da094dc9a80ac04828771fbd P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:36.474380 1787 raft_consensus.cc:738] T 93ecdce2da094dc9a80ac04828771fbd P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Initialized, Role: FOLLOWER
I20250625 03:30:36.474653 2052 consensus_queue.cc:1035] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:30:36.475008 1787 consensus_queue.cc:260] T 93ecdce2da094dc9a80ac04828771fbd P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.478137 1593 raft_consensus.cc:3058] T 393f73bcf106475cbee7a645b0d9660c P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:36.488662 1787 ts_tablet_manager.cc:1428] T 93ecdce2da094dc9a80ac04828771fbd P 7e9c4f2e01164f33b2e9034ed148398e: Time spent starting tablet: real 0.020s user 0.007s sys 0.000s
I20250625 03:30:36.489470 1787 tablet_bootstrap.cc:492] T 9943bb8023444f49a11df01d93738f1e P 7e9c4f2e01164f33b2e9034ed148398e: Bootstrap starting.
I20250625 03:30:36.502103 1492 catalog_manager.cc:5582] T 441042afd59544a4a04bf85fa69d7d55 P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: HEALTHY } } }
I20250625 03:30:36.511555 1786 tablet_bootstrap.cc:654] T 64add559c121402aa1f7753538a50857 P ba464e89e0f044a0a0ea3e6125cbf2a1: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:36.512537 1787 tablet_bootstrap.cc:654] T 9943bb8023444f49a11df01d93738f1e P 7e9c4f2e01164f33b2e9034ed148398e: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:36.547300 1744 raft_consensus.cc:1273] T 0c2b6052daaa4c57aaa55361e8d6e01c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20250625 03:30:36.549542 1785 tablet_bootstrap.cc:654] T 441042afd59544a4a04bf85fa69d7d55 P 3f2aa40978064c9e9983cf3745eed206: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:36.549957 2093 consensus_queue.cc:1035] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:30:36.565726 1786 tablet_bootstrap.cc:492] T 64add559c121402aa1f7753538a50857 P ba464e89e0f044a0a0ea3e6125cbf2a1: No bootstrap required, opened a new log
I20250625 03:30:36.566650 1786 ts_tablet_manager.cc:1397] T 64add559c121402aa1f7753538a50857 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent bootstrapping tablet: real 0.111s user 0.016s sys 0.010s
I20250625 03:30:36.572037 2093 consensus_queue.cc:1035] T 3037be35f2054cbbabd8a47062f84244 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:30:36.577634 1787 tablet_bootstrap.cc:492] T 9943bb8023444f49a11df01d93738f1e P 7e9c4f2e01164f33b2e9034ed148398e: No bootstrap required, opened a new log
I20250625 03:30:36.580472 1787 ts_tablet_manager.cc:1397] T 9943bb8023444f49a11df01d93738f1e P 7e9c4f2e01164f33b2e9034ed148398e: Time spent bootstrapping tablet: real 0.091s user 0.013s sys 0.024s
I20250625 03:30:36.583401 1785 tablet_bootstrap.cc:492] T 441042afd59544a4a04bf85fa69d7d55 P 3f2aa40978064c9e9983cf3745eed206: No bootstrap required, opened a new log
I20250625 03:30:36.593288 1785 ts_tablet_manager.cc:1397] T 441042afd59544a4a04bf85fa69d7d55 P 3f2aa40978064c9e9983cf3745eed206: Time spent bootstrapping tablet: real 0.157s user 0.010s sys 0.007s
I20250625 03:30:36.587478 1786 raft_consensus.cc:357] T 64add559c121402aa1f7753538a50857 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.595082 1786 raft_consensus.cc:383] T 64add559c121402aa1f7753538a50857 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:36.595373 1786 raft_consensus.cc:738] T 64add559c121402aa1f7753538a50857 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Initialized, Role: FOLLOWER
I20250625 03:30:36.596071 1786 consensus_queue.cc:260] T 64add559c121402aa1f7753538a50857 P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.588045 1787 raft_consensus.cc:357] T 9943bb8023444f49a11df01d93738f1e P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.597887 1787 raft_consensus.cc:383] T 9943bb8023444f49a11df01d93738f1e P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:36.598152 1787 raft_consensus.cc:738] T 9943bb8023444f49a11df01d93738f1e P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Initialized, Role: FOLLOWER
I20250625 03:30:36.598713 1787 consensus_queue.cc:260] T 9943bb8023444f49a11df01d93738f1e P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.600363 1787 ts_tablet_manager.cc:1428] T 9943bb8023444f49a11df01d93738f1e P 7e9c4f2e01164f33b2e9034ed148398e: Time spent starting tablet: real 0.019s user 0.006s sys 0.000s
I20250625 03:30:36.601243 1787 tablet_bootstrap.cc:492] T a5a18934cc3f490288432ee1cb30b278 P 7e9c4f2e01164f33b2e9034ed148398e: Bootstrap starting.
I20250625 03:30:36.605894 1785 raft_consensus.cc:357] T 441042afd59544a4a04bf85fa69d7d55 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.606647 1785 raft_consensus.cc:383] T 441042afd59544a4a04bf85fa69d7d55 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:36.606940 1785 raft_consensus.cc:738] T 441042afd59544a4a04bf85fa69d7d55 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Initialized, Role: FOLLOWER
I20250625 03:30:36.607538 1785 consensus_queue.cc:260] T 441042afd59544a4a04bf85fa69d7d55 P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.608327 1787 tablet_bootstrap.cc:654] T a5a18934cc3f490288432ee1cb30b278 P 7e9c4f2e01164f33b2e9034ed148398e: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:36.606379 2093 consensus_queue.cc:1035] T 3037be35f2054cbbabd8a47062f84244 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:30:36.610942 1785 ts_tablet_manager.cc:1428] T 441042afd59544a4a04bf85fa69d7d55 P 3f2aa40978064c9e9983cf3745eed206: Time spent starting tablet: real 0.016s user 0.006s sys 0.000s
I20250625 03:30:36.620151 1785 tablet_bootstrap.cc:492] T 64add559c121402aa1f7753538a50857 P 3f2aa40978064c9e9983cf3745eed206: Bootstrap starting.
I20250625 03:30:36.627117 1787 tablet_bootstrap.cc:492] T a5a18934cc3f490288432ee1cb30b278 P 7e9c4f2e01164f33b2e9034ed148398e: No bootstrap required, opened a new log
I20250625 03:30:36.627627 1787 ts_tablet_manager.cc:1397] T a5a18934cc3f490288432ee1cb30b278 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent bootstrapping tablet: real 0.027s user 0.010s sys 0.000s
I20250625 03:30:36.629940 1787 raft_consensus.cc:357] T a5a18934cc3f490288432ee1cb30b278 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.630685 1787 raft_consensus.cc:383] T a5a18934cc3f490288432ee1cb30b278 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:36.630940 1787 raft_consensus.cc:738] T a5a18934cc3f490288432ee1cb30b278 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Initialized, Role: FOLLOWER
I20250625 03:30:36.631366 1785 tablet_bootstrap.cc:654] T 64add559c121402aa1f7753538a50857 P 3f2aa40978064c9e9983cf3745eed206: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:36.631521 1787 consensus_queue.cc:260] T a5a18934cc3f490288432ee1cb30b278 P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.633808 1787 ts_tablet_manager.cc:1428] T a5a18934cc3f490288432ee1cb30b278 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20250625 03:30:36.634316 1975 raft_consensus.cc:491] T c04f7c2d00994557b1cb83234b36fceb P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:36.634855 1975 raft_consensus.cc:513] T c04f7c2d00994557b1cb83234b36fceb P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.640373 1975 leader_election.cc:290] T c04f7c2d00994557b1cb83234b36fceb P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:36.640594 1744 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c04f7c2d00994557b1cb83234b36fceb" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:36.641273 1744 raft_consensus.cc:2466] T c04f7c2d00994557b1cb83234b36fceb P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 0.
I20250625 03:30:36.642606 1636 leader_election.cc:304] T c04f7c2d00994557b1cb83234b36fceb P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters:
I20250625 03:30:36.643431 1975 raft_consensus.cc:2802] T c04f7c2d00994557b1cb83234b36fceb P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:30:36.643796 1975 raft_consensus.cc:491] T c04f7c2d00994557b1cb83234b36fceb P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:30:36.644153 1975 raft_consensus.cc:3058] T c04f7c2d00994557b1cb83234b36fceb P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:36.645186 1590 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c04f7c2d00994557b1cb83234b36fceb" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
W20250625 03:30:36.646697 1635 leader_election.cc:343] T c04f7c2d00994557b1cb83234b36fceb P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:36.647418 1787 tablet_bootstrap.cc:492] T cc3b100d6d574a68b79e6a8f23d77201 P 7e9c4f2e01164f33b2e9034ed148398e: Bootstrap starting.
I20250625 03:30:36.652499 1975 raft_consensus.cc:513] T c04f7c2d00994557b1cb83234b36fceb P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.653357 1787 tablet_bootstrap.cc:654] T cc3b100d6d574a68b79e6a8f23d77201 P 7e9c4f2e01164f33b2e9034ed148398e: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:36.655321 1975 leader_election.cc:290] T c04f7c2d00994557b1cb83234b36fceb P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:36.656705 1592 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c04f7c2d00994557b1cb83234b36fceb" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
I20250625 03:30:36.657346 1785 tablet_bootstrap.cc:492] T 64add559c121402aa1f7753538a50857 P 3f2aa40978064c9e9983cf3745eed206: No bootstrap required, opened a new log
I20250625 03:30:36.657794 1785 ts_tablet_manager.cc:1397] T 64add559c121402aa1f7753538a50857 P 3f2aa40978064c9e9983cf3745eed206: Time spent bootstrapping tablet: real 0.038s user 0.014s sys 0.001s
I20250625 03:30:36.659264 1743 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c04f7c2d00994557b1cb83234b36fceb" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:30:36.659857 1743 raft_consensus.cc:3058] T c04f7c2d00994557b1cb83234b36fceb P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Advancing to term 1
W20250625 03:30:36.662952 1635 leader_election.cc:343] T c04f7c2d00994557b1cb83234b36fceb P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:36.672915 1743 raft_consensus.cc:2466] T c04f7c2d00994557b1cb83234b36fceb P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 1.
I20250625 03:30:36.678763 1785 raft_consensus.cc:357] T 64add559c121402aa1f7753538a50857 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.679893 1785 raft_consensus.cc:383] T 64add559c121402aa1f7753538a50857 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:36.680198 1785 raft_consensus.cc:738] T 64add559c121402aa1f7753538a50857 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Initialized, Role: FOLLOWER
I20250625 03:30:36.681571 1786 ts_tablet_manager.cc:1428] T 64add559c121402aa1f7753538a50857 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent starting tablet: real 0.115s user 0.006s sys 0.002s
I20250625 03:30:36.683183 1636 leader_election.cc:304] T c04f7c2d00994557b1cb83234b36fceb P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:36.684088 1785 consensus_queue.cc:260] T 64add559c121402aa1f7753538a50857 P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.686530 1785 ts_tablet_manager.cc:1428] T 64add559c121402aa1f7753538a50857 P 3f2aa40978064c9e9983cf3745eed206: Time spent starting tablet: real 0.028s user 0.006s sys 0.000s
I20250625 03:30:36.687413 1785 tablet_bootstrap.cc:492] T fa68c3b7143345958f883bde3591b622 P 3f2aa40978064c9e9983cf3745eed206: Bootstrap starting.
I20250625 03:30:36.695326 1786 tablet_bootstrap.cc:492] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1: Bootstrap starting.
I20250625 03:30:36.707567 1787 tablet_bootstrap.cc:492] T cc3b100d6d574a68b79e6a8f23d77201 P 7e9c4f2e01164f33b2e9034ed148398e: No bootstrap required, opened a new log
I20250625 03:30:36.708123 1787 ts_tablet_manager.cc:1397] T cc3b100d6d574a68b79e6a8f23d77201 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent bootstrapping tablet: real 0.061s user 0.042s sys 0.014s
I20250625 03:30:36.709944 1975 raft_consensus.cc:491] T 441042afd59544a4a04bf85fa69d7d55 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:36.710683 1975 raft_consensus.cc:513] T 441042afd59544a4a04bf85fa69d7d55 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.712904 1975 leader_election.cc:290] T 441042afd59544a4a04bf85fa69d7d55 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:36.713276 1786 tablet_bootstrap.cc:654] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:36.715763 1974 raft_consensus.cc:2802] T c04f7c2d00994557b1cb83234b36fceb P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:30:36.716058 1743 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "441042afd59544a4a04bf85fa69d7d55" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:36.716320 1974 raft_consensus.cc:695] T c04f7c2d00994557b1cb83234b36fceb P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Becoming Leader. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Running, Role: LEADER
I20250625 03:30:36.717653 1974 consensus_queue.cc:237] T c04f7c2d00994557b1cb83234b36fceb P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.720286 1785 tablet_bootstrap.cc:654] T fa68c3b7143345958f883bde3591b622 P 3f2aa40978064c9e9983cf3745eed206: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:36.725474 1592 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "441042afd59544a4a04bf85fa69d7d55" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:36.726399 1592 raft_consensus.cc:2391] T 441042afd59544a4a04bf85fa69d7d55 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f2aa40978064c9e9983cf3745eed206 in current term 1: Already voted for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in this term.
I20250625 03:30:36.727382 1635 leader_election.cc:304] T 441042afd59544a4a04bf85fa69d7d55 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206; no voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:36.710748 1787 raft_consensus.cc:357] T cc3b100d6d574a68b79e6a8f23d77201 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.728228 1975 raft_consensus.cc:3058] T 441042afd59544a4a04bf85fa69d7d55 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:36.728549 1787 raft_consensus.cc:383] T cc3b100d6d574a68b79e6a8f23d77201 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:36.728770 1787 raft_consensus.cc:738] T cc3b100d6d574a68b79e6a8f23d77201 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Initialized, Role: FOLLOWER
I20250625 03:30:36.729249 1787 consensus_queue.cc:260] T cc3b100d6d574a68b79e6a8f23d77201 P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.731194 1787 ts_tablet_manager.cc:1428] T cc3b100d6d574a68b79e6a8f23d77201 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent starting tablet: real 0.023s user 0.004s sys 0.001s
I20250625 03:30:36.732118 1787 tablet_bootstrap.cc:492] T b31026f89f1e49949acec419db9649d3 P 7e9c4f2e01164f33b2e9034ed148398e: Bootstrap starting.
I20250625 03:30:36.735863 1975 raft_consensus.cc:2747] T 441042afd59544a4a04bf85fa69d7d55 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:30:36.739034 1786 tablet_bootstrap.cc:492] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1: No bootstrap required, opened a new log
I20250625 03:30:36.739478 1786 ts_tablet_manager.cc:1397] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent bootstrapping tablet: real 0.044s user 0.007s sys 0.003s
I20250625 03:30:36.743374 1786 raft_consensus.cc:357] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.744334 1786 raft_consensus.cc:383] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:36.744700 1786 raft_consensus.cc:738] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Initialized, Role: FOLLOWER
I20250625 03:30:36.745846 1787 tablet_bootstrap.cc:654] T b31026f89f1e49949acec419db9649d3 P 7e9c4f2e01164f33b2e9034ed148398e: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:36.746855 1786 consensus_queue.cc:260] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.749383 1786 ts_tablet_manager.cc:1428] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent starting tablet: real 0.010s user 0.008s sys 0.000s
I20250625 03:30:36.757650 1786 tablet_bootstrap.cc:492] T a1d83fca2b484feeaff6f350fe749b24 P ba464e89e0f044a0a0ea3e6125cbf2a1: Bootstrap starting.
I20250625 03:30:36.764523 1786 tablet_bootstrap.cc:654] T a1d83fca2b484feeaff6f350fe749b24 P ba464e89e0f044a0a0ea3e6125cbf2a1: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:36.766094 1950 raft_consensus.cc:491] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:36.766590 1950 raft_consensus.cc:513] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.768528 1950 leader_election.cc:290] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:36.769989 1592 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b31026f89f1e49949acec419db9649d3" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:36.771625 1592 raft_consensus.cc:3058] T 9943bb8023444f49a11df01d93738f1e P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:36.772480 1671 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b31026f89f1e49949acec419db9649d3" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:36.773099 1671 raft_consensus.cc:2466] T b31026f89f1e49949acec419db9649d3 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 0.
W20250625 03:30:36.774178 1709 leader_election.cc:343] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:36.776098 1708 leader_election.cc:304] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:36.777365 1951 raft_consensus.cc:2802] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:30:36.777738 1951 raft_consensus.cc:491] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:30:36.778059 1951 raft_consensus.cc:3058] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:36.782970 1787 tablet_bootstrap.cc:492] T b31026f89f1e49949acec419db9649d3 P 7e9c4f2e01164f33b2e9034ed148398e: No bootstrap required, opened a new log
I20250625 03:30:36.783372 1787 ts_tablet_manager.cc:1397] T b31026f89f1e49949acec419db9649d3 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent bootstrapping tablet: real 0.051s user 0.011s sys 0.000s
I20250625 03:30:36.785619 1841 raft_consensus.cc:491] T cc3b100d6d574a68b79e6a8f23d77201 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:36.786048 1841 raft_consensus.cc:513] T cc3b100d6d574a68b79e6a8f23d77201 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.786484 1787 raft_consensus.cc:357] T b31026f89f1e49949acec419db9649d3 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.787120 1787 raft_consensus.cc:383] T b31026f89f1e49949acec419db9649d3 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:36.787358 1787 raft_consensus.cc:738] T b31026f89f1e49949acec419db9649d3 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Initialized, Role: FOLLOWER
I20250625 03:30:36.787982 1787 consensus_queue.cc:260] T b31026f89f1e49949acec419db9649d3 P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.789076 1596 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cc3b100d6d574a68b79e6a8f23d77201" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:36.789611 1785 tablet_bootstrap.cc:492] T fa68c3b7143345958f883bde3591b622 P 3f2aa40978064c9e9983cf3745eed206: No bootstrap required, opened a new log
I20250625 03:30:36.789722 1596 raft_consensus.cc:2466] T cc3b100d6d574a68b79e6a8f23d77201 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 0.
I20250625 03:30:36.790087 1785 ts_tablet_manager.cc:1397] T fa68c3b7143345958f883bde3591b622 P 3f2aa40978064c9e9983cf3745eed206: Time spent bootstrapping tablet: real 0.103s user 0.013s sys 0.019s
I20250625 03:30:36.790427 1787 ts_tablet_manager.cc:1428] T b31026f89f1e49949acec419db9649d3 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent starting tablet: real 0.007s user 0.000s sys 0.005s
I20250625 03:30:36.791355 1787 tablet_bootstrap.cc:492] T a1d83fca2b484feeaff6f350fe749b24 P 7e9c4f2e01164f33b2e9034ed148398e: Bootstrap starting.
I20250625 03:30:36.787531 1951 raft_consensus.cc:513] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.792994 1709 leader_election.cc:304] T cc3b100d6d574a68b79e6a8f23d77201 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters:
I20250625 03:30:36.793967 1950 raft_consensus.cc:2802] T cc3b100d6d574a68b79e6a8f23d77201 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:30:36.794363 1950 raft_consensus.cc:491] T cc3b100d6d574a68b79e6a8f23d77201 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:30:36.794675 1951 leader_election.cc:290] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:36.794770 1950 raft_consensus.cc:3058] T cc3b100d6d574a68b79e6a8f23d77201 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:36.783356 1492 catalog_manager.cc:5582] T c04f7c2d00994557b1cb83234b36fceb P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } }
I20250625 03:30:36.797665 1787 tablet_bootstrap.cc:654] T a1d83fca2b484feeaff6f350fe749b24 P 7e9c4f2e01164f33b2e9034ed148398e: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:36.801172 1667 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b31026f89f1e49949acec419db9649d3" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:30:36.801534 1668 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cc3b100d6d574a68b79e6a8f23d77201" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:36.801822 1667 raft_consensus.cc:3058] T b31026f89f1e49949acec419db9649d3 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:36.802318 1668 raft_consensus.cc:2466] T cc3b100d6d574a68b79e6a8f23d77201 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 0.
I20250625 03:30:36.806507 1594 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b31026f89f1e49949acec419db9649d3" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
I20250625 03:30:36.807171 1594 raft_consensus.cc:3058] T b31026f89f1e49949acec419db9649d3 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:36.811105 1841 leader_election.cc:290] T cc3b100d6d574a68b79e6a8f23d77201 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:36.812825 1785 raft_consensus.cc:357] T fa68c3b7143345958f883bde3591b622 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.813547 1785 raft_consensus.cc:383] T fa68c3b7143345958f883bde3591b622 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:36.813817 1785 raft_consensus.cc:738] T fa68c3b7143345958f883bde3591b622 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Initialized, Role: FOLLOWER
I20250625 03:30:36.814455 1785 consensus_queue.cc:260] T fa68c3b7143345958f883bde3591b622 P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.815083 1667 raft_consensus.cc:2466] T b31026f89f1e49949acec419db9649d3 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 1.
I20250625 03:30:36.826365 1975 consensus_queue.cc:1035] T 31885ef6a0c64613ae6723c07f9400b0 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:30:36.818717 1708 leader_election.cc:304] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters:
I20250625 03:30:36.828841 1787 tablet_bootstrap.cc:492] T a1d83fca2b484feeaff6f350fe749b24 P 7e9c4f2e01164f33b2e9034ed148398e: No bootstrap required, opened a new log
I20250625 03:30:36.829182 2054 raft_consensus.cc:2802] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:30:36.829361 1787 ts_tablet_manager.cc:1397] T a1d83fca2b484feeaff6f350fe749b24 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent bootstrapping tablet: real 0.038s user 0.011s sys 0.008s
I20250625 03:30:36.829664 1786 tablet_bootstrap.cc:492] T a1d83fca2b484feeaff6f350fe749b24 P ba464e89e0f044a0a0ea3e6125cbf2a1: No bootstrap required, opened a new log
I20250625 03:30:36.829718 2054 raft_consensus.cc:695] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Becoming Leader. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Running, Role: LEADER
I20250625 03:30:36.830969 1786 ts_tablet_manager.cc:1397] T a1d83fca2b484feeaff6f350fe749b24 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent bootstrapping tablet: real 0.073s user 0.013s sys 0.000s
I20250625 03:30:36.830773 2054 consensus_queue.cc:237] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.833928 1786 raft_consensus.cc:357] T a1d83fca2b484feeaff6f350fe749b24 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.834857 1786 raft_consensus.cc:383] T a1d83fca2b484feeaff6f350fe749b24 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:36.835192 1786 raft_consensus.cc:738] T a1d83fca2b484feeaff6f350fe749b24 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Initialized, Role: FOLLOWER
I20250625 03:30:36.836848 2047 raft_consensus.cc:491] T 64add559c121402aa1f7753538a50857 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:36.837357 2047 raft_consensus.cc:513] T 64add559c121402aa1f7753538a50857 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.837443 1787 raft_consensus.cc:357] T a1d83fca2b484feeaff6f350fe749b24 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.838322 1785 ts_tablet_manager.cc:1428] T fa68c3b7143345958f883bde3591b622 P 3f2aa40978064c9e9983cf3745eed206: Time spent starting tablet: real 0.048s user 0.005s sys 0.003s
I20250625 03:30:36.838424 1787 raft_consensus.cc:383] T a1d83fca2b484feeaff6f350fe749b24 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:36.838938 1787 raft_consensus.cc:738] T a1d83fca2b484feeaff6f350fe749b24 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Initialized, Role: FOLLOWER
I20250625 03:30:36.839532 2047 leader_election.cc:290] T 64add559c121402aa1f7753538a50857 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:36.839672 1787 consensus_queue.cc:260] T a1d83fca2b484feeaff6f350fe749b24 P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.842032 1787 ts_tablet_manager.cc:1428] T a1d83fca2b484feeaff6f350fe749b24 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent starting tablet: real 0.012s user 0.005s sys 0.000s
I20250625 03:30:36.842330 1786 consensus_queue.cc:260] T a1d83fca2b484feeaff6f350fe749b24 P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.843075 1787 tablet_bootstrap.cc:492] T fa68c3b7143345958f883bde3591b622 P 7e9c4f2e01164f33b2e9034ed148398e: Bootstrap starting.
I20250625 03:30:36.844447 1786 ts_tablet_manager.cc:1428] T a1d83fca2b484feeaff6f350fe749b24 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent starting tablet: real 0.013s user 0.007s sys 0.000s
I20250625 03:30:36.844316 1592 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "64add559c121402aa1f7753538a50857" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:36.844697 1785 tablet_bootstrap.cc:492] T b3f18b9311894580bc336199d357df41 P 3f2aa40978064c9e9983cf3745eed206: Bootstrap starting.
W20250625 03:30:36.845633 1709 leader_election.cc:343] T 64add559c121402aa1f7753538a50857 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:36.847002 1786 tablet_bootstrap.cc:492] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P ba464e89e0f044a0a0ea3e6125cbf2a1: Bootstrap starting.
I20250625 03:30:36.848331 1667 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "64add559c121402aa1f7753538a50857" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:36.848970 1667 raft_consensus.cc:2466] T 64add559c121402aa1f7753538a50857 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 0.
I20250625 03:30:36.852777 1786 tablet_bootstrap.cc:654] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P ba464e89e0f044a0a0ea3e6125cbf2a1: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:36.855154 1708 leader_election.cc:304] T 64add559c121402aa1f7753538a50857 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:36.856504 1841 raft_consensus.cc:2802] T 64add559c121402aa1f7753538a50857 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:30:36.856850 1841 raft_consensus.cc:491] T 64add559c121402aa1f7753538a50857 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:30:36.857169 1841 raft_consensus.cc:3058] T 64add559c121402aa1f7753538a50857 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:36.858258 1787 tablet_bootstrap.cc:654] T fa68c3b7143345958f883bde3591b622 P 7e9c4f2e01164f33b2e9034ed148398e: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:36.867122 1785 tablet_bootstrap.cc:654] T b3f18b9311894580bc336199d357df41 P 3f2aa40978064c9e9983cf3745eed206: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:36.870183 1950 raft_consensus.cc:513] T cc3b100d6d574a68b79e6a8f23d77201 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.870952 1787 tablet_bootstrap.cc:492] T fa68c3b7143345958f883bde3591b622 P 7e9c4f2e01164f33b2e9034ed148398e: No bootstrap required, opened a new log
I20250625 03:30:36.871459 1787 ts_tablet_manager.cc:1397] T fa68c3b7143345958f883bde3591b622 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent bootstrapping tablet: real 0.029s user 0.013s sys 0.004s
I20250625 03:30:36.874652 1787 raft_consensus.cc:357] T fa68c3b7143345958f883bde3591b622 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.875541 1787 raft_consensus.cc:383] T fa68c3b7143345958f883bde3591b622 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:36.875876 1787 raft_consensus.cc:738] T fa68c3b7143345958f883bde3591b622 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Initialized, Role: FOLLOWER
I20250625 03:30:36.876645 1787 consensus_queue.cc:260] T fa68c3b7143345958f883bde3591b622 P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.864843 1594 raft_consensus.cc:2466] T b31026f89f1e49949acec419db9649d3 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 1.
I20250625 03:30:36.885663 1950 leader_election.cc:290] T cc3b100d6d574a68b79e6a8f23d77201 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
W20250625 03:30:36.886154 1635 consensus_peers.cc:487] T 31885ef6a0c64613ae6723c07f9400b0 P 3f2aa40978064c9e9983cf3745eed206 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:30:36.884747 1841 raft_consensus.cc:513] T 64add559c121402aa1f7753538a50857 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.891042 1787 ts_tablet_manager.cc:1428] T fa68c3b7143345958f883bde3591b622 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent starting tablet: real 0.019s user 0.003s sys 0.003s
I20250625 03:30:36.892318 1787 tablet_bootstrap.cc:492] T b3f18b9311894580bc336199d357df41 P 7e9c4f2e01164f33b2e9034ed148398e: Bootstrap starting.
I20250625 03:30:36.892448 1841 leader_election.cc:290] T 64add559c121402aa1f7753538a50857 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:36.893443 1592 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cc3b100d6d574a68b79e6a8f23d77201" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
I20250625 03:30:36.893850 1596 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "64add559c121402aa1f7753538a50857" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
I20250625 03:30:36.894070 1592 raft_consensus.cc:3058] T cc3b100d6d574a68b79e6a8f23d77201 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:36.890372 1671 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cc3b100d6d574a68b79e6a8f23d77201" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:30:36.895143 1671 raft_consensus.cc:3058] T cc3b100d6d574a68b79e6a8f23d77201 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Advancing to term 1
W20250625 03:30:36.903313 1709 leader_election.cc:343] T 64add559c121402aa1f7753538a50857 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:36.899523 1667 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "64add559c121402aa1f7753538a50857" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:30:36.904318 1667 raft_consensus.cc:3058] T 64add559c121402aa1f7753538a50857 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:36.889833 1943 raft_consensus.cc:491] T 93ecdce2da094dc9a80ac04828771fbd P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:36.913534 1671 raft_consensus.cc:2466] T cc3b100d6d574a68b79e6a8f23d77201 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 1.
I20250625 03:30:36.916206 1785 tablet_bootstrap.cc:492] T b3f18b9311894580bc336199d357df41 P 3f2aa40978064c9e9983cf3745eed206: No bootstrap required, opened a new log
I20250625 03:30:36.923811 1785 ts_tablet_manager.cc:1397] T b3f18b9311894580bc336199d357df41 P 3f2aa40978064c9e9983cf3745eed206: Time spent bootstrapping tablet: real 0.079s user 0.018s sys 0.002s
I20250625 03:30:36.918577 1786 tablet_bootstrap.cc:492] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P ba464e89e0f044a0a0ea3e6125cbf2a1: No bootstrap required, opened a new log
I20250625 03:30:36.924054 1708 leader_election.cc:304] T cc3b100d6d574a68b79e6a8f23d77201 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters:
I20250625 03:30:36.907953 1943 raft_consensus.cc:513] T 93ecdce2da094dc9a80ac04828771fbd P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.924654 1786 ts_tablet_manager.cc:1397] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent bootstrapping tablet: real 0.078s user 0.013s sys 0.014s
I20250625 03:30:36.926810 1594 raft_consensus.cc:3058] T 93ecdce2da094dc9a80ac04828771fbd P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:36.931152 1667 raft_consensus.cc:2466] T 64add559c121402aa1f7753538a50857 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 1.
I20250625 03:30:36.933669 1743 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "93ecdce2da094dc9a80ac04828771fbd" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:36.933918 1592 raft_consensus.cc:2466] T cc3b100d6d574a68b79e6a8f23d77201 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 1.
I20250625 03:30:36.934188 1786 raft_consensus.cc:357] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.934846 1786 raft_consensus.cc:383] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:36.935129 1786 raft_consensus.cc:738] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Initialized, Role: FOLLOWER
I20250625 03:30:36.935781 1708 leader_election.cc:304] T 64add559c121402aa1f7753538a50857 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:36.935731 1786 consensus_queue.cc:260] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.936765 1841 raft_consensus.cc:2802] T 64add559c121402aa1f7753538a50857 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:30:36.937873 1841 raft_consensus.cc:695] T 64add559c121402aa1f7753538a50857 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Becoming Leader. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Running, Role: LEADER
I20250625 03:30:36.938632 1841 consensus_queue.cc:237] T 64add559c121402aa1f7753538a50857 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.938848 1491 catalog_manager.cc:5582] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: HEALTHY } } }
I20250625 03:30:36.945561 1667 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "93ecdce2da094dc9a80ac04828771fbd" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:36.939628 1785 raft_consensus.cc:357] T b3f18b9311894580bc336199d357df41 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.946760 1785 raft_consensus.cc:383] T b3f18b9311894580bc336199d357df41 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:36.947059 1785 raft_consensus.cc:738] T b3f18b9311894580bc336199d357df41 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Initialized, Role: FOLLOWER
I20250625 03:30:36.947779 1785 consensus_queue.cc:260] T b3f18b9311894580bc336199d357df41 P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.941170 1787 tablet_bootstrap.cc:654] T b3f18b9311894580bc336199d357df41 P 7e9c4f2e01164f33b2e9034ed148398e: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:36.942328 1786 ts_tablet_manager.cc:1428] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent starting tablet: real 0.017s user 0.005s sys 0.000s
I20250625 03:30:36.942298 1943 leader_election.cc:290] T 93ecdce2da094dc9a80ac04828771fbd P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:36.943574 2053 raft_consensus.cc:491] T a5a18934cc3f490288432ee1cb30b278 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:36.953800 1786 tablet_bootstrap.cc:492] T 188e56b819ae44f9b72baefcbc749400 P ba464e89e0f044a0a0ea3e6125cbf2a1: Bootstrap starting.
I20250625 03:30:36.953661 2053 raft_consensus.cc:513] T a5a18934cc3f490288432ee1cb30b278 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.928881 2054 raft_consensus.cc:2802] T cc3b100d6d574a68b79e6a8f23d77201 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:30:36.956596 2053 leader_election.cc:290] T a5a18934cc3f490288432ee1cb30b278 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:36.957350 1785 ts_tablet_manager.cc:1428] T b3f18b9311894580bc336199d357df41 P 3f2aa40978064c9e9983cf3745eed206: Time spent starting tablet: real 0.033s user 0.006s sys 0.000s
I20250625 03:30:36.958211 1743 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a5a18934cc3f490288432ee1cb30b278" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:36.959986 1785 tablet_bootstrap.cc:492] T 390aa72f98414be291f01e4e4fec77f1 P 3f2aa40978064c9e9983cf3745eed206: Bootstrap starting.
W20250625 03:30:36.961414 1561 leader_election.cc:343] T a5a18934cc3f490288432ee1cb30b278 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:36.962724 2054 raft_consensus.cc:695] T cc3b100d6d574a68b79e6a8f23d77201 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Becoming Leader. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Running, Role: LEADER
I20250625 03:30:36.964870 2054 consensus_queue.cc:237] T cc3b100d6d574a68b79e6a8f23d77201 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.965879 2052 raft_consensus.cc:491] T b3f18b9311894580bc336199d357df41 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:36.966352 2052 raft_consensus.cc:513] T b3f18b9311894580bc336199d357df41 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.969650 2052 leader_election.cc:290] T b3f18b9311894580bc336199d357df41 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:36.970690 1743 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b3f18b9311894580bc336199d357df41" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:36.971323 1743 raft_consensus.cc:2466] T b3f18b9311894580bc336199d357df41 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 0.
I20250625 03:30:36.972322 1636 leader_election.cc:304] T b3f18b9311894580bc336199d357df41 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters:
I20250625 03:30:36.974825 2052 raft_consensus.cc:2802] T b3f18b9311894580bc336199d357df41 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:30:36.974727 1592 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b3f18b9311894580bc336199d357df41" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:36.975231 2052 raft_consensus.cc:491] T b3f18b9311894580bc336199d357df41 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:30:36.975778 2052 raft_consensus.cc:3058] T b3f18b9311894580bc336199d357df41 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Advancing to term 1
W20250625 03:30:36.978010 1635 leader_election.cc:343] T b3f18b9311894580bc336199d357df41 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:36.980933 1950 consensus_queue.cc:1035] T 441042afd59544a4a04bf85fa69d7d55 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:30:36.986943 1787 tablet_bootstrap.cc:492] T b3f18b9311894580bc336199d357df41 P 7e9c4f2e01164f33b2e9034ed148398e: No bootstrap required, opened a new log
I20250625 03:30:36.987454 1787 ts_tablet_manager.cc:1397] T b3f18b9311894580bc336199d357df41 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent bootstrapping tablet: real 0.096s user 0.009s sys 0.003s
I20250625 03:30:36.988559 1667 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a5a18934cc3f490288432ee1cb30b278" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:36.989542 1667 raft_consensus.cc:2466] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 0.
I20250625 03:30:36.996480 1950 raft_consensus.cc:491] T a1d83fca2b484feeaff6f350fe749b24 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:36.996505 1559 leader_election.cc:304] T 93ecdce2da094dc9a80ac04828771fbd P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e; no voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:36.997030 1950 raft_consensus.cc:513] T a1d83fca2b484feeaff6f350fe749b24 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:36.998142 1559 leader_election.cc:304] T a5a18934cc3f490288432ee1cb30b278 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e; no voters: ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:36.999125 2053 raft_consensus.cc:2747] T 93ecdce2da094dc9a80ac04828771fbd P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:30:36.999783 1950 leader_election.cc:290] T a1d83fca2b484feeaff6f350fe749b24 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:36.999624 1592 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a1d83fca2b484feeaff6f350fe749b24" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:37.000466 1592 raft_consensus.cc:2466] T a1d83fca2b484feeaff6f350fe749b24 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 0.
I20250625 03:30:36.999730 2053 raft_consensus.cc:2802] T a5a18934cc3f490288432ee1cb30b278 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:30:37.001295 2053 raft_consensus.cc:491] T a5a18934cc3f490288432ee1cb30b278 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:30:37.001451 1709 leader_election.cc:304] T a1d83fca2b484feeaff6f350fe749b24 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters:
I20250625 03:30:37.001652 2053 raft_consensus.cc:3058] T a5a18934cc3f490288432ee1cb30b278 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:37.002342 1950 raft_consensus.cc:2802] T a1d83fca2b484feeaff6f350fe749b24 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:30:37.002686 1950 raft_consensus.cc:491] T a1d83fca2b484feeaff6f350fe749b24 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:30:37.003049 1950 raft_consensus.cc:3058] T a1d83fca2b484feeaff6f350fe749b24 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:37.005034 1786 tablet_bootstrap.cc:654] T 188e56b819ae44f9b72baefcbc749400 P ba464e89e0f044a0a0ea3e6125cbf2a1: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:37.005487 1951 raft_consensus.cc:491] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:37.005951 1951 raft_consensus.cc:513] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:37.009085 1951 leader_election.cc:290] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:37.011905 2053 raft_consensus.cc:513] T a5a18934cc3f490288432ee1cb30b278 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:37.012401 1951 consensus_queue.cc:1035] T 441042afd59544a4a04bf85fa69d7d55 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:30:37.013841 2053 leader_election.cc:290] T a5a18934cc3f490288432ee1cb30b278 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 election: Requested vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:37.014843 1743 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a5a18934cc3f490288432ee1cb30b278" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
W20250625 03:30:37.016543 1561 leader_election.cc:343] T a5a18934cc3f490288432ee1cb30b278 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:37.009783 1667 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a1d83fca2b484feeaff6f350fe749b24" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:37.010812 1593 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a9ae17eec3fe4ce0841d3fb17c91a8b8" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:37.020599 1785 tablet_bootstrap.cc:654] T 390aa72f98414be291f01e4e4fec77f1 P 3f2aa40978064c9e9983cf3745eed206: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:37.011485 1668 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a9ae17eec3fe4ce0841d3fb17c91a8b8" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:37.029193 1787 raft_consensus.cc:357] T b3f18b9311894580bc336199d357df41 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
W20250625 03:30:37.029551 1709 leader_election.cc:343] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
W20250625 03:30:37.042709 1708 leader_election.cc:343] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:37.034471 2052 raft_consensus.cc:513] T b3f18b9311894580bc336199d357df41 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:37.043974 1787 raft_consensus.cc:383] T b3f18b9311894580bc336199d357df41 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:37.045572 1787 raft_consensus.cc:738] T b3f18b9311894580bc336199d357df41 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Initialized, Role: FOLLOWER
I20250625 03:30:37.047010 1787 consensus_queue.cc:260] T b3f18b9311894580bc336199d357df41 P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:37.066143 1787 ts_tablet_manager.cc:1428] T b3f18b9311894580bc336199d357df41 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent starting tablet: real 0.078s user 0.003s sys 0.006s
I20250625 03:30:37.066298 1708 leader_election.cc:304] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:37.069515 1787 tablet_bootstrap.cc:492] T ba2ab3296190416aa07624e6d69ba09b P 7e9c4f2e01164f33b2e9034ed148398e: Bootstrap starting.
I20250625 03:30:37.071532 1841 raft_consensus.cc:2747] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:30:37.072659 2052 leader_election.cc:290] T b3f18b9311894580bc336199d357df41 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:37.077359 1743 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b3f18b9311894580bc336199d357df41" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:30:37.078049 1743 raft_consensus.cc:3058] T b3f18b9311894580bc336199d357df41 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Advancing to term 1
W20250625 03:30:37.084568 1708 leader_election.cc:343] T a1d83fca2b484feeaff6f350fe749b24 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:37.097236 1594 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b3f18b9311894580bc336199d357df41" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
I20250625 03:30:37.097810 1667 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a5a18934cc3f490288432ee1cb30b278" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:30:37.108649 1594 raft_consensus.cc:3058] T b3f18b9311894580bc336199d357df41 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:37.114975 1786 tablet_bootstrap.cc:492] T 188e56b819ae44f9b72baefcbc749400 P ba464e89e0f044a0a0ea3e6125cbf2a1: No bootstrap required, opened a new log
I20250625 03:30:37.115478 1786 ts_tablet_manager.cc:1397] T 188e56b819ae44f9b72baefcbc749400 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent bootstrapping tablet: real 0.162s user 0.014s sys 0.012s
I20250625 03:30:37.116405 1492 catalog_manager.cc:5582] T 64add559c121402aa1f7753538a50857 P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: HEALTHY } } }
I20250625 03:30:37.117507 1492 catalog_manager.cc:5582] T cc3b100d6d574a68b79e6a8f23d77201 P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: HEALTHY } } }
I20250625 03:30:37.111939 1667 raft_consensus.cc:3058] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:37.120534 1950 raft_consensus.cc:513] T a1d83fca2b484feeaff6f350fe749b24 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:37.122481 1950 leader_election.cc:290] T a1d83fca2b484feeaff6f350fe749b24 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:37.123431 1593 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a1d83fca2b484feeaff6f350fe749b24" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
I20250625 03:30:37.124042 1593 raft_consensus.cc:3058] T a1d83fca2b484feeaff6f350fe749b24 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:37.133455 1593 raft_consensus.cc:2466] T a1d83fca2b484feeaff6f350fe749b24 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 1.
I20250625 03:30:37.136632 1943 raft_consensus.cc:491] T fa68c3b7143345958f883bde3591b622 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:37.137157 1943 raft_consensus.cc:513] T fa68c3b7143345958f883bde3591b622 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:37.139504 1943 leader_election.cc:290] T fa68c3b7143345958f883bde3591b622 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:37.145501 1709 leader_election.cc:304] T a1d83fca2b484feeaff6f350fe749b24 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters:
I20250625 03:30:37.147429 1670 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fa68c3b7143345958f883bde3591b622" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:37.148097 1670 raft_consensus.cc:2466] T fa68c3b7143345958f883bde3591b622 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 0.
I20250625 03:30:37.148900 2141 raft_consensus.cc:2802] T a1d83fca2b484feeaff6f350fe749b24 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:30:37.149451 2141 raft_consensus.cc:695] T a1d83fca2b484feeaff6f350fe749b24 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Becoming Leader. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Running, Role: LEADER
I20250625 03:30:37.141811 1668 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a1d83fca2b484feeaff6f350fe749b24" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:30:37.152065 1559 leader_election.cc:304] T fa68c3b7143345958f883bde3591b622 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e; no voters:
I20250625 03:30:37.153463 1739 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fa68c3b7143345958f883bde3591b622" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:37.154106 1739 raft_consensus.cc:2466] T fa68c3b7143345958f883bde3591b622 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 0.
I20250625 03:30:37.154633 2138 raft_consensus.cc:2802] T fa68c3b7143345958f883bde3591b622 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:30:37.155014 2138 raft_consensus.cc:491] T fa68c3b7143345958f883bde3591b622 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:30:37.155340 2138 raft_consensus.cc:3058] T fa68c3b7143345958f883bde3591b622 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Advancing to term 1
W20250625 03:30:37.157471 1708 leader_election.cc:343] T a1d83fca2b484feeaff6f350fe749b24 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:37.160938 1786 raft_consensus.cc:357] T 188e56b819ae44f9b72baefcbc749400 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:37.161897 1786 raft_consensus.cc:383] T 188e56b819ae44f9b72baefcbc749400 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:37.162249 1786 raft_consensus.cc:738] T 188e56b819ae44f9b72baefcbc749400 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Initialized, Role: FOLLOWER
I20250625 03:30:37.163493 1786 consensus_queue.cc:260] T 188e56b819ae44f9b72baefcbc749400 P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:37.178453 1594 raft_consensus.cc:2466] T b3f18b9311894580bc336199d357df41 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 1.
I20250625 03:30:37.180624 1785 tablet_bootstrap.cc:492] T 390aa72f98414be291f01e4e4fec77f1 P 3f2aa40978064c9e9983cf3745eed206: No bootstrap required, opened a new log
I20250625 03:30:37.181480 1785 ts_tablet_manager.cc:1397] T 390aa72f98414be291f01e4e4fec77f1 P 3f2aa40978064c9e9983cf3745eed206: Time spent bootstrapping tablet: real 0.222s user 0.039s sys 0.052s
I20250625 03:30:37.188817 1743 raft_consensus.cc:2466] T b3f18b9311894580bc336199d357df41 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 1.
I20250625 03:30:37.195384 2141 consensus_queue.cc:237] T a1d83fca2b484feeaff6f350fe749b24 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:37.197544 1636 leader_election.cc:304] T b3f18b9311894580bc336199d357df41 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters:
I20250625 03:30:37.199012 1975 raft_consensus.cc:2802] T b3f18b9311894580bc336199d357df41 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:30:37.199501 1975 raft_consensus.cc:695] T b3f18b9311894580bc336199d357df41 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Becoming Leader. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Running, Role: LEADER
I20250625 03:30:37.201681 1975 consensus_queue.cc:237] T b3f18b9311894580bc336199d357df41 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
W20250625 03:30:37.203231 1561 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.131:39359, user_credentials={real_user=slave}} blocked reactor thread for 50477.6us
I20250625 03:30:37.188956 1667 raft_consensus.cc:2466] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 1.
I20250625 03:30:37.211788 1786 ts_tablet_manager.cc:1428] T 188e56b819ae44f9b72baefcbc749400 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent starting tablet: real 0.096s user 0.004s sys 0.004s
I20250625 03:30:37.212848 1786 tablet_bootstrap.cc:492] T 390aa72f98414be291f01e4e4fec77f1 P ba464e89e0f044a0a0ea3e6125cbf2a1: Bootstrap starting.
I20250625 03:30:37.228483 1974 consensus_queue.cc:1035] T c04f7c2d00994557b1cb83234b36fceb P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:30:37.230113 1786 tablet_bootstrap.cc:654] T 390aa72f98414be291f01e4e4fec77f1 P ba464e89e0f044a0a0ea3e6125cbf2a1: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:37.231684 1785 raft_consensus.cc:357] T 390aa72f98414be291f01e4e4fec77f1 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:37.232463 1785 raft_consensus.cc:383] T 390aa72f98414be291f01e4e4fec77f1 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:37.232756 1785 raft_consensus.cc:738] T 390aa72f98414be291f01e4e4fec77f1 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Initialized, Role: FOLLOWER
I20250625 03:30:37.233561 1785 consensus_queue.cc:260] T 390aa72f98414be291f01e4e4fec77f1 P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:37.235888 1785 ts_tablet_manager.cc:1428] T 390aa72f98414be291f01e4e4fec77f1 P 3f2aa40978064c9e9983cf3745eed206: Time spent starting tablet: real 0.054s user 0.005s sys 0.000s
I20250625 03:30:37.238318 1785 tablet_bootstrap.cc:492] T add8a729ea684e7eab256135c01309df P 3f2aa40978064c9e9983cf3745eed206: Bootstrap starting.
I20250625 03:30:37.245875 1787 tablet_bootstrap.cc:654] T ba2ab3296190416aa07624e6d69ba09b P 7e9c4f2e01164f33b2e9034ed148398e: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:37.200695 2138 raft_consensus.cc:513] T fa68c3b7143345958f883bde3591b622 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:37.252964 1785 tablet_bootstrap.cc:654] T add8a729ea684e7eab256135c01309df P 3f2aa40978064c9e9983cf3745eed206: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:37.260140 2138 leader_election.cc:290] T fa68c3b7143345958f883bde3591b622 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 election: Requested vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
W20250625 03:30:37.295895 1559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.130:34293, user_credentials={real_user=slave}} blocked reactor thread for 61489.1us
W20250625 03:30:37.299242 1561 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.131:39359, user_credentials={real_user=slave}} blocked reactor thread for 81487.9us
I20250625 03:30:37.301784 1559 leader_election.cc:304] T a5a18934cc3f490288432ee1cb30b278 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e; no voters: ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:37.310555 1744 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fa68c3b7143345958f883bde3591b622" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:30:37.313895 1744 raft_consensus.cc:3058] T fa68c3b7143345958f883bde3591b622 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:37.323215 1666 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fa68c3b7143345958f883bde3591b622" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:30:37.324519 1666 raft_consensus.cc:3058] T fa68c3b7143345958f883bde3591b622 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:37.327906 1950 raft_consensus.cc:491] T 188e56b819ae44f9b72baefcbc749400 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:37.329581 1950 raft_consensus.cc:513] T 188e56b819ae44f9b72baefcbc749400 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
W20250625 03:30:37.349726 1559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:34293, user_credentials={real_user=slave}} blocked reactor thread for 51046.2us
I20250625 03:30:37.350477 1943 raft_consensus.cc:2802] T a5a18934cc3f490288432ee1cb30b278 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:30:37.351158 1943 raft_consensus.cc:695] T a5a18934cc3f490288432ee1cb30b278 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 LEADER]: Becoming Leader. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Running, Role: LEADER
I20250625 03:30:37.352370 1943 consensus_queue.cc:237] T a5a18934cc3f490288432ee1cb30b278 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:37.353500 1786 tablet_bootstrap.cc:492] T 390aa72f98414be291f01e4e4fec77f1 P ba464e89e0f044a0a0ea3e6125cbf2a1: No bootstrap required, opened a new log
I20250625 03:30:37.354563 1786 ts_tablet_manager.cc:1397] T 390aa72f98414be291f01e4e4fec77f1 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent bootstrapping tablet: real 0.142s user 0.009s sys 0.013s
I20250625 03:30:37.368115 1786 raft_consensus.cc:357] T 390aa72f98414be291f01e4e4fec77f1 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:37.368918 1786 raft_consensus.cc:383] T 390aa72f98414be291f01e4e4fec77f1 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:37.369266 1786 raft_consensus.cc:738] T 390aa72f98414be291f01e4e4fec77f1 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Initialized, Role: FOLLOWER
I20250625 03:30:37.371753 1841 consensus_queue.cc:1035] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:30:37.370091 1786 consensus_queue.cc:260] T 390aa72f98414be291f01e4e4fec77f1 P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:37.395427 1950 leader_election.cc:290] T 188e56b819ae44f9b72baefcbc749400 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
W20250625 03:30:37.394913 1635 consensus_peers.cc:487] T c04f7c2d00994557b1cb83234b36fceb P 3f2aa40978064c9e9983cf3745eed206 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20250625 03:30:37.399783 2149 log.cc:927] Time spent T b3f18b9311894580bc336199d357df41 P 3f2aa40978064c9e9983cf3745eed206: Append to log took a long time: real 0.126s user 0.000s sys 0.001s
I20250625 03:30:37.402616 1665 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "188e56b819ae44f9b72baefcbc749400" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
W20250625 03:30:37.410508 1708 leader_election.cc:343] T 188e56b819ae44f9b72baefcbc749400 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:37.414386 1492 catalog_manager.cc:5582] T a1d83fca2b484feeaff6f350fe749b24 P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: HEALTHY } } }
I20250625 03:30:37.448570 1951 consensus_queue.cc:1035] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:30:37.455389 1744 raft_consensus.cc:2466] T fa68c3b7143345958f883bde3591b622 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 1.
I20250625 03:30:37.458936 1787 tablet_bootstrap.cc:492] T ba2ab3296190416aa07624e6d69ba09b P 7e9c4f2e01164f33b2e9034ed148398e: No bootstrap required, opened a new log
I20250625 03:30:37.459933 1787 ts_tablet_manager.cc:1397] T ba2ab3296190416aa07624e6d69ba09b P 7e9c4f2e01164f33b2e9034ed148398e: Time spent bootstrapping tablet: real 0.393s user 0.022s sys 0.009s
I20250625 03:30:37.469262 1786 ts_tablet_manager.cc:1428] T 390aa72f98414be291f01e4e4fec77f1 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent starting tablet: real 0.114s user 0.005s sys 0.007s
I20250625 03:30:37.415995 1594 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "188e56b819ae44f9b72baefcbc749400" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:37.488353 1561 leader_election.cc:304] T fa68c3b7143345958f883bde3591b622 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters:
I20250625 03:30:37.488667 1786 tablet_bootstrap.cc:492] T e38dc50880914156805b07aa82e30863 P ba464e89e0f044a0a0ea3e6125cbf2a1: Bootstrap starting.
I20250625 03:30:37.486302 1492 catalog_manager.cc:5582] T b3f18b9311894580bc336199d357df41 P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } }
W20250625 03:30:37.493853 1709 leader_election.cc:343] T 188e56b819ae44f9b72baefcbc749400 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:37.493956 2053 raft_consensus.cc:2802] T fa68c3b7143345958f883bde3591b622 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:30:37.494374 1709 leader_election.cc:304] T 188e56b819ae44f9b72baefcbc749400 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:37.494555 2053 raft_consensus.cc:695] T fa68c3b7143345958f883bde3591b622 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 LEADER]: Becoming Leader. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Running, Role: LEADER
I20250625 03:30:37.497274 2053 consensus_queue.cc:237] T fa68c3b7143345958f883bde3591b622 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:37.498656 2054 raft_consensus.cc:2747] T 188e56b819ae44f9b72baefcbc749400 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:30:37.504890 2052 raft_consensus.cc:491] T 390aa72f98414be291f01e4e4fec77f1 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:37.510270 2052 raft_consensus.cc:513] T 390aa72f98414be291f01e4e4fec77f1 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:37.524274 2052 leader_election.cc:290] T 390aa72f98414be291f01e4e4fec77f1 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:37.525120 1594 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "390aa72f98414be291f01e4e4fec77f1" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
W20250625 03:30:37.526633 1635 leader_election.cc:343] T 390aa72f98414be291f01e4e4fec77f1 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:37.516547 1787 raft_consensus.cc:357] T ba2ab3296190416aa07624e6d69ba09b P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:37.505517 1950 consensus_queue.cc:1035] T 64add559c121402aa1f7753538a50857 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20250625 03:30:37.528354 1787 raft_consensus.cc:383] T ba2ab3296190416aa07624e6d69ba09b P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:37.528752 1787 raft_consensus.cc:738] T ba2ab3296190416aa07624e6d69ba09b P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Initialized, Role: FOLLOWER
I20250625 03:30:37.530241 1787 consensus_queue.cc:260] T ba2ab3296190416aa07624e6d69ba09b P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
W20250625 03:30:37.532195 1709 consensus_peers.cc:487] T 64add559c121402aa1f7753538a50857 P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:30:37.532200 1787 ts_tablet_manager.cc:1428] T ba2ab3296190416aa07624e6d69ba09b P 7e9c4f2e01164f33b2e9034ed148398e: Time spent starting tablet: real 0.048s user 0.008s sys 0.000s
I20250625 03:30:37.533663 1787 tablet_bootstrap.cc:492] T c04f7c2d00994557b1cb83234b36fceb P 7e9c4f2e01164f33b2e9034ed148398e: Bootstrap starting.
I20250625 03:30:37.535380 1744 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "390aa72f98414be291f01e4e4fec77f1" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:37.536362 1744 raft_consensus.cc:2466] T 390aa72f98414be291f01e4e4fec77f1 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 0.
I20250625 03:30:37.544965 1636 leader_election.cc:304] T 390aa72f98414be291f01e4e4fec77f1 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:37.565636 2054 consensus_queue.cc:1035] T cc3b100d6d574a68b79e6a8f23d77201 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:30:37.560508 2052 raft_consensus.cc:2802] T 390aa72f98414be291f01e4e4fec77f1 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:30:37.569370 2052 raft_consensus.cc:491] T 390aa72f98414be291f01e4e4fec77f1 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:30:37.569828 2052 raft_consensus.cc:3058] T 390aa72f98414be291f01e4e4fec77f1 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:37.574347 1785 tablet_bootstrap.cc:492] T add8a729ea684e7eab256135c01309df P 3f2aa40978064c9e9983cf3745eed206: No bootstrap required, opened a new log
I20250625 03:30:37.575671 2141 consensus_queue.cc:1035] T cc3b100d6d574a68b79e6a8f23d77201 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20250625 03:30:37.589695 1786 tablet_bootstrap.cc:654] T e38dc50880914156805b07aa82e30863 P ba464e89e0f044a0a0ea3e6125cbf2a1: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:37.592350 1666 raft_consensus.cc:2466] T fa68c3b7143345958f883bde3591b622 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 1.
I20250625 03:30:37.607033 2141 consensus_queue.cc:1035] T a1d83fca2b484feeaff6f350fe749b24 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:30:37.618675 1491 catalog_manager.cc:5582] T a5a18934cc3f490288432ee1cb30b278 P 7e9c4f2e01164f33b2e9034ed148398e reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129). New cstate: current_term: 1 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } }
I20250625 03:30:37.625309 1785 ts_tablet_manager.cc:1397] T add8a729ea684e7eab256135c01309df P 3f2aa40978064c9e9983cf3745eed206: Time spent bootstrapping tablet: real 0.387s user 0.017s sys 0.005s
I20250625 03:30:37.642968 2052 raft_consensus.cc:513] T 390aa72f98414be291f01e4e4fec77f1 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:37.646392 1594 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "390aa72f98414be291f01e4e4fec77f1" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
W20250625 03:30:37.648643 1635 leader_election.cc:343] T 390aa72f98414be291f01e4e4fec77f1 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:37.653456 1744 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "390aa72f98414be291f01e4e4fec77f1" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:30:37.654141 1744 raft_consensus.cc:3058] T 390aa72f98414be291f01e4e4fec77f1 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:37.660362 2052 leader_election.cc:290] T 390aa72f98414be291f01e4e4fec77f1 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:37.677531 1787 tablet_bootstrap.cc:654] T c04f7c2d00994557b1cb83234b36fceb P 7e9c4f2e01164f33b2e9034ed148398e: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:37.681108 1974 consensus_queue.cc:1035] T b3f18b9311894580bc336199d357df41 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:30:37.684441 1785 raft_consensus.cc:357] T add8a729ea684e7eab256135c01309df P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:37.685868 1785 raft_consensus.cc:383] T add8a729ea684e7eab256135c01309df P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:37.686141 1785 raft_consensus.cc:738] T add8a729ea684e7eab256135c01309df P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Initialized, Role: FOLLOWER
I20250625 03:30:37.687330 1785 consensus_queue.cc:260] T add8a729ea684e7eab256135c01309df P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:37.698352 1744 raft_consensus.cc:2466] T 390aa72f98414be291f01e4e4fec77f1 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 1.
I20250625 03:30:37.699270 1786 tablet_bootstrap.cc:492] T e38dc50880914156805b07aa82e30863 P ba464e89e0f044a0a0ea3e6125cbf2a1: No bootstrap required, opened a new log
I20250625 03:30:37.699781 1786 ts_tablet_manager.cc:1397] T e38dc50880914156805b07aa82e30863 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent bootstrapping tablet: real 0.211s user 0.018s sys 0.006s
I20250625 03:30:37.699826 1636 leader_election.cc:304] T 390aa72f98414be291f01e4e4fec77f1 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:37.704504 2052 raft_consensus.cc:2802] T 390aa72f98414be291f01e4e4fec77f1 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:30:37.705076 2052 raft_consensus.cc:695] T 390aa72f98414be291f01e4e4fec77f1 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Becoming Leader. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Running, Role: LEADER
I20250625 03:30:37.705950 2052 consensus_queue.cc:237] T 390aa72f98414be291f01e4e4fec77f1 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:37.707508 1786 raft_consensus.cc:357] T e38dc50880914156805b07aa82e30863 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:37.708313 1786 raft_consensus.cc:383] T e38dc50880914156805b07aa82e30863 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:37.708617 1786 raft_consensus.cc:738] T e38dc50880914156805b07aa82e30863 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Initialized, Role: FOLLOWER
I20250625 03:30:37.708958 1592 raft_consensus.cc:3058] T ba2ab3296190416aa07624e6d69ba09b P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:37.709416 1786 consensus_queue.cc:260] T e38dc50880914156805b07aa82e30863 P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:37.711512 1491 catalog_manager.cc:5582] T fa68c3b7143345958f883bde3591b622 P 7e9c4f2e01164f33b2e9034ed148398e reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129). New cstate: current_term: 1 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } }
W20250625 03:30:37.714550 1542 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20250625 03:30:37.729115 1786 ts_tablet_manager.cc:1428] T e38dc50880914156805b07aa82e30863 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent starting tablet: real 0.029s user 0.007s sys 0.000s
I20250625 03:30:37.731630 1786 tablet_bootstrap.cc:492] T a5a18934cc3f490288432ee1cb30b278 P ba464e89e0f044a0a0ea3e6125cbf2a1: Bootstrap starting.
W20250625 03:30:37.747102 1708 consensus_peers.cc:487] T a1d83fca2b484feeaff6f350fe749b24 P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Couldn't send request to peer 3f2aa40978064c9e9983cf3745eed206. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:30:37.750133 1787 tablet_bootstrap.cc:492] T c04f7c2d00994557b1cb83234b36fceb P 7e9c4f2e01164f33b2e9034ed148398e: No bootstrap required, opened a new log
I20250625 03:30:37.750707 1787 ts_tablet_manager.cc:1397] T c04f7c2d00994557b1cb83234b36fceb P 7e9c4f2e01164f33b2e9034ed148398e: Time spent bootstrapping tablet: real 0.217s user 0.012s sys 0.006s
I20250625 03:30:37.751186 2052 consensus_queue.cc:1035] T b3f18b9311894580bc336199d357df41 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:30:37.752141 1785 ts_tablet_manager.cc:1428] T add8a729ea684e7eab256135c01309df P 3f2aa40978064c9e9983cf3745eed206: Time spent starting tablet: real 0.126s user 0.008s sys 0.001s
I20250625 03:30:37.753898 1786 tablet_bootstrap.cc:654] T a5a18934cc3f490288432ee1cb30b278 P ba464e89e0f044a0a0ea3e6125cbf2a1: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:37.761036 2153 raft_consensus.cc:491] T e38dc50880914156805b07aa82e30863 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:37.761562 2153 raft_consensus.cc:513] T e38dc50880914156805b07aa82e30863 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:37.762282 1492 catalog_manager.cc:5582] T 390aa72f98414be291f01e4e4fec77f1 P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } }
I20250625 03:30:37.763635 2153 leader_election.cc:290] T e38dc50880914156805b07aa82e30863 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:37.764523 1785 tablet_bootstrap.cc:492] T a1d83fca2b484feeaff6f350fe749b24 P 3f2aa40978064c9e9983cf3745eed206: Bootstrap starting.
I20250625 03:30:37.766152 1671 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e38dc50880914156805b07aa82e30863" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:37.767374 1594 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e38dc50880914156805b07aa82e30863" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
W20250625 03:30:37.767722 1708 leader_election.cc:343] T e38dc50880914156805b07aa82e30863 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Illegal state: must be running to vote when last-logged opid is not known
W20250625 03:30:37.768916 1709 leader_election.cc:343] T e38dc50880914156805b07aa82e30863 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:37.769398 1709 leader_election.cc:304] T e38dc50880914156805b07aa82e30863 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:37.769688 1787 raft_consensus.cc:357] T c04f7c2d00994557b1cb83234b36fceb P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:37.770262 1787 raft_consensus.cc:383] T c04f7c2d00994557b1cb83234b36fceb P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:37.770476 1787 raft_consensus.cc:738] T c04f7c2d00994557b1cb83234b36fceb P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Initialized, Role: FOLLOWER
I20250625 03:30:37.771024 1787 consensus_queue.cc:260] T c04f7c2d00994557b1cb83234b36fceb P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:37.774587 1787 ts_tablet_manager.cc:1428] T c04f7c2d00994557b1cb83234b36fceb P 7e9c4f2e01164f33b2e9034ed148398e: Time spent starting tablet: real 0.024s user 0.007s sys 0.001s
I20250625 03:30:37.775655 1787 tablet_bootstrap.cc:492] T 31885ef6a0c64613ae6723c07f9400b0 P 7e9c4f2e01164f33b2e9034ed148398e: Bootstrap starting.
I20250625 03:30:37.775697 2053 consensus_queue.cc:1035] T a5a18934cc3f490288432ee1cb30b278 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:30:37.780148 2053 raft_consensus.cc:491] T c04f7c2d00994557b1cb83234b36fceb P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:37.780651 2053 raft_consensus.cc:513] T c04f7c2d00994557b1cb83234b36fceb P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:37.786099 1665 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c04f7c2d00994557b1cb83234b36fceb" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:37.786724 1743 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c04f7c2d00994557b1cb83234b36fceb" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:37.771068 2153 raft_consensus.cc:2747] T e38dc50880914156805b07aa82e30863 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:30:37.784804 2053 leader_election.cc:290] T c04f7c2d00994557b1cb83234b36fceb P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:37.800444 1559 leader_election.cc:304] T c04f7c2d00994557b1cb83234b36fceb P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e; no voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:37.804500 2053 raft_consensus.cc:2747] T c04f7c2d00994557b1cb83234b36fceb P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:30:37.812870 1594 raft_consensus.cc:3058] T c04f7c2d00994557b1cb83234b36fceb P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:37.844506 1786 tablet_bootstrap.cc:492] T a5a18934cc3f490288432ee1cb30b278 P ba464e89e0f044a0a0ea3e6125cbf2a1: No bootstrap required, opened a new log
I20250625 03:30:37.845119 1786 ts_tablet_manager.cc:1397] T a5a18934cc3f490288432ee1cb30b278 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent bootstrapping tablet: real 0.114s user 0.015s sys 0.004s
I20250625 03:30:37.848959 1787 tablet_bootstrap.cc:654] T 31885ef6a0c64613ae6723c07f9400b0 P 7e9c4f2e01164f33b2e9034ed148398e: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:37.850628 1786 raft_consensus.cc:357] T a5a18934cc3f490288432ee1cb30b278 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:37.851507 1786 raft_consensus.cc:383] T a5a18934cc3f490288432ee1cb30b278 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:37.851824 1786 raft_consensus.cc:738] T a5a18934cc3f490288432ee1cb30b278 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Initialized, Role: FOLLOWER
I20250625 03:30:37.852630 1786 consensus_queue.cc:260] T a5a18934cc3f490288432ee1cb30b278 P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
W20250625 03:30:37.854584 1561 consensus_peers.cc:487] T a5a18934cc3f490288432ee1cb30b278 P 7e9c4f2e01164f33b2e9034ed148398e -> Peer ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): Couldn't send request to peer ba464e89e0f044a0a0ea3e6125cbf2a1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:30:37.855213 1786 ts_tablet_manager.cc:1428] T a5a18934cc3f490288432ee1cb30b278 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent starting tablet: real 0.010s user 0.007s sys 0.000s
I20250625 03:30:37.859499 1786 tablet_bootstrap.cc:492] T 44f429469440455593143983452a9fe3 P ba464e89e0f044a0a0ea3e6125cbf2a1: Bootstrap starting.
I20250625 03:30:37.880321 1785 tablet_bootstrap.cc:654] T a1d83fca2b484feeaff6f350fe749b24 P 3f2aa40978064c9e9983cf3745eed206: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:37.894811 2141 raft_consensus.cc:491] T a5a18934cc3f490288432ee1cb30b278 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:37.895452 2141 raft_consensus.cc:513] T a5a18934cc3f490288432ee1cb30b278 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:37.897969 2141 leader_election.cc:290] T a5a18934cc3f490288432ee1cb30b278 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:37.900641 1593 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a5a18934cc3f490288432ee1cb30b278" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:37.905843 1785 tablet_bootstrap.cc:492] T a1d83fca2b484feeaff6f350fe749b24 P 3f2aa40978064c9e9983cf3745eed206: No bootstrap required, opened a new log
I20250625 03:30:37.908473 1785 ts_tablet_manager.cc:1397] T a1d83fca2b484feeaff6f350fe749b24 P 3f2aa40978064c9e9983cf3745eed206: Time spent bootstrapping tablet: real 0.144s user 0.014s sys 0.001s
I20250625 03:30:37.907001 1671 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a5a18934cc3f490288432ee1cb30b278" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:37.907157 1786 tablet_bootstrap.cc:654] T 44f429469440455593143983452a9fe3 P ba464e89e0f044a0a0ea3e6125cbf2a1: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:37.913448 1708 leader_election.cc:304] T a5a18934cc3f490288432ee1cb30b278 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:37.914637 2153 raft_consensus.cc:2747] T a5a18934cc3f490288432ee1cb30b278 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:30:37.917341 1785 raft_consensus.cc:357] T a1d83fca2b484feeaff6f350fe749b24 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:37.940776 1787 tablet_bootstrap.cc:492] T 31885ef6a0c64613ae6723c07f9400b0 P 7e9c4f2e01164f33b2e9034ed148398e: No bootstrap required, opened a new log
I20250625 03:30:37.944814 1787 ts_tablet_manager.cc:1397] T 31885ef6a0c64613ae6723c07f9400b0 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent bootstrapping tablet: real 0.169s user 0.020s sys 0.058s
I20250625 03:30:37.944296 1785 raft_consensus.cc:383] T a1d83fca2b484feeaff6f350fe749b24 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:37.947062 1785 raft_consensus.cc:738] T a1d83fca2b484feeaff6f350fe749b24 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Initialized, Role: FOLLOWER
I20250625 03:30:37.947501 1787 raft_consensus.cc:357] T 31885ef6a0c64613ae6723c07f9400b0 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:37.947778 1785 consensus_queue.cc:260] T a1d83fca2b484feeaff6f350fe749b24 P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:37.948230 1787 raft_consensus.cc:383] T 31885ef6a0c64613ae6723c07f9400b0 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:37.948700 1787 raft_consensus.cc:738] T 31885ef6a0c64613ae6723c07f9400b0 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Initialized, Role: FOLLOWER
I20250625 03:30:37.949340 1787 consensus_queue.cc:260] T 31885ef6a0c64613ae6723c07f9400b0 P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:37.952170 1785 ts_tablet_manager.cc:1428] T a1d83fca2b484feeaff6f350fe749b24 P 3f2aa40978064c9e9983cf3745eed206: Time spent starting tablet: real 0.043s user 0.004s sys 0.003s
I20250625 03:30:37.959900 1785 tablet_bootstrap.cc:492] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 3f2aa40978064c9e9983cf3745eed206: Bootstrap starting.
I20250625 03:30:37.963382 2053 consensus_queue.cc:1035] T fa68c3b7143345958f883bde3591b622 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:30:37.966203 1785 tablet_bootstrap.cc:654] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 3f2aa40978064c9e9983cf3745eed206: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:37.976543 1787 ts_tablet_manager.cc:1428] T 31885ef6a0c64613ae6723c07f9400b0 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent starting tablet: real 0.031s user 0.004s sys 0.002s
I20250625 03:30:37.981930 1786 tablet_bootstrap.cc:492] T 44f429469440455593143983452a9fe3 P ba464e89e0f044a0a0ea3e6125cbf2a1: No bootstrap required, opened a new log
I20250625 03:30:37.982527 1786 ts_tablet_manager.cc:1397] T 44f429469440455593143983452a9fe3 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent bootstrapping tablet: real 0.123s user 0.013s sys 0.000s
I20250625 03:30:37.985208 1786 raft_consensus.cc:357] T 44f429469440455593143983452a9fe3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:37.986027 1786 raft_consensus.cc:383] T 44f429469440455593143983452a9fe3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:37.986361 1786 raft_consensus.cc:738] T 44f429469440455593143983452a9fe3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Initialized, Role: FOLLOWER
I20250625 03:30:37.987242 1786 consensus_queue.cc:260] T 44f429469440455593143983452a9fe3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:37.991196 1786 ts_tablet_manager.cc:1428] T 44f429469440455593143983452a9fe3 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent starting tablet: real 0.008s user 0.005s sys 0.002s
I20250625 03:30:38.001688 1787 tablet_bootstrap.cc:492] T 390aa72f98414be291f01e4e4fec77f1 P 7e9c4f2e01164f33b2e9034ed148398e: Bootstrap starting.
I20250625 03:30:38.011024 1787 tablet_bootstrap.cc:654] T 390aa72f98414be291f01e4e4fec77f1 P 7e9c4f2e01164f33b2e9034ed148398e: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:38.012641 1786 tablet_bootstrap.cc:492] T 70328d972b5943009ef0c7d92cbae349 P ba464e89e0f044a0a0ea3e6125cbf2a1: Bootstrap starting.
I20250625 03:30:38.021792 2148 consensus_queue.cc:1035] T fa68c3b7143345958f883bde3591b622 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:30:38.023284 1975 raft_consensus.cc:491] T add8a729ea684e7eab256135c01309df P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:38.024185 1975 raft_consensus.cc:513] T add8a729ea684e7eab256135c01309df P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:38.027654 1594 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "add8a729ea684e7eab256135c01309df" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
W20250625 03:30:38.030587 1635 leader_election.cc:343] T add8a729ea684e7eab256135c01309df P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:38.031375 1785 tablet_bootstrap.cc:492] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 3f2aa40978064c9e9983cf3745eed206: No bootstrap required, opened a new log
I20250625 03:30:38.031509 1975 leader_election.cc:290] T add8a729ea684e7eab256135c01309df P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:38.031860 1785 ts_tablet_manager.cc:1397] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 3f2aa40978064c9e9983cf3745eed206: Time spent bootstrapping tablet: real 0.072s user 0.027s sys 0.020s
I20250625 03:30:38.033886 1744 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "add8a729ea684e7eab256135c01309df" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
W20250625 03:30:38.035737 1636 leader_election.cc:343] T add8a729ea684e7eab256135c01309df P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:38.036208 1636 leader_election.cc:304] T add8a729ea684e7eab256135c01309df P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206; no voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:38.038357 1975 raft_consensus.cc:2747] T add8a729ea684e7eab256135c01309df P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:30:38.047318 1785 raft_consensus.cc:357] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:38.048054 1785 raft_consensus.cc:383] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:38.048352 1785 raft_consensus.cc:738] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Initialized, Role: FOLLOWER
I20250625 03:30:38.048986 1785 consensus_queue.cc:260] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:38.051391 1785 ts_tablet_manager.cc:1428] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 3f2aa40978064c9e9983cf3745eed206: Time spent starting tablet: real 0.019s user 0.004s sys 0.007s
I20250625 03:30:38.052423 1786 tablet_bootstrap.cc:654] T 70328d972b5943009ef0c7d92cbae349 P ba464e89e0f044a0a0ea3e6125cbf2a1: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:38.052459 1785 tablet_bootstrap.cc:492] T c977876716a0400a9482dd8e0ad33b86 P 3f2aa40978064c9e9983cf3745eed206: Bootstrap starting.
I20250625 03:30:38.059475 1785 tablet_bootstrap.cc:654] T c977876716a0400a9482dd8e0ad33b86 P 3f2aa40978064c9e9983cf3745eed206: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:38.087927 2148 raft_consensus.cc:491] T 31885ef6a0c64613ae6723c07f9400b0 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:38.088510 2148 raft_consensus.cc:513] T 31885ef6a0c64613ae6723c07f9400b0 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:38.091627 2148 leader_election.cc:290] T 31885ef6a0c64613ae6723c07f9400b0 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:38.093247 1665 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "31885ef6a0c64613ae6723c07f9400b0" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:38.095310 1743 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "31885ef6a0c64613ae6723c07f9400b0" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:38.098671 1561 leader_election.cc:304] T 31885ef6a0c64613ae6723c07f9400b0 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e; no voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:38.097638 1787 tablet_bootstrap.cc:492] T 390aa72f98414be291f01e4e4fec77f1 P 7e9c4f2e01164f33b2e9034ed148398e: No bootstrap required, opened a new log
I20250625 03:30:38.100174 1975 raft_consensus.cc:491] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:38.099701 2148 raft_consensus.cc:2747] T 31885ef6a0c64613ae6723c07f9400b0 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:30:38.100378 1787 ts_tablet_manager.cc:1397] T 390aa72f98414be291f01e4e4fec77f1 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent bootstrapping tablet: real 0.099s user 0.012s sys 0.005s
I20250625 03:30:38.100629 1975 raft_consensus.cc:513] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:38.102726 1975 leader_election.cc:290] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:38.103410 1594 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e58b1ae66ee14c6f8d6f2db8dda2b842" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
W20250625 03:30:38.107991 1635 leader_election.cc:343] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:38.108322 1785 tablet_bootstrap.cc:492] T c977876716a0400a9482dd8e0ad33b86 P 3f2aa40978064c9e9983cf3745eed206: No bootstrap required, opened a new log
I20250625 03:30:38.108779 1785 ts_tablet_manager.cc:1397] T c977876716a0400a9482dd8e0ad33b86 P 3f2aa40978064c9e9983cf3745eed206: Time spent bootstrapping tablet: real 0.057s user 0.021s sys 0.023s
I20250625 03:30:38.099680 1786 tablet_bootstrap.cc:492] T 70328d972b5943009ef0c7d92cbae349 P ba464e89e0f044a0a0ea3e6125cbf2a1: No bootstrap required, opened a new log
I20250625 03:30:38.111406 1785 raft_consensus.cc:357] T c977876716a0400a9482dd8e0ad33b86 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:38.112170 1785 raft_consensus.cc:383] T c977876716a0400a9482dd8e0ad33b86 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:38.112468 1785 raft_consensus.cc:738] T c977876716a0400a9482dd8e0ad33b86 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Initialized, Role: FOLLOWER
I20250625 03:30:38.112859 1743 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e58b1ae66ee14c6f8d6f2db8dda2b842" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:38.111351 1786 ts_tablet_manager.cc:1397] T 70328d972b5943009ef0c7d92cbae349 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent bootstrapping tablet: real 0.100s user 0.006s sys 0.010s
I20250625 03:30:38.113130 1785 consensus_queue.cc:260] T c977876716a0400a9482dd8e0ad33b86 P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
W20250625 03:30:38.114266 1636 leader_election.cc:343] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:38.114674 1636 leader_election.cc:304] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206; no voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:38.115434 1785 ts_tablet_manager.cc:1428] T c977876716a0400a9482dd8e0ad33b86 P 3f2aa40978064c9e9983cf3745eed206: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20250625 03:30:38.115744 2052 raft_consensus.cc:2747] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:30:38.117762 1786 raft_consensus.cc:357] T 70328d972b5943009ef0c7d92cbae349 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:38.118458 1786 raft_consensus.cc:383] T 70328d972b5943009ef0c7d92cbae349 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:38.118716 1786 raft_consensus.cc:738] T 70328d972b5943009ef0c7d92cbae349 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Initialized, Role: FOLLOWER
I20250625 03:30:38.120168 1785 tablet_bootstrap.cc:492] T 6d7a37b3448d468baa1b9422a6167c9a P 3f2aa40978064c9e9983cf3745eed206: Bootstrap starting.
I20250625 03:30:38.126406 1785 tablet_bootstrap.cc:654] T 6d7a37b3448d468baa1b9422a6167c9a P 3f2aa40978064c9e9983cf3745eed206: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:38.127184 1786 consensus_queue.cc:260] T 70328d972b5943009ef0c7d92cbae349 P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:38.129004 1787 raft_consensus.cc:357] T 390aa72f98414be291f01e4e4fec77f1 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:38.129707 1787 raft_consensus.cc:383] T 390aa72f98414be291f01e4e4fec77f1 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:38.130052 1787 raft_consensus.cc:738] T 390aa72f98414be291f01e4e4fec77f1 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Initialized, Role: FOLLOWER
I20250625 03:30:38.130760 1787 consensus_queue.cc:260] T 390aa72f98414be291f01e4e4fec77f1 P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:38.137517 1785 tablet_bootstrap.cc:492] T 6d7a37b3448d468baa1b9422a6167c9a P 3f2aa40978064c9e9983cf3745eed206: No bootstrap required, opened a new log
I20250625 03:30:38.138013 1785 ts_tablet_manager.cc:1397] T 6d7a37b3448d468baa1b9422a6167c9a P 3f2aa40978064c9e9983cf3745eed206: Time spent bootstrapping tablet: real 0.018s user 0.015s sys 0.000s
I20250625 03:30:38.140473 1785 raft_consensus.cc:357] T 6d7a37b3448d468baa1b9422a6167c9a P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:38.141140 1785 raft_consensus.cc:383] T 6d7a37b3448d468baa1b9422a6167c9a P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:38.141388 1785 raft_consensus.cc:738] T 6d7a37b3448d468baa1b9422a6167c9a P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Initialized, Role: FOLLOWER
I20250625 03:30:38.141446 1787 ts_tablet_manager.cc:1428] T 390aa72f98414be291f01e4e4fec77f1 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent starting tablet: real 0.040s user 0.003s sys 0.002s
I20250625 03:30:38.143502 1786 ts_tablet_manager.cc:1428] T 70328d972b5943009ef0c7d92cbae349 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent starting tablet: real 0.030s user 0.005s sys 0.001s
I20250625 03:30:38.145938 1786 tablet_bootstrap.cc:492] T add8a729ea684e7eab256135c01309df P ba464e89e0f044a0a0ea3e6125cbf2a1: Bootstrap starting.
I20250625 03:30:38.146592 1950 raft_consensus.cc:491] T 44f429469440455593143983452a9fe3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:38.147051 1950 raft_consensus.cc:513] T 44f429469440455593143983452a9fe3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:38.149878 1665 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "44f429469440455593143983452a9fe3" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:38.150830 1594 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "44f429469440455593143983452a9fe3" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
W20250625 03:30:38.151316 1708 leader_election.cc:343] T 44f429469440455593143983452a9fe3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Illegal state: must be running to vote when last-logged opid is not known
W20250625 03:30:38.152175 1709 leader_election.cc:343] T 44f429469440455593143983452a9fe3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:38.152576 1709 leader_election.cc:304] T 44f429469440455593143983452a9fe3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:38.153409 2141 raft_consensus.cc:2747] T 44f429469440455593143983452a9fe3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:30:38.153738 1950 leader_election.cc:290] T 44f429469440455593143983452a9fe3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:38.144706 1787 tablet_bootstrap.cc:492] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e: Bootstrap starting.
I20250625 03:30:38.144073 1785 consensus_queue.cc:260] T 6d7a37b3448d468baa1b9422a6167c9a P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:38.156611 1785 ts_tablet_manager.cc:1428] T 6d7a37b3448d468baa1b9422a6167c9a P 3f2aa40978064c9e9983cf3745eed206: Time spent starting tablet: real 0.018s user 0.010s sys 0.000s
I20250625 03:30:38.158066 1785 tablet_bootstrap.cc:492] T e38dc50880914156805b07aa82e30863 P 3f2aa40978064c9e9983cf3745eed206: Bootstrap starting.
I20250625 03:30:38.160549 1787 tablet_bootstrap.cc:654] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:38.164232 1785 tablet_bootstrap.cc:654] T e38dc50880914156805b07aa82e30863 P 3f2aa40978064c9e9983cf3745eed206: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:38.177680 1665 raft_consensus.cc:3058] T a1d83fca2b484feeaff6f350fe749b24 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:38.191591 1786 tablet_bootstrap.cc:654] T add8a729ea684e7eab256135c01309df P ba464e89e0f044a0a0ea3e6125cbf2a1: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:38.197180 1785 tablet_bootstrap.cc:492] T e38dc50880914156805b07aa82e30863 P 3f2aa40978064c9e9983cf3745eed206: No bootstrap required, opened a new log
I20250625 03:30:38.202260 1785 ts_tablet_manager.cc:1397] T e38dc50880914156805b07aa82e30863 P 3f2aa40978064c9e9983cf3745eed206: Time spent bootstrapping tablet: real 0.044s user 0.011s sys 0.020s
I20250625 03:30:38.204661 1785 raft_consensus.cc:357] T e38dc50880914156805b07aa82e30863 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:38.205780 1785 raft_consensus.cc:383] T e38dc50880914156805b07aa82e30863 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:38.206087 1785 raft_consensus.cc:738] T e38dc50880914156805b07aa82e30863 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Initialized, Role: FOLLOWER
I20250625 03:30:38.206768 1785 consensus_queue.cc:260] T e38dc50880914156805b07aa82e30863 P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:38.212621 1786 tablet_bootstrap.cc:492] T add8a729ea684e7eab256135c01309df P ba464e89e0f044a0a0ea3e6125cbf2a1: No bootstrap required, opened a new log
I20250625 03:30:38.213111 1786 ts_tablet_manager.cc:1397] T add8a729ea684e7eab256135c01309df P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent bootstrapping tablet: real 0.067s user 0.004s sys 0.010s
I20250625 03:30:38.219780 1787 tablet_bootstrap.cc:492] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e: No bootstrap required, opened a new log
I20250625 03:30:38.220379 1787 ts_tablet_manager.cc:1397] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent bootstrapping tablet: real 0.076s user 0.015s sys 0.000s
I20250625 03:30:38.223116 1787 raft_consensus.cc:357] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:38.223798 1787 raft_consensus.cc:383] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:38.224082 1787 raft_consensus.cc:738] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Initialized, Role: FOLLOWER
I20250625 03:30:38.224710 1787 consensus_queue.cc:260] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:38.215593 1786 raft_consensus.cc:357] T add8a729ea684e7eab256135c01309df P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:38.225656 1785 ts_tablet_manager.cc:1428] T e38dc50880914156805b07aa82e30863 P 3f2aa40978064c9e9983cf3745eed206: Time spent starting tablet: real 0.023s user 0.006s sys 0.000s
I20250625 03:30:38.225805 1786 raft_consensus.cc:383] T add8a729ea684e7eab256135c01309df P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:38.226079 1786 raft_consensus.cc:738] T add8a729ea684e7eab256135c01309df P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Initialized, Role: FOLLOWER
I20250625 03:30:38.226869 1785 tablet_bootstrap.cc:492] T 59ac1803c12d43448ef566f886cc22e6 P 3f2aa40978064c9e9983cf3745eed206: Bootstrap starting.
I20250625 03:30:38.226732 1786 consensus_queue.cc:260] T add8a729ea684e7eab256135c01309df P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:38.237486 1787 ts_tablet_manager.cc:1428] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent starting tablet: real 0.017s user 0.006s sys 0.000s
I20250625 03:30:38.238621 1787 tablet_bootstrap.cc:492] T 6d7a37b3448d468baa1b9422a6167c9a P 7e9c4f2e01164f33b2e9034ed148398e: Bootstrap starting.
I20250625 03:30:38.255077 1786 ts_tablet_manager.cc:1428] T add8a729ea684e7eab256135c01309df P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent starting tablet: real 0.042s user 0.005s sys 0.003s
I20250625 03:30:38.258018 1594 raft_consensus.cc:3058] T 390aa72f98414be291f01e4e4fec77f1 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:38.262022 1785 tablet_bootstrap.cc:654] T 59ac1803c12d43448ef566f886cc22e6 P 3f2aa40978064c9e9983cf3745eed206: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:38.262655 1975 consensus_queue.cc:1035] T 390aa72f98414be291f01e4e4fec77f1 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20250625 03:30:38.266129 1786 tablet_bootstrap.cc:492] T df29d87d804d44438345052a5902052f P ba464e89e0f044a0a0ea3e6125cbf2a1: Bootstrap starting.
I20250625 03:30:38.266258 1787 tablet_bootstrap.cc:654] T 6d7a37b3448d468baa1b9422a6167c9a P 7e9c4f2e01164f33b2e9034ed148398e: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:38.269156 1975 raft_consensus.cc:491] T e38dc50880914156805b07aa82e30863 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:38.270855 1975 raft_consensus.cc:513] T e38dc50880914156805b07aa82e30863 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:38.272907 1975 leader_election.cc:290] T e38dc50880914156805b07aa82e30863 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:38.274632 1593 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e38dc50880914156805b07aa82e30863" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:38.278095 2148 raft_consensus.cc:491] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:38.277683 2052 consensus_queue.cc:1035] T 390aa72f98414be291f01e4e4fec77f1 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:30:38.278625 2148 raft_consensus.cc:513] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
W20250625 03:30:38.279228 1635 leader_election.cc:343] T e38dc50880914156805b07aa82e30863 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:38.303174 1665 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e58b1ae66ee14c6f8d6f2db8dda2b842" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:38.303867 1665 raft_consensus.cc:2466] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 0.
I20250625 03:30:38.299376 2148 leader_election.cc:290] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:38.305718 1559 leader_election.cc:304] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e; no voters:
I20250625 03:30:38.312034 1739 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e38dc50880914156805b07aa82e30863" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:38.312723 1739 raft_consensus.cc:2466] T e38dc50880914156805b07aa82e30863 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 0.
I20250625 03:30:38.313490 2147 raft_consensus.cc:2802] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:30:38.319135 1743 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e58b1ae66ee14c6f8d6f2db8dda2b842" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:38.321072 2147 raft_consensus.cc:491] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:30:38.321484 2147 raft_consensus.cc:3058] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Advancing to term 1
W20250625 03:30:38.325244 1561 leader_election.cc:343] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:38.327170 1636 leader_election.cc:304] T e38dc50880914156805b07aa82e30863 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:38.328621 2052 raft_consensus.cc:2802] T e38dc50880914156805b07aa82e30863 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:30:38.329464 2052 raft_consensus.cc:491] T e38dc50880914156805b07aa82e30863 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:30:38.329816 2052 raft_consensus.cc:3058] T e38dc50880914156805b07aa82e30863 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:38.359447 2141 raft_consensus.cc:491] T 70328d972b5943009ef0c7d92cbae349 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:38.360049 2141 raft_consensus.cc:513] T 70328d972b5943009ef0c7d92cbae349 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:38.356885 2147 raft_consensus.cc:513] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:38.361078 2052 raft_consensus.cc:513] T e38dc50880914156805b07aa82e30863 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:38.362080 2141 leader_election.cc:290] T 70328d972b5943009ef0c7d92cbae349 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:38.362782 2147 leader_election.cc:290] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 election: Requested vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:38.363827 1592 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "70328d972b5943009ef0c7d92cbae349" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:38.364228 2093 raft_consensus.cc:491] T 6d7a37b3448d468baa1b9422a6167c9a P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:38.364873 1785 tablet_bootstrap.cc:492] T 59ac1803c12d43448ef566f886cc22e6 P 3f2aa40978064c9e9983cf3745eed206: No bootstrap required, opened a new log
I20250625 03:30:38.366410 1665 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e58b1ae66ee14c6f8d6f2db8dda2b842" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:30:38.366780 1785 ts_tablet_manager.cc:1397] T 59ac1803c12d43448ef566f886cc22e6 P 3f2aa40978064c9e9983cf3745eed206: Time spent bootstrapping tablet: real 0.140s user 0.012s sys 0.000s
I20250625 03:30:38.367017 1665 raft_consensus.cc:3058] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:38.370508 1785 raft_consensus.cc:357] T 59ac1803c12d43448ef566f886cc22e6 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:38.371467 1785 raft_consensus.cc:383] T 59ac1803c12d43448ef566f886cc22e6 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:38.376425 1786 tablet_bootstrap.cc:654] T df29d87d804d44438345052a5902052f P ba464e89e0f044a0a0ea3e6125cbf2a1: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:38.371830 1785 raft_consensus.cc:738] T 59ac1803c12d43448ef566f886cc22e6 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Initialized, Role: FOLLOWER
I20250625 03:30:38.378495 1665 raft_consensus.cc:2466] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 1.
I20250625 03:30:38.364657 2093 raft_consensus.cc:513] T 6d7a37b3448d468baa1b9422a6167c9a P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
W20250625 03:30:38.365183 1709 leader_election.cc:343] T 70328d972b5943009ef0c7d92cbae349 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:38.382179 1592 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e38dc50880914156805b07aa82e30863" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
I20250625 03:30:38.384734 1975 raft_consensus.cc:491] T c977876716a0400a9482dd8e0ad33b86 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:38.396327 1559 leader_election.cc:304] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e; no voters:
I20250625 03:30:38.397934 1785 consensus_queue.cc:260] T 59ac1803c12d43448ef566f886cc22e6 P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:38.399539 2052 leader_election.cc:290] T e38dc50880914156805b07aa82e30863 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:38.397148 1975 raft_consensus.cc:513] T c977876716a0400a9482dd8e0ad33b86 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:38.400571 2093 leader_election.cc:290] T 6d7a37b3448d468baa1b9422a6167c9a P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
W20250625 03:30:38.401669 1635 leader_election.cc:343] T e38dc50880914156805b07aa82e30863 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:38.401890 1975 leader_election.cc:290] T c977876716a0400a9482dd8e0ad33b86 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:38.402971 1592 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6d7a37b3448d468baa1b9422a6167c9a" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:38.403368 1594 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c977876716a0400a9482dd8e0ad33b86" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:38.402530 1785 ts_tablet_manager.cc:1428] T 59ac1803c12d43448ef566f886cc22e6 P 3f2aa40978064c9e9983cf3745eed206: Time spent starting tablet: real 0.035s user 0.006s sys 0.000s
W20250625 03:30:38.404879 1635 leader_election.cc:343] T 6d7a37b3448d468baa1b9422a6167c9a P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
W20250625 03:30:38.415563 1635 leader_election.cc:343] T c977876716a0400a9482dd8e0ad33b86 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:38.416410 1787 tablet_bootstrap.cc:492] T 6d7a37b3448d468baa1b9422a6167c9a P 7e9c4f2e01164f33b2e9034ed148398e: No bootstrap required, opened a new log
I20250625 03:30:38.416880 1787 ts_tablet_manager.cc:1397] T 6d7a37b3448d468baa1b9422a6167c9a P 7e9c4f2e01164f33b2e9034ed148398e: Time spent bootstrapping tablet: real 0.178s user 0.008s sys 0.005s
I20250625 03:30:38.408769 1671 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "70328d972b5943009ef0c7d92cbae349" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:38.420143 1743 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e38dc50880914156805b07aa82e30863" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:30:38.420310 1785 tablet_bootstrap.cc:492] T 58c56cde04014b85b662a9b4cbaa726f P 3f2aa40978064c9e9983cf3745eed206: Bootstrap starting.
I20250625 03:30:38.420643 1743 raft_consensus.cc:3058] T e38dc50880914156805b07aa82e30863 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:38.422241 1739 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6d7a37b3448d468baa1b9422a6167c9a" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:38.404140 2148 raft_consensus.cc:2802] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Leader election won for term 1
W20250625 03:30:38.424263 1636 leader_election.cc:343] T 6d7a37b3448d468baa1b9422a6167c9a P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:38.424468 2148 raft_consensus.cc:695] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 LEADER]: Becoming Leader. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Running, Role: LEADER
I20250625 03:30:38.424753 1636 leader_election.cc:304] T 6d7a37b3448d468baa1b9422a6167c9a P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206; no voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:38.425367 2148 consensus_queue.cc:237] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:38.427888 1741 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e58b1ae66ee14c6f8d6f2db8dda2b842" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:30:38.439167 2192 raft_consensus.cc:2747] T 6d7a37b3448d468baa1b9422a6167c9a P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:30:38.442541 1743 raft_consensus.cc:2466] T e38dc50880914156805b07aa82e30863 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 1.
W20250625 03:30:38.464968 1708 leader_election.cc:343] T 70328d972b5943009ef0c7d92cbae349 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:38.465524 1708 leader_election.cc:304] T 70328d972b5943009ef0c7d92cbae349 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:38.467634 1636 leader_election.cc:304] T e38dc50880914156805b07aa82e30863 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:38.474468 1743 raft_consensus.cc:3058] T a5a18934cc3f490288432ee1cb30b278 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:38.472973 2153 raft_consensus.cc:2747] T 70328d972b5943009ef0c7d92cbae349 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:30:38.478485 2192 raft_consensus.cc:2802] T e38dc50880914156805b07aa82e30863 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:30:38.479274 2192 raft_consensus.cc:695] T e38dc50880914156805b07aa82e30863 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Becoming Leader. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Running, Role: LEADER
I20250625 03:30:38.480299 2192 consensus_queue.cc:237] T e38dc50880914156805b07aa82e30863 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:38.465114 1739 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c977876716a0400a9482dd8e0ad33b86" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:38.505132 1786 tablet_bootstrap.cc:492] T df29d87d804d44438345052a5902052f P ba464e89e0f044a0a0ea3e6125cbf2a1: No bootstrap required, opened a new log
I20250625 03:30:38.505613 1786 ts_tablet_manager.cc:1397] T df29d87d804d44438345052a5902052f P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent bootstrapping tablet: real 0.240s user 0.033s sys 0.015s
I20250625 03:30:38.509886 1787 raft_consensus.cc:357] T 6d7a37b3448d468baa1b9422a6167c9a P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:38.510454 1787 raft_consensus.cc:383] T 6d7a37b3448d468baa1b9422a6167c9a P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:38.510718 1787 raft_consensus.cc:738] T 6d7a37b3448d468baa1b9422a6167c9a P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Initialized, Role: FOLLOWER
W20250625 03:30:38.510875 1636 leader_election.cc:343] T c977876716a0400a9482dd8e0ad33b86 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:38.511359 1636 leader_election.cc:304] T c977876716a0400a9482dd8e0ad33b86 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206; no voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:38.515882 2052 raft_consensus.cc:2747] T c977876716a0400a9482dd8e0ad33b86 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250625 03:30:38.516431 1561 leader_election.cc:343] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:38.517030 1593 raft_consensus.cc:3058] T 31885ef6a0c64613ae6723c07f9400b0 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Advancing to term 1
W20250625 03:30:38.541479 1561 consensus_peers.cc:487] T df29d87d804d44438345052a5902052f P 7e9c4f2e01164f33b2e9034ed148398e -> Peer ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): Couldn't send request to peer ba464e89e0f044a0a0ea3e6125cbf2a1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20250625 03:30:38.551542 1787 consensus_queue.cc:260] T 6d7a37b3448d468baa1b9422a6167c9a P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:38.554858 1787 ts_tablet_manager.cc:1428] T 6d7a37b3448d468baa1b9422a6167c9a P 7e9c4f2e01164f33b2e9034ed148398e: Time spent starting tablet: real 0.138s user 0.004s sys 0.011s
I20250625 03:30:38.556285 1785 tablet_bootstrap.cc:654] T 58c56cde04014b85b662a9b4cbaa726f P 3f2aa40978064c9e9983cf3745eed206: Neither blocks nor log segments found. Creating new log.
W20250625 03:30:38.571875 1636 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.131:39359, user_credentials={real_user=slave}} blocked reactor thread for 61044.5us
I20250625 03:30:38.583231 1786 raft_consensus.cc:357] T df29d87d804d44438345052a5902052f P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:38.584321 1786 raft_consensus.cc:383] T df29d87d804d44438345052a5902052f P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:38.585626 1786 raft_consensus.cc:738] T df29d87d804d44438345052a5902052f P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Initialized, Role: FOLLOWER
I20250625 03:30:38.591558 1787 tablet_bootstrap.cc:492] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 7e9c4f2e01164f33b2e9034ed148398e: Bootstrap starting.
I20250625 03:30:38.592916 1786 consensus_queue.cc:260] T df29d87d804d44438345052a5902052f P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:38.595193 1494 catalog_manager.cc:5582] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129). New cstate: current_term: 1 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } }
I20250625 03:30:38.596658 1786 ts_tablet_manager.cc:1428] T df29d87d804d44438345052a5902052f P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent starting tablet: real 0.091s user 0.010s sys 0.006s
I20250625 03:30:38.599633 1786 tablet_bootstrap.cc:492] T 59ac1803c12d43448ef566f886cc22e6 P ba464e89e0f044a0a0ea3e6125cbf2a1: Bootstrap starting.
W20250625 03:30:38.637882 2194 log.cc:927] Time spent T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e: Append to log took a long time: real 0.097s user 0.008s sys 0.003s
I20250625 03:30:38.676044 2138 raft_consensus.cc:491] T 6d7a37b3448d468baa1b9422a6167c9a P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:38.676668 2138 raft_consensus.cc:513] T 6d7a37b3448d468baa1b9422a6167c9a P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:38.678021 1787 tablet_bootstrap.cc:654] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 7e9c4f2e01164f33b2e9034ed148398e: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:38.678683 2138 leader_election.cc:290] T 6d7a37b3448d468baa1b9422a6167c9a P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:38.681139 1739 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6d7a37b3448d468baa1b9422a6167c9a" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:38.682017 1785 tablet_bootstrap.cc:492] T 58c56cde04014b85b662a9b4cbaa726f P 3f2aa40978064c9e9983cf3745eed206: No bootstrap required, opened a new log
I20250625 03:30:38.682457 1785 ts_tablet_manager.cc:1397] T 58c56cde04014b85b662a9b4cbaa726f P 3f2aa40978064c9e9983cf3745eed206: Time spent bootstrapping tablet: real 0.263s user 0.026s sys 0.028s
W20250625 03:30:38.682804 1561 leader_election.cc:343] T 6d7a37b3448d468baa1b9422a6167c9a P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:38.685063 1785 raft_consensus.cc:357] T 58c56cde04014b85b662a9b4cbaa726f P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:38.685755 1785 raft_consensus.cc:383] T 58c56cde04014b85b662a9b4cbaa726f P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:38.686031 1785 raft_consensus.cc:738] T 58c56cde04014b85b662a9b4cbaa726f P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Initialized, Role: FOLLOWER
I20250625 03:30:38.686686 1785 consensus_queue.cc:260] T 58c56cde04014b85b662a9b4cbaa726f P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:38.690398 1785 ts_tablet_manager.cc:1428] T 58c56cde04014b85b662a9b4cbaa726f P 3f2aa40978064c9e9983cf3745eed206: Time spent starting tablet: real 0.008s user 0.004s sys 0.004s
I20250625 03:30:38.691223 1785 tablet_bootstrap.cc:492] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 3f2aa40978064c9e9983cf3745eed206: Bootstrap starting.
I20250625 03:30:38.690054 1492 catalog_manager.cc:5582] T e38dc50880914156805b07aa82e30863 P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } }
I20250625 03:30:38.693837 1786 tablet_bootstrap.cc:654] T 59ac1803c12d43448ef566f886cc22e6 P ba464e89e0f044a0a0ea3e6125cbf2a1: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:38.697223 1785 tablet_bootstrap.cc:654] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 3f2aa40978064c9e9983cf3745eed206: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:38.701191 1787 tablet_bootstrap.cc:492] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 7e9c4f2e01164f33b2e9034ed148398e: No bootstrap required, opened a new log
I20250625 03:30:38.701623 1787 ts_tablet_manager.cc:1397] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent bootstrapping tablet: real 0.126s user 0.010s sys 0.002s
I20250625 03:30:38.708343 1785 tablet_bootstrap.cc:492] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 3f2aa40978064c9e9983cf3745eed206: No bootstrap required, opened a new log
I20250625 03:30:38.708786 1785 ts_tablet_manager.cc:1397] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 3f2aa40978064c9e9983cf3745eed206: Time spent bootstrapping tablet: real 0.018s user 0.015s sys 0.001s
I20250625 03:30:38.708988 1787 raft_consensus.cc:357] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:38.709699 1787 raft_consensus.cc:383] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:38.709988 1787 raft_consensus.cc:738] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Initialized, Role: FOLLOWER
I20250625 03:30:38.710569 1787 consensus_queue.cc:260] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:38.711846 1785 raft_consensus.cc:357] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:38.712603 1785 raft_consensus.cc:383] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:38.712854 1785 raft_consensus.cc:738] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Initialized, Role: FOLLOWER
I20250625 03:30:38.713492 1785 consensus_queue.cc:260] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:38.715534 1787 ts_tablet_manager.cc:1428] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent starting tablet: real 0.014s user 0.002s sys 0.004s
I20250625 03:30:38.715821 1785 ts_tablet_manager.cc:1428] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 3f2aa40978064c9e9983cf3745eed206: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20250625 03:30:38.716588 1787 tablet_bootstrap.cc:492] T 64add559c121402aa1f7753538a50857 P 7e9c4f2e01164f33b2e9034ed148398e: Bootstrap starting.
I20250625 03:30:38.717272 1785 tablet_bootstrap.cc:492] T 44f429469440455593143983452a9fe3 P 3f2aa40978064c9e9983cf3745eed206: Bootstrap starting.
I20250625 03:30:38.720527 1786 tablet_bootstrap.cc:492] T 59ac1803c12d43448ef566f886cc22e6 P ba464e89e0f044a0a0ea3e6125cbf2a1: No bootstrap required, opened a new log
I20250625 03:30:38.720995 1786 ts_tablet_manager.cc:1397] T 59ac1803c12d43448ef566f886cc22e6 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent bootstrapping tablet: real 0.122s user 0.012s sys 0.001s
I20250625 03:30:38.723488 1786 raft_consensus.cc:357] T 59ac1803c12d43448ef566f886cc22e6 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:38.724434 1786 raft_consensus.cc:383] T 59ac1803c12d43448ef566f886cc22e6 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:38.724718 1786 raft_consensus.cc:738] T 59ac1803c12d43448ef566f886cc22e6 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Initialized, Role: FOLLOWER
I20250625 03:30:38.725297 1786 consensus_queue.cc:260] T 59ac1803c12d43448ef566f886cc22e6 P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:38.726317 1950 raft_consensus.cc:491] T add8a729ea684e7eab256135c01309df P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:38.726703 1950 raft_consensus.cc:513] T add8a729ea684e7eab256135c01309df P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:38.727413 1786 ts_tablet_manager.cc:1428] T 59ac1803c12d43448ef566f886cc22e6 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent starting tablet: real 0.006s user 0.005s sys 0.001s
I20250625 03:30:38.728384 1950 leader_election.cc:290] T add8a729ea684e7eab256135c01309df P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:38.728695 1786 tablet_bootstrap.cc:492] T 58c56cde04014b85b662a9b4cbaa726f P ba464e89e0f044a0a0ea3e6125cbf2a1: Bootstrap starting.
I20250625 03:30:38.731666 1671 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6d7a37b3448d468baa1b9422a6167c9a" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:38.732419 1671 raft_consensus.cc:2466] T 6d7a37b3448d468baa1b9422a6167c9a P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 0.
I20250625 03:30:38.733361 1590 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "add8a729ea684e7eab256135c01309df" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
W20250625 03:30:38.734915 1709 leader_election.cc:343] T add8a729ea684e7eab256135c01309df P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:38.736536 1785 tablet_bootstrap.cc:654] T 44f429469440455593143983452a9fe3 P 3f2aa40978064c9e9983cf3745eed206: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:38.738003 1786 tablet_bootstrap.cc:654] T 58c56cde04014b85b662a9b4cbaa726f P ba464e89e0f044a0a0ea3e6125cbf2a1: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:38.738188 1559 leader_election.cc:304] T 6d7a37b3448d468baa1b9422a6167c9a P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e; no voters: ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:38.739766 2138 raft_consensus.cc:2802] T 6d7a37b3448d468baa1b9422a6167c9a P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:30:38.740200 2138 raft_consensus.cc:491] T 6d7a37b3448d468baa1b9422a6167c9a P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:30:38.740545 2138 raft_consensus.cc:3058] T 6d7a37b3448d468baa1b9422a6167c9a P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:38.749425 1787 tablet_bootstrap.cc:654] T 64add559c121402aa1f7753538a50857 P 7e9c4f2e01164f33b2e9034ed148398e: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:38.754278 2138 raft_consensus.cc:513] T 6d7a37b3448d468baa1b9422a6167c9a P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:38.761924 1671 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "add8a729ea684e7eab256135c01309df" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:38.762537 1671 raft_consensus.cc:2466] T add8a729ea684e7eab256135c01309df P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 0.
I20250625 03:30:38.770134 1743 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6d7a37b3448d468baa1b9422a6167c9a" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
W20250625 03:30:38.771689 1561 leader_election.cc:343] T 6d7a37b3448d468baa1b9422a6167c9a P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:38.773744 2138 leader_election.cc:290] T 6d7a37b3448d468baa1b9422a6167c9a P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 election: Requested vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:38.776566 1708 leader_election.cc:304] T add8a729ea684e7eab256135c01309df P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:38.777667 2200 raft_consensus.cc:2802] T add8a729ea684e7eab256135c01309df P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:30:38.778051 2200 raft_consensus.cc:491] T add8a729ea684e7eab256135c01309df P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:30:38.778375 2200 raft_consensus.cc:3058] T add8a729ea684e7eab256135c01309df P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:38.789750 1671 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6d7a37b3448d468baa1b9422a6167c9a" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:30:38.790477 1671 raft_consensus.cc:3058] T 6d7a37b3448d468baa1b9422a6167c9a P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:38.794039 1787 tablet_bootstrap.cc:492] T 64add559c121402aa1f7753538a50857 P 7e9c4f2e01164f33b2e9034ed148398e: No bootstrap required, opened a new log
I20250625 03:30:38.794526 1787 ts_tablet_manager.cc:1397] T 64add559c121402aa1f7753538a50857 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent bootstrapping tablet: real 0.078s user 0.006s sys 0.008s
I20250625 03:30:38.801455 2200 raft_consensus.cc:513] T add8a729ea684e7eab256135c01309df P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:38.803346 2200 leader_election.cc:290] T add8a729ea684e7eab256135c01309df P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:38.805590 1786 tablet_bootstrap.cc:492] T 58c56cde04014b85b662a9b4cbaa726f P ba464e89e0f044a0a0ea3e6125cbf2a1: No bootstrap required, opened a new log
I20250625 03:30:38.806046 1786 ts_tablet_manager.cc:1397] T 58c56cde04014b85b662a9b4cbaa726f P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent bootstrapping tablet: real 0.078s user 0.008s sys 0.009s
I20250625 03:30:38.806100 1590 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "add8a729ea684e7eab256135c01309df" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
W20250625 03:30:38.807950 1709 leader_election.cc:343] T add8a729ea684e7eab256135c01309df P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:38.808691 1786 raft_consensus.cc:357] T 58c56cde04014b85b662a9b4cbaa726f P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:38.809381 1786 raft_consensus.cc:383] T 58c56cde04014b85b662a9b4cbaa726f P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:38.809626 1786 raft_consensus.cc:738] T 58c56cde04014b85b662a9b4cbaa726f P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Initialized, Role: FOLLOWER
I20250625 03:30:38.797084 1787 raft_consensus.cc:357] T 64add559c121402aa1f7753538a50857 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:38.811388 1787 raft_consensus.cc:383] T 64add559c121402aa1f7753538a50857 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:38.811661 1787 raft_consensus.cc:738] T 64add559c121402aa1f7753538a50857 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Initialized, Role: FOLLOWER
I20250625 03:30:38.812269 1787 consensus_queue.cc:260] T 64add559c121402aa1f7753538a50857 P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:38.815124 1786 consensus_queue.cc:260] T 58c56cde04014b85b662a9b4cbaa726f P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:38.817277 1670 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "add8a729ea684e7eab256135c01309df" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:30:38.817880 1670 raft_consensus.cc:3058] T add8a729ea684e7eab256135c01309df P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Advancing to term 1
W20250625 03:30:38.830549 1561 consensus_peers.cc:487] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e -> Peer ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): Couldn't send request to peer ba464e89e0f044a0a0ea3e6125cbf2a1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:30:38.831395 2191 raft_consensus.cc:491] T 59ac1803c12d43448ef566f886cc22e6 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:38.831667 1787 ts_tablet_manager.cc:1428] T 64add559c121402aa1f7753538a50857 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent starting tablet: real 0.037s user 0.005s sys 0.002s
I20250625 03:30:38.831880 2191 raft_consensus.cc:513] T 59ac1803c12d43448ef566f886cc22e6 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:38.832666 1787 tablet_bootstrap.cc:492] T e38dc50880914156805b07aa82e30863 P 7e9c4f2e01164f33b2e9034ed148398e: Bootstrap starting.
I20250625 03:30:38.834173 2191 leader_election.cc:290] T 59ac1803c12d43448ef566f886cc22e6 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:38.836308 1786 ts_tablet_manager.cc:1428] T 58c56cde04014b85b662a9b4cbaa726f P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent starting tablet: real 0.030s user 0.005s sys 0.003s
I20250625 03:30:38.836479 1593 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "59ac1803c12d43448ef566f886cc22e6" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:38.837317 1786 tablet_bootstrap.cc:492] T e58b1ae66ee14c6f8d6f2db8dda2b842 P ba464e89e0f044a0a0ea3e6125cbf2a1: Bootstrap starting.
W20250625 03:30:38.837754 1635 leader_election.cc:343] T 59ac1803c12d43448ef566f886cc22e6 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:38.836326 1743 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "59ac1803c12d43448ef566f886cc22e6" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:38.839972 1743 raft_consensus.cc:2466] T 59ac1803c12d43448ef566f886cc22e6 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 0.
I20250625 03:30:38.841162 1636 leader_election.cc:304] T 59ac1803c12d43448ef566f886cc22e6 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:38.842509 2192 raft_consensus.cc:2802] T 59ac1803c12d43448ef566f886cc22e6 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:30:38.842876 2192 raft_consensus.cc:491] T 59ac1803c12d43448ef566f886cc22e6 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:30:38.843245 2192 raft_consensus.cc:3058] T 59ac1803c12d43448ef566f886cc22e6 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:38.843490 1786 tablet_bootstrap.cc:654] T e58b1ae66ee14c6f8d6f2db8dda2b842 P ba464e89e0f044a0a0ea3e6125cbf2a1: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:38.852468 1785 tablet_bootstrap.cc:492] T 44f429469440455593143983452a9fe3 P 3f2aa40978064c9e9983cf3745eed206: No bootstrap required, opened a new log
I20250625 03:30:38.852811 1787 tablet_bootstrap.cc:654] T e38dc50880914156805b07aa82e30863 P 7e9c4f2e01164f33b2e9034ed148398e: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:38.853338 1785 ts_tablet_manager.cc:1397] T 44f429469440455593143983452a9fe3 P 3f2aa40978064c9e9983cf3745eed206: Time spent bootstrapping tablet: real 0.136s user 0.040s sys 0.056s
I20250625 03:30:38.856314 1785 raft_consensus.cc:357] T 44f429469440455593143983452a9fe3 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:38.857309 1785 raft_consensus.cc:383] T 44f429469440455593143983452a9fe3 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:38.857645 1785 raft_consensus.cc:738] T 44f429469440455593143983452a9fe3 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Initialized, Role: FOLLOWER
I20250625 03:30:38.858382 1785 consensus_queue.cc:260] T 44f429469440455593143983452a9fe3 P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:38.860808 1785 ts_tablet_manager.cc:1428] T 44f429469440455593143983452a9fe3 P 3f2aa40978064c9e9983cf3745eed206: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20250625 03:30:38.862226 1785 tablet_bootstrap.cc:492] T 70328d972b5943009ef0c7d92cbae349 P 3f2aa40978064c9e9983cf3745eed206: Bootstrap starting.
I20250625 03:30:38.867766 1785 tablet_bootstrap.cc:654] T 70328d972b5943009ef0c7d92cbae349 P 3f2aa40978064c9e9983cf3745eed206: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:38.871248 2192 raft_consensus.cc:513] T 59ac1803c12d43448ef566f886cc22e6 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:38.891963 1671 raft_consensus.cc:2466] T 6d7a37b3448d468baa1b9422a6167c9a P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 1.
I20250625 03:30:38.897543 2191 raft_consensus.cc:491] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:38.898059 2191 raft_consensus.cc:513] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:38.900444 1786 tablet_bootstrap.cc:492] T e58b1ae66ee14c6f8d6f2db8dda2b842 P ba464e89e0f044a0a0ea3e6125cbf2a1: No bootstrap required, opened a new log
I20250625 03:30:38.906662 1786 ts_tablet_manager.cc:1397] T e58b1ae66ee14c6f8d6f2db8dda2b842 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent bootstrapping tablet: real 0.070s user 0.010s sys 0.007s
W20250625 03:30:38.896095 1542 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20250625 03:30:38.900568 1743 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "59ac1803c12d43448ef566f886cc22e6" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:30:38.907544 1743 raft_consensus.cc:3058] T 59ac1803c12d43448ef566f886cc22e6 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:38.906149 1593 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "59ac1803c12d43448ef566f886cc22e6" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
W20250625 03:30:38.908998 1635 leader_election.cc:343] T 59ac1803c12d43448ef566f886cc22e6 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:38.907567 2192 leader_election.cc:290] T 59ac1803c12d43448ef566f886cc22e6 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:38.909857 1590 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a9ae17eec3fe4ce0841d3fb17c91a8b8" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:38.913695 1590 raft_consensus.cc:2466] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 0.
I20250625 03:30:38.916610 1786 raft_consensus.cc:357] T e58b1ae66ee14c6f8d6f2db8dda2b842 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:38.917443 1786 raft_consensus.cc:383] T e58b1ae66ee14c6f8d6f2db8dda2b842 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:38.910604 1739 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a9ae17eec3fe4ce0841d3fb17c91a8b8" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:38.927675 1635 leader_election.cc:304] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e; no voters:
I20250625 03:30:38.930248 1743 raft_consensus.cc:2466] T 59ac1803c12d43448ef566f886cc22e6 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 1.
I20250625 03:30:38.931329 1636 leader_election.cc:304] T 59ac1803c12d43448ef566f886cc22e6 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:38.928966 1786 raft_consensus.cc:738] T e58b1ae66ee14c6f8d6f2db8dda2b842 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Initialized, Role: FOLLOWER
I20250625 03:30:38.932749 2052 raft_consensus.cc:2802] T 59ac1803c12d43448ef566f886cc22e6 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:30:38.933274 2052 raft_consensus.cc:695] T 59ac1803c12d43448ef566f886cc22e6 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Becoming Leader. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Running, Role: LEADER
I20250625 03:30:38.934073 2052 consensus_queue.cc:237] T 59ac1803c12d43448ef566f886cc22e6 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:38.932471 1739 raft_consensus.cc:2466] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 0.
I20250625 03:30:38.912735 1670 raft_consensus.cc:2466] T add8a729ea684e7eab256135c01309df P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 1.
I20250625 03:30:38.935243 2192 raft_consensus.cc:2802] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:30:38.935751 2192 raft_consensus.cc:491] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:30:38.899991 2191 leader_election.cc:290] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:38.942554 1559 leader_election.cc:304] T 6d7a37b3448d468baa1b9422a6167c9a P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e; no voters: ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:38.943343 2053 consensus_queue.cc:1035] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:30:38.944727 2192 raft_consensus.cc:3058] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:38.946190 1786 consensus_queue.cc:260] T e58b1ae66ee14c6f8d6f2db8dda2b842 P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:38.949399 1786 ts_tablet_manager.cc:1428] T e58b1ae66ee14c6f8d6f2db8dda2b842 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent starting tablet: real 0.042s user 0.007s sys 0.000s
I20250625 03:30:38.952462 1785 tablet_bootstrap.cc:492] T 70328d972b5943009ef0c7d92cbae349 P 3f2aa40978064c9e9983cf3745eed206: No bootstrap required, opened a new log
I20250625 03:30:38.953114 1785 ts_tablet_manager.cc:1397] T 70328d972b5943009ef0c7d92cbae349 P 3f2aa40978064c9e9983cf3745eed206: Time spent bootstrapping tablet: real 0.091s user 0.023s sys 0.034s
I20250625 03:30:38.956113 2053 raft_consensus.cc:2802] T 6d7a37b3448d468baa1b9422a6167c9a P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:30:38.956662 2053 raft_consensus.cc:695] T 6d7a37b3448d468baa1b9422a6167c9a P 7e9c4f2e01164f33b2e9034ed148398e [term 1 LEADER]: Becoming Leader. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Running, Role: LEADER
I20250625 03:30:38.956403 2192 raft_consensus.cc:513] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:38.957470 2053 consensus_queue.cc:237] T 6d7a37b3448d468baa1b9422a6167c9a P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:38.958774 2192 leader_election.cc:290] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:38.963248 1593 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a9ae17eec3fe4ce0841d3fb17c91a8b8" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
I20250625 03:30:38.963778 1593 raft_consensus.cc:3058] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:38.961138 1785 raft_consensus.cc:357] T 70328d972b5943009ef0c7d92cbae349 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:38.964994 1785 raft_consensus.cc:383] T 70328d972b5943009ef0c7d92cbae349 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:38.965760 1785 raft_consensus.cc:738] T 70328d972b5943009ef0c7d92cbae349 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Initialized, Role: FOLLOWER
I20250625 03:30:38.966886 1785 consensus_queue.cc:260] T 70328d972b5943009ef0c7d92cbae349 P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
W20250625 03:30:38.968568 1635 consensus_peers.cc:487] T e38dc50880914156805b07aa82e30863 P 3f2aa40978064c9e9983cf3745eed206 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:30:38.970649 1708 leader_election.cc:304] T add8a729ea684e7eab256135c01309df P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:38.971642 1950 raft_consensus.cc:2802] T add8a729ea684e7eab256135c01309df P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:30:38.974982 1593 raft_consensus.cc:2466] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 1.
I20250625 03:30:38.978607 1739 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a9ae17eec3fe4ce0841d3fb17c91a8b8" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:30:38.979230 1739 raft_consensus.cc:3058] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:38.984881 1786 tablet_bootstrap.cc:492] T 6d7a37b3448d468baa1b9422a6167c9a P ba464e89e0f044a0a0ea3e6125cbf2a1: Bootstrap starting.
I20250625 03:30:38.987388 1950 raft_consensus.cc:695] T add8a729ea684e7eab256135c01309df P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Becoming Leader. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Running, Role: LEADER
I20250625 03:30:38.988194 1950 consensus_queue.cc:237] T add8a729ea684e7eab256135c01309df P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:38.989226 1590 raft_consensus.cc:3058] T 64add559c121402aa1f7753538a50857 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:38.989897 1635 leader_election.cc:304] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e; no voters:
I20250625 03:30:38.990675 2191 raft_consensus.cc:2802] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:30:38.991190 2191 raft_consensus.cc:695] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Becoming Leader. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Running, Role: LEADER
I20250625 03:30:38.995947 1787 tablet_bootstrap.cc:492] T e38dc50880914156805b07aa82e30863 P 7e9c4f2e01164f33b2e9034ed148398e: No bootstrap required, opened a new log
I20250625 03:30:38.994916 2191 consensus_queue.cc:237] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:38.996510 1787 ts_tablet_manager.cc:1397] T e38dc50880914156805b07aa82e30863 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent bootstrapping tablet: real 0.164s user 0.043s sys 0.027s
I20250625 03:30:39.000869 1787 raft_consensus.cc:357] T e38dc50880914156805b07aa82e30863 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:39.001538 1787 raft_consensus.cc:383] T e38dc50880914156805b07aa82e30863 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:39.001802 1787 raft_consensus.cc:738] T e38dc50880914156805b07aa82e30863 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Initialized, Role: FOLLOWER
I20250625 03:30:39.002394 1787 consensus_queue.cc:260] T e38dc50880914156805b07aa82e30863 P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:39.006413 1785 ts_tablet_manager.cc:1428] T 70328d972b5943009ef0c7d92cbae349 P 3f2aa40978064c9e9983cf3745eed206: Time spent starting tablet: real 0.053s user 0.006s sys 0.002s
I20250625 03:30:39.006490 1787 ts_tablet_manager.cc:1428] T e38dc50880914156805b07aa82e30863 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent starting tablet: real 0.010s user 0.002s sys 0.005s
I20250625 03:30:39.007522 1785 tablet_bootstrap.cc:492] T 188e56b819ae44f9b72baefcbc749400 P 3f2aa40978064c9e9983cf3745eed206: Bootstrap starting.
I20250625 03:30:39.007915 1787 tablet_bootstrap.cc:492] T 188e56b819ae44f9b72baefcbc749400 P 7e9c4f2e01164f33b2e9034ed148398e: Bootstrap starting.
I20250625 03:30:39.020635 1494 catalog_manager.cc:5582] T 6d7a37b3448d468baa1b9422a6167c9a P 7e9c4f2e01164f33b2e9034ed148398e reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129). New cstate: current_term: 1 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } }
I20250625 03:30:39.029944 1975 raft_consensus.cc:491] T 58c56cde04014b85b662a9b4cbaa726f P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:39.058120 1492 catalog_manager.cc:5582] T 59ac1803c12d43448ef566f886cc22e6 P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } }
I20250625 03:30:39.034921 1975 raft_consensus.cc:513] T 58c56cde04014b85b662a9b4cbaa726f P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:39.064826 1975 leader_election.cc:290] T 58c56cde04014b85b662a9b4cbaa726f P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:39.083271 1785 tablet_bootstrap.cc:654] T 188e56b819ae44f9b72baefcbc749400 P 3f2aa40978064c9e9983cf3745eed206: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:39.090939 1739 raft_consensus.cc:2466] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 1.
I20250625 03:30:39.092458 1950 raft_consensus.cc:491] T df29d87d804d44438345052a5902052f P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:39.093407 1950 raft_consensus.cc:513] T df29d87d804d44438345052a5902052f P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:39.095752 1950 leader_election.cc:290] T df29d87d804d44438345052a5902052f P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:39.098145 1743 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "58c56cde04014b85b662a9b4cbaa726f" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:39.098886 1743 raft_consensus.cc:2466] T 58c56cde04014b85b662a9b4cbaa726f P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 0.
I20250625 03:30:39.101406 1636 leader_election.cc:304] T 58c56cde04014b85b662a9b4cbaa726f P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters:
I20250625 03:30:39.109405 1975 raft_consensus.cc:2802] T 58c56cde04014b85b662a9b4cbaa726f P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:30:39.122872 1491 catalog_manager.cc:5582] T add8a729ea684e7eab256135c01309df P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: HEALTHY } } }
I20250625 03:30:39.126724 1667 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "df29d87d804d44438345052a5902052f" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:39.126857 1593 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "df29d87d804d44438345052a5902052f" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:39.126797 2052 consensus_queue.cc:1035] T e38dc50880914156805b07aa82e30863 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:30:39.127859 1592 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "58c56cde04014b85b662a9b4cbaa726f" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
W20250625 03:30:39.133277 1635 leader_election.cc:343] T 58c56cde04014b85b662a9b4cbaa726f P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:39.116935 1975 raft_consensus.cc:491] T 58c56cde04014b85b662a9b4cbaa726f P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:30:39.135659 1975 raft_consensus.cc:3058] T 58c56cde04014b85b662a9b4cbaa726f P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:39.149878 1709 leader_election.cc:304] T df29d87d804d44438345052a5902052f P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:39.156355 2195 raft_consensus.cc:2747] T df29d87d804d44438345052a5902052f P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:30:39.165012 1787 tablet_bootstrap.cc:654] T 188e56b819ae44f9b72baefcbc749400 P 7e9c4f2e01164f33b2e9034ed148398e: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:39.184859 2192 raft_consensus.cc:491] T 70328d972b5943009ef0c7d92cbae349 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:39.205340 1491 catalog_manager.cc:5582] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } }
I20250625 03:30:39.225448 1786 tablet_bootstrap.cc:654] T 6d7a37b3448d468baa1b9422a6167c9a P ba464e89e0f044a0a0ea3e6125cbf2a1: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:39.251094 2199 raft_consensus.cc:491] T 188e56b819ae44f9b72baefcbc749400 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:39.251816 2199 raft_consensus.cc:513] T 188e56b819ae44f9b72baefcbc749400 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:39.254385 2199 leader_election.cc:290] T 188e56b819ae44f9b72baefcbc749400 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:39.257704 1666 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "188e56b819ae44f9b72baefcbc749400" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:39.261361 1593 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "188e56b819ae44f9b72baefcbc749400" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
W20250625 03:30:39.270179 1709 leader_election.cc:343] T 188e56b819ae44f9b72baefcbc749400 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:39.210534 2192 raft_consensus.cc:513] T 70328d972b5943009ef0c7d92cbae349 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:39.248212 2191 raft_consensus.cc:491] T 44f429469440455593143983452a9fe3 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:39.295380 1785 tablet_bootstrap.cc:492] T 188e56b819ae44f9b72baefcbc749400 P 3f2aa40978064c9e9983cf3745eed206: No bootstrap required, opened a new log
I20250625 03:30:39.295858 1785 ts_tablet_manager.cc:1397] T 188e56b819ae44f9b72baefcbc749400 P 3f2aa40978064c9e9983cf3745eed206: Time spent bootstrapping tablet: real 0.289s user 0.022s sys 0.022s
I20250625 03:30:39.293318 2191 raft_consensus.cc:513] T 44f429469440455593143983452a9fe3 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:39.378342 2192 leader_election.cc:290] T 70328d972b5943009ef0c7d92cbae349 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:39.407905 1975 raft_consensus.cc:513] T 58c56cde04014b85b662a9b4cbaa726f P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:39.441392 1592 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "70328d972b5943009ef0c7d92cbae349" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:39.442456 1594 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "44f429469440455593143983452a9fe3" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:39.443585 2191 leader_election.cc:290] T 44f429469440455593143983452a9fe3 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:39.451356 2197 raft_consensus.cc:491] T e38dc50880914156805b07aa82e30863 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:39.441994 1975 leader_election.cc:290] T 58c56cde04014b85b662a9b4cbaa726f P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:39.451817 2197 raft_consensus.cc:513] T e38dc50880914156805b07aa82e30863 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:39.453351 1950 raft_consensus.cc:491] T e58b1ae66ee14c6f8d6f2db8dda2b842 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:39.453779 1950 raft_consensus.cc:513] T e58b1ae66ee14c6f8d6f2db8dda2b842 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:39.449798 1785 raft_consensus.cc:357] T 188e56b819ae44f9b72baefcbc749400 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:39.455484 1785 raft_consensus.cc:383] T 188e56b819ae44f9b72baefcbc749400 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:39.455749 1785 raft_consensus.cc:738] T 188e56b819ae44f9b72baefcbc749400 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Initialized, Role: FOLLOWER
I20250625 03:30:39.458735 1785 consensus_queue.cc:260] T 188e56b819ae44f9b72baefcbc749400 P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:39.460609 1736 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "70328d972b5943009ef0c7d92cbae349" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:39.466411 1736 raft_consensus.cc:2466] T 70328d972b5943009ef0c7d92cbae349 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 0.
I20250625 03:30:39.526669 2197 leader_election.cc:290] T e38dc50880914156805b07aa82e30863 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:39.531672 1786 tablet_bootstrap.cc:492] T 6d7a37b3448d468baa1b9422a6167c9a P ba464e89e0f044a0a0ea3e6125cbf2a1: No bootstrap required, opened a new log
I20250625 03:30:39.532639 1786 ts_tablet_manager.cc:1397] T 6d7a37b3448d468baa1b9422a6167c9a P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent bootstrapping tablet: real 0.548s user 0.025s sys 0.000s
I20250625 03:30:39.535105 1950 leader_election.cc:290] T e58b1ae66ee14c6f8d6f2db8dda2b842 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:39.542402 1594 raft_consensus.cc:3058] T e38dc50880914156805b07aa82e30863 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:39.546586 1785 ts_tablet_manager.cc:1428] T 188e56b819ae44f9b72baefcbc749400 P 3f2aa40978064c9e9983cf3745eed206: Time spent starting tablet: real 0.250s user 0.027s sys 0.046s
I20250625 03:30:39.549572 1744 raft_consensus.cc:3058] T e58b1ae66ee14c6f8d6f2db8dda2b842 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Advancing to term 1
W20250625 03:30:39.550549 1708 leader_election.cc:343] T 188e56b819ae44f9b72baefcbc749400 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:39.550976 1708 leader_election.cc:304] T 188e56b819ae44f9b72baefcbc749400 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:39.553359 2234 raft_consensus.cc:2747] T 188e56b819ae44f9b72baefcbc749400 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250625 03:30:39.548571 1709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:39903, user_credentials={real_user=slave}} blocked reactor thread for 80618.1us
I20250625 03:30:39.561542 1593 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "58c56cde04014b85b662a9b4cbaa726f" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
W20250625 03:30:39.561559 1561 consensus_peers.cc:487] T 6d7a37b3448d468baa1b9422a6167c9a P 7e9c4f2e01164f33b2e9034ed148398e -> Peer ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): Couldn't send request to peer ba464e89e0f044a0a0ea3e6125cbf2a1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:30:39.569186 1786 raft_consensus.cc:357] T 6d7a37b3448d468baa1b9422a6167c9a P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:39.569877 1786 raft_consensus.cc:383] T 6d7a37b3448d468baa1b9422a6167c9a P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:39.570147 1786 raft_consensus.cc:738] T 6d7a37b3448d468baa1b9422a6167c9a P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Initialized, Role: FOLLOWER
I20250625 03:30:39.570797 1590 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e58b1ae66ee14c6f8d6f2db8dda2b842" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:39.570722 1786 consensus_queue.cc:260] T 6d7a37b3448d468baa1b9422a6167c9a P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:39.574698 1636 leader_election.cc:304] T 70328d972b5943009ef0c7d92cbae349 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters:
I20250625 03:30:39.579541 1786 ts_tablet_manager.cc:1428] T 6d7a37b3448d468baa1b9422a6167c9a P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent starting tablet: real 0.047s user 0.004s sys 0.002s
I20250625 03:30:39.580812 1786 tablet_bootstrap.cc:492] T c977876716a0400a9482dd8e0ad33b86 P ba464e89e0f044a0a0ea3e6125cbf2a1: Bootstrap starting.
I20250625 03:30:39.554203 1739 raft_consensus.cc:3058] T df29d87d804d44438345052a5902052f P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:39.587777 1671 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e58b1ae66ee14c6f8d6f2db8dda2b842" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
W20250625 03:30:39.604321 1635 leader_election.cc:343] T 70328d972b5943009ef0c7d92cbae349 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
W20250625 03:30:39.605618 1635 leader_election.cc:343] T 44f429469440455593143983452a9fe3 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
W20250625 03:30:39.607396 1635 consensus_peers.cc:487] T 59ac1803c12d43448ef566f886cc22e6 P 3f2aa40978064c9e9983cf3745eed206 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:30:39.610836 1668 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e38dc50880914156805b07aa82e30863" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:39.628412 2229 consensus_queue.cc:1035] T 6d7a37b3448d468baa1b9422a6167c9a P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20250625 03:30:39.640044 2241 raft_consensus.cc:491] T 188e56b819ae44f9b72baefcbc749400 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:39.640585 2241 raft_consensus.cc:513] T 188e56b819ae44f9b72baefcbc749400 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:39.643230 1736 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "44f429469440455593143983452a9fe3" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:39.644503 2241 leader_election.cc:290] T 188e56b819ae44f9b72baefcbc749400 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
W20250625 03:30:39.645509 1635 leader_election.cc:343] T 58c56cde04014b85b662a9b4cbaa726f P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:39.646823 1787 tablet_bootstrap.cc:492] T 188e56b819ae44f9b72baefcbc749400 P 7e9c4f2e01164f33b2e9034ed148398e: No bootstrap required, opened a new log
I20250625 03:30:39.647280 1787 ts_tablet_manager.cc:1397] T 188e56b819ae44f9b72baefcbc749400 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent bootstrapping tablet: real 0.640s user 0.023s sys 0.023s
I20250625 03:30:39.625038 2192 raft_consensus.cc:2802] T 70328d972b5943009ef0c7d92cbae349 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20250625 03:30:39.652127 1709 consensus_peers.cc:487] T add8a729ea684e7eab256135c01309df P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:30:39.643867 1736 raft_consensus.cc:2466] T 44f429469440455593143983452a9fe3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 0.
I20250625 03:30:39.670011 1737 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "188e56b819ae44f9b72baefcbc749400" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:39.670938 1737 raft_consensus.cc:2466] T 188e56b819ae44f9b72baefcbc749400 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 0.
I20250625 03:30:39.672406 1592 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "188e56b819ae44f9b72baefcbc749400" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:39.651507 1741 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "58c56cde04014b85b662a9b4cbaa726f" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:30:39.652133 2192 raft_consensus.cc:491] T 70328d972b5943009ef0c7d92cbae349 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20250625 03:30:39.665967 1708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.130:34293, user_credentials={real_user=slave}} blocked reactor thread for 52240.5us
I20250625 03:30:39.690438 1636 leader_election.cc:304] T 188e56b819ae44f9b72baefcbc749400 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters:
I20250625 03:30:39.700074 1636 leader_election.cc:304] T 44f429469440455593143983452a9fe3 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:39.670053 2200 raft_consensus.cc:491] T 6d7a37b3448d468baa1b9422a6167c9a P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:39.691418 2192 raft_consensus.cc:3058] T 70328d972b5943009ef0c7d92cbae349 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:39.698300 1741 raft_consensus.cc:3058] T 58c56cde04014b85b662a9b4cbaa726f P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:39.716789 1708 leader_election.cc:304] T e58b1ae66ee14c6f8d6f2db8dda2b842 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:39.708114 2191 raft_consensus.cc:2802] T 188e56b819ae44f9b72baefcbc749400 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:30:39.737633 1787 raft_consensus.cc:357] T 188e56b819ae44f9b72baefcbc749400 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:39.738400 1787 raft_consensus.cc:383] T 188e56b819ae44f9b72baefcbc749400 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:39.738656 1787 raft_consensus.cc:738] T 188e56b819ae44f9b72baefcbc749400 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Initialized, Role: FOLLOWER
I20250625 03:30:39.739202 1787 consensus_queue.cc:260] T 188e56b819ae44f9b72baefcbc749400 P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:39.728987 1951 raft_consensus.cc:2747] T e58b1ae66ee14c6f8d6f2db8dda2b842 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:30:39.734853 2191 raft_consensus.cc:491] T 188e56b819ae44f9b72baefcbc749400 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:30:39.746882 2191 raft_consensus.cc:3058] T 188e56b819ae44f9b72baefcbc749400 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:39.747752 1742 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e38dc50880914156805b07aa82e30863" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:39.749265 1561 leader_election.cc:304] T e38dc50880914156805b07aa82e30863 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e; no voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:39.750952 2053 raft_consensus.cc:2747] T e38dc50880914156805b07aa82e30863 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:30:39.753571 2239 raft_consensus.cc:2802] T 44f429469440455593143983452a9fe3 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:30:39.714437 2200 raft_consensus.cc:513] T 6d7a37b3448d468baa1b9422a6167c9a P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:39.774806 1786 tablet_bootstrap.cc:654] T c977876716a0400a9482dd8e0ad33b86 P ba464e89e0f044a0a0ea3e6125cbf2a1: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:39.775352 1787 ts_tablet_manager.cc:1428] T 188e56b819ae44f9b72baefcbc749400 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent starting tablet: real 0.128s user 0.007s sys 0.000s
I20250625 03:30:39.777487 1592 raft_consensus.cc:2466] T 188e56b819ae44f9b72baefcbc749400 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 0.
I20250625 03:30:39.782723 1741 raft_consensus.cc:2466] T 58c56cde04014b85b662a9b4cbaa726f P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 1.
I20250625 03:30:39.784431 2192 raft_consensus.cc:513] T 70328d972b5943009ef0c7d92cbae349 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:39.792203 2235 consensus_queue.cc:1035] T add8a729ea684e7eab256135c01309df P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20250625 03:30:39.794816 1635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:39903, user_credentials={real_user=slave}} blocked reactor thread for 86795.3us
I20250625 03:30:39.789644 2239 raft_consensus.cc:491] T 44f429469440455593143983452a9fe3 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:30:39.800165 2239 raft_consensus.cc:3058] T 44f429469440455593143983452a9fe3 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:39.806520 1787 tablet_bootstrap.cc:492] T 70328d972b5943009ef0c7d92cbae349 P 7e9c4f2e01164f33b2e9034ed148398e: Bootstrap starting.
W20250625 03:30:39.807714 1636 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.131:39359, user_credentials={real_user=slave}} blocked reactor thread for 78098.1us
I20250625 03:30:39.811015 2247 consensus_queue.cc:1035] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20250625 03:30:39.819125 1787 tablet_bootstrap.cc:654] T 70328d972b5943009ef0c7d92cbae349 P 7e9c4f2e01164f33b2e9034ed148398e: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:39.843732 2191 raft_consensus.cc:513] T 188e56b819ae44f9b72baefcbc749400 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:39.845819 2191 leader_election.cc:290] T 188e56b819ae44f9b72baefcbc749400 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:39.843817 2192 leader_election.cc:290] T 70328d972b5943009ef0c7d92cbae349 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:39.847950 1664 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6d7a37b3448d468baa1b9422a6167c9a" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:39.849537 1786 tablet_bootstrap.cc:492] T c977876716a0400a9482dd8e0ad33b86 P ba464e89e0f044a0a0ea3e6125cbf2a1: No bootstrap required, opened a new log
I20250625 03:30:39.850149 1786 ts_tablet_manager.cc:1397] T c977876716a0400a9482dd8e0ad33b86 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent bootstrapping tablet: real 0.270s user 0.019s sys 0.011s
I20250625 03:30:39.852543 1786 raft_consensus.cc:357] T c977876716a0400a9482dd8e0ad33b86 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:39.853152 1786 raft_consensus.cc:383] T c977876716a0400a9482dd8e0ad33b86 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:39.853399 1786 raft_consensus.cc:738] T c977876716a0400a9482dd8e0ad33b86 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Initialized, Role: FOLLOWER
I20250625 03:30:39.854135 1786 consensus_queue.cc:260] T c977876716a0400a9482dd8e0ad33b86 P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:39.846779 2200 leader_election.cc:290] T 6d7a37b3448d468baa1b9422a6167c9a P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:39.857468 1596 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6d7a37b3448d468baa1b9422a6167c9a" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:39.858822 2239 raft_consensus.cc:513] T 44f429469440455593143983452a9fe3 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:39.859529 1786 ts_tablet_manager.cc:1428] T c977876716a0400a9482dd8e0ad33b86 P ba464e89e0f044a0a0ea3e6125cbf2a1: Time spent starting tablet: real 0.009s user 0.007s sys 0.001s
I20250625 03:30:39.860520 1741 raft_consensus.cc:3058] T 6d7a37b3448d468baa1b9422a6167c9a P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:39.870687 1709 leader_election.cc:304] T 6d7a37b3448d468baa1b9422a6167c9a P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:39.839399 2257 consensus_queue.cc:1035] T 59ac1803c12d43448ef566f886cc22e6 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.034s
I20250625 03:30:39.879139 1636 leader_election.cc:304] T 58c56cde04014b85b662a9b4cbaa726f P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:39.879815 2237 consensus_queue.cc:1035] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:30:39.882639 2192 raft_consensus.cc:2802] T 58c56cde04014b85b662a9b4cbaa726f P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:30:39.889056 2192 raft_consensus.cc:695] T 58c56cde04014b85b662a9b4cbaa726f P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Becoming Leader. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Running, Role: LEADER
I20250625 03:30:39.892447 2239 leader_election.cc:290] T 44f429469440455593143983452a9fe3 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:39.902617 1592 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "44f429469440455593143983452a9fe3" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
I20250625 03:30:39.904265 1742 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "70328d972b5943009ef0c7d92cbae349" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:30:39.904868 1742 raft_consensus.cc:3058] T 70328d972b5943009ef0c7d92cbae349 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:39.905114 1591 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "188e56b819ae44f9b72baefcbc749400" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
I20250625 03:30:39.905681 1591 raft_consensus.cc:3058] T 188e56b819ae44f9b72baefcbc749400 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Advancing to term 1
W20250625 03:30:39.913516 1635 leader_election.cc:343] T 44f429469440455593143983452a9fe3 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:39.889930 2192 consensus_queue.cc:237] T 58c56cde04014b85b662a9b4cbaa726f P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:39.922612 1738 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "188e56b819ae44f9b72baefcbc749400" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:30:39.923292 1738 raft_consensus.cc:3058] T 188e56b819ae44f9b72baefcbc749400 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:39.927520 1740 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "44f429469440455593143983452a9fe3" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:30:39.928175 1740 raft_consensus.cc:3058] T 44f429469440455593143983452a9fe3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:39.929590 1594 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "70328d972b5943009ef0c7d92cbae349" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
W20250625 03:30:39.950282 1635 leader_election.cc:343] T 70328d972b5943009ef0c7d92cbae349 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:39.963325 1787 tablet_bootstrap.cc:492] T 70328d972b5943009ef0c7d92cbae349 P 7e9c4f2e01164f33b2e9034ed148398e: No bootstrap required, opened a new log
I20250625 03:30:39.963938 1787 ts_tablet_manager.cc:1397] T 70328d972b5943009ef0c7d92cbae349 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent bootstrapping tablet: real 0.166s user 0.016s sys 0.004s
I20250625 03:30:39.966475 1787 raft_consensus.cc:357] T 70328d972b5943009ef0c7d92cbae349 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:39.967211 1787 raft_consensus.cc:383] T 70328d972b5943009ef0c7d92cbae349 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:39.967517 1787 raft_consensus.cc:738] T 70328d972b5943009ef0c7d92cbae349 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Initialized, Role: FOLLOWER
I20250625 03:30:39.968237 1787 consensus_queue.cc:260] T 70328d972b5943009ef0c7d92cbae349 P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:39.978497 1740 raft_consensus.cc:2466] T 44f429469440455593143983452a9fe3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 1.
I20250625 03:30:39.979570 1742 raft_consensus.cc:2466] T 70328d972b5943009ef0c7d92cbae349 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 1.
I20250625 03:30:39.981288 1787 ts_tablet_manager.cc:1428] T 70328d972b5943009ef0c7d92cbae349 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent starting tablet: real 0.017s user 0.005s sys 0.000s
W20250625 03:30:39.991353 1542 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20250625 03:30:39.995627 1636 leader_election.cc:304] T 44f429469440455593143983452a9fe3 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:39.997115 1636 leader_election.cc:304] T 70328d972b5943009ef0c7d92cbae349 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:40.010950 1787 tablet_bootstrap.cc:492] T 58c56cde04014b85b662a9b4cbaa726f P 7e9c4f2e01164f33b2e9034ed148398e: Bootstrap starting.
I20250625 03:30:40.014007 2258 raft_consensus.cc:2802] T 70328d972b5943009ef0c7d92cbae349 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:30:40.011191 2237 raft_consensus.cc:2802] T 44f429469440455593143983452a9fe3 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:30:40.018458 2258 raft_consensus.cc:695] T 70328d972b5943009ef0c7d92cbae349 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Becoming Leader. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Running, Role: LEADER
I20250625 03:30:40.019362 2258 consensus_queue.cc:237] T 70328d972b5943009ef0c7d92cbae349 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:40.023829 2237 raft_consensus.cc:695] T 44f429469440455593143983452a9fe3 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Becoming Leader. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Running, Role: LEADER
I20250625 03:30:40.027113 2237 consensus_queue.cc:237] T 44f429469440455593143983452a9fe3 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:40.021692 1738 raft_consensus.cc:2466] T 188e56b819ae44f9b72baefcbc749400 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 1.
I20250625 03:30:40.036054 1636 leader_election.cc:304] T 188e56b819ae44f9b72baefcbc749400 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters:
I20250625 03:30:40.043061 2256 raft_consensus.cc:2802] T 188e56b819ae44f9b72baefcbc749400 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:30:40.043641 2256 raft_consensus.cc:695] T 188e56b819ae44f9b72baefcbc749400 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Becoming Leader. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Running, Role: LEADER
I20250625 03:30:40.133430 1591 raft_consensus.cc:2466] T 188e56b819ae44f9b72baefcbc749400 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 1.
I20250625 03:30:40.120946 2256 consensus_queue.cc:237] T 188e56b819ae44f9b72baefcbc749400 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:40.140113 1492 catalog_manager.cc:5582] T 58c56cde04014b85b662a9b4cbaa726f P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } }
I20250625 03:30:40.224150 2224 raft_consensus.cc:491] T c977876716a0400a9482dd8e0ad33b86 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:40.224678 2224 raft_consensus.cc:513] T c977876716a0400a9482dd8e0ad33b86 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:40.226549 2224 leader_election.cc:290] T c977876716a0400a9482dd8e0ad33b86 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:40.219237 2254 raft_consensus.cc:2747] T 6d7a37b3448d468baa1b9422a6167c9a P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:30:40.254294 1591 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c977876716a0400a9482dd8e0ad33b86" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:30:40.247732 1787 tablet_bootstrap.cc:700] T 58c56cde04014b85b662a9b4cbaa726f P 7e9c4f2e01164f33b2e9034ed148398e: Time spent opening tablet: real 0.118s user 0.000s sys 0.016s
I20250625 03:30:40.261389 1787 tablet_bootstrap.cc:654] T 58c56cde04014b85b662a9b4cbaa726f P 7e9c4f2e01164f33b2e9034ed148398e: Neither blocks nor log segments found. Creating new log.
W20250625 03:30:40.268679 1709 leader_election.cc:343] T c977876716a0400a9482dd8e0ad33b86 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:40.274726 1667 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c977876716a0400a9482dd8e0ad33b86" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:40.275370 1667 raft_consensus.cc:2466] T c977876716a0400a9482dd8e0ad33b86 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 0.
I20250625 03:30:40.312445 2253 raft_consensus.cc:491] T 70328d972b5943009ef0c7d92cbae349 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:40.338783 2253 raft_consensus.cc:513] T 70328d972b5943009ef0c7d92cbae349 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:40.341445 2253 leader_election.cc:290] T 70328d972b5943009ef0c7d92cbae349 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:40.346344 1708 leader_election.cc:304] T c977876716a0400a9482dd8e0ad33b86 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:40.348302 1744 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "70328d972b5943009ef0c7d92cbae349" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:40.349052 1744 raft_consensus.cc:2391] T 70328d972b5943009ef0c7d92cbae349 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e9c4f2e01164f33b2e9034ed148398e in current term 1: Already voted for candidate 3f2aa40978064c9e9983cf3745eed206 in this term.
I20250625 03:30:40.353996 1662 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "70328d972b5943009ef0c7d92cbae349" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:40.352387 2199 raft_consensus.cc:2802] T c977876716a0400a9482dd8e0ad33b86 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:30:40.358753 2199 raft_consensus.cc:491] T c977876716a0400a9482dd8e0ad33b86 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:30:40.359108 2199 raft_consensus.cc:3058] T c977876716a0400a9482dd8e0ad33b86 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:40.366657 1559 leader_election.cc:304] T 70328d972b5943009ef0c7d92cbae349 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e; no voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:40.370711 2221 raft_consensus.cc:3058] T 70328d972b5943009ef0c7d92cbae349 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:40.397840 2221 raft_consensus.cc:2747] T 70328d972b5943009ef0c7d92cbae349 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250625 03:30:40.399811 2272 log.cc:927] Time spent T 59ac1803c12d43448ef566f886cc22e6 P 3f2aa40978064c9e9983cf3745eed206: Append to log took a long time: real 0.062s user 0.003s sys 0.000s
I20250625 03:30:40.401319 1787 tablet_bootstrap.cc:492] T 58c56cde04014b85b662a9b4cbaa726f P 7e9c4f2e01164f33b2e9034ed148398e: No bootstrap required, opened a new log
I20250625 03:30:40.401793 1787 ts_tablet_manager.cc:1397] T 58c56cde04014b85b662a9b4cbaa726f P 7e9c4f2e01164f33b2e9034ed148398e: Time spent bootstrapping tablet: real 0.409s user 0.005s sys 0.032s
I20250625 03:30:40.404138 1787 raft_consensus.cc:357] T 58c56cde04014b85b662a9b4cbaa726f P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:40.404780 1787 raft_consensus.cc:383] T 58c56cde04014b85b662a9b4cbaa726f P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:40.405033 1787 raft_consensus.cc:738] T 58c56cde04014b85b662a9b4cbaa726f P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Initialized, Role: FOLLOWER
I20250625 03:30:40.405619 1787 consensus_queue.cc:260] T 58c56cde04014b85b662a9b4cbaa726f P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:40.406075 2199 raft_consensus.cc:513] T c977876716a0400a9482dd8e0ad33b86 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:40.407385 1787 ts_tablet_manager.cc:1428] T 58c56cde04014b85b662a9b4cbaa726f P 7e9c4f2e01164f33b2e9034ed148398e: Time spent starting tablet: real 0.005s user 0.000s sys 0.004s
I20250625 03:30:40.408154 1787 tablet_bootstrap.cc:492] T c977876716a0400a9482dd8e0ad33b86 P 7e9c4f2e01164f33b2e9034ed148398e: Bootstrap starting.
I20250625 03:30:40.412216 1787 tablet_bootstrap.cc:654] T c977876716a0400a9482dd8e0ad33b86 P 7e9c4f2e01164f33b2e9034ed148398e: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:40.413821 2199 leader_election.cc:290] T c977876716a0400a9482dd8e0ad33b86 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:40.414645 1596 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c977876716a0400a9482dd8e0ad33b86" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
W20250625 03:30:40.417255 1709 leader_election.cc:343] T c977876716a0400a9482dd8e0ad33b86 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:30:40.423403 1664 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c977876716a0400a9482dd8e0ad33b86" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:30:40.424078 1664 raft_consensus.cc:3058] T c977876716a0400a9482dd8e0ad33b86 P 3f2aa40978064c9e9983cf3745eed206 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:40.425078 1787 tablet_bootstrap.cc:492] T c977876716a0400a9482dd8e0ad33b86 P 7e9c4f2e01164f33b2e9034ed148398e: No bootstrap required, opened a new log
I20250625 03:30:40.425590 1787 ts_tablet_manager.cc:1397] T c977876716a0400a9482dd8e0ad33b86 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent bootstrapping tablet: real 0.018s user 0.010s sys 0.004s
I20250625 03:30:40.427901 1787 raft_consensus.cc:357] T c977876716a0400a9482dd8e0ad33b86 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:40.428696 1787 raft_consensus.cc:383] T c977876716a0400a9482dd8e0ad33b86 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:40.429010 1787 raft_consensus.cc:738] T c977876716a0400a9482dd8e0ad33b86 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Initialized, Role: FOLLOWER
I20250625 03:30:40.429723 1787 consensus_queue.cc:260] T c977876716a0400a9482dd8e0ad33b86 P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:40.431699 1664 raft_consensus.cc:2466] T c977876716a0400a9482dd8e0ad33b86 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 1.
I20250625 03:30:40.431926 1787 ts_tablet_manager.cc:1428] T c977876716a0400a9482dd8e0ad33b86 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20250625 03:30:40.433084 1787 tablet_bootstrap.cc:492] T add8a729ea684e7eab256135c01309df P 7e9c4f2e01164f33b2e9034ed148398e: Bootstrap starting.
I20250625 03:30:40.434140 1708 leader_election.cc:304] T c977876716a0400a9482dd8e0ad33b86 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:30:40.434864 2199 raft_consensus.cc:2802] T c977876716a0400a9482dd8e0ad33b86 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:30:40.435487 2199 raft_consensus.cc:695] T c977876716a0400a9482dd8e0ad33b86 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Becoming Leader. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Running, Role: LEADER
I20250625 03:30:40.436762 2199 consensus_queue.cc:237] T c977876716a0400a9482dd8e0ad33b86 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:40.439750 1787 tablet_bootstrap.cc:654] T add8a729ea684e7eab256135c01309df P 7e9c4f2e01164f33b2e9034ed148398e: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:40.451246 2258 consensus_queue.cc:1035] T 44f429469440455593143983452a9fe3 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250625 03:30:40.458999 1635 consensus_peers.cc:487] T 44f429469440455593143983452a9fe3 P 3f2aa40978064c9e9983cf3745eed206 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:30:40.468372 2258 consensus_queue.cc:1035] T 58c56cde04014b85b662a9b4cbaa726f P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:30:40.471879 1787 tablet_bootstrap.cc:492] T add8a729ea684e7eab256135c01309df P 7e9c4f2e01164f33b2e9034ed148398e: No bootstrap required, opened a new log
I20250625 03:30:40.480381 1787 ts_tablet_manager.cc:1397] T add8a729ea684e7eab256135c01309df P 7e9c4f2e01164f33b2e9034ed148398e: Time spent bootstrapping tablet: real 0.047s user 0.022s sys 0.000s
I20250625 03:30:40.482882 1787 raft_consensus.cc:357] T add8a729ea684e7eab256135c01309df P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:40.476047 2221 raft_consensus.cc:491] T 58c56cde04014b85b662a9b4cbaa726f P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:40.485630 2221 raft_consensus.cc:513] T 58c56cde04014b85b662a9b4cbaa726f P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:40.474586 1491 catalog_manager.cc:5582] T c977876716a0400a9482dd8e0ad33b86 P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: HEALTHY } } }
I20250625 03:30:40.487555 2221 leader_election.cc:290] T 58c56cde04014b85b662a9b4cbaa726f P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:40.489151 1787 raft_consensus.cc:383] T add8a729ea684e7eab256135c01309df P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:40.489060 1663 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "58c56cde04014b85b662a9b4cbaa726f" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:40.489696 1787 raft_consensus.cc:738] T add8a729ea684e7eab256135c01309df P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Initialized, Role: FOLLOWER
I20250625 03:30:40.490454 1787 consensus_queue.cc:260] T add8a729ea684e7eab256135c01309df P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:40.491931 1739 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "58c56cde04014b85b662a9b4cbaa726f" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:40.492998 1787 ts_tablet_manager.cc:1428] T add8a729ea684e7eab256135c01309df P 7e9c4f2e01164f33b2e9034ed148398e: Time spent starting tablet: real 0.012s user 0.004s sys 0.001s
I20250625 03:30:40.493970 1787 tablet_bootstrap.cc:492] T 44f429469440455593143983452a9fe3 P 7e9c4f2e01164f33b2e9034ed148398e: Bootstrap starting.
I20250625 03:30:40.493785 1561 leader_election.cc:304] T 58c56cde04014b85b662a9b4cbaa726f P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e; no voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:40.494869 2221 raft_consensus.cc:2747] T 58c56cde04014b85b662a9b4cbaa726f P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:30:40.496646 1596 raft_consensus.cc:3058] T 58c56cde04014b85b662a9b4cbaa726f P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:40.514482 1595 raft_consensus.cc:3058] T add8a729ea684e7eab256135c01309df P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:40.521065 1787 tablet_bootstrap.cc:654] T 44f429469440455593143983452a9fe3 P 7e9c4f2e01164f33b2e9034ed148398e: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:40.482249 1493 catalog_manager.cc:5582] T 70328d972b5943009ef0c7d92cbae349 P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } }
I20250625 03:30:40.536094 1493 catalog_manager.cc:5582] T 188e56b819ae44f9b72baefcbc749400 P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } }
I20250625 03:30:40.539026 2242 consensus_queue.cc:1035] T 58c56cde04014b85b662a9b4cbaa726f P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:30:40.540426 1787 tablet_bootstrap.cc:492] T 44f429469440455593143983452a9fe3 P 7e9c4f2e01164f33b2e9034ed148398e: No bootstrap required, opened a new log
I20250625 03:30:40.540887 1787 ts_tablet_manager.cc:1397] T 44f429469440455593143983452a9fe3 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent bootstrapping tablet: real 0.047s user 0.015s sys 0.004s
I20250625 03:30:40.547371 1787 raft_consensus.cc:357] T 44f429469440455593143983452a9fe3 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:40.539969 1493 catalog_manager.cc:5582] T 44f429469440455593143983452a9fe3 P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } }
I20250625 03:30:40.548839 1787 raft_consensus.cc:383] T 44f429469440455593143983452a9fe3 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:40.549188 1787 raft_consensus.cc:738] T 44f429469440455593143983452a9fe3 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Initialized, Role: FOLLOWER
I20250625 03:30:40.549757 1787 consensus_queue.cc:260] T 44f429469440455593143983452a9fe3 P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:40.551888 1787 ts_tablet_manager.cc:1428] T 44f429469440455593143983452a9fe3 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent starting tablet: real 0.011s user 0.004s sys 0.000s
I20250625 03:30:40.553071 1787 tablet_bootstrap.cc:492] T 59ac1803c12d43448ef566f886cc22e6 P 7e9c4f2e01164f33b2e9034ed148398e: Bootstrap starting.
I20250625 03:30:40.559808 1787 tablet_bootstrap.cc:654] T 59ac1803c12d43448ef566f886cc22e6 P 7e9c4f2e01164f33b2e9034ed148398e: Neither blocks nor log segments found. Creating new log.
I20250625 03:30:40.573760 2258 consensus_queue.cc:1035] T 188e56b819ae44f9b72baefcbc749400 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:30:40.579541 1787 tablet_bootstrap.cc:492] T 59ac1803c12d43448ef566f886cc22e6 P 7e9c4f2e01164f33b2e9034ed148398e: No bootstrap required, opened a new log
I20250625 03:30:40.580384 1787 ts_tablet_manager.cc:1397] T 59ac1803c12d43448ef566f886cc22e6 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent bootstrapping tablet: real 0.027s user 0.011s sys 0.002s
I20250625 03:30:40.597278 2258 consensus_queue.cc:1035] T 188e56b819ae44f9b72baefcbc749400 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:30:40.603157 1787 raft_consensus.cc:357] T 59ac1803c12d43448ef566f886cc22e6 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:40.606470 1787 raft_consensus.cc:383] T 59ac1803c12d43448ef566f886cc22e6 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:30:40.606772 1787 raft_consensus.cc:738] T 59ac1803c12d43448ef566f886cc22e6 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Initialized, Role: FOLLOWER
I20250625 03:30:40.607771 1787 consensus_queue.cc:260] T 59ac1803c12d43448ef566f886cc22e6 P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:40.610198 1787 ts_tablet_manager.cc:1428] T 59ac1803c12d43448ef566f886cc22e6 P 7e9c4f2e01164f33b2e9034ed148398e: Time spent starting tablet: real 0.026s user 0.005s sys 0.000s
I20250625 03:30:40.621388 2238 consensus_queue.cc:1035] T 70328d972b5943009ef0c7d92cbae349 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:30:40.647919 2238 consensus_queue.cc:1035] T 70328d972b5943009ef0c7d92cbae349 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:30:40.760632 2197 raft_consensus.cc:491] T 59ac1803c12d43448ef566f886cc22e6 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:40.761212 2197 raft_consensus.cc:513] T 59ac1803c12d43448ef566f886cc22e6 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:40.762494 2221 raft_consensus.cc:491] T c977876716a0400a9482dd8e0ad33b86 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:40.762984 2221 raft_consensus.cc:513] T c977876716a0400a9482dd8e0ad33b86 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:40.763840 1663 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "59ac1803c12d43448ef566f886cc22e6" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:40.765542 2197 leader_election.cc:290] T 59ac1803c12d43448ef566f886cc22e6 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:40.766327 1744 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c977876716a0400a9482dd8e0ad33b86" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:40.767144 1745 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "59ac1803c12d43448ef566f886cc22e6" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:40.766837 2221 leader_election.cc:290] T c977876716a0400a9482dd8e0ad33b86 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:40.768587 1663 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c977876716a0400a9482dd8e0ad33b86" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:40.768874 1561 leader_election.cc:304] T 59ac1803c12d43448ef566f886cc22e6 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e; no voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:40.769399 1663 raft_consensus.cc:2391] T c977876716a0400a9482dd8e0ad33b86 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e9c4f2e01164f33b2e9034ed148398e in current term 1: Already voted for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in this term.
I20250625 03:30:40.770258 2221 raft_consensus.cc:2747] T 59ac1803c12d43448ef566f886cc22e6 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:30:40.770435 1559 leader_election.cc:304] T c977876716a0400a9482dd8e0ad33b86 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e; no voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:40.771198 2221 raft_consensus.cc:3058] T c977876716a0400a9482dd8e0ad33b86 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:40.778466 2221 raft_consensus.cc:2747] T c977876716a0400a9482dd8e0ad33b86 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:30:40.791962 2221 raft_consensus.cc:491] T 44f429469440455593143983452a9fe3 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:30:40.792526 2221 raft_consensus.cc:513] T 44f429469440455593143983452a9fe3 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:30:40.795204 1663 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "44f429469440455593143983452a9fe3" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:30:40.796336 2221 leader_election.cc:290] T 44f429469440455593143983452a9fe3 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:40.796562 1744 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "44f429469440455593143983452a9fe3" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:30:40.797700 1561 leader_election.cc:304] T 44f429469440455593143983452a9fe3 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e; no voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:30:40.798239 2221 raft_consensus.cc:2747] T 44f429469440455593143983452a9fe3 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:30:40.946951 1595 raft_consensus.cc:3058] T 44f429469440455593143983452a9fe3 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:40.977691 1595 raft_consensus.cc:3058] T 59ac1803c12d43448ef566f886cc22e6 P 7e9c4f2e01164f33b2e9034ed148398e [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:30:41.047536 2200 consensus_queue.cc:1035] T c977876716a0400a9482dd8e0ad33b86 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:30:41.070571 2200 consensus_queue.cc:1035] T c977876716a0400a9482dd8e0ad33b86 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:30:41.728129 426 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250625 03:30:41.757763 2297 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250625 03:30:41.760200 2298 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250625 03:30:41.766115 2300 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250625 03:30:41.766623 426 server_base.cc:1048] running on GCE node
I20250625 03:30:41.768189 426 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250625 03:30:41.768419 426 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250625 03:30:41.768616 426 hybrid_clock.cc:648] HybridClock initialized: now 1750822241768600 us; error 0 us; skew 500 ppm
I20250625 03:30:41.769138 426 server_base.cc:848] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250625 03:30:41.776522 426 webserver.cc:469] Webserver started at http://127.0.106.132:42269/ using document root <none> and password file <none>
I20250625 03:30:41.777228 426 fs_manager.cc:362] Metadata directory not provided
I20250625 03:30:41.777581 426 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250625 03:30:41.778017 426 server_base.cc:896] This appears to be a new deployment of Kudu; creating new FS layout
I20250625 03:30:41.779681 426 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/ts-3-root/instance:
uuid: "df8b9755d156478aafca552f9e9c539e"
format_stamp: "Formatted at 2025-06-25 03:30:41 on dist-test-slave-lj23"
I20250625 03:30:41.788055 426 fs_manager.cc:696] Time spent creating directory manager: real 0.007s user 0.005s sys 0.000s
I20250625 03:30:41.795696 2305 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250625 03:30:41.797096 426 fs_manager.cc:730] Time spent opening block manager: real 0.006s user 0.003s sys 0.003s
I20250625 03:30:41.797456 426 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/ts-3-root
uuid: "df8b9755d156478aafca552f9e9c539e"
format_stamp: "Formatted at 2025-06-25 03:30:41 on dist-test-slave-lj23"
I20250625 03:30:41.797760 426 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250625 03:30:41.809865 426 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250625 03:30:41.811645 426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250625 03:30:41.815410 426 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20250625 03:30:41.859755 426 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250625 03:30:41.859997 426 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250625 03:30:41.860366 426 ts_tablet_manager.cc:610] Registered 0 tablets
I20250625 03:30:41.860615 426 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250625 03:30:41.993693 426 rpc_server.cc:307] RPC server started. Bound to: 127.0.106.132:34493
I20250625 03:30:41.993822 2369 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.106.132:34493 every 8 connection(s)
I20250625 03:30:42.006788 426 auto_leader_rebalancer-test.cc:417] add a tserver: df8b9755d156478aafca552f9e9c539e
I20250625 03:30:42.033748 2370 heartbeater.cc:344] Connected to a master server at 127.0.106.190:39719
I20250625 03:30:42.034173 2370 heartbeater.cc:461] Registering TS with master...
I20250625 03:30:42.035027 2370 heartbeater.cc:507] Master 127.0.106.190:39719 requested a full tablet report, sending...
I20250625 03:30:42.037213 1493 ts_manager.cc:194] Registered new tserver with Master: df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493)
I20250625 03:30:42.039274 1493 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59758
I20250625 03:30:42.211059 1596 consensus_queue.cc:237] T f9458dec7953448d8550396d67fad249 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:42.222965 1745 raft_consensus.cc:1273] T f9458dec7953448d8550396d67fad249 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20250625 03:30:42.224493 2197 consensus_queue.cc:1035] T f9458dec7953448d8550396d67fad249 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:30:42.230165 1663 raft_consensus.cc:1273] T f9458dec7953448d8550396d67fad249 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20250625 03:30:42.233392 2313 consensus_queue.cc:1035] T f9458dec7953448d8550396d67fad249 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20250625 03:30:42.243078 2221 raft_consensus.cc:2953] T f9458dec7953448d8550396d67fad249 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:42.252610 1744 raft_consensus.cc:2953] T f9458dec7953448d8550396d67fad249 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
W20250625 03:30:42.253772 1559 consensus_peers.cc:487] T f9458dec7953448d8550396d67fad249 P 7e9c4f2e01164f33b2e9034ed148398e -> Peer df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493): Couldn't send request to peer df8b9755d156478aafca552f9e9c539e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f9458dec7953448d8550396d67fad249. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:30:42.268152 1491 catalog_manager.cc:5582] T f9458dec7953448d8550396d67fad249 P 7e9c4f2e01164f33b2e9034ed148398e reported cstate change: config changed from index -1 to 3, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New cstate: current_term: 2 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20250625 03:30:42.277222 1663 raft_consensus.cc:2953] T f9458dec7953448d8550396d67fad249 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:42.306596 1745 consensus_queue.cc:237] T afe48b30a4e64a4d8faf2a5b42d5c706 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:42.324883 1663 raft_consensus.cc:1273] T afe48b30a4e64a4d8faf2a5b42d5c706 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 03:30:42.326706 1595 raft_consensus.cc:1273] T afe48b30a4e64a4d8faf2a5b42d5c706 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 03:30:42.328481 2199 consensus_queue.cc:1035] T afe48b30a4e64a4d8faf2a5b42d5c706 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:30:42.351150 2199 raft_consensus.cc:2953] T afe48b30a4e64a4d8faf2a5b42d5c706 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:42.363188 1595 raft_consensus.cc:2953] T afe48b30a4e64a4d8faf2a5b42d5c706 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:42.371852 2235 consensus_queue.cc:1035] T afe48b30a4e64a4d8faf2a5b42d5c706 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:30:42.372804 1745 consensus_queue.cc:237] T ba2ab3296190416aa07624e6d69ba09b P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:42.372953 1494 catalog_manager.cc:5582] T afe48b30a4e64a4d8faf2a5b42d5c706 P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New cstate: current_term: 1 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20250625 03:30:42.385105 1708 consensus_peers.cc:487] T afe48b30a4e64a4d8faf2a5b42d5c706 P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493): Couldn't send request to peer df8b9755d156478aafca552f9e9c539e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: afe48b30a4e64a4d8faf2a5b42d5c706. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:30:42.397717 1664 raft_consensus.cc:2953] T afe48b30a4e64a4d8faf2a5b42d5c706 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:42.403071 1663 raft_consensus.cc:1273] T ba2ab3296190416aa07624e6d69ba09b P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20250625 03:30:42.404170 1708 consensus_peers.cc:487] T ba2ab3296190416aa07624e6d69ba09b P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493): Couldn't send request to peer df8b9755d156478aafca552f9e9c539e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ba2ab3296190416aa07624e6d69ba09b. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:30:42.406569 2199 consensus_queue.cc:1035] T ba2ab3296190416aa07624e6d69ba09b P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:30:42.414672 1595 raft_consensus.cc:1273] T ba2ab3296190416aa07624e6d69ba09b P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 03:30:42.415958 2235 consensus_queue.cc:1035] T ba2ab3296190416aa07624e6d69ba09b P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:30:42.449366 2312 raft_consensus.cc:2953] T ba2ab3296190416aa07624e6d69ba09b P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:42.454099 1591 raft_consensus.cc:2953] T ba2ab3296190416aa07624e6d69ba09b P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:42.460717 1662 raft_consensus.cc:2953] T ba2ab3296190416aa07624e6d69ba09b P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:42.475180 1493 catalog_manager.cc:5582] T ba2ab3296190416aa07624e6d69ba09b P 7e9c4f2e01164f33b2e9034ed148398e reported cstate change: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New cstate: current_term: 1 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:42.486588 1591 consensus_queue.cc:237] T fa68c3b7143345958f883bde3591b622 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
W20250625 03:30:42.498029 1559 consensus_peers.cc:487] T fa68c3b7143345958f883bde3591b622 P 7e9c4f2e01164f33b2e9034ed148398e -> Peer df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493): Couldn't send request to peer df8b9755d156478aafca552f9e9c539e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fa68c3b7143345958f883bde3591b622. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:30:42.499622 1664 raft_consensus.cc:1273] T fa68c3b7143345958f883bde3591b622 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 03:30:42.501197 1745 raft_consensus.cc:1273] T fa68c3b7143345958f883bde3591b622 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 03:30:42.501171 2221 consensus_queue.cc:1035] T fa68c3b7143345958f883bde3591b622 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20250625 03:30:42.502820 2313 consensus_queue.cc:1035] T fa68c3b7143345958f883bde3591b622 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:30:42.521209 2313 raft_consensus.cc:2953] T fa68c3b7143345958f883bde3591b622 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:42.522464 1744 raft_consensus.cc:2953] T fa68c3b7143345958f883bde3591b622 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:42.526474 1662 raft_consensus.cc:2953] T fa68c3b7143345958f883bde3591b622 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:42.546940 1493 catalog_manager.cc:5582] T fa68c3b7143345958f883bde3591b622 P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New cstate: current_term: 1 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:42.839964 2396 ts_tablet_manager.cc:927] T f9458dec7953448d8550396d67fad249 P df8b9755d156478aafca552f9e9c539e: Initiating tablet copy from peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903)
I20250625 03:30:42.848217 2396 tablet_copy_client.cc:323] T f9458dec7953448d8550396d67fad249 P df8b9755d156478aafca552f9e9c539e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.106.129:39903
I20250625 03:30:42.867094 2400 ts_tablet_manager.cc:927] T afe48b30a4e64a4d8faf2a5b42d5c706 P df8b9755d156478aafca552f9e9c539e: Initiating tablet copy from peer ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:42.884840 1606 tablet_copy_service.cc:140] P 7e9c4f2e01164f33b2e9034ed148398e: Received BeginTabletCopySession request for tablet f9458dec7953448d8550396d67fad249 from peer df8b9755d156478aafca552f9e9c539e ({username='slave'} at 127.0.0.1:44210)
I20250625 03:30:42.885588 1606 tablet_copy_service.cc:161] P 7e9c4f2e01164f33b2e9034ed148398e: Beginning new tablet copy session on tablet f9458dec7953448d8550396d67fad249 from peer df8b9755d156478aafca552f9e9c539e at {username='slave'} at 127.0.0.1:44210: session id = df8b9755d156478aafca552f9e9c539e-f9458dec7953448d8550396d67fad249
I20250625 03:30:42.883864 2400 tablet_copy_client.cc:323] T afe48b30a4e64a4d8faf2a5b42d5c706 P df8b9755d156478aafca552f9e9c539e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.106.131:39359
I20250625 03:30:42.903411 1606 tablet_copy_source_session.cc:215] T f9458dec7953448d8550396d67fad249 P 7e9c4f2e01164f33b2e9034ed148398e: Tablet Copy: opened 0 blocks and 1 log segments
I20250625 03:30:42.907404 2396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9458dec7953448d8550396d67fad249. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:42.915403 1755 tablet_copy_service.cc:140] P ba464e89e0f044a0a0ea3e6125cbf2a1: Received BeginTabletCopySession request for tablet afe48b30a4e64a4d8faf2a5b42d5c706 from peer df8b9755d156478aafca552f9e9c539e ({username='slave'} at 127.0.0.1:39774)
I20250625 03:30:42.916290 1755 tablet_copy_service.cc:161] P ba464e89e0f044a0a0ea3e6125cbf2a1: Beginning new tablet copy session on tablet afe48b30a4e64a4d8faf2a5b42d5c706 from peer df8b9755d156478aafca552f9e9c539e at {username='slave'} at 127.0.0.1:39774: session id = df8b9755d156478aafca552f9e9c539e-afe48b30a4e64a4d8faf2a5b42d5c706
I20250625 03:30:42.933775 2396 tablet_copy_client.cc:806] T f9458dec7953448d8550396d67fad249 P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 0 data blocks...
I20250625 03:30:42.940265 2396 tablet_copy_client.cc:670] T f9458dec7953448d8550396d67fad249 P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 1 WAL segments...
I20250625 03:30:42.939684 1755 tablet_copy_source_session.cc:215] T afe48b30a4e64a4d8faf2a5b42d5c706 P ba464e89e0f044a0a0ea3e6125cbf2a1: Tablet Copy: opened 0 blocks and 1 log segments
I20250625 03:30:42.950398 2400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afe48b30a4e64a4d8faf2a5b42d5c706. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:42.959721 2396 tablet_copy_client.cc:538] T f9458dec7953448d8550396d67fad249 P df8b9755d156478aafca552f9e9c539e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250625 03:30:42.973762 2400 tablet_copy_client.cc:806] T afe48b30a4e64a4d8faf2a5b42d5c706 P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 0 data blocks...
I20250625 03:30:42.974526 2400 tablet_copy_client.cc:670] T afe48b30a4e64a4d8faf2a5b42d5c706 P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 1 WAL segments...
I20250625 03:30:42.994505 2400 tablet_copy_client.cc:538] T afe48b30a4e64a4d8faf2a5b42d5c706 P df8b9755d156478aafca552f9e9c539e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250625 03:30:42.996737 2404 ts_tablet_manager.cc:927] T fa68c3b7143345958f883bde3591b622 P df8b9755d156478aafca552f9e9c539e: Initiating tablet copy from peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903)
I20250625 03:30:43.004776 2400 tablet_bootstrap.cc:492] T afe48b30a4e64a4d8faf2a5b42d5c706 P df8b9755d156478aafca552f9e9c539e: Bootstrap starting.
I20250625 03:30:43.010028 2404 tablet_copy_client.cc:323] T fa68c3b7143345958f883bde3591b622 P df8b9755d156478aafca552f9e9c539e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.106.129:39903
I20250625 03:30:43.011564 1606 tablet_copy_service.cc:140] P 7e9c4f2e01164f33b2e9034ed148398e: Received BeginTabletCopySession request for tablet fa68c3b7143345958f883bde3591b622 from peer df8b9755d156478aafca552f9e9c539e ({username='slave'} at 127.0.0.1:44210)
I20250625 03:30:43.012167 1606 tablet_copy_service.cc:161] P 7e9c4f2e01164f33b2e9034ed148398e: Beginning new tablet copy session on tablet fa68c3b7143345958f883bde3591b622 from peer df8b9755d156478aafca552f9e9c539e at {username='slave'} at 127.0.0.1:44210: session id = df8b9755d156478aafca552f9e9c539e-fa68c3b7143345958f883bde3591b622
I20250625 03:30:43.019531 1606 tablet_copy_source_session.cc:215] T fa68c3b7143345958f883bde3591b622 P 7e9c4f2e01164f33b2e9034ed148398e: Tablet Copy: opened 0 blocks and 1 log segments
I20250625 03:30:43.026693 2404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa68c3b7143345958f883bde3591b622. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:43.041910 2370 heartbeater.cc:499] Master 127.0.106.190:39719 was elected leader, sending a full tablet report...
I20250625 03:30:43.050422 2404 tablet_copy_client.cc:806] T fa68c3b7143345958f883bde3591b622 P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 0 data blocks...
I20250625 03:30:43.051040 2404 tablet_copy_client.cc:670] T fa68c3b7143345958f883bde3591b622 P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 1 WAL segments...
I20250625 03:30:43.052654 2407 ts_tablet_manager.cc:927] T ba2ab3296190416aa07624e6d69ba09b P df8b9755d156478aafca552f9e9c539e: Initiating tablet copy from peer ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:43.059181 2404 tablet_copy_client.cc:538] T fa68c3b7143345958f883bde3591b622 P df8b9755d156478aafca552f9e9c539e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250625 03:30:43.060191 2396 tablet_bootstrap.cc:492] T f9458dec7953448d8550396d67fad249 P df8b9755d156478aafca552f9e9c539e: Bootstrap starting.
I20250625 03:30:43.070261 2407 tablet_copy_client.cc:323] T ba2ab3296190416aa07624e6d69ba09b P df8b9755d156478aafca552f9e9c539e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.106.131:39359
I20250625 03:30:43.071942 1755 tablet_copy_service.cc:140] P ba464e89e0f044a0a0ea3e6125cbf2a1: Received BeginTabletCopySession request for tablet ba2ab3296190416aa07624e6d69ba09b from peer df8b9755d156478aafca552f9e9c539e ({username='slave'} at 127.0.0.1:39774)
I20250625 03:30:43.072561 1755 tablet_copy_service.cc:161] P ba464e89e0f044a0a0ea3e6125cbf2a1: Beginning new tablet copy session on tablet ba2ab3296190416aa07624e6d69ba09b from peer df8b9755d156478aafca552f9e9c539e at {username='slave'} at 127.0.0.1:39774: session id = df8b9755d156478aafca552f9e9c539e-ba2ab3296190416aa07624e6d69ba09b
I20250625 03:30:43.073493 2400 tablet_bootstrap.cc:492] T afe48b30a4e64a4d8faf2a5b42d5c706 P df8b9755d156478aafca552f9e9c539e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:30:43.074568 2400 tablet_bootstrap.cc:492] T afe48b30a4e64a4d8faf2a5b42d5c706 P df8b9755d156478aafca552f9e9c539e: Bootstrap complete.
I20250625 03:30:43.075284 2400 ts_tablet_manager.cc:1397] T afe48b30a4e64a4d8faf2a5b42d5c706 P df8b9755d156478aafca552f9e9c539e: Time spent bootstrapping tablet: real 0.071s user 0.025s sys 0.005s
I20250625 03:30:43.078233 2400 raft_consensus.cc:357] T afe48b30a4e64a4d8faf2a5b42d5c706 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:43.079046 2400 raft_consensus.cc:738] T afe48b30a4e64a4d8faf2a5b42d5c706 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: df8b9755d156478aafca552f9e9c539e, State: Initialized, Role: LEARNER
I20250625 03:30:43.079692 2400 consensus_queue.cc:260] T afe48b30a4e64a4d8faf2a5b42d5c706 P df8b9755d156478aafca552f9e9c539e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:43.082329 1755 tablet_copy_source_session.cc:215] T ba2ab3296190416aa07624e6d69ba09b P ba464e89e0f044a0a0ea3e6125cbf2a1: Tablet Copy: opened 0 blocks and 1 log segments
I20250625 03:30:43.084270 2404 tablet_bootstrap.cc:492] T fa68c3b7143345958f883bde3591b622 P df8b9755d156478aafca552f9e9c539e: Bootstrap starting.
I20250625 03:30:43.088505 2400 ts_tablet_manager.cc:1428] T afe48b30a4e64a4d8faf2a5b42d5c706 P df8b9755d156478aafca552f9e9c539e: Time spent starting tablet: real 0.013s user 0.005s sys 0.007s
I20250625 03:30:43.091972 2407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba2ab3296190416aa07624e6d69ba09b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:43.097769 1755 tablet_copy_service.cc:342] P ba464e89e0f044a0a0ea3e6125cbf2a1: Request end of tablet copy session df8b9755d156478aafca552f9e9c539e-afe48b30a4e64a4d8faf2a5b42d5c706 received from {username='slave'} at 127.0.0.1:39774
I20250625 03:30:43.098306 1755 tablet_copy_service.cc:434] P ba464e89e0f044a0a0ea3e6125cbf2a1: ending tablet copy session df8b9755d156478aafca552f9e9c539e-afe48b30a4e64a4d8faf2a5b42d5c706 on tablet afe48b30a4e64a4d8faf2a5b42d5c706 with peer df8b9755d156478aafca552f9e9c539e
I20250625 03:30:43.122792 2407 tablet_copy_client.cc:806] T ba2ab3296190416aa07624e6d69ba09b P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 0 data blocks...
I20250625 03:30:43.126003 2407 tablet_copy_client.cc:670] T ba2ab3296190416aa07624e6d69ba09b P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 1 WAL segments...
I20250625 03:30:43.137034 2407 tablet_copy_client.cc:538] T ba2ab3296190416aa07624e6d69ba09b P df8b9755d156478aafca552f9e9c539e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250625 03:30:43.137674 2404 tablet_bootstrap.cc:492] T fa68c3b7143345958f883bde3591b622 P df8b9755d156478aafca552f9e9c539e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:30:43.138567 2404 tablet_bootstrap.cc:492] T fa68c3b7143345958f883bde3591b622 P df8b9755d156478aafca552f9e9c539e: Bootstrap complete.
I20250625 03:30:43.139240 2404 ts_tablet_manager.cc:1397] T fa68c3b7143345958f883bde3591b622 P df8b9755d156478aafca552f9e9c539e: Time spent bootstrapping tablet: real 0.071s user 0.027s sys 0.005s
I20250625 03:30:43.142627 2404 raft_consensus.cc:357] T fa68c3b7143345958f883bde3591b622 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:43.143544 2404 raft_consensus.cc:738] T fa68c3b7143345958f883bde3591b622 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: df8b9755d156478aafca552f9e9c539e, State: Initialized, Role: LEARNER
I20250625 03:30:43.144198 2404 consensus_queue.cc:260] T fa68c3b7143345958f883bde3591b622 P df8b9755d156478aafca552f9e9c539e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:43.146508 2404 ts_tablet_manager.cc:1428] T fa68c3b7143345958f883bde3591b622 P df8b9755d156478aafca552f9e9c539e: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20250625 03:30:43.150682 1606 tablet_copy_service.cc:342] P 7e9c4f2e01164f33b2e9034ed148398e: Request end of tablet copy session df8b9755d156478aafca552f9e9c539e-fa68c3b7143345958f883bde3591b622 received from {username='slave'} at 127.0.0.1:44210
I20250625 03:30:43.151116 1606 tablet_copy_service.cc:434] P 7e9c4f2e01164f33b2e9034ed148398e: ending tablet copy session df8b9755d156478aafca552f9e9c539e-fa68c3b7143345958f883bde3591b622 on tablet fa68c3b7143345958f883bde3591b622 with peer df8b9755d156478aafca552f9e9c539e
I20250625 03:30:43.154770 2407 tablet_bootstrap.cc:492] T ba2ab3296190416aa07624e6d69ba09b P df8b9755d156478aafca552f9e9c539e: Bootstrap starting.
I20250625 03:30:43.167922 2396 tablet_bootstrap.cc:492] T f9458dec7953448d8550396d67fad249 P df8b9755d156478aafca552f9e9c539e: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:30:43.169108 2396 tablet_bootstrap.cc:492] T f9458dec7953448d8550396d67fad249 P df8b9755d156478aafca552f9e9c539e: Bootstrap complete.
I20250625 03:30:43.169857 2396 ts_tablet_manager.cc:1397] T f9458dec7953448d8550396d67fad249 P df8b9755d156478aafca552f9e9c539e: Time spent bootstrapping tablet: real 0.110s user 0.025s sys 0.003s
I20250625 03:30:43.182673 2396 raft_consensus.cc:357] T f9458dec7953448d8550396d67fad249 P df8b9755d156478aafca552f9e9c539e [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:43.183626 2396 raft_consensus.cc:738] T f9458dec7953448d8550396d67fad249 P df8b9755d156478aafca552f9e9c539e [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: df8b9755d156478aafca552f9e9c539e, State: Initialized, Role: LEARNER
I20250625 03:30:43.185309 2396 consensus_queue.cc:260] T f9458dec7953448d8550396d67fad249 P df8b9755d156478aafca552f9e9c539e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:43.188234 2396 ts_tablet_manager.cc:1428] T f9458dec7953448d8550396d67fad249 P df8b9755d156478aafca552f9e9c539e: Time spent starting tablet: real 0.018s user 0.006s sys 0.003s
I20250625 03:30:43.192468 1606 tablet_copy_service.cc:342] P 7e9c4f2e01164f33b2e9034ed148398e: Request end of tablet copy session df8b9755d156478aafca552f9e9c539e-f9458dec7953448d8550396d67fad249 received from {username='slave'} at 127.0.0.1:44210
I20250625 03:30:43.192945 1606 tablet_copy_service.cc:434] P 7e9c4f2e01164f33b2e9034ed148398e: ending tablet copy session df8b9755d156478aafca552f9e9c539e-f9458dec7953448d8550396d67fad249 on tablet f9458dec7953448d8550396d67fad249 with peer df8b9755d156478aafca552f9e9c539e
I20250625 03:30:43.195515 2407 tablet_bootstrap.cc:492] T ba2ab3296190416aa07624e6d69ba09b P df8b9755d156478aafca552f9e9c539e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:30:43.196516 2407 tablet_bootstrap.cc:492] T ba2ab3296190416aa07624e6d69ba09b P df8b9755d156478aafca552f9e9c539e: Bootstrap complete.
I20250625 03:30:43.198331 2407 ts_tablet_manager.cc:1397] T ba2ab3296190416aa07624e6d69ba09b P df8b9755d156478aafca552f9e9c539e: Time spent bootstrapping tablet: real 0.044s user 0.017s sys 0.015s
I20250625 03:30:43.201926 2407 raft_consensus.cc:357] T ba2ab3296190416aa07624e6d69ba09b P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:43.202811 2407 raft_consensus.cc:738] T ba2ab3296190416aa07624e6d69ba09b P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: df8b9755d156478aafca552f9e9c539e, State: Initialized, Role: LEARNER
I20250625 03:30:43.203485 2407 consensus_queue.cc:260] T ba2ab3296190416aa07624e6d69ba09b P df8b9755d156478aafca552f9e9c539e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:43.205958 2407 ts_tablet_manager.cc:1428] T ba2ab3296190416aa07624e6d69ba09b P df8b9755d156478aafca552f9e9c539e: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20250625 03:30:43.207471 1755 tablet_copy_service.cc:342] P ba464e89e0f044a0a0ea3e6125cbf2a1: Request end of tablet copy session df8b9755d156478aafca552f9e9c539e-ba2ab3296190416aa07624e6d69ba09b received from {username='slave'} at 127.0.0.1:39774
I20250625 03:30:43.207890 1755 tablet_copy_service.cc:434] P ba464e89e0f044a0a0ea3e6125cbf2a1: ending tablet copy session df8b9755d156478aafca552f9e9c539e-ba2ab3296190416aa07624e6d69ba09b on tablet ba2ab3296190416aa07624e6d69ba09b with peer df8b9755d156478aafca552f9e9c539e
I20250625 03:30:43.396751 2345 raft_consensus.cc:1215] T afe48b30a4e64a4d8faf2a5b42d5c706 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20250625 03:30:43.442168 2345 raft_consensus.cc:1215] T f9458dec7953448d8550396d67fad249 P df8b9755d156478aafca552f9e9c539e [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3] Dedup: 2.3->[]
I20250625 03:30:43.558444 2345 raft_consensus.cc:1215] T ba2ab3296190416aa07624e6d69ba09b P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20250625 03:30:43.605199 2345 raft_consensus.cc:1215] T fa68c3b7143345958f883bde3591b622 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20250625 03:30:43.862720 2403 raft_consensus.cc:1062] T afe48b30a4e64a4d8faf2a5b42d5c706 P ba464e89e0f044a0a0ea3e6125cbf2a1: attempting to promote NON_VOTER df8b9755d156478aafca552f9e9c539e to VOTER
I20250625 03:30:43.865392 2403 consensus_queue.cc:237] T afe48b30a4e64a4d8faf2a5b42d5c706 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:30:43.872078 1662 raft_consensus.cc:1273] T afe48b30a4e64a4d8faf2a5b42d5c706 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:30:43.873517 2345 raft_consensus.cc:1273] T afe48b30a4e64a4d8faf2a5b42d5c706 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:30:43.875244 2199 consensus_queue.cc:1035] T afe48b30a4e64a4d8faf2a5b42d5c706 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:30:43.876849 2199 consensus_queue.cc:1035] T afe48b30a4e64a4d8faf2a5b42d5c706 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:30:43.880825 1591 raft_consensus.cc:1273] T afe48b30a4e64a4d8faf2a5b42d5c706 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:30:43.882375 2235 consensus_queue.cc:1035] T afe48b30a4e64a4d8faf2a5b42d5c706 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:30:43.924598 2403 raft_consensus.cc:2953] T afe48b30a4e64a4d8faf2a5b42d5c706 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:43.945941 1595 raft_consensus.cc:2953] T afe48b30a4e64a4d8faf2a5b42d5c706 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:43.939262 1662 raft_consensus.cc:2953] T afe48b30a4e64a4d8faf2a5b42d5c706 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:43.954661 2345 raft_consensus.cc:2953] T afe48b30a4e64a4d8faf2a5b42d5c706 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:43.969533 1491 catalog_manager.cc:5582] T afe48b30a4e64a4d8faf2a5b42d5c706 P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20250625 03:30:44.017969 2221 raft_consensus.cc:1062] T f9458dec7953448d8550396d67fad249 P 7e9c4f2e01164f33b2e9034ed148398e: attempting to promote NON_VOTER df8b9755d156478aafca552f9e9c539e to VOTER
I20250625 03:30:44.025472 2221 consensus_queue.cc:237] T f9458dec7953448d8550396d67fad249 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:30:44.065689 2345 raft_consensus.cc:1273] T f9458dec7953448d8550396d67fad249 P df8b9755d156478aafca552f9e9c539e [term 2 LEARNER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20250625 03:30:44.065985 1662 raft_consensus.cc:1273] T f9458dec7953448d8550396d67fad249 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20250625 03:30:44.065090 1745 raft_consensus.cc:1273] T f9458dec7953448d8550396d67fad249 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20250625 03:30:44.068912 2313 consensus_queue.cc:1035] T f9458dec7953448d8550396d67fad249 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:30:44.074484 2313 consensus_queue.cc:1035] T f9458dec7953448d8550396d67fad249 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:30:44.076753 2313 consensus_queue.cc:1035] T f9458dec7953448d8550396d67fad249 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20250625 03:30:44.100142 2413 raft_consensus.cc:1062] T fa68c3b7143345958f883bde3591b622 P 7e9c4f2e01164f33b2e9034ed148398e: attempting to promote NON_VOTER df8b9755d156478aafca552f9e9c539e to VOTER
I20250625 03:30:44.102384 2413 consensus_queue.cc:237] T fa68c3b7143345958f883bde3591b622 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:30:44.113462 2422 raft_consensus.cc:2953] T f9458dec7953448d8550396d67fad249 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:44.125104 2199 raft_consensus.cc:1062] T ba2ab3296190416aa07624e6d69ba09b P ba464e89e0f044a0a0ea3e6125cbf2a1: attempting to promote NON_VOTER df8b9755d156478aafca552f9e9c539e to VOTER
I20250625 03:30:44.127187 2344 raft_consensus.cc:2953] T f9458dec7953448d8550396d67fad249 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:44.129945 2199 consensus_queue.cc:237] T ba2ab3296190416aa07624e6d69ba09b P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:30:44.122563 1662 raft_consensus.cc:2953] T f9458dec7953448d8550396d67fad249 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:44.157011 1744 consensus_queue.cc:237] T afe48b30a4e64a4d8faf2a5b42d5c706 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:30:44.158515 1492 catalog_manager.cc:5582] T f9458dec7953448d8550396d67fad249 P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: config changed from index 3 to 4, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:44.167919 1664 raft_consensus.cc:1273] T afe48b30a4e64a4d8faf2a5b42d5c706 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250625 03:30:44.169188 2403 consensus_queue.cc:1035] T afe48b30a4e64a4d8faf2a5b42d5c706 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:30:44.181480 2345 raft_consensus.cc:1273] T fa68c3b7143345958f883bde3591b622 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:30:44.183565 2343 raft_consensus.cc:1273] T ba2ab3296190416aa07624e6d69ba09b P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:30:44.185071 2344 raft_consensus.cc:1273] T afe48b30a4e64a4d8faf2a5b42d5c706 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250625 03:30:44.181659 1663 raft_consensus.cc:1273] T ba2ab3296190416aa07624e6d69ba09b P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:30:44.189980 2423 consensus_queue.cc:1035] T fa68c3b7143345958f883bde3591b622 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:30:44.193475 1596 raft_consensus.cc:1273] T ba2ab3296190416aa07624e6d69ba09b P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:30:44.191277 2415 consensus_queue.cc:1035] T ba2ab3296190416aa07624e6d69ba09b P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:30:44.195600 2403 consensus_queue.cc:1035] T afe48b30a4e64a4d8faf2a5b42d5c706 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20250625 03:30:44.222612 1636 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.131:39359, user_credentials={real_user=slave}} blocked reactor thread for 84528.5us
I20250625 03:30:44.223881 2235 consensus_queue.cc:1035] T ba2ab3296190416aa07624e6d69ba09b P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:30:44.224752 2199 consensus_queue.cc:1035] T ba2ab3296190416aa07624e6d69ba09b P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:30:44.240849 1664 raft_consensus.cc:1273] T fa68c3b7143345958f883bde3591b622 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:30:44.251874 2432 consensus_queue.cc:1035] T fa68c3b7143345958f883bde3591b622 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20250625 03:30:44.260262 2415 raft_consensus.cc:2953] T afe48b30a4e64a4d8faf2a5b42d5c706 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
W20250625 03:30:44.287597 1708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.130:34293, user_credentials={real_user=slave}} blocked reactor thread for 77005.7us
I20250625 03:30:44.310585 1739 raft_consensus.cc:1273] T fa68c3b7143345958f883bde3591b622 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20250625 03:30:44.358014 2437 log.cc:927] Time spent T fa68c3b7143345958f883bde3591b622 P df8b9755d156478aafca552f9e9c539e: Append to log took a long time: real 0.081s user 0.004s sys 0.000s
I20250625 03:30:44.358487 1591 consensus_queue.cc:237] T f9458dec7953448d8550396d67fad249 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:30:44.362452 1663 raft_consensus.cc:2953] T afe48b30a4e64a4d8faf2a5b42d5c706 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:44.314014 1739 raft_consensus.cc:2953] T f9458dec7953448d8550396d67fad249 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:44.342640 2313 consensus_queue.cc:1035] T fa68c3b7143345958f883bde3591b622 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
W20250625 03:30:44.385330 1635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:39903, user_credentials={real_user=slave}} blocked reactor thread for 83823.9us
I20250625 03:30:44.552644 1480 catalog_manager.cc:5095] ChangeConfig:REMOVE_PEER RPC for tablet afe48b30a4e64a4d8faf2a5b42d5c706 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20250625 03:30:44.560341 1708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.130:34293, user_credentials={real_user=slave}} blocked reactor thread for 52214.2us
I20250625 03:30:44.568537 2235 raft_consensus.cc:2953] T ba2ab3296190416aa07624e6d69ba09b P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:44.576689 1494 catalog_manager.cc:5582] T afe48b30a4e64a4d8faf2a5b42d5c706 P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: config changed from index 3 to 4, VOTER 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) evicted. New cstate: current_term: 1 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
W20250625 03:30:44.586020 1635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:39903, user_credentials={real_user=slave}} blocked reactor thread for 45450.9us
I20250625 03:30:44.613765 2343 raft_consensus.cc:2953] T afe48b30a4e64a4d8faf2a5b42d5c706 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:44.618961 1662 raft_consensus.cc:2953] T ba2ab3296190416aa07624e6d69ba09b P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:44.633028 2423 raft_consensus.cc:2953] T fa68c3b7143345958f883bde3591b622 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:44.642421 1739 raft_consensus.cc:2953] T fa68c3b7143345958f883bde3591b622 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:44.660517 1582 tablet_service.cc:1515] Processing DeleteTablet for tablet afe48b30a4e64a4d8faf2a5b42d5c706 with delete_type TABLET_DATA_TOMBSTONED (TS 7e9c4f2e01164f33b2e9034ed148398e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52712
I20250625 03:30:44.680378 1590 raft_consensus.cc:2953] T ba2ab3296190416aa07624e6d69ba09b P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
W20250625 03:30:44.692770 1559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.130:34293, user_credentials={real_user=slave}} blocked reactor thread for 320133us
I20250625 03:30:44.698010 1493 catalog_manager.cc:5582] T ba2ab3296190416aa07624e6d69ba09b P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:44.712901 2343 raft_consensus.cc:1273] T f9458dec7953448d8550396d67fad249 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250625 03:30:44.711997 2344 raft_consensus.cc:2953] T fa68c3b7143345958f883bde3591b622 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:44.714908 1664 raft_consensus.cc:1273] T f9458dec7953448d8550396d67fad249 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250625 03:30:44.724454 1494 catalog_manager.cc:5582] T fa68c3b7143345958f883bde3591b622 P 7e9c4f2e01164f33b2e9034ed148398e reported cstate change: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250625 03:30:44.728058 2221 consensus_queue.cc:1035] T f9458dec7953448d8550396d67fad249 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250625 03:30:44.728513 1737 consensus_queue.cc:237] T ba2ab3296190416aa07624e6d69ba09b P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:30:44.729997 2450 tablet_replica.cc:331] T afe48b30a4e64a4d8faf2a5b42d5c706 P 7e9c4f2e01164f33b2e9034ed148398e: stopping tablet replica
I20250625 03:30:44.735337 2450 raft_consensus.cc:2241] T afe48b30a4e64a4d8faf2a5b42d5c706 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:30:44.735396 2445 consensus_queue.cc:1035] T f9458dec7953448d8550396d67fad249 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20250625 03:30:44.736230 2450 raft_consensus.cc:2270] T afe48b30a4e64a4d8faf2a5b42d5c706 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:30:44.739229 1664 raft_consensus.cc:2953] T fa68c3b7143345958f883bde3591b622 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:44.770247 1596 consensus_queue.cc:237] T fa68c3b7143345958f883bde3591b622 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
W20250625 03:30:44.776023 1708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.130:34293, user_credentials={real_user=slave}} blocked reactor thread for 101526us
I20250625 03:30:44.779381 2343 raft_consensus.cc:2953] T ba2ab3296190416aa07624e6d69ba09b P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:44.788439 2344 raft_consensus.cc:2953] T f9458dec7953448d8550396d67fad249 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:44.790560 2450 ts_tablet_manager.cc:1905] T afe48b30a4e64a4d8faf2a5b42d5c706 P 7e9c4f2e01164f33b2e9034ed148398e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250625 03:30:44.795703 1589 raft_consensus.cc:1273] T ba2ab3296190416aa07624e6d69ba09b P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250625 03:30:44.806246 2343 raft_consensus.cc:1273] T ba2ab3296190416aa07624e6d69ba09b P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250625 03:30:44.807865 2451 consensus_queue.cc:1035] T ba2ab3296190416aa07624e6d69ba09b P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:30:44.813103 1667 raft_consensus.cc:2953] T f9458dec7953448d8550396d67fad249 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:44.809794 2445 raft_consensus.cc:2953] T f9458dec7953448d8550396d67fad249 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:44.817059 2199 consensus_queue.cc:1035] T ba2ab3296190416aa07624e6d69ba09b P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:30:44.823956 1745 raft_consensus.cc:1273] T fa68c3b7143345958f883bde3591b622 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250625 03:30:44.827149 2433 consensus_queue.cc:1035] T fa68c3b7143345958f883bde3591b622 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:30:44.830653 2343 raft_consensus.cc:1273] T fa68c3b7143345958f883bde3591b622 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250625 03:30:44.833280 2423 consensus_queue.cc:1035] T fa68c3b7143345958f883bde3591b622 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:30:44.838197 2435 raft_consensus.cc:2953] T ba2ab3296190416aa07624e6d69ba09b P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:44.843900 1493 catalog_manager.cc:5582] T f9458dec7953448d8550396d67fad249 P df8b9755d156478aafca552f9e9c539e reported cstate change: config changed from index 4 to 5, VOTER ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) evicted. New cstate: current_term: 2 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:44.849413 1596 raft_consensus.cc:2953] T ba2ab3296190416aa07624e6d69ba09b P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:44.854749 1732 tablet_service.cc:1515] Processing DeleteTablet for tablet f9458dec7953448d8550396d67fad249 with delete_type TABLET_DATA_TOMBSTONED (TS ba464e89e0f044a0a0ea3e6125cbf2a1 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:43672
I20250625 03:30:44.854753 2343 raft_consensus.cc:2953] T ba2ab3296190416aa07624e6d69ba09b P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:44.870216 2432 raft_consensus.cc:2953] T fa68c3b7143345958f883bde3591b622 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:44.875730 1480 catalog_manager.cc:5095] ChangeConfig:REMOVE_PEER RPC for tablet ba2ab3296190416aa07624e6d69ba09b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250625 03:30:44.888761 1745 raft_consensus.cc:2953] T fa68c3b7143345958f883bde3591b622 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:44.903503 2452 tablet_replica.cc:331] T f9458dec7953448d8550396d67fad249 P ba464e89e0f044a0a0ea3e6125cbf2a1: stopping tablet replica
I20250625 03:30:44.904712 2452 raft_consensus.cc:2241] T f9458dec7953448d8550396d67fad249 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:30:44.905454 2452 raft_consensus.cc:2270] T f9458dec7953448d8550396d67fad249 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:30:44.910919 2452 ts_tablet_manager.cc:1905] T f9458dec7953448d8550396d67fad249 P ba464e89e0f044a0a0ea3e6125cbf2a1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250625 03:30:44.946004 1494 catalog_manager.cc:5582] T ba2ab3296190416aa07624e6d69ba09b P df8b9755d156478aafca552f9e9c539e reported cstate change: config changed from index 3 to 4, VOTER 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) evicted. New cstate: current_term: 1 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:44.955438 1479 catalog_manager.cc:5095] ChangeConfig:REMOVE_PEER RPC for tablet f9458dec7953448d8550396d67fad249 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250625 03:30:44.965022 1658 tablet_service.cc:1515] Processing DeleteTablet for tablet ba2ab3296190416aa07624e6d69ba09b with delete_type TABLET_DATA_TOMBSTONED (TS 3f2aa40978064c9e9983cf3745eed206 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53744
I20250625 03:30:44.976997 1493 catalog_manager.cc:5582] T fa68c3b7143345958f883bde3591b622 P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: config changed from index 3 to 4, VOTER 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) evicted. New cstate: current_term: 1 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:44.982538 1479 catalog_manager.cc:5095] ChangeConfig:REMOVE_PEER RPC for tablet fa68c3b7143345958f883bde3591b622 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250625 03:30:44.956765 2344 raft_consensus.cc:2953] T fa68c3b7143345958f883bde3591b622 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:45.007457 2452 ts_tablet_manager.cc:1918] T f9458dec7953448d8550396d67fad249 P ba464e89e0f044a0a0ea3e6125cbf2a1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20250625 03:30:45.008136 2452 log.cc:1199] T f9458dec7953448d8550396d67fad249 P ba464e89e0f044a0a0ea3e6125cbf2a1: Deleting WAL directory at /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/ts-2-root/wals/f9458dec7953448d8550396d67fad249
I20250625 03:30:44.993162 2453 tablet_replica.cc:331] T ba2ab3296190416aa07624e6d69ba09b P 3f2aa40978064c9e9983cf3745eed206: stopping tablet replica
I20250625 03:30:45.016579 1480 catalog_manager.cc:4928] TS ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): tablet f9458dec7953448d8550396d67fad249 (table test-workload [id=7f663eabec024fd1911b406c660fa838]) successfully deleted
I20250625 03:30:44.989347 2450 ts_tablet_manager.cc:1918] T afe48b30a4e64a4d8faf2a5b42d5c706 P 7e9c4f2e01164f33b2e9034ed148398e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20250625 03:30:45.012611 1658 tablet_service.cc:1515] Processing DeleteTablet for tablet fa68c3b7143345958f883bde3591b622 with delete_type TABLET_DATA_TOMBSTONED (TS 3f2aa40978064c9e9983cf3745eed206 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53744
I20250625 03:30:45.026692 2450 log.cc:1199] T afe48b30a4e64a4d8faf2a5b42d5c706 P 7e9c4f2e01164f33b2e9034ed148398e: Deleting WAL directory at /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/ts-0-root/wals/afe48b30a4e64a4d8faf2a5b42d5c706
I20250625 03:30:45.028486 1479 catalog_manager.cc:4928] TS 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): tablet afe48b30a4e64a4d8faf2a5b42d5c706 (table test-workload [id=7f663eabec024fd1911b406c660fa838]) successfully deleted
I20250625 03:30:45.041311 2453 raft_consensus.cc:2241] T ba2ab3296190416aa07624e6d69ba09b P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:30:45.042232 2453 raft_consensus.cc:2270] T ba2ab3296190416aa07624e6d69ba09b P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:30:45.046175 2453 ts_tablet_manager.cc:1905] T ba2ab3296190416aa07624e6d69ba09b P 3f2aa40978064c9e9983cf3745eed206: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250625 03:30:45.064966 2453 ts_tablet_manager.cc:1918] T ba2ab3296190416aa07624e6d69ba09b P 3f2aa40978064c9e9983cf3745eed206: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20250625 03:30:45.065452 2453 log.cc:1199] T ba2ab3296190416aa07624e6d69ba09b P 3f2aa40978064c9e9983cf3745eed206: Deleting WAL directory at /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/ts-1-root/wals/ba2ab3296190416aa07624e6d69ba09b
I20250625 03:30:45.067273 1478 catalog_manager.cc:4928] TS 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): tablet ba2ab3296190416aa07624e6d69ba09b (table test-workload [id=7f663eabec024fd1911b406c660fa838]) successfully deleted
I20250625 03:30:45.067898 2453 tablet_replica.cc:331] T fa68c3b7143345958f883bde3591b622 P 3f2aa40978064c9e9983cf3745eed206: stopping tablet replica
I20250625 03:30:45.069001 2453 raft_consensus.cc:2241] T fa68c3b7143345958f883bde3591b622 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:30:45.073403 2453 raft_consensus.cc:2270] T fa68c3b7143345958f883bde3591b622 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:30:45.076910 2453 ts_tablet_manager.cc:1905] T fa68c3b7143345958f883bde3591b622 P 3f2aa40978064c9e9983cf3745eed206: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250625 03:30:45.096527 2453 ts_tablet_manager.cc:1918] T fa68c3b7143345958f883bde3591b622 P 3f2aa40978064c9e9983cf3745eed206: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20250625 03:30:45.097066 2453 log.cc:1199] T fa68c3b7143345958f883bde3591b622 P 3f2aa40978064c9e9983cf3745eed206: Deleting WAL directory at /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/ts-1-root/wals/fa68c3b7143345958f883bde3591b622
I20250625 03:30:45.098505 1478 catalog_manager.cc:4928] TS 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): tablet fa68c3b7143345958f883bde3591b622 (table test-workload [id=7f663eabec024fd1911b406c660fa838]) successfully deleted
I20250625 03:30:46.081257 1664 consensus_queue.cc:237] T 9643cfd400804eb8b9037c5e9efddfba P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:46.087564 1739 raft_consensus.cc:1273] T 9643cfd400804eb8b9037c5e9efddfba P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 03:30:46.089666 2455 consensus_queue.cc:1035] T 9643cfd400804eb8b9037c5e9efddfba P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20250625 03:30:46.094034 1590 raft_consensus.cc:1273] T 9643cfd400804eb8b9037c5e9efddfba P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 03:30:46.095422 2430 consensus_queue.cc:1035] T 9643cfd400804eb8b9037c5e9efddfba P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20250625 03:30:46.109189 2455 raft_consensus.cc:2953] T 9643cfd400804eb8b9037c5e9efddfba P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:46.116443 1739 raft_consensus.cc:2953] T 9643cfd400804eb8b9037c5e9efddfba P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:46.117254 1591 raft_consensus.cc:2953] T 9643cfd400804eb8b9037c5e9efddfba P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:46.127382 1667 consensus_queue.cc:237] T 188e56b819ae44f9b72baefcbc749400 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
W20250625 03:30:46.132652 1634 consensus_peers.cc:487] T 9643cfd400804eb8b9037c5e9efddfba P 3f2aa40978064c9e9983cf3745eed206 -> Peer df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493): Couldn't send request to peer df8b9755d156478aafca552f9e9c539e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9643cfd400804eb8b9037c5e9efddfba. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:30:46.131944 1493 catalog_manager.cc:5582] T 9643cfd400804eb8b9037c5e9efddfba P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New cstate: current_term: 1 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20250625 03:30:46.150668 1596 raft_consensus.cc:1273] T 188e56b819ae44f9b72baefcbc749400 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20250625 03:30:46.151482 1634 consensus_peers.cc:487] T 188e56b819ae44f9b72baefcbc749400 P 3f2aa40978064c9e9983cf3745eed206 -> Peer df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493): Couldn't send request to peer df8b9755d156478aafca552f9e9c539e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 188e56b819ae44f9b72baefcbc749400. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:30:46.152376 2438 consensus_queue.cc:1035] T 188e56b819ae44f9b72baefcbc749400 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:30:46.153019 1739 raft_consensus.cc:1273] T 188e56b819ae44f9b72baefcbc749400 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 03:30:46.154793 2438 consensus_queue.cc:1035] T 188e56b819ae44f9b72baefcbc749400 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:30:46.169267 2438 raft_consensus.cc:2953] T 188e56b819ae44f9b72baefcbc749400 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:46.171221 1590 raft_consensus.cc:2953] T 188e56b819ae44f9b72baefcbc749400 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:46.174060 1745 raft_consensus.cc:2953] T 188e56b819ae44f9b72baefcbc749400 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:46.192282 1667 consensus_queue.cc:237] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:46.199054 1492 catalog_manager.cc:5582] T 188e56b819ae44f9b72baefcbc749400 P 7e9c4f2e01164f33b2e9034ed148398e reported cstate change: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New cstate: current_term: 1 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:46.212582 1745 raft_consensus.cc:1273] T 0c2b6052daaa4c57aaa55361e8d6e01c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20250625 03:30:46.213881 1634 consensus_peers.cc:487] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206 -> Peer df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493): Couldn't send request to peer df8b9755d156478aafca552f9e9c539e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0c2b6052daaa4c57aaa55361e8d6e01c. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:30:46.214025 2455 consensus_queue.cc:1035] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:30:46.214325 1596 raft_consensus.cc:1273] T 0c2b6052daaa4c57aaa55361e8d6e01c P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:30:46.215553 2438 consensus_queue.cc:1035] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:30:46.220890 2455 raft_consensus.cc:2953] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206 [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:46.222715 1745 raft_consensus.cc:2953] T 0c2b6052daaa4c57aaa55361e8d6e01c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:46.227921 1596 raft_consensus.cc:2953] T 0c2b6052daaa4c57aaa55361e8d6e01c P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:46.242488 1493 catalog_manager.cc:5582] T 0c2b6052daaa4c57aaa55361e8d6e01c P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New cstate: current_term: 2 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:46.244217 1596 consensus_queue.cc:237] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:46.267445 1745 raft_consensus.cc:1273] T e58b1ae66ee14c6f8d6f2db8dda2b842 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 03:30:46.268889 2432 consensus_queue.cc:1035] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20250625 03:30:46.270668 1559 consensus_peers.cc:487] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e -> Peer df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493): Couldn't send request to peer df8b9755d156478aafca552f9e9c539e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e58b1ae66ee14c6f8d6f2db8dda2b842. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:30:46.271608 1667 raft_consensus.cc:1273] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 03:30:46.272835 2432 consensus_queue.cc:1035] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:30:46.280002 2445 raft_consensus.cc:2953] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:46.289218 1739 raft_consensus.cc:2953] T e58b1ae66ee14c6f8d6f2db8dda2b842 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:46.329958 1493 catalog_manager.cc:5582] T e58b1ae66ee14c6f8d6f2db8dda2b842 P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New cstate: current_term: 1 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
W20250625 03:30:46.341827 1559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.130:34293, user_credentials={real_user=slave}} blocked reactor thread for 59997.7us
I20250625 03:30:46.355768 1667 raft_consensus.cc:2953] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:46.487496 2482 ts_tablet_manager.cc:927] T 9643cfd400804eb8b9037c5e9efddfba P df8b9755d156478aafca552f9e9c539e: Initiating tablet copy from peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:46.489257 2482 tablet_copy_client.cc:323] T 9643cfd400804eb8b9037c5e9efddfba P df8b9755d156478aafca552f9e9c539e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.106.130:34293
I20250625 03:30:46.511929 1681 tablet_copy_service.cc:140] P 3f2aa40978064c9e9983cf3745eed206: Received BeginTabletCopySession request for tablet 9643cfd400804eb8b9037c5e9efddfba from peer df8b9755d156478aafca552f9e9c539e ({username='slave'} at 127.0.0.1:55766)
I20250625 03:30:46.512459 1681 tablet_copy_service.cc:161] P 3f2aa40978064c9e9983cf3745eed206: Beginning new tablet copy session on tablet 9643cfd400804eb8b9037c5e9efddfba from peer df8b9755d156478aafca552f9e9c539e at {username='slave'} at 127.0.0.1:55766: session id = df8b9755d156478aafca552f9e9c539e-9643cfd400804eb8b9037c5e9efddfba
I20250625 03:30:46.519380 1681 tablet_copy_source_session.cc:215] T 9643cfd400804eb8b9037c5e9efddfba P 3f2aa40978064c9e9983cf3745eed206: Tablet Copy: opened 0 blocks and 1 log segments
I20250625 03:30:46.522580 2482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9643cfd400804eb8b9037c5e9efddfba. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:46.545354 2482 tablet_copy_client.cc:806] T 9643cfd400804eb8b9037c5e9efddfba P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 0 data blocks...
I20250625 03:30:46.545915 2482 tablet_copy_client.cc:670] T 9643cfd400804eb8b9037c5e9efddfba P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 1 WAL segments...
I20250625 03:30:46.550370 2482 tablet_copy_client.cc:538] T 9643cfd400804eb8b9037c5e9efddfba P df8b9755d156478aafca552f9e9c539e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250625 03:30:46.558053 2482 tablet_bootstrap.cc:492] T 9643cfd400804eb8b9037c5e9efddfba P df8b9755d156478aafca552f9e9c539e: Bootstrap starting.
I20250625 03:30:46.577176 2482 tablet_bootstrap.cc:492] T 9643cfd400804eb8b9037c5e9efddfba P df8b9755d156478aafca552f9e9c539e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:30:46.578013 2482 tablet_bootstrap.cc:492] T 9643cfd400804eb8b9037c5e9efddfba P df8b9755d156478aafca552f9e9c539e: Bootstrap complete.
I20250625 03:30:46.578534 2482 ts_tablet_manager.cc:1397] T 9643cfd400804eb8b9037c5e9efddfba P df8b9755d156478aafca552f9e9c539e: Time spent bootstrapping tablet: real 0.021s user 0.014s sys 0.004s
I20250625 03:30:46.581012 2482 raft_consensus.cc:357] T 9643cfd400804eb8b9037c5e9efddfba P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:46.581643 2482 raft_consensus.cc:738] T 9643cfd400804eb8b9037c5e9efddfba P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: df8b9755d156478aafca552f9e9c539e, State: Initialized, Role: LEARNER
I20250625 03:30:46.582249 2482 consensus_queue.cc:260] T 9643cfd400804eb8b9037c5e9efddfba P df8b9755d156478aafca552f9e9c539e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:46.585176 2482 ts_tablet_manager.cc:1428] T 9643cfd400804eb8b9037c5e9efddfba P df8b9755d156478aafca552f9e9c539e: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20250625 03:30:46.588255 1681 tablet_copy_service.cc:342] P 3f2aa40978064c9e9983cf3745eed206: Request end of tablet copy session df8b9755d156478aafca552f9e9c539e-9643cfd400804eb8b9037c5e9efddfba received from {username='slave'} at 127.0.0.1:55766
I20250625 03:30:46.588676 1681 tablet_copy_service.cc:434] P 3f2aa40978064c9e9983cf3745eed206: ending tablet copy session df8b9755d156478aafca552f9e9c539e-9643cfd400804eb8b9037c5e9efddfba on tablet 9643cfd400804eb8b9037c5e9efddfba with peer df8b9755d156478aafca552f9e9c539e
I20250625 03:30:46.667603 2482 ts_tablet_manager.cc:927] T e58b1ae66ee14c6f8d6f2db8dda2b842 P df8b9755d156478aafca552f9e9c539e: Initiating tablet copy from peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903)
I20250625 03:30:46.669247 2482 tablet_copy_client.cc:323] T e58b1ae66ee14c6f8d6f2db8dda2b842 P df8b9755d156478aafca552f9e9c539e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.106.129:39903
I20250625 03:30:46.670743 1606 tablet_copy_service.cc:140] P 7e9c4f2e01164f33b2e9034ed148398e: Received BeginTabletCopySession request for tablet e58b1ae66ee14c6f8d6f2db8dda2b842 from peer df8b9755d156478aafca552f9e9c539e ({username='slave'} at 127.0.0.1:44210)
I20250625 03:30:46.671295 1606 tablet_copy_service.cc:161] P 7e9c4f2e01164f33b2e9034ed148398e: Beginning new tablet copy session on tablet e58b1ae66ee14c6f8d6f2db8dda2b842 from peer df8b9755d156478aafca552f9e9c539e at {username='slave'} at 127.0.0.1:44210: session id = df8b9755d156478aafca552f9e9c539e-e58b1ae66ee14c6f8d6f2db8dda2b842
I20250625 03:30:46.677368 1606 tablet_copy_source_session.cc:215] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e: Tablet Copy: opened 0 blocks and 1 log segments
I20250625 03:30:46.679817 2482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e58b1ae66ee14c6f8d6f2db8dda2b842. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:46.697049 2482 tablet_copy_client.cc:806] T e58b1ae66ee14c6f8d6f2db8dda2b842 P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 0 data blocks...
I20250625 03:30:46.697615 2482 tablet_copy_client.cc:670] T e58b1ae66ee14c6f8d6f2db8dda2b842 P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 1 WAL segments...
I20250625 03:30:46.701076 2482 tablet_copy_client.cc:538] T e58b1ae66ee14c6f8d6f2db8dda2b842 P df8b9755d156478aafca552f9e9c539e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250625 03:30:46.710347 2482 tablet_bootstrap.cc:492] T e58b1ae66ee14c6f8d6f2db8dda2b842 P df8b9755d156478aafca552f9e9c539e: Bootstrap starting.
I20250625 03:30:46.738606 2482 tablet_bootstrap.cc:492] T e58b1ae66ee14c6f8d6f2db8dda2b842 P df8b9755d156478aafca552f9e9c539e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:30:46.739795 2482 tablet_bootstrap.cc:492] T e58b1ae66ee14c6f8d6f2db8dda2b842 P df8b9755d156478aafca552f9e9c539e: Bootstrap complete.
I20250625 03:30:46.740377 2482 ts_tablet_manager.cc:1397] T e58b1ae66ee14c6f8d6f2db8dda2b842 P df8b9755d156478aafca552f9e9c539e: Time spent bootstrapping tablet: real 0.030s user 0.021s sys 0.000s
I20250625 03:30:46.741281 2489 ts_tablet_manager.cc:927] T 0c2b6052daaa4c57aaa55361e8d6e01c P df8b9755d156478aafca552f9e9c539e: Initiating tablet copy from peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:46.742996 2482 raft_consensus.cc:357] T e58b1ae66ee14c6f8d6f2db8dda2b842 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:46.743877 2482 raft_consensus.cc:738] T e58b1ae66ee14c6f8d6f2db8dda2b842 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: df8b9755d156478aafca552f9e9c539e, State: Initialized, Role: LEARNER
I20250625 03:30:46.743867 2489 tablet_copy_client.cc:323] T 0c2b6052daaa4c57aaa55361e8d6e01c P df8b9755d156478aafca552f9e9c539e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.106.130:34293
I20250625 03:30:46.744918 2482 consensus_queue.cc:260] T e58b1ae66ee14c6f8d6f2db8dda2b842 P df8b9755d156478aafca552f9e9c539e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:46.745767 1681 tablet_copy_service.cc:140] P 3f2aa40978064c9e9983cf3745eed206: Received BeginTabletCopySession request for tablet 0c2b6052daaa4c57aaa55361e8d6e01c from peer df8b9755d156478aafca552f9e9c539e ({username='slave'} at 127.0.0.1:55766)
I20250625 03:30:46.746309 1681 tablet_copy_service.cc:161] P 3f2aa40978064c9e9983cf3745eed206: Beginning new tablet copy session on tablet 0c2b6052daaa4c57aaa55361e8d6e01c from peer df8b9755d156478aafca552f9e9c539e at {username='slave'} at 127.0.0.1:55766: session id = df8b9755d156478aafca552f9e9c539e-0c2b6052daaa4c57aaa55361e8d6e01c
I20250625 03:30:46.747309 2482 ts_tablet_manager.cc:1428] T e58b1ae66ee14c6f8d6f2db8dda2b842 P df8b9755d156478aafca552f9e9c539e: Time spent starting tablet: real 0.007s user 0.004s sys 0.000s
I20250625 03:30:46.748929 1606 tablet_copy_service.cc:342] P 7e9c4f2e01164f33b2e9034ed148398e: Request end of tablet copy session df8b9755d156478aafca552f9e9c539e-e58b1ae66ee14c6f8d6f2db8dda2b842 received from {username='slave'} at 127.0.0.1:44210
I20250625 03:30:46.749369 1606 tablet_copy_service.cc:434] P 7e9c4f2e01164f33b2e9034ed148398e: ending tablet copy session df8b9755d156478aafca552f9e9c539e-e58b1ae66ee14c6f8d6f2db8dda2b842 on tablet e58b1ae66ee14c6f8d6f2db8dda2b842 with peer df8b9755d156478aafca552f9e9c539e
I20250625 03:30:46.754827 1681 tablet_copy_source_session.cc:215] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206: Tablet Copy: opened 0 blocks and 1 log segments
I20250625 03:30:46.756420 2482 ts_tablet_manager.cc:927] T 188e56b819ae44f9b72baefcbc749400 P df8b9755d156478aafca552f9e9c539e: Initiating tablet copy from peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:46.758208 2489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c2b6052daaa4c57aaa55361e8d6e01c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:46.768705 2482 tablet_copy_client.cc:323] T 188e56b819ae44f9b72baefcbc749400 P df8b9755d156478aafca552f9e9c539e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.106.130:34293
I20250625 03:30:46.772100 1681 tablet_copy_service.cc:140] P 3f2aa40978064c9e9983cf3745eed206: Received BeginTabletCopySession request for tablet 188e56b819ae44f9b72baefcbc749400 from peer df8b9755d156478aafca552f9e9c539e ({username='slave'} at 127.0.0.1:55766)
I20250625 03:30:46.772652 1681 tablet_copy_service.cc:161] P 3f2aa40978064c9e9983cf3745eed206: Beginning new tablet copy session on tablet 188e56b819ae44f9b72baefcbc749400 from peer df8b9755d156478aafca552f9e9c539e at {username='slave'} at 127.0.0.1:55766: session id = df8b9755d156478aafca552f9e9c539e-188e56b819ae44f9b72baefcbc749400
I20250625 03:30:46.780126 2489 tablet_copy_client.cc:806] T 0c2b6052daaa4c57aaa55361e8d6e01c P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 0 data blocks...
I20250625 03:30:46.780706 2489 tablet_copy_client.cc:670] T 0c2b6052daaa4c57aaa55361e8d6e01c P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 1 WAL segments...
I20250625 03:30:46.780699 1681 tablet_copy_source_session.cc:215] T 188e56b819ae44f9b72baefcbc749400 P 3f2aa40978064c9e9983cf3745eed206: Tablet Copy: opened 0 blocks and 1 log segments
I20250625 03:30:46.783825 2482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 188e56b819ae44f9b72baefcbc749400. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:46.784587 2489 tablet_copy_client.cc:538] T 0c2b6052daaa4c57aaa55361e8d6e01c P df8b9755d156478aafca552f9e9c539e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250625 03:30:46.794404 2489 tablet_bootstrap.cc:492] T 0c2b6052daaa4c57aaa55361e8d6e01c P df8b9755d156478aafca552f9e9c539e: Bootstrap starting.
I20250625 03:30:46.818066 2489 tablet_bootstrap.cc:492] T 0c2b6052daaa4c57aaa55361e8d6e01c P df8b9755d156478aafca552f9e9c539e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:30:46.818471 2482 tablet_copy_client.cc:806] T 188e56b819ae44f9b72baefcbc749400 P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 0 data blocks...
I20250625 03:30:46.819026 2482 tablet_copy_client.cc:670] T 188e56b819ae44f9b72baefcbc749400 P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 1 WAL segments...
I20250625 03:30:46.819156 2489 tablet_bootstrap.cc:492] T 0c2b6052daaa4c57aaa55361e8d6e01c P df8b9755d156478aafca552f9e9c539e: Bootstrap complete.
I20250625 03:30:46.819978 2489 ts_tablet_manager.cc:1397] T 0c2b6052daaa4c57aaa55361e8d6e01c P df8b9755d156478aafca552f9e9c539e: Time spent bootstrapping tablet: real 0.026s user 0.021s sys 0.005s
I20250625 03:30:46.822304 2482 tablet_copy_client.cc:538] T 188e56b819ae44f9b72baefcbc749400 P df8b9755d156478aafca552f9e9c539e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250625 03:30:46.822958 2489 raft_consensus.cc:357] T 0c2b6052daaa4c57aaa55361e8d6e01c P df8b9755d156478aafca552f9e9c539e [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:46.823859 2489 raft_consensus.cc:738] T 0c2b6052daaa4c57aaa55361e8d6e01c P df8b9755d156478aafca552f9e9c539e [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: df8b9755d156478aafca552f9e9c539e, State: Initialized, Role: LEARNER
I20250625 03:30:46.824517 2489 consensus_queue.cc:260] T 0c2b6052daaa4c57aaa55361e8d6e01c P df8b9755d156478aafca552f9e9c539e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:46.827437 2489 ts_tablet_manager.cc:1428] T 0c2b6052daaa4c57aaa55361e8d6e01c P df8b9755d156478aafca552f9e9c539e: Time spent starting tablet: real 0.007s user 0.002s sys 0.003s
I20250625 03:30:46.829109 1680 tablet_copy_service.cc:342] P 3f2aa40978064c9e9983cf3745eed206: Request end of tablet copy session df8b9755d156478aafca552f9e9c539e-0c2b6052daaa4c57aaa55361e8d6e01c received from {username='slave'} at 127.0.0.1:55766
I20250625 03:30:46.829515 1680 tablet_copy_service.cc:434] P 3f2aa40978064c9e9983cf3745eed206: ending tablet copy session df8b9755d156478aafca552f9e9c539e-0c2b6052daaa4c57aaa55361e8d6e01c on tablet 0c2b6052daaa4c57aaa55361e8d6e01c with peer df8b9755d156478aafca552f9e9c539e
I20250625 03:30:46.829895 2482 tablet_bootstrap.cc:492] T 188e56b819ae44f9b72baefcbc749400 P df8b9755d156478aafca552f9e9c539e: Bootstrap starting.
I20250625 03:30:46.854979 2482 tablet_bootstrap.cc:492] T 188e56b819ae44f9b72baefcbc749400 P df8b9755d156478aafca552f9e9c539e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:30:46.855662 2482 tablet_bootstrap.cc:492] T 188e56b819ae44f9b72baefcbc749400 P df8b9755d156478aafca552f9e9c539e: Bootstrap complete.
I20250625 03:30:46.856328 2482 ts_tablet_manager.cc:1397] T 188e56b819ae44f9b72baefcbc749400 P df8b9755d156478aafca552f9e9c539e: Time spent bootstrapping tablet: real 0.027s user 0.018s sys 0.008s
I20250625 03:30:46.858872 2482 raft_consensus.cc:357] T 188e56b819ae44f9b72baefcbc749400 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:46.859625 2482 raft_consensus.cc:738] T 188e56b819ae44f9b72baefcbc749400 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: df8b9755d156478aafca552f9e9c539e, State: Initialized, Role: LEARNER
I20250625 03:30:46.860236 2482 consensus_queue.cc:260] T 188e56b819ae44f9b72baefcbc749400 P df8b9755d156478aafca552f9e9c539e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:46.862270 2482 ts_tablet_manager.cc:1428] T 188e56b819ae44f9b72baefcbc749400 P df8b9755d156478aafca552f9e9c539e: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20250625 03:30:46.863636 1680 tablet_copy_service.cc:342] P 3f2aa40978064c9e9983cf3745eed206: Request end of tablet copy session df8b9755d156478aafca552f9e9c539e-188e56b819ae44f9b72baefcbc749400 received from {username='slave'} at 127.0.0.1:55766
I20250625 03:30:46.864082 1680 tablet_copy_service.cc:434] P 3f2aa40978064c9e9983cf3745eed206: ending tablet copy session df8b9755d156478aafca552f9e9c539e-188e56b819ae44f9b72baefcbc749400 on tablet 188e56b819ae44f9b72baefcbc749400 with peer df8b9755d156478aafca552f9e9c539e
I20250625 03:30:47.063488 2344 raft_consensus.cc:1215] T 9643cfd400804eb8b9037c5e9efddfba P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20250625 03:30:47.091297 2344 raft_consensus.cc:1215] T e58b1ae66ee14c6f8d6f2db8dda2b842 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20250625 03:30:47.176204 2344 raft_consensus.cc:1215] T 0c2b6052daaa4c57aaa55361e8d6e01c P df8b9755d156478aafca552f9e9c539e [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2] Dedup: 2.2->[]
I20250625 03:30:47.353384 2344 raft_consensus.cc:1215] T 188e56b819ae44f9b72baefcbc749400 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20250625 03:30:47.543573 2501 raft_consensus.cc:1062] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e: attempting to promote NON_VOTER df8b9755d156478aafca552f9e9c539e to VOTER
I20250625 03:30:47.547730 2501 consensus_queue.cc:237] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:30:47.574239 2344 raft_consensus.cc:1273] T e58b1ae66ee14c6f8d6f2db8dda2b842 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:30:47.576488 2495 consensus_queue.cc:1035] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20250625 03:30:47.579524 1663 raft_consensus.cc:1273] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:30:47.579984 1737 raft_consensus.cc:1273] T e58b1ae66ee14c6f8d6f2db8dda2b842 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:30:47.582090 2499 consensus_queue.cc:1035] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20250625 03:30:47.585412 2499 consensus_queue.cc:1035] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20250625 03:30:47.645402 2480 raft_consensus.cc:2953] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:47.658859 2502 raft_consensus.cc:1062] T 9643cfd400804eb8b9037c5e9efddfba P 3f2aa40978064c9e9983cf3745eed206: attempting to promote NON_VOTER df8b9755d156478aafca552f9e9c539e to VOTER
I20250625 03:30:47.665735 1664 raft_consensus.cc:2953] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:47.654901 1737 raft_consensus.cc:2953] T e58b1ae66ee14c6f8d6f2db8dda2b842 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:47.668037 2502 consensus_queue.cc:237] T 9643cfd400804eb8b9037c5e9efddfba P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:30:47.677498 1494 catalog_manager.cc:5582] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e reported cstate change: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250625 03:30:47.657953 2343 raft_consensus.cc:2953] T e58b1ae66ee14c6f8d6f2db8dda2b842 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:47.695731 2345 raft_consensus.cc:1273] T 9643cfd400804eb8b9037c5e9efddfba P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:30:47.697240 1595 raft_consensus.cc:1273] T 9643cfd400804eb8b9037c5e9efddfba P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:30:47.697430 2502 consensus_queue.cc:1035] T 9643cfd400804eb8b9037c5e9efddfba P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20250625 03:30:47.699100 2503 consensus_queue.cc:1035] T 9643cfd400804eb8b9037c5e9efddfba P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20250625 03:30:47.704607 1737 raft_consensus.cc:1273] T 9643cfd400804eb8b9037c5e9efddfba P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:30:47.707301 2503 consensus_queue.cc:1035] T 9643cfd400804eb8b9037c5e9efddfba P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:30:47.731014 2503 raft_consensus.cc:1062] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206: attempting to promote NON_VOTER df8b9755d156478aafca552f9e9c539e to VOTER
I20250625 03:30:47.747582 2503 consensus_queue.cc:237] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:30:47.775595 1739 raft_consensus.cc:1273] T 0c2b6052daaa4c57aaa55361e8d6e01c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20250625 03:30:47.777127 2345 raft_consensus.cc:1273] T 0c2b6052daaa4c57aaa55361e8d6e01c P df8b9755d156478aafca552f9e9c539e [term 2 LEARNER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20250625 03:30:47.776389 1591 raft_consensus.cc:2953] T 9643cfd400804eb8b9037c5e9efddfba P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:47.779608 2430 consensus_queue.cc:1035] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20250625 03:30:47.781488 2473 consensus_queue.cc:1035] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20250625 03:30:47.767752 2504 raft_consensus.cc:2953] T 9643cfd400804eb8b9037c5e9efddfba P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:47.841917 1591 consensus_queue.cc:237] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:30:47.850770 1587 raft_consensus.cc:1273] T 0c2b6052daaa4c57aaa55361e8d6e01c P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20250625 03:30:47.867468 1493 catalog_manager.cc:5582] T 9643cfd400804eb8b9037c5e9efddfba P 7e9c4f2e01164f33b2e9034ed148398e reported cstate change: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:47.868680 2503 raft_consensus.cc:2953] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:47.871886 1739 raft_consensus.cc:2953] T 9643cfd400804eb8b9037c5e9efddfba P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:47.888866 2345 raft_consensus.cc:1273] T e58b1ae66ee14c6f8d6f2db8dda2b842 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250625 03:30:47.890092 1737 raft_consensus.cc:1273] T e58b1ae66ee14c6f8d6f2db8dda2b842 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250625 03:30:47.890635 2501 consensus_queue.cc:1035] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:30:47.891567 2518 consensus_queue.cc:1035] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20250625 03:30:47.898546 2343 raft_consensus.cc:2953] T 9643cfd400804eb8b9037c5e9efddfba P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:47.914320 2480 raft_consensus.cc:2953] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:47.898664 2345 raft_consensus.cc:2953] T 0c2b6052daaa4c57aaa55361e8d6e01c P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:47.916453 1739 raft_consensus.cc:2953] T 0c2b6052daaa4c57aaa55361e8d6e01c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:47.916551 2344 raft_consensus.cc:2953] T e58b1ae66ee14c6f8d6f2db8dda2b842 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:47.924960 1479 catalog_manager.cc:5095] ChangeConfig:REMOVE_PEER RPC for tablet e58b1ae66ee14c6f8d6f2db8dda2b842 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250625 03:30:47.934213 1491 catalog_manager.cc:5582] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e reported cstate change: config changed from index 3 to 4, VOTER 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) evicted. New cstate: current_term: 1 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250625 03:30:47.938280 2495 consensus_queue.cc:1035] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:30:47.904536 2504 raft_consensus.cc:1062] T 188e56b819ae44f9b72baefcbc749400 P 3f2aa40978064c9e9983cf3745eed206: attempting to promote NON_VOTER df8b9755d156478aafca552f9e9c539e to VOTER
I20250625 03:30:47.954116 1493 catalog_manager.cc:5582] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20250625 03:30:47.948858 2504 consensus_queue.cc:237] T 188e56b819ae44f9b72baefcbc749400 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:30:47.964102 1658 tablet_service.cc:1515] Processing DeleteTablet for tablet e58b1ae66ee14c6f8d6f2db8dda2b842 with delete_type TABLET_DATA_TOMBSTONED (TS 3f2aa40978064c9e9983cf3745eed206 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53744
I20250625 03:30:47.966056 1739 raft_consensus.cc:2953] T e58b1ae66ee14c6f8d6f2db8dda2b842 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:47.967010 1595 raft_consensus.cc:2953] T 0c2b6052daaa4c57aaa55361e8d6e01c P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:47.998257 2525 tablet_replica.cc:331] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 3f2aa40978064c9e9983cf3745eed206: stopping tablet replica
I20250625 03:30:47.999694 2525 raft_consensus.cc:2241] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:30:48.000598 2525 raft_consensus.cc:2270] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:30:48.007777 2525 ts_tablet_manager.cc:1905] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 3f2aa40978064c9e9983cf3745eed206: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250625 03:30:48.015688 1595 raft_consensus.cc:1273] T 188e56b819ae44f9b72baefcbc749400 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:30:48.017410 2430 consensus_queue.cc:1035] T 188e56b819ae44f9b72baefcbc749400 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:30:48.019702 1739 raft_consensus.cc:1273] T 188e56b819ae44f9b72baefcbc749400 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:30:48.023478 2430 consensus_queue.cc:1035] T 188e56b819ae44f9b72baefcbc749400 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:30:48.025576 1664 consensus_queue.cc:237] T 9643cfd400804eb8b9037c5e9efddfba P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:30:48.030086 2344 raft_consensus.cc:1273] T 188e56b819ae44f9b72baefcbc749400 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:30:48.031664 2343 raft_consensus.cc:1273] T 9643cfd400804eb8b9037c5e9efddfba P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250625 03:30:48.031705 1737 raft_consensus.cc:1273] T 9643cfd400804eb8b9037c5e9efddfba P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250625 03:30:48.034126 2504 consensus_queue.cc:1035] T 9643cfd400804eb8b9037c5e9efddfba P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:30:48.034186 2455 consensus_queue.cc:1035] T 188e56b819ae44f9b72baefcbc749400 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20250625 03:30:48.037196 2455 consensus_queue.cc:1035] T 9643cfd400804eb8b9037c5e9efddfba P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:30:48.053252 2430 raft_consensus.cc:2953] T 9643cfd400804eb8b9037c5e9efddfba P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:48.064862 2343 raft_consensus.cc:2953] T 9643cfd400804eb8b9037c5e9efddfba P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:48.066116 1745 raft_consensus.cc:2953] T 9643cfd400804eb8b9037c5e9efddfba P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:48.070824 2518 raft_consensus.cc:2953] T 188e56b819ae44f9b72baefcbc749400 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:48.080741 1478 catalog_manager.cc:5095] ChangeConfig:REMOVE_PEER RPC for tablet 9643cfd400804eb8b9037c5e9efddfba with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250625 03:30:48.081533 2344 raft_consensus.cc:2953] T 188e56b819ae44f9b72baefcbc749400 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:48.083521 1739 raft_consensus.cc:2953] T 188e56b819ae44f9b72baefcbc749400 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:48.095685 1491 catalog_manager.cc:5582] T 9643cfd400804eb8b9037c5e9efddfba P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: config changed from index 3 to 4, VOTER 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) evicted. New cstate: current_term: 1 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250625 03:30:48.107475 1582 tablet_service.cc:1515] Processing DeleteTablet for tablet 9643cfd400804eb8b9037c5e9efddfba with delete_type TABLET_DATA_TOMBSTONED (TS 7e9c4f2e01164f33b2e9034ed148398e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52712
I20250625 03:30:48.110658 2525 ts_tablet_manager.cc:1918] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 3f2aa40978064c9e9983cf3745eed206: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20250625 03:30:48.111297 2525 log.cc:1199] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 3f2aa40978064c9e9983cf3745eed206: Deleting WAL directory at /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/ts-1-root/wals/e58b1ae66ee14c6f8d6f2db8dda2b842
I20250625 03:30:48.113590 1478 catalog_manager.cc:4928] TS 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): tablet e58b1ae66ee14c6f8d6f2db8dda2b842 (table test-workload [id=7f663eabec024fd1911b406c660fa838]) successfully deleted
I20250625 03:30:48.114660 1589 raft_consensus.cc:2953] T 188e56b819ae44f9b72baefcbc749400 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:48.119689 1491 catalog_manager.cc:5582] T 188e56b819ae44f9b72baefcbc749400 P df8b9755d156478aafca552f9e9c539e reported cstate change: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:48.149612 2530 tablet_replica.cc:331] T 9643cfd400804eb8b9037c5e9efddfba P 7e9c4f2e01164f33b2e9034ed148398e: stopping tablet replica
I20250625 03:30:48.158349 1663 consensus_queue.cc:237] T 188e56b819ae44f9b72baefcbc749400 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:30:48.163357 2530 raft_consensus.cc:2241] T 9643cfd400804eb8b9037c5e9efddfba P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:30:48.163975 1595 raft_consensus.cc:1273] T 188e56b819ae44f9b72baefcbc749400 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250625 03:30:48.164218 2530 raft_consensus.cc:2270] T 9643cfd400804eb8b9037c5e9efddfba P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:30:48.166327 2344 raft_consensus.cc:1273] T 188e56b819ae44f9b72baefcbc749400 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250625 03:30:48.166749 2504 consensus_queue.cc:1035] T 188e56b819ae44f9b72baefcbc749400 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:30:48.168088 2518 consensus_queue.cc:1035] T 188e56b819ae44f9b72baefcbc749400 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:30:48.174139 2530 ts_tablet_manager.cc:1905] T 9643cfd400804eb8b9037c5e9efddfba P 7e9c4f2e01164f33b2e9034ed148398e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250625 03:30:48.178259 2518 raft_consensus.cc:2953] T 188e56b819ae44f9b72baefcbc749400 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:48.179935 2344 raft_consensus.cc:2953] T 188e56b819ae44f9b72baefcbc749400 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:48.181696 1595 raft_consensus.cc:2953] T 188e56b819ae44f9b72baefcbc749400 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:48.190001 2530 ts_tablet_manager.cc:1918] T 9643cfd400804eb8b9037c5e9efddfba P 7e9c4f2e01164f33b2e9034ed148398e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20250625 03:30:48.190531 2530 log.cc:1199] T 9643cfd400804eb8b9037c5e9efddfba P 7e9c4f2e01164f33b2e9034ed148398e: Deleting WAL directory at /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/ts-0-root/wals/9643cfd400804eb8b9037c5e9efddfba
I20250625 03:30:48.192296 1479 catalog_manager.cc:4928] TS 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): tablet 9643cfd400804eb8b9037c5e9efddfba (table test-workload [id=7f663eabec024fd1911b406c660fa838]) successfully deleted
I20250625 03:30:48.193027 1478 catalog_manager.cc:5095] ChangeConfig:REMOVE_PEER RPC for tablet 188e56b819ae44f9b72baefcbc749400 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250625 03:30:48.196480 1493 catalog_manager.cc:5582] T 188e56b819ae44f9b72baefcbc749400 P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: config changed from index 3 to 4, VOTER ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) evicted. New cstate: current_term: 1 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250625 03:30:48.208194 1732 tablet_service.cc:1515] Processing DeleteTablet for tablet 188e56b819ae44f9b72baefcbc749400 with delete_type TABLET_DATA_TOMBSTONED (TS ba464e89e0f044a0a0ea3e6125cbf2a1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43672
I20250625 03:30:48.211750 2531 tablet_replica.cc:331] T 188e56b819ae44f9b72baefcbc749400 P ba464e89e0f044a0a0ea3e6125cbf2a1: stopping tablet replica
I20250625 03:30:48.212939 2531 raft_consensus.cc:2241] T 188e56b819ae44f9b72baefcbc749400 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:30:48.213609 2531 raft_consensus.cc:2270] T 188e56b819ae44f9b72baefcbc749400 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:30:48.219496 2531 ts_tablet_manager.cc:1905] T 188e56b819ae44f9b72baefcbc749400 P ba464e89e0f044a0a0ea3e6125cbf2a1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250625 03:30:48.239920 2531 ts_tablet_manager.cc:1918] T 188e56b819ae44f9b72baefcbc749400 P ba464e89e0f044a0a0ea3e6125cbf2a1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20250625 03:30:48.240391 2531 log.cc:1199] T 188e56b819ae44f9b72baefcbc749400 P ba464e89e0f044a0a0ea3e6125cbf2a1: Deleting WAL directory at /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/ts-2-root/wals/188e56b819ae44f9b72baefcbc749400
I20250625 03:30:48.242273 1480 catalog_manager.cc:4928] TS ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): tablet 188e56b819ae44f9b72baefcbc749400 (table test-workload [id=7f663eabec024fd1911b406c660fa838]) successfully deleted
I20250625 03:30:48.327873 1664 consensus_queue.cc:237] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:30:48.332544 2344 raft_consensus.cc:1273] T 0c2b6052daaa4c57aaa55361e8d6e01c P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20250625 03:30:48.333740 2430 consensus_queue.cc:1035] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:30:48.334008 1589 raft_consensus.cc:1273] T 0c2b6052daaa4c57aaa55361e8d6e01c P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20250625 03:30:48.337193 2430 consensus_queue.cc:1035] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:30:48.342255 2430 raft_consensus.cc:2953] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:48.343227 2344 raft_consensus.cc:2953] T 0c2b6052daaa4c57aaa55361e8d6e01c P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:48.348280 1595 raft_consensus.cc:2953] T 0c2b6052daaa4c57aaa55361e8d6e01c P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:48.353770 1478 catalog_manager.cc:5095] ChangeConfig:REMOVE_PEER RPC for tablet 0c2b6052daaa4c57aaa55361e8d6e01c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250625 03:30:48.358731 1494 catalog_manager.cc:5582] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: config changed from index 3 to 4, VOTER ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) evicted. New cstate: current_term: 2 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250625 03:30:48.376262 1732 tablet_service.cc:1515] Processing DeleteTablet for tablet 0c2b6052daaa4c57aaa55361e8d6e01c with delete_type TABLET_DATA_TOMBSTONED (TS ba464e89e0f044a0a0ea3e6125cbf2a1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43672
I20250625 03:30:48.377393 2531 tablet_replica.cc:331] T 0c2b6052daaa4c57aaa55361e8d6e01c P ba464e89e0f044a0a0ea3e6125cbf2a1: stopping tablet replica
I20250625 03:30:48.378247 2531 raft_consensus.cc:2241] T 0c2b6052daaa4c57aaa55361e8d6e01c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:30:48.378990 2531 raft_consensus.cc:2270] T 0c2b6052daaa4c57aaa55361e8d6e01c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:30:48.383522 2531 ts_tablet_manager.cc:1905] T 0c2b6052daaa4c57aaa55361e8d6e01c P ba464e89e0f044a0a0ea3e6125cbf2a1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250625 03:30:48.397544 2531 ts_tablet_manager.cc:1918] T 0c2b6052daaa4c57aaa55361e8d6e01c P ba464e89e0f044a0a0ea3e6125cbf2a1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20250625 03:30:48.397984 2531 log.cc:1199] T 0c2b6052daaa4c57aaa55361e8d6e01c P ba464e89e0f044a0a0ea3e6125cbf2a1: Deleting WAL directory at /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/ts-2-root/wals/0c2b6052daaa4c57aaa55361e8d6e01c
I20250625 03:30:48.399371 1480 catalog_manager.cc:4928] TS ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): tablet 0c2b6052daaa4c57aaa55361e8d6e01c (table test-workload [id=7f663eabec024fd1911b406c660fa838]) successfully deleted
I20250625 03:30:49.428495 1739 consensus_queue.cc:237] T 731095860aad436e9658ab3ff5010f9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:49.443578 1663 raft_consensus.cc:1273] T 731095860aad436e9658ab3ff5010f9d P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20250625 03:30:49.444654 1708 consensus_peers.cc:487] T 731095860aad436e9658ab3ff5010f9d P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493): Couldn't send request to peer df8b9755d156478aafca552f9e9c539e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 731095860aad436e9658ab3ff5010f9d. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:30:49.445714 2436 consensus_queue.cc:1035] T 731095860aad436e9658ab3ff5010f9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:30:49.445797 1589 raft_consensus.cc:1273] T 731095860aad436e9658ab3ff5010f9d P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 03:30:49.446938 2532 consensus_queue.cc:1035] T 731095860aad436e9658ab3ff5010f9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:30:49.457269 2496 raft_consensus.cc:2953] T 731095860aad436e9658ab3ff5010f9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:49.459252 1587 raft_consensus.cc:2953] T 731095860aad436e9658ab3ff5010f9d P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:49.471396 1664 raft_consensus.cc:2953] T 731095860aad436e9658ab3ff5010f9d P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:49.487547 1739 consensus_queue.cc:237] T b15eb94b9d3d4f6987b5fa5e20193655 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:49.487902 1493 catalog_manager.cc:5582] T 731095860aad436e9658ab3ff5010f9d P 7e9c4f2e01164f33b2e9034ed148398e reported cstate change: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New cstate: current_term: 1 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:49.494515 1664 raft_consensus.cc:1273] T b15eb94b9d3d4f6987b5fa5e20193655 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 03:30:49.495900 2532 consensus_queue.cc:1035] T b15eb94b9d3d4f6987b5fa5e20193655 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20250625 03:30:49.497532 1708 consensus_peers.cc:487] T b15eb94b9d3d4f6987b5fa5e20193655 P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493): Couldn't send request to peer df8b9755d156478aafca552f9e9c539e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b15eb94b9d3d4f6987b5fa5e20193655. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:30:49.499866 1587 raft_consensus.cc:1273] T b15eb94b9d3d4f6987b5fa5e20193655 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 03:30:49.501464 2497 consensus_queue.cc:1035] T b15eb94b9d3d4f6987b5fa5e20193655 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:30:49.508949 2436 raft_consensus.cc:2953] T b15eb94b9d3d4f6987b5fa5e20193655 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:49.511081 1664 raft_consensus.cc:2953] T b15eb94b9d3d4f6987b5fa5e20193655 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:49.519996 1587 raft_consensus.cc:2953] T b15eb94b9d3d4f6987b5fa5e20193655 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:49.522740 1663 consensus_queue.cc:237] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:49.530750 1739 raft_consensus.cc:1273] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 03:30:49.531147 1589 raft_consensus.cc:1273] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 03:30:49.530608 1494 catalog_manager.cc:5582] T b15eb94b9d3d4f6987b5fa5e20193655 P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New cstate: current_term: 1 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20250625 03:30:49.532245 2533 consensus_queue.cc:1035] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:30:49.533135 2430 consensus_queue.cc:1035] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20250625 03:30:49.538437 1634 consensus_peers.cc:487] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 3f2aa40978064c9e9983cf3745eed206 -> Peer df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493): Couldn't send request to peer df8b9755d156478aafca552f9e9c539e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a9ae17eec3fe4ce0841d3fb17c91a8b8. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:30:49.546963 2533 raft_consensus.cc:2953] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:49.548782 1589 raft_consensus.cc:2953] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:49.562764 1664 consensus_queue.cc:237] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:49.583775 1745 raft_consensus.cc:2953] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
W20250625 03:30:49.586263 1634 consensus_peers.cc:487] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 3f2aa40978064c9e9983cf3745eed206 -> Peer df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493): Couldn't send request to peer df8b9755d156478aafca552f9e9c539e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3c2c045dee4b4b4faa93fa9d0ccdaa1c. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:30:49.585914 1494 catalog_manager.cc:5582] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New cstate: current_term: 1 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20250625 03:30:49.588891 1589 raft_consensus.cc:1273] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 03:30:49.594106 2503 consensus_queue.cc:1035] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:30:49.595830 1739 raft_consensus.cc:1273] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 03:30:49.599601 2430 consensus_queue.cc:1035] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:30:49.615382 2503 raft_consensus.cc:2953] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:49.617525 1589 raft_consensus.cc:2953] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:49.624789 1745 raft_consensus.cc:2953] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:49.633720 1492 catalog_manager.cc:5582] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New cstate: current_term: 1 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20250625 03:30:49.836730 2550 ts_tablet_manager.cc:927] T 731095860aad436e9658ab3ff5010f9d P df8b9755d156478aafca552f9e9c539e: Initiating tablet copy from peer ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:49.838716 2550 tablet_copy_client.cc:323] T 731095860aad436e9658ab3ff5010f9d P df8b9755d156478aafca552f9e9c539e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.106.131:39359
I20250625 03:30:49.840615 1755 tablet_copy_service.cc:140] P ba464e89e0f044a0a0ea3e6125cbf2a1: Received BeginTabletCopySession request for tablet 731095860aad436e9658ab3ff5010f9d from peer df8b9755d156478aafca552f9e9c539e ({username='slave'} at 127.0.0.1:39774)
I20250625 03:30:49.841212 1755 tablet_copy_service.cc:161] P ba464e89e0f044a0a0ea3e6125cbf2a1: Beginning new tablet copy session on tablet 731095860aad436e9658ab3ff5010f9d from peer df8b9755d156478aafca552f9e9c539e at {username='slave'} at 127.0.0.1:39774: session id = df8b9755d156478aafca552f9e9c539e-731095860aad436e9658ab3ff5010f9d
I20250625 03:30:49.848477 1755 tablet_copy_source_session.cc:215] T 731095860aad436e9658ab3ff5010f9d P ba464e89e0f044a0a0ea3e6125cbf2a1: Tablet Copy: opened 0 blocks and 1 log segments
I20250625 03:30:49.852138 2550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 731095860aad436e9658ab3ff5010f9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:49.867435 2550 tablet_copy_client.cc:806] T 731095860aad436e9658ab3ff5010f9d P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 0 data blocks...
I20250625 03:30:49.868041 2550 tablet_copy_client.cc:670] T 731095860aad436e9658ab3ff5010f9d P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 1 WAL segments...
I20250625 03:30:49.873785 2550 tablet_copy_client.cc:538] T 731095860aad436e9658ab3ff5010f9d P df8b9755d156478aafca552f9e9c539e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250625 03:30:49.881577 2550 tablet_bootstrap.cc:492] T 731095860aad436e9658ab3ff5010f9d P df8b9755d156478aafca552f9e9c539e: Bootstrap starting.
I20250625 03:30:49.901489 2550 tablet_bootstrap.cc:492] T 731095860aad436e9658ab3ff5010f9d P df8b9755d156478aafca552f9e9c539e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:30:49.902397 2550 tablet_bootstrap.cc:492] T 731095860aad436e9658ab3ff5010f9d P df8b9755d156478aafca552f9e9c539e: Bootstrap complete.
I20250625 03:30:49.903065 2550 ts_tablet_manager.cc:1397] T 731095860aad436e9658ab3ff5010f9d P df8b9755d156478aafca552f9e9c539e: Time spent bootstrapping tablet: real 0.022s user 0.020s sys 0.001s
I20250625 03:30:49.906190 2550 raft_consensus.cc:357] T 731095860aad436e9658ab3ff5010f9d P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:49.907199 2550 raft_consensus.cc:738] T 731095860aad436e9658ab3ff5010f9d P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: df8b9755d156478aafca552f9e9c539e, State: Initialized, Role: LEARNER
I20250625 03:30:49.907902 2550 consensus_queue.cc:260] T 731095860aad436e9658ab3ff5010f9d P df8b9755d156478aafca552f9e9c539e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:49.912845 2554 ts_tablet_manager.cc:927] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P df8b9755d156478aafca552f9e9c539e: Initiating tablet copy from peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:49.917135 2554 tablet_copy_client.cc:323] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P df8b9755d156478aafca552f9e9c539e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.106.130:34293
I20250625 03:30:49.919595 1680 tablet_copy_service.cc:140] P 3f2aa40978064c9e9983cf3745eed206: Received BeginTabletCopySession request for tablet a9ae17eec3fe4ce0841d3fb17c91a8b8 from peer df8b9755d156478aafca552f9e9c539e ({username='slave'} at 127.0.0.1:55766)
I20250625 03:30:49.919903 2550 ts_tablet_manager.cc:1428] T 731095860aad436e9658ab3ff5010f9d P df8b9755d156478aafca552f9e9c539e: Time spent starting tablet: real 0.016s user 0.012s sys 0.000s
I20250625 03:30:49.920188 1680 tablet_copy_service.cc:161] P 3f2aa40978064c9e9983cf3745eed206: Beginning new tablet copy session on tablet a9ae17eec3fe4ce0841d3fb17c91a8b8 from peer df8b9755d156478aafca552f9e9c539e at {username='slave'} at 127.0.0.1:55766: session id = df8b9755d156478aafca552f9e9c539e-a9ae17eec3fe4ce0841d3fb17c91a8b8
I20250625 03:30:49.924959 1755 tablet_copy_service.cc:342] P ba464e89e0f044a0a0ea3e6125cbf2a1: Request end of tablet copy session df8b9755d156478aafca552f9e9c539e-731095860aad436e9658ab3ff5010f9d received from {username='slave'} at 127.0.0.1:39774
I20250625 03:30:49.925385 1755 tablet_copy_service.cc:434] P ba464e89e0f044a0a0ea3e6125cbf2a1: ending tablet copy session df8b9755d156478aafca552f9e9c539e-731095860aad436e9658ab3ff5010f9d on tablet 731095860aad436e9658ab3ff5010f9d with peer df8b9755d156478aafca552f9e9c539e
I20250625 03:30:49.930223 1680 tablet_copy_source_session.cc:215] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 3f2aa40978064c9e9983cf3745eed206: Tablet Copy: opened 0 blocks and 1 log segments
I20250625 03:30:49.934988 2554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9ae17eec3fe4ce0841d3fb17c91a8b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:49.950073 2554 tablet_copy_client.cc:806] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 0 data blocks...
I20250625 03:30:49.950632 2554 tablet_copy_client.cc:670] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 1 WAL segments...
I20250625 03:30:49.954926 2554 tablet_copy_client.cc:538] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P df8b9755d156478aafca552f9e9c539e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250625 03:30:49.963497 2554 tablet_bootstrap.cc:492] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P df8b9755d156478aafca552f9e9c539e: Bootstrap starting.
I20250625 03:30:49.981709 2554 tablet_bootstrap.cc:492] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P df8b9755d156478aafca552f9e9c539e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:30:49.982589 2554 tablet_bootstrap.cc:492] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P df8b9755d156478aafca552f9e9c539e: Bootstrap complete.
I20250625 03:30:49.983222 2554 ts_tablet_manager.cc:1397] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P df8b9755d156478aafca552f9e9c539e: Time spent bootstrapping tablet: real 0.020s user 0.020s sys 0.001s
I20250625 03:30:49.985765 2554 raft_consensus.cc:357] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:49.986621 2554 raft_consensus.cc:738] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: df8b9755d156478aafca552f9e9c539e, State: Initialized, Role: LEARNER
I20250625 03:30:49.987205 2554 consensus_queue.cc:260] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P df8b9755d156478aafca552f9e9c539e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:49.989410 2554 ts_tablet_manager.cc:1428] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P df8b9755d156478aafca552f9e9c539e: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20250625 03:30:49.991019 1680 tablet_copy_service.cc:342] P 3f2aa40978064c9e9983cf3745eed206: Request end of tablet copy session df8b9755d156478aafca552f9e9c539e-a9ae17eec3fe4ce0841d3fb17c91a8b8 received from {username='slave'} at 127.0.0.1:55766
I20250625 03:30:49.991468 1680 tablet_copy_service.cc:434] P 3f2aa40978064c9e9983cf3745eed206: ending tablet copy session df8b9755d156478aafca552f9e9c539e-a9ae17eec3fe4ce0841d3fb17c91a8b8 on tablet a9ae17eec3fe4ce0841d3fb17c91a8b8 with peer df8b9755d156478aafca552f9e9c539e
I20250625 03:30:50.036512 2554 ts_tablet_manager.cc:927] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P df8b9755d156478aafca552f9e9c539e: Initiating tablet copy from peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:50.038802 2554 tablet_copy_client.cc:323] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P df8b9755d156478aafca552f9e9c539e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.106.130:34293
I20250625 03:30:50.040304 1680 tablet_copy_service.cc:140] P 3f2aa40978064c9e9983cf3745eed206: Received BeginTabletCopySession request for tablet 3c2c045dee4b4b4faa93fa9d0ccdaa1c from peer df8b9755d156478aafca552f9e9c539e ({username='slave'} at 127.0.0.1:55766)
I20250625 03:30:50.040820 1680 tablet_copy_service.cc:161] P 3f2aa40978064c9e9983cf3745eed206: Beginning new tablet copy session on tablet 3c2c045dee4b4b4faa93fa9d0ccdaa1c from peer df8b9755d156478aafca552f9e9c539e at {username='slave'} at 127.0.0.1:55766: session id = df8b9755d156478aafca552f9e9c539e-3c2c045dee4b4b4faa93fa9d0ccdaa1c
I20250625 03:30:50.041818 2550 ts_tablet_manager.cc:927] T b15eb94b9d3d4f6987b5fa5e20193655 P df8b9755d156478aafca552f9e9c539e: Initiating tablet copy from peer ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:50.052742 2550 tablet_copy_client.cc:323] T b15eb94b9d3d4f6987b5fa5e20193655 P df8b9755d156478aafca552f9e9c539e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.106.131:39359
I20250625 03:30:50.054268 1755 tablet_copy_service.cc:140] P ba464e89e0f044a0a0ea3e6125cbf2a1: Received BeginTabletCopySession request for tablet b15eb94b9d3d4f6987b5fa5e20193655 from peer df8b9755d156478aafca552f9e9c539e ({username='slave'} at 127.0.0.1:39774)
I20250625 03:30:50.054791 1755 tablet_copy_service.cc:161] P ba464e89e0f044a0a0ea3e6125cbf2a1: Beginning new tablet copy session on tablet b15eb94b9d3d4f6987b5fa5e20193655 from peer df8b9755d156478aafca552f9e9c539e at {username='slave'} at 127.0.0.1:39774: session id = df8b9755d156478aafca552f9e9c539e-b15eb94b9d3d4f6987b5fa5e20193655
I20250625 03:30:50.055953 1680 tablet_copy_source_session.cc:215] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 3f2aa40978064c9e9983cf3745eed206: Tablet Copy: opened 0 blocks and 1 log segments
I20250625 03:30:50.061528 2554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c2c045dee4b4b4faa93fa9d0ccdaa1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:50.070564 1755 tablet_copy_source_session.cc:215] T b15eb94b9d3d4f6987b5fa5e20193655 P ba464e89e0f044a0a0ea3e6125cbf2a1: Tablet Copy: opened 0 blocks and 1 log segments
I20250625 03:30:50.073621 2550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b15eb94b9d3d4f6987b5fa5e20193655. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:50.082966 2554 tablet_copy_client.cc:806] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 0 data blocks...
I20250625 03:30:50.083628 2554 tablet_copy_client.cc:670] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 1 WAL segments...
I20250625 03:30:50.089016 2554 tablet_copy_client.cc:538] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P df8b9755d156478aafca552f9e9c539e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250625 03:30:50.092813 2550 tablet_copy_client.cc:806] T b15eb94b9d3d4f6987b5fa5e20193655 P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 0 data blocks...
I20250625 03:30:50.093493 2550 tablet_copy_client.cc:670] T b15eb94b9d3d4f6987b5fa5e20193655 P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 1 WAL segments...
I20250625 03:30:50.097735 2554 tablet_bootstrap.cc:492] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P df8b9755d156478aafca552f9e9c539e: Bootstrap starting.
I20250625 03:30:50.099514 2550 tablet_copy_client.cc:538] T b15eb94b9d3d4f6987b5fa5e20193655 P df8b9755d156478aafca552f9e9c539e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250625 03:30:50.118216 2550 tablet_bootstrap.cc:492] T b15eb94b9d3d4f6987b5fa5e20193655 P df8b9755d156478aafca552f9e9c539e: Bootstrap starting.
I20250625 03:30:50.124805 2554 tablet_bootstrap.cc:492] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P df8b9755d156478aafca552f9e9c539e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:30:50.125859 2554 tablet_bootstrap.cc:492] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P df8b9755d156478aafca552f9e9c539e: Bootstrap complete.
I20250625 03:30:50.126578 2554 ts_tablet_manager.cc:1397] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P df8b9755d156478aafca552f9e9c539e: Time spent bootstrapping tablet: real 0.029s user 0.009s sys 0.020s
I20250625 03:30:50.129724 2554 raft_consensus.cc:357] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:50.130523 2554 raft_consensus.cc:738] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: df8b9755d156478aafca552f9e9c539e, State: Initialized, Role: LEARNER
I20250625 03:30:50.131142 2554 consensus_queue.cc:260] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P df8b9755d156478aafca552f9e9c539e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:50.136971 2554 ts_tablet_manager.cc:1428] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P df8b9755d156478aafca552f9e9c539e: Time spent starting tablet: real 0.010s user 0.005s sys 0.001s
I20250625 03:30:50.138798 1680 tablet_copy_service.cc:342] P 3f2aa40978064c9e9983cf3745eed206: Request end of tablet copy session df8b9755d156478aafca552f9e9c539e-3c2c045dee4b4b4faa93fa9d0ccdaa1c received from {username='slave'} at 127.0.0.1:55766
I20250625 03:30:50.139237 1680 tablet_copy_service.cc:434] P 3f2aa40978064c9e9983cf3745eed206: ending tablet copy session df8b9755d156478aafca552f9e9c539e-3c2c045dee4b4b4faa93fa9d0ccdaa1c on tablet 3c2c045dee4b4b4faa93fa9d0ccdaa1c with peer df8b9755d156478aafca552f9e9c539e
I20250625 03:30:50.159754 2550 tablet_bootstrap.cc:492] T b15eb94b9d3d4f6987b5fa5e20193655 P df8b9755d156478aafca552f9e9c539e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:30:50.160689 2550 tablet_bootstrap.cc:492] T b15eb94b9d3d4f6987b5fa5e20193655 P df8b9755d156478aafca552f9e9c539e: Bootstrap complete.
I20250625 03:30:50.161437 2550 ts_tablet_manager.cc:1397] T b15eb94b9d3d4f6987b5fa5e20193655 P df8b9755d156478aafca552f9e9c539e: Time spent bootstrapping tablet: real 0.043s user 0.014s sys 0.008s
I20250625 03:30:50.163770 2550 raft_consensus.cc:357] T b15eb94b9d3d4f6987b5fa5e20193655 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:50.164551 2550 raft_consensus.cc:738] T b15eb94b9d3d4f6987b5fa5e20193655 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: df8b9755d156478aafca552f9e9c539e, State: Initialized, Role: LEARNER
I20250625 03:30:50.165071 2550 consensus_queue.cc:260] T b15eb94b9d3d4f6987b5fa5e20193655 P df8b9755d156478aafca552f9e9c539e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:50.167351 2550 ts_tablet_manager.cc:1428] T b15eb94b9d3d4f6987b5fa5e20193655 P df8b9755d156478aafca552f9e9c539e: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20250625 03:30:50.168926 1755 tablet_copy_service.cc:342] P ba464e89e0f044a0a0ea3e6125cbf2a1: Request end of tablet copy session df8b9755d156478aafca552f9e9c539e-b15eb94b9d3d4f6987b5fa5e20193655 received from {username='slave'} at 127.0.0.1:39774
I20250625 03:30:50.169303 1755 tablet_copy_service.cc:434] P ba464e89e0f044a0a0ea3e6125cbf2a1: ending tablet copy session df8b9755d156478aafca552f9e9c539e-b15eb94b9d3d4f6987b5fa5e20193655 on tablet b15eb94b9d3d4f6987b5fa5e20193655 with peer df8b9755d156478aafca552f9e9c539e
I20250625 03:30:50.292655 2343 raft_consensus.cc:1215] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20250625 03:30:50.397086 2343 raft_consensus.cc:1215] T 731095860aad436e9658ab3ff5010f9d P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20250625 03:30:50.477052 2343 raft_consensus.cc:1215] T b15eb94b9d3d4f6987b5fa5e20193655 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20250625 03:30:50.558254 2343 raft_consensus.cc:1215] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20250625 03:30:50.778679 2430 raft_consensus.cc:1062] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 3f2aa40978064c9e9983cf3745eed206: attempting to promote NON_VOTER df8b9755d156478aafca552f9e9c539e to VOTER
I20250625 03:30:50.780725 2430 consensus_queue.cc:237] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:30:50.787227 1591 raft_consensus.cc:1273] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:30:50.787616 2343 raft_consensus.cc:1273] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:30:50.787775 1745 raft_consensus.cc:1273] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:30:50.789083 2430 consensus_queue.cc:1035] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:30:50.790769 2430 consensus_queue.cc:1035] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:30:50.792387 2563 consensus_queue.cc:1035] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:30:50.831779 2430 raft_consensus.cc:2953] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:50.833633 1589 raft_consensus.cc:2953] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:50.837823 1737 raft_consensus.cc:2953] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:50.846186 2343 raft_consensus.cc:2953] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:50.850822 1492 catalog_manager.cc:5582] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 7e9c4f2e01164f33b2e9034ed148398e reported cstate change: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:50.883582 1663 consensus_queue.cc:237] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:30:50.885996 2496 raft_consensus.cc:1062] T 731095860aad436e9658ab3ff5010f9d P ba464e89e0f044a0a0ea3e6125cbf2a1: attempting to promote NON_VOTER df8b9755d156478aafca552f9e9c539e to VOTER
I20250625 03:30:50.888213 2496 consensus_queue.cc:237] T 731095860aad436e9658ab3ff5010f9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:30:50.901775 2343 raft_consensus.cc:1273] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250625 03:30:50.903888 2503 consensus_queue.cc:1035] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:30:50.910872 1745 raft_consensus.cc:1273] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250625 03:30:50.910967 2344 raft_consensus.cc:1273] T 731095860aad436e9658ab3ff5010f9d P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:30:50.910236 1589 raft_consensus.cc:1273] T 731095860aad436e9658ab3ff5010f9d P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:30:50.912743 2503 consensus_queue.cc:1035] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:30:50.914381 2533 raft_consensus.cc:2953] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:50.916479 2436 consensus_queue.cc:1035] T 731095860aad436e9658ab3ff5010f9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:30:50.918670 2436 consensus_queue.cc:1035] T 731095860aad436e9658ab3ff5010f9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:30:50.918341 1737 raft_consensus.cc:2953] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:50.910238 1663 raft_consensus.cc:1273] T 731095860aad436e9658ab3ff5010f9d P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:30:50.921787 2343 raft_consensus.cc:2953] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:50.928368 2496 consensus_queue.cc:1035] T 731095860aad436e9658ab3ff5010f9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:30:50.930426 1478 catalog_manager.cc:5095] ChangeConfig:REMOVE_PEER RPC for tablet a9ae17eec3fe4ce0841d3fb17c91a8b8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250625 03:30:50.943240 1494 catalog_manager.cc:5582] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: config changed from index 3 to 4, VOTER 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) evicted. New cstate: current_term: 1 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250625 03:30:50.953688 1582 tablet_service.cc:1515] Processing DeleteTablet for tablet a9ae17eec3fe4ce0841d3fb17c91a8b8 with delete_type TABLET_DATA_TOMBSTONED (TS 7e9c4f2e01164f33b2e9034ed148398e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52712
I20250625 03:30:50.963363 2576 tablet_replica.cc:331] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 7e9c4f2e01164f33b2e9034ed148398e: stopping tablet replica
I20250625 03:30:50.964288 2576 raft_consensus.cc:2241] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:30:50.964848 2576 raft_consensus.cc:2270] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:30:50.966225 2561 raft_consensus.cc:1062] T b15eb94b9d3d4f6987b5fa5e20193655 P ba464e89e0f044a0a0ea3e6125cbf2a1: attempting to promote NON_VOTER df8b9755d156478aafca552f9e9c539e to VOTER
I20250625 03:30:50.968823 2561 consensus_queue.cc:237] T b15eb94b9d3d4f6987b5fa5e20193655 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:30:50.971235 2572 raft_consensus.cc:2953] T 731095860aad436e9658ab3ff5010f9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:50.973002 2576 ts_tablet_manager.cc:1905] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 7e9c4f2e01164f33b2e9034ed148398e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250625 03:30:50.977982 1663 raft_consensus.cc:2953] T 731095860aad436e9658ab3ff5010f9d P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:50.986413 1591 raft_consensus.cc:1273] T b15eb94b9d3d4f6987b5fa5e20193655 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:30:50.983367 1664 raft_consensus.cc:1273] T b15eb94b9d3d4f6987b5fa5e20193655 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:30:50.983687 2344 raft_consensus.cc:1273] T b15eb94b9d3d4f6987b5fa5e20193655 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:30:50.992163 2579 consensus_queue.cc:1035] T b15eb94b9d3d4f6987b5fa5e20193655 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:30:51.003713 2573 consensus_queue.cc:1035] T b15eb94b9d3d4f6987b5fa5e20193655 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20250625 03:30:51.007440 2496 consensus_queue.cc:1035] T b15eb94b9d3d4f6987b5fa5e20193655 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:30:51.006567 2343 raft_consensus.cc:2953] T 731095860aad436e9658ab3ff5010f9d P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:51.010857 1493 catalog_manager.cc:5582] T 731095860aad436e9658ab3ff5010f9d P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:51.025731 2533 raft_consensus.cc:1062] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 3f2aa40978064c9e9983cf3745eed206: attempting to promote NON_VOTER df8b9755d156478aafca552f9e9c539e to VOTER
I20250625 03:30:51.033720 1589 raft_consensus.cc:2953] T 731095860aad436e9658ab3ff5010f9d P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:51.045981 1737 consensus_queue.cc:237] T 731095860aad436e9658ab3ff5010f9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:30:51.035794 2533 consensus_queue.cc:237] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:30:51.065500 1664 raft_consensus.cc:1273] T 731095860aad436e9658ab3ff5010f9d P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250625 03:30:51.068111 2343 raft_consensus.cc:1273] T 731095860aad436e9658ab3ff5010f9d P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250625 03:30:51.067932 2579 consensus_queue.cc:1035] T 731095860aad436e9658ab3ff5010f9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:30:51.073695 2573 raft_consensus.cc:2953] T b15eb94b9d3d4f6987b5fa5e20193655 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:51.080263 2581 consensus_queue.cc:1035] T 731095860aad436e9658ab3ff5010f9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:30:51.085582 2581 raft_consensus.cc:2953] T 731095860aad436e9658ab3ff5010f9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:51.090611 1589 raft_consensus.cc:2953] T b15eb94b9d3d4f6987b5fa5e20193655 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:51.088260 1663 raft_consensus.cc:2953] T 731095860aad436e9658ab3ff5010f9d P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:51.093106 2345 raft_consensus.cc:1273] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:30:51.094254 1739 raft_consensus.cc:1273] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:30:51.097636 2430 consensus_queue.cc:1035] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:30:51.102134 2563 consensus_queue.cc:1035] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:30:51.103495 1665 raft_consensus.cc:2953] T b15eb94b9d3d4f6987b5fa5e20193655 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:51.106658 1591 raft_consensus.cc:1273] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:30:51.108448 2563 consensus_queue.cc:1035] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:30:51.118660 1494 catalog_manager.cc:5582] T b15eb94b9d3d4f6987b5fa5e20193655 P 7e9c4f2e01164f33b2e9034ed148398e reported cstate change: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:51.121004 2342 raft_consensus.cc:2953] T b15eb94b9d3d4f6987b5fa5e20193655 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:51.134531 2341 raft_consensus.cc:2953] T 731095860aad436e9658ab3ff5010f9d P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:51.139984 1494 catalog_manager.cc:5582] T 731095860aad436e9658ab3ff5010f9d P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: config changed from index 3 to 4, VOTER 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) evicted. New cstate: current_term: 1 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:51.145112 2576 ts_tablet_manager.cc:1918] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 7e9c4f2e01164f33b2e9034ed148398e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20250625 03:30:51.145633 2576 log.cc:1199] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 7e9c4f2e01164f33b2e9034ed148398e: Deleting WAL directory at /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/ts-0-root/wals/a9ae17eec3fe4ce0841d3fb17c91a8b8
I20250625 03:30:51.147293 1479 catalog_manager.cc:4928] TS 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): tablet a9ae17eec3fe4ce0841d3fb17c91a8b8 (table test-workload [id=7f663eabec024fd1911b406c660fa838]) successfully deleted
I20250625 03:30:51.151966 2563 raft_consensus.cc:2953] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:51.160048 2345 raft_consensus.cc:2953] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:51.167541 1480 catalog_manager.cc:5095] ChangeConfig:REMOVE_PEER RPC for tablet 731095860aad436e9658ab3ff5010f9d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250625 03:30:51.174726 1737 raft_consensus.cc:2953] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:51.177659 1589 raft_consensus.cc:2953] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:51.180106 1739 consensus_queue.cc:237] T b15eb94b9d3d4f6987b5fa5e20193655 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:30:51.187587 1591 raft_consensus.cc:1273] T b15eb94b9d3d4f6987b5fa5e20193655 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250625 03:30:51.189075 2579 consensus_queue.cc:1035] T b15eb94b9d3d4f6987b5fa5e20193655 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:30:51.191975 2345 raft_consensus.cc:1273] T b15eb94b9d3d4f6987b5fa5e20193655 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250625 03:30:51.196081 1582 tablet_service.cc:1515] Processing DeleteTablet for tablet 731095860aad436e9658ab3ff5010f9d with delete_type TABLET_DATA_TOMBSTONED (TS 7e9c4f2e01164f33b2e9034ed148398e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52712
I20250625 03:30:51.197108 2576 tablet_replica.cc:331] T 731095860aad436e9658ab3ff5010f9d P 7e9c4f2e01164f33b2e9034ed148398e: stopping tablet replica
I20250625 03:30:51.198112 2576 raft_consensus.cc:2241] T 731095860aad436e9658ab3ff5010f9d P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:30:51.199393 2576 raft_consensus.cc:2270] T 731095860aad436e9658ab3ff5010f9d P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:30:51.203294 2576 ts_tablet_manager.cc:1905] T 731095860aad436e9658ab3ff5010f9d P 7e9c4f2e01164f33b2e9034ed148398e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250625 03:30:51.203339 1493 catalog_manager.cc:5582] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 7e9c4f2e01164f33b2e9034ed148398e reported cstate change: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:51.208230 2580 consensus_queue.cc:1035] T b15eb94b9d3d4f6987b5fa5e20193655 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20250625 03:30:51.217077 2572 raft_consensus.cc:2953] T b15eb94b9d3d4f6987b5fa5e20193655 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:51.225247 2345 raft_consensus.cc:2953] T b15eb94b9d3d4f6987b5fa5e20193655 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:51.230190 1591 raft_consensus.cc:2953] T b15eb94b9d3d4f6987b5fa5e20193655 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:51.245304 1665 consensus_queue.cc:237] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:30:51.250123 1494 catalog_manager.cc:5582] T b15eb94b9d3d4f6987b5fa5e20193655 P df8b9755d156478aafca552f9e9c539e reported cstate change: config changed from index 3 to 4, VOTER 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) evicted. New cstate: current_term: 1 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:51.253940 1480 catalog_manager.cc:5095] ChangeConfig:REMOVE_PEER RPC for tablet b15eb94b9d3d4f6987b5fa5e20193655 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250625 03:30:51.257747 1591 raft_consensus.cc:1273] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250625 03:30:51.259656 2503 consensus_queue.cc:1035] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:30:51.264150 1658 tablet_service.cc:1515] Processing DeleteTablet for tablet b15eb94b9d3d4f6987b5fa5e20193655 with delete_type TABLET_DATA_TOMBSTONED (TS 3f2aa40978064c9e9983cf3745eed206 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53744
I20250625 03:30:51.269816 2533 raft_consensus.cc:2953] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:51.276218 2345 raft_consensus.cc:1273] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250625 03:30:51.277522 2563 consensus_queue.cc:1035] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:30:51.277748 1589 raft_consensus.cc:2953] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:51.280332 2576 ts_tablet_manager.cc:1918] T 731095860aad436e9658ab3ff5010f9d P 7e9c4f2e01164f33b2e9034ed148398e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20250625 03:30:51.280804 2576 log.cc:1199] T 731095860aad436e9658ab3ff5010f9d P 7e9c4f2e01164f33b2e9034ed148398e: Deleting WAL directory at /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/ts-0-root/wals/731095860aad436e9658ab3ff5010f9d
I20250625 03:30:51.282130 2345 raft_consensus.cc:2953] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:51.291059 1479 catalog_manager.cc:4928] TS 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): tablet 731095860aad436e9658ab3ff5010f9d (table test-workload [id=7f663eabec024fd1911b406c660fa838]) successfully deleted
I20250625 03:30:51.291980 1478 catalog_manager.cc:5095] ChangeConfig:REMOVE_PEER RPC for tablet 3c2c045dee4b4b4faa93fa9d0ccdaa1c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250625 03:30:51.302855 2590 tablet_replica.cc:331] T b15eb94b9d3d4f6987b5fa5e20193655 P 3f2aa40978064c9e9983cf3745eed206: stopping tablet replica
I20250625 03:30:51.303951 2590 raft_consensus.cc:2241] T b15eb94b9d3d4f6987b5fa5e20193655 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:30:51.304731 2590 raft_consensus.cc:2270] T b15eb94b9d3d4f6987b5fa5e20193655 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:30:51.307170 1494 catalog_manager.cc:5582] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: config changed from index 3 to 4, VOTER ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) evicted. New cstate: current_term: 1 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20250625 03:30:51.307821 2590 ts_tablet_manager.cc:1905] T b15eb94b9d3d4f6987b5fa5e20193655 P 3f2aa40978064c9e9983cf3745eed206: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250625 03:30:51.318578 1732 tablet_service.cc:1515] Processing DeleteTablet for tablet 3c2c045dee4b4b4faa93fa9d0ccdaa1c with delete_type TABLET_DATA_TOMBSTONED (TS ba464e89e0f044a0a0ea3e6125cbf2a1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43672
I20250625 03:30:51.320133 2591 tablet_replica.cc:331] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P ba464e89e0f044a0a0ea3e6125cbf2a1: stopping tablet replica
I20250625 03:30:51.321488 2591 raft_consensus.cc:2241] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:30:51.322202 2591 raft_consensus.cc:2270] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:30:51.327817 2590 ts_tablet_manager.cc:1918] T b15eb94b9d3d4f6987b5fa5e20193655 P 3f2aa40978064c9e9983cf3745eed206: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20250625 03:30:51.328352 2590 log.cc:1199] T b15eb94b9d3d4f6987b5fa5e20193655 P 3f2aa40978064c9e9983cf3745eed206: Deleting WAL directory at /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/ts-1-root/wals/b15eb94b9d3d4f6987b5fa5e20193655
I20250625 03:30:51.329099 2591 ts_tablet_manager.cc:1905] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P ba464e89e0f044a0a0ea3e6125cbf2a1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250625 03:30:51.330013 1478 catalog_manager.cc:4928] TS 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): tablet b15eb94b9d3d4f6987b5fa5e20193655 (table test-workload [id=7f663eabec024fd1911b406c660fa838]) successfully deleted
I20250625 03:30:51.342089 2591 ts_tablet_manager.cc:1918] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P ba464e89e0f044a0a0ea3e6125cbf2a1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20250625 03:30:51.342687 2591 log.cc:1199] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P ba464e89e0f044a0a0ea3e6125cbf2a1: Deleting WAL directory at /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/ts-2-root/wals/3c2c045dee4b4b4faa93fa9d0ccdaa1c
I20250625 03:30:51.345355 1480 catalog_manager.cc:4928] TS ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): tablet 3c2c045dee4b4b4faa93fa9d0ccdaa1c (table test-workload [id=7f663eabec024fd1911b406c660fa838]) successfully deleted
I20250625 03:30:52.364624 1665 consensus_queue.cc:237] T 31885ef6a0c64613ae6723c07f9400b0 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:52.370182 1745 raft_consensus.cc:1273] T 31885ef6a0c64613ae6723c07f9400b0 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20250625 03:30:52.370288 1634 consensus_peers.cc:487] T 31885ef6a0c64613ae6723c07f9400b0 P 3f2aa40978064c9e9983cf3745eed206 -> Peer df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493): Couldn't send request to peer df8b9755d156478aafca552f9e9c539e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 31885ef6a0c64613ae6723c07f9400b0. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:30:52.370767 1591 raft_consensus.cc:1273] T 31885ef6a0c64613ae6723c07f9400b0 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 03:30:52.371524 2592 consensus_queue.cc:1035] T 31885ef6a0c64613ae6723c07f9400b0 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:30:52.372364 2430 consensus_queue.cc:1035] T 31885ef6a0c64613ae6723c07f9400b0 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:30:52.381112 2503 raft_consensus.cc:2953] T 31885ef6a0c64613ae6723c07f9400b0 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:52.383771 1745 raft_consensus.cc:2953] T 31885ef6a0c64613ae6723c07f9400b0 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:52.401232 1665 consensus_queue.cc:237] T d50c52b197294003b238a37da2fb55d8 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:52.400825 1492 catalog_manager.cc:5582] T 31885ef6a0c64613ae6723c07f9400b0 P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New cstate: current_term: 1 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20250625 03:30:52.391436 1591 raft_consensus.cc:2953] T 31885ef6a0c64613ae6723c07f9400b0 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:52.417454 1745 raft_consensus.cc:1273] T d50c52b197294003b238a37da2fb55d8 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 03:30:52.420258 2592 consensus_queue.cc:1035] T d50c52b197294003b238a37da2fb55d8 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20250625 03:30:52.423552 1634 consensus_peers.cc:487] T d50c52b197294003b238a37da2fb55d8 P 3f2aa40978064c9e9983cf3745eed206 -> Peer df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493): Couldn't send request to peer df8b9755d156478aafca552f9e9c539e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d50c52b197294003b238a37da2fb55d8. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:30:52.426384 1589 raft_consensus.cc:1273] T d50c52b197294003b238a37da2fb55d8 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 03:30:52.428177 2503 consensus_queue.cc:1035] T d50c52b197294003b238a37da2fb55d8 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:30:52.438067 2592 raft_consensus.cc:2953] T d50c52b197294003b238a37da2fb55d8 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:52.446743 1737 raft_consensus.cc:2953] T d50c52b197294003b238a37da2fb55d8 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:52.457448 1745 consensus_queue.cc:237] T fb6e83db706647e28e491a02f1641980 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:52.487680 1665 raft_consensus.cc:1273] T fb6e83db706647e28e491a02f1641980 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20250625 03:30:52.489673 1708 consensus_peers.cc:487] T fb6e83db706647e28e491a02f1641980 P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493): Couldn't send request to peer df8b9755d156478aafca552f9e9c539e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fb6e83db706647e28e491a02f1641980. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:30:52.493913 2594 consensus_queue.cc:1035] T fb6e83db706647e28e491a02f1641980 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20250625 03:30:52.496624 1591 raft_consensus.cc:1273] T fb6e83db706647e28e491a02f1641980 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 03:30:52.497936 2594 consensus_queue.cc:1035] T fb6e83db706647e28e491a02f1641980 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:30:52.508231 2594 raft_consensus.cc:2953] T fb6e83db706647e28e491a02f1641980 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:52.513880 1494 catalog_manager.cc:5582] T d50c52b197294003b238a37da2fb55d8 P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New cstate: current_term: 1 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:52.498705 1591 raft_consensus.cc:2953] T d50c52b197294003b238a37da2fb55d8 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:52.524984 1665 raft_consensus.cc:2953] T fb6e83db706647e28e491a02f1641980 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:52.532785 1595 consensus_queue.cc:237] T d9038fc1ce0d4b528c02c68012e1277d P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:52.537077 1491 catalog_manager.cc:5582] T fb6e83db706647e28e491a02f1641980 P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New cstate: current_term: 1 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20250625 03:30:52.543605 1559 consensus_peers.cc:487] T d9038fc1ce0d4b528c02c68012e1277d P 7e9c4f2e01164f33b2e9034ed148398e -> Peer df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493): Couldn't send request to peer df8b9755d156478aafca552f9e9c539e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d9038fc1ce0d4b528c02c68012e1277d. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:30:52.545598 1737 raft_consensus.cc:1273] T d9038fc1ce0d4b528c02c68012e1277d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 03:30:52.548564 2605 consensus_queue.cc:1035] T d9038fc1ce0d4b528c02c68012e1277d P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:30:52.548072 1665 raft_consensus.cc:1273] T d9038fc1ce0d4b528c02c68012e1277d P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 03:30:52.551692 2605 consensus_queue.cc:1035] T d9038fc1ce0d4b528c02c68012e1277d P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:30:52.551381 1589 raft_consensus.cc:2953] T fb6e83db706647e28e491a02f1641980 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:52.576368 2605 raft_consensus.cc:2953] T d9038fc1ce0d4b528c02c68012e1277d P 7e9c4f2e01164f33b2e9034ed148398e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:52.578866 1737 raft_consensus.cc:2953] T d9038fc1ce0d4b528c02c68012e1277d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:52.583246 1665 raft_consensus.cc:2953] T d9038fc1ce0d4b528c02c68012e1277d P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:52.598281 1494 catalog_manager.cc:5582] T d9038fc1ce0d4b528c02c68012e1277d P 7e9c4f2e01164f33b2e9034ed148398e reported cstate change: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New cstate: current_term: 1 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20250625 03:30:52.938759 2612 ts_tablet_manager.cc:927] T 31885ef6a0c64613ae6723c07f9400b0 P df8b9755d156478aafca552f9e9c539e: Initiating tablet copy from peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:52.940459 2612 tablet_copy_client.cc:323] T 31885ef6a0c64613ae6723c07f9400b0 P df8b9755d156478aafca552f9e9c539e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.106.130:34293
I20250625 03:30:52.941835 1680 tablet_copy_service.cc:140] P 3f2aa40978064c9e9983cf3745eed206: Received BeginTabletCopySession request for tablet 31885ef6a0c64613ae6723c07f9400b0 from peer df8b9755d156478aafca552f9e9c539e ({username='slave'} at 127.0.0.1:55766)
I20250625 03:30:52.942368 1680 tablet_copy_service.cc:161] P 3f2aa40978064c9e9983cf3745eed206: Beginning new tablet copy session on tablet 31885ef6a0c64613ae6723c07f9400b0 from peer df8b9755d156478aafca552f9e9c539e at {username='slave'} at 127.0.0.1:55766: session id = df8b9755d156478aafca552f9e9c539e-31885ef6a0c64613ae6723c07f9400b0
I20250625 03:30:52.950662 1680 tablet_copy_source_session.cc:215] T 31885ef6a0c64613ae6723c07f9400b0 P 3f2aa40978064c9e9983cf3745eed206: Tablet Copy: opened 0 blocks and 1 log segments
I20250625 03:30:52.953321 2612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31885ef6a0c64613ae6723c07f9400b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:52.967881 2612 tablet_copy_client.cc:806] T 31885ef6a0c64613ae6723c07f9400b0 P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 0 data blocks...
I20250625 03:30:52.968519 2612 tablet_copy_client.cc:670] T 31885ef6a0c64613ae6723c07f9400b0 P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 1 WAL segments...
I20250625 03:30:52.972100 2612 tablet_copy_client.cc:538] T 31885ef6a0c64613ae6723c07f9400b0 P df8b9755d156478aafca552f9e9c539e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250625 03:30:52.979650 2612 tablet_bootstrap.cc:492] T 31885ef6a0c64613ae6723c07f9400b0 P df8b9755d156478aafca552f9e9c539e: Bootstrap starting.
I20250625 03:30:52.986670 2615 ts_tablet_manager.cc:927] T d50c52b197294003b238a37da2fb55d8 P df8b9755d156478aafca552f9e9c539e: Initiating tablet copy from peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:52.992553 2615 tablet_copy_client.cc:323] T d50c52b197294003b238a37da2fb55d8 P df8b9755d156478aafca552f9e9c539e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.106.130:34293
I20250625 03:30:52.994498 1680 tablet_copy_service.cc:140] P 3f2aa40978064c9e9983cf3745eed206: Received BeginTabletCopySession request for tablet d50c52b197294003b238a37da2fb55d8 from peer df8b9755d156478aafca552f9e9c539e ({username='slave'} at 127.0.0.1:55766)
I20250625 03:30:52.995239 1680 tablet_copy_service.cc:161] P 3f2aa40978064c9e9983cf3745eed206: Beginning new tablet copy session on tablet d50c52b197294003b238a37da2fb55d8 from peer df8b9755d156478aafca552f9e9c539e at {username='slave'} at 127.0.0.1:55766: session id = df8b9755d156478aafca552f9e9c539e-d50c52b197294003b238a37da2fb55d8
I20250625 03:30:52.996405 2614 ts_tablet_manager.cc:927] T d9038fc1ce0d4b528c02c68012e1277d P df8b9755d156478aafca552f9e9c539e: Initiating tablet copy from peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903)
I20250625 03:30:53.009701 2614 tablet_copy_client.cc:323] T d9038fc1ce0d4b528c02c68012e1277d P df8b9755d156478aafca552f9e9c539e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.106.129:39903
I20250625 03:30:53.013005 1680 tablet_copy_source_session.cc:215] T d50c52b197294003b238a37da2fb55d8 P 3f2aa40978064c9e9983cf3745eed206: Tablet Copy: opened 0 blocks and 1 log segments
I20250625 03:30:53.011956 1606 tablet_copy_service.cc:140] P 7e9c4f2e01164f33b2e9034ed148398e: Received BeginTabletCopySession request for tablet d9038fc1ce0d4b528c02c68012e1277d from peer df8b9755d156478aafca552f9e9c539e ({username='slave'} at 127.0.0.1:44210)
I20250625 03:30:53.017751 1606 tablet_copy_service.cc:161] P 7e9c4f2e01164f33b2e9034ed148398e: Beginning new tablet copy session on tablet d9038fc1ce0d4b528c02c68012e1277d from peer df8b9755d156478aafca552f9e9c539e at {username='slave'} at 127.0.0.1:44210: session id = df8b9755d156478aafca552f9e9c539e-d9038fc1ce0d4b528c02c68012e1277d
I20250625 03:30:53.019629 2615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d50c52b197294003b238a37da2fb55d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:53.021981 2612 tablet_bootstrap.cc:492] T 31885ef6a0c64613ae6723c07f9400b0 P df8b9755d156478aafca552f9e9c539e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:30:53.022966 2612 tablet_bootstrap.cc:492] T 31885ef6a0c64613ae6723c07f9400b0 P df8b9755d156478aafca552f9e9c539e: Bootstrap complete.
I20250625 03:30:53.023715 2612 ts_tablet_manager.cc:1397] T 31885ef6a0c64613ae6723c07f9400b0 P df8b9755d156478aafca552f9e9c539e: Time spent bootstrapping tablet: real 0.044s user 0.028s sys 0.000s
I20250625 03:30:53.027458 1606 tablet_copy_source_session.cc:215] T d9038fc1ce0d4b528c02c68012e1277d P 7e9c4f2e01164f33b2e9034ed148398e: Tablet Copy: opened 0 blocks and 1 log segments
I20250625 03:30:53.027585 2612 raft_consensus.cc:357] T 31885ef6a0c64613ae6723c07f9400b0 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:53.028633 2612 raft_consensus.cc:738] T 31885ef6a0c64613ae6723c07f9400b0 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: df8b9755d156478aafca552f9e9c539e, State: Initialized, Role: LEARNER
I20250625 03:30:53.029393 2612 consensus_queue.cc:260] T 31885ef6a0c64613ae6723c07f9400b0 P df8b9755d156478aafca552f9e9c539e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:53.031230 2614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9038fc1ce0d4b528c02c68012e1277d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:53.039347 2612 ts_tablet_manager.cc:1428] T 31885ef6a0c64613ae6723c07f9400b0 P df8b9755d156478aafca552f9e9c539e: Time spent starting tablet: real 0.015s user 0.005s sys 0.007s
I20250625 03:30:53.045228 1681 tablet_copy_service.cc:342] P 3f2aa40978064c9e9983cf3745eed206: Request end of tablet copy session df8b9755d156478aafca552f9e9c539e-31885ef6a0c64613ae6723c07f9400b0 received from {username='slave'} at 127.0.0.1:55766
I20250625 03:30:53.045687 1681 tablet_copy_service.cc:434] P 3f2aa40978064c9e9983cf3745eed206: ending tablet copy session df8b9755d156478aafca552f9e9c539e-31885ef6a0c64613ae6723c07f9400b0 on tablet 31885ef6a0c64613ae6723c07f9400b0 with peer df8b9755d156478aafca552f9e9c539e
I20250625 03:30:53.057996 2614 tablet_copy_client.cc:806] T d9038fc1ce0d4b528c02c68012e1277d P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 0 data blocks...
I20250625 03:30:53.058584 2614 tablet_copy_client.cc:670] T d9038fc1ce0d4b528c02c68012e1277d P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 1 WAL segments...
I20250625 03:30:53.060914 2615 tablet_copy_client.cc:806] T d50c52b197294003b238a37da2fb55d8 P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 0 data blocks...
I20250625 03:30:53.061398 2615 tablet_copy_client.cc:670] T d50c52b197294003b238a37da2fb55d8 P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 1 WAL segments...
I20250625 03:30:53.063354 2614 tablet_copy_client.cc:538] T d9038fc1ce0d4b528c02c68012e1277d P df8b9755d156478aafca552f9e9c539e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250625 03:30:53.067268 2615 tablet_copy_client.cc:538] T d50c52b197294003b238a37da2fb55d8 P df8b9755d156478aafca552f9e9c539e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250625 03:30:53.075829 2614 tablet_bootstrap.cc:492] T d9038fc1ce0d4b528c02c68012e1277d P df8b9755d156478aafca552f9e9c539e: Bootstrap starting.
I20250625 03:30:53.076871 2615 tablet_bootstrap.cc:492] T d50c52b197294003b238a37da2fb55d8 P df8b9755d156478aafca552f9e9c539e: Bootstrap starting.
I20250625 03:30:53.079650 2612 ts_tablet_manager.cc:927] T fb6e83db706647e28e491a02f1641980 P df8b9755d156478aafca552f9e9c539e: Initiating tablet copy from peer ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:53.093250 2612 tablet_copy_client.cc:323] T fb6e83db706647e28e491a02f1641980 P df8b9755d156478aafca552f9e9c539e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.106.131:39359
I20250625 03:30:53.095338 1755 tablet_copy_service.cc:140] P ba464e89e0f044a0a0ea3e6125cbf2a1: Received BeginTabletCopySession request for tablet fb6e83db706647e28e491a02f1641980 from peer df8b9755d156478aafca552f9e9c539e ({username='slave'} at 127.0.0.1:39774)
I20250625 03:30:53.095873 1755 tablet_copy_service.cc:161] P ba464e89e0f044a0a0ea3e6125cbf2a1: Beginning new tablet copy session on tablet fb6e83db706647e28e491a02f1641980 from peer df8b9755d156478aafca552f9e9c539e at {username='slave'} at 127.0.0.1:39774: session id = df8b9755d156478aafca552f9e9c539e-fb6e83db706647e28e491a02f1641980
I20250625 03:30:53.104315 1755 tablet_copy_source_session.cc:215] T fb6e83db706647e28e491a02f1641980 P ba464e89e0f044a0a0ea3e6125cbf2a1: Tablet Copy: opened 0 blocks and 1 log segments
I20250625 03:30:53.106587 2615 tablet_bootstrap.cc:492] T d50c52b197294003b238a37da2fb55d8 P df8b9755d156478aafca552f9e9c539e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:30:53.107581 2612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb6e83db706647e28e491a02f1641980. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:53.107631 2615 tablet_bootstrap.cc:492] T d50c52b197294003b238a37da2fb55d8 P df8b9755d156478aafca552f9e9c539e: Bootstrap complete.
I20250625 03:30:53.108654 2615 ts_tablet_manager.cc:1397] T d50c52b197294003b238a37da2fb55d8 P df8b9755d156478aafca552f9e9c539e: Time spent bootstrapping tablet: real 0.032s user 0.017s sys 0.005s
I20250625 03:30:53.113479 2614 tablet_bootstrap.cc:492] T d9038fc1ce0d4b528c02c68012e1277d P df8b9755d156478aafca552f9e9c539e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:30:53.114472 2614 tablet_bootstrap.cc:492] T d9038fc1ce0d4b528c02c68012e1277d P df8b9755d156478aafca552f9e9c539e: Bootstrap complete.
I20250625 03:30:53.115594 2614 ts_tablet_manager.cc:1397] T d9038fc1ce0d4b528c02c68012e1277d P df8b9755d156478aafca552f9e9c539e: Time spent bootstrapping tablet: real 0.040s user 0.013s sys 0.013s
I20250625 03:30:53.115903 2615 raft_consensus.cc:357] T d50c52b197294003b238a37da2fb55d8 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:53.117559 2615 raft_consensus.cc:738] T d50c52b197294003b238a37da2fb55d8 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: df8b9755d156478aafca552f9e9c539e, State: Initialized, Role: LEARNER
I20250625 03:30:53.118367 2614 raft_consensus.cc:357] T d9038fc1ce0d4b528c02c68012e1277d P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:53.119196 2614 raft_consensus.cc:738] T d9038fc1ce0d4b528c02c68012e1277d P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: df8b9755d156478aafca552f9e9c539e, State: Initialized, Role: LEARNER
I20250625 03:30:53.119112 2615 consensus_queue.cc:260] T d50c52b197294003b238a37da2fb55d8 P df8b9755d156478aafca552f9e9c539e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:53.120052 2614 consensus_queue.cc:260] T d9038fc1ce0d4b528c02c68012e1277d P df8b9755d156478aafca552f9e9c539e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:53.122571 2615 ts_tablet_manager.cc:1428] T d50c52b197294003b238a37da2fb55d8 P df8b9755d156478aafca552f9e9c539e: Time spent starting tablet: real 0.014s user 0.002s sys 0.004s
I20250625 03:30:53.123165 2614 ts_tablet_manager.cc:1428] T d9038fc1ce0d4b528c02c68012e1277d P df8b9755d156478aafca552f9e9c539e: Time spent starting tablet: real 0.007s user 0.000s sys 0.005s
I20250625 03:30:53.124533 1680 tablet_copy_service.cc:342] P 3f2aa40978064c9e9983cf3745eed206: Request end of tablet copy session df8b9755d156478aafca552f9e9c539e-d50c52b197294003b238a37da2fb55d8 received from {username='slave'} at 127.0.0.1:55766
I20250625 03:30:53.124974 1680 tablet_copy_service.cc:434] P 3f2aa40978064c9e9983cf3745eed206: ending tablet copy session df8b9755d156478aafca552f9e9c539e-d50c52b197294003b238a37da2fb55d8 on tablet d50c52b197294003b238a37da2fb55d8 with peer df8b9755d156478aafca552f9e9c539e
I20250625 03:30:53.125656 2612 tablet_copy_client.cc:806] T fb6e83db706647e28e491a02f1641980 P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 0 data blocks...
I20250625 03:30:53.126379 2612 tablet_copy_client.cc:670] T fb6e83db706647e28e491a02f1641980 P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 1 WAL segments...
I20250625 03:30:53.127626 1606 tablet_copy_service.cc:342] P 7e9c4f2e01164f33b2e9034ed148398e: Request end of tablet copy session df8b9755d156478aafca552f9e9c539e-d9038fc1ce0d4b528c02c68012e1277d received from {username='slave'} at 127.0.0.1:44210
I20250625 03:30:53.128070 1606 tablet_copy_service.cc:434] P 7e9c4f2e01164f33b2e9034ed148398e: ending tablet copy session df8b9755d156478aafca552f9e9c539e-d9038fc1ce0d4b528c02c68012e1277d on tablet d9038fc1ce0d4b528c02c68012e1277d with peer df8b9755d156478aafca552f9e9c539e
I20250625 03:30:53.136440 2612 tablet_copy_client.cc:538] T fb6e83db706647e28e491a02f1641980 P df8b9755d156478aafca552f9e9c539e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250625 03:30:53.144938 2612 tablet_bootstrap.cc:492] T fb6e83db706647e28e491a02f1641980 P df8b9755d156478aafca552f9e9c539e: Bootstrap starting.
I20250625 03:30:53.162681 2612 tablet_bootstrap.cc:492] T fb6e83db706647e28e491a02f1641980 P df8b9755d156478aafca552f9e9c539e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:30:53.163589 2612 tablet_bootstrap.cc:492] T fb6e83db706647e28e491a02f1641980 P df8b9755d156478aafca552f9e9c539e: Bootstrap complete.
I20250625 03:30:53.164276 2612 ts_tablet_manager.cc:1397] T fb6e83db706647e28e491a02f1641980 P df8b9755d156478aafca552f9e9c539e: Time spent bootstrapping tablet: real 0.020s user 0.019s sys 0.000s
I20250625 03:30:53.166751 2612 raft_consensus.cc:357] T fb6e83db706647e28e491a02f1641980 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:53.167515 2612 raft_consensus.cc:738] T fb6e83db706647e28e491a02f1641980 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: df8b9755d156478aafca552f9e9c539e, State: Initialized, Role: LEARNER
I20250625 03:30:53.168074 2612 consensus_queue.cc:260] T fb6e83db706647e28e491a02f1641980 P df8b9755d156478aafca552f9e9c539e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:53.170163 2612 ts_tablet_manager.cc:1428] T fb6e83db706647e28e491a02f1641980 P df8b9755d156478aafca552f9e9c539e: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20250625 03:30:53.172081 1755 tablet_copy_service.cc:342] P ba464e89e0f044a0a0ea3e6125cbf2a1: Request end of tablet copy session df8b9755d156478aafca552f9e9c539e-fb6e83db706647e28e491a02f1641980 received from {username='slave'} at 127.0.0.1:39774
I20250625 03:30:53.172531 1755 tablet_copy_service.cc:434] P ba464e89e0f044a0a0ea3e6125cbf2a1: ending tablet copy session df8b9755d156478aafca552f9e9c539e-fb6e83db706647e28e491a02f1641980 on tablet fb6e83db706647e28e491a02f1641980 with peer df8b9755d156478aafca552f9e9c539e
I20250625 03:30:53.479763 2341 raft_consensus.cc:1215] T d50c52b197294003b238a37da2fb55d8 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20250625 03:30:53.492769 2341 raft_consensus.cc:1215] T d9038fc1ce0d4b528c02c68012e1277d P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20250625 03:30:53.504702 2341 raft_consensus.cc:1215] T 31885ef6a0c64613ae6723c07f9400b0 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20250625 03:30:53.595537 2341 raft_consensus.cc:1215] T fb6e83db706647e28e491a02f1641980 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20250625 03:30:53.888585 2503 raft_consensus.cc:1062] T d50c52b197294003b238a37da2fb55d8 P 3f2aa40978064c9e9983cf3745eed206: attempting to promote NON_VOTER df8b9755d156478aafca552f9e9c539e to VOTER
I20250625 03:30:53.890805 2503 consensus_queue.cc:237] T d50c52b197294003b238a37da2fb55d8 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:30:53.900976 2341 raft_consensus.cc:1273] T d50c52b197294003b238a37da2fb55d8 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:30:53.903101 1589 raft_consensus.cc:1273] T d50c52b197294003b238a37da2fb55d8 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:30:53.901279 1745 raft_consensus.cc:1273] T d50c52b197294003b238a37da2fb55d8 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:30:53.904210 2503 consensus_queue.cc:1035] T d50c52b197294003b238a37da2fb55d8 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20250625 03:30:53.906387 2624 consensus_queue.cc:1035] T d50c52b197294003b238a37da2fb55d8 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:30:53.908524 2592 consensus_queue.cc:1035] T d50c52b197294003b238a37da2fb55d8 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:30:53.944607 2592 raft_consensus.cc:2953] T d50c52b197294003b238a37da2fb55d8 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:53.946496 2341 raft_consensus.cc:2953] T d50c52b197294003b238a37da2fb55d8 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:53.959164 1491 catalog_manager.cc:5582] T d50c52b197294003b238a37da2fb55d8 P df8b9755d156478aafca552f9e9c539e reported cstate change: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:53.960673 1737 raft_consensus.cc:2953] T d50c52b197294003b238a37da2fb55d8 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:53.963346 1595 raft_consensus.cc:2953] T d50c52b197294003b238a37da2fb55d8 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:54.010377 1664 consensus_queue.cc:237] T d50c52b197294003b238a37da2fb55d8 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:30:54.015045 2341 raft_consensus.cc:1273] T d50c52b197294003b238a37da2fb55d8 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250625 03:30:54.016568 2624 consensus_queue.cc:1035] T d50c52b197294003b238a37da2fb55d8 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20250625 03:30:54.017098 1595 raft_consensus.cc:1273] T d50c52b197294003b238a37da2fb55d8 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250625 03:30:54.019167 2626 consensus_queue.cc:1035] T d50c52b197294003b238a37da2fb55d8 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:30:54.022507 2624 raft_consensus.cc:2953] T d50c52b197294003b238a37da2fb55d8 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:54.028844 1595 raft_consensus.cc:2953] T d50c52b197294003b238a37da2fb55d8 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:54.028685 2341 raft_consensus.cc:2953] T d50c52b197294003b238a37da2fb55d8 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:54.035980 1478 catalog_manager.cc:5095] ChangeConfig:REMOVE_PEER RPC for tablet d50c52b197294003b238a37da2fb55d8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250625 03:30:54.045639 1492 catalog_manager.cc:5582] T d50c52b197294003b238a37da2fb55d8 P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: config changed from index 3 to 4, VOTER ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) evicted. New cstate: current_term: 1 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250625 03:30:54.058207 1732 tablet_service.cc:1515] Processing DeleteTablet for tablet d50c52b197294003b238a37da2fb55d8 with delete_type TABLET_DATA_TOMBSTONED (TS ba464e89e0f044a0a0ea3e6125cbf2a1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43672
I20250625 03:30:54.059989 2605 raft_consensus.cc:1062] T d9038fc1ce0d4b528c02c68012e1277d P 7e9c4f2e01164f33b2e9034ed148398e: attempting to promote NON_VOTER df8b9755d156478aafca552f9e9c539e to VOTER
I20250625 03:30:54.063482 2605 consensus_queue.cc:237] T d9038fc1ce0d4b528c02c68012e1277d P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:30:54.076967 2636 tablet_replica.cc:331] T d50c52b197294003b238a37da2fb55d8 P ba464e89e0f044a0a0ea3e6125cbf2a1: stopping tablet replica
I20250625 03:30:54.079033 2636 raft_consensus.cc:2241] T d50c52b197294003b238a37da2fb55d8 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:30:54.079872 2636 raft_consensus.cc:2270] T d50c52b197294003b238a37da2fb55d8 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:30:54.087448 2503 raft_consensus.cc:1062] T 31885ef6a0c64613ae6723c07f9400b0 P 3f2aa40978064c9e9983cf3745eed206: attempting to promote NON_VOTER df8b9755d156478aafca552f9e9c539e to VOTER
I20250625 03:30:54.087780 2636 ts_tablet_manager.cc:1905] T d50c52b197294003b238a37da2fb55d8 P ba464e89e0f044a0a0ea3e6125cbf2a1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250625 03:30:54.089980 2503 consensus_queue.cc:237] T 31885ef6a0c64613ae6723c07f9400b0 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:30:54.093796 1737 raft_consensus.cc:1273] T d9038fc1ce0d4b528c02c68012e1277d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:30:54.095958 1665 raft_consensus.cc:1273] T d9038fc1ce0d4b528c02c68012e1277d P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:30:54.097038 2341 raft_consensus.cc:1273] T d9038fc1ce0d4b528c02c68012e1277d P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:30:54.098352 1737 raft_consensus.cc:1273] T 31885ef6a0c64613ae6723c07f9400b0 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:30:54.098446 2345 raft_consensus.cc:1273] T 31885ef6a0c64613ae6723c07f9400b0 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:30:54.100600 2592 consensus_queue.cc:1035] T 31885ef6a0c64613ae6723c07f9400b0 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:30:54.101871 1589 raft_consensus.cc:1273] T 31885ef6a0c64613ae6723c07f9400b0 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:30:54.102324 2592 consensus_queue.cc:1035] T 31885ef6a0c64613ae6723c07f9400b0 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:30:54.102800 2605 consensus_queue.cc:1035] T d9038fc1ce0d4b528c02c68012e1277d P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:30:54.103241 2626 consensus_queue.cc:1035] T 31885ef6a0c64613ae6723c07f9400b0 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:30:54.104096 2635 consensus_queue.cc:1035] T d9038fc1ce0d4b528c02c68012e1277d P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:30:54.106974 2635 consensus_queue.cc:1035] T d9038fc1ce0d4b528c02c68012e1277d P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:30:54.136119 2594 raft_consensus.cc:1062] T fb6e83db706647e28e491a02f1641980 P ba464e89e0f044a0a0ea3e6125cbf2a1: attempting to promote NON_VOTER df8b9755d156478aafca552f9e9c539e to VOTER
I20250625 03:30:54.139204 2594 consensus_queue.cc:237] T fb6e83db706647e28e491a02f1641980 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:30:54.152323 2592 raft_consensus.cc:2953] T 31885ef6a0c64613ae6723c07f9400b0 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:54.153375 2635 raft_consensus.cc:2953] T d9038fc1ce0d4b528c02c68012e1277d P 7e9c4f2e01164f33b2e9034ed148398e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:54.156693 2636 ts_tablet_manager.cc:1918] T d50c52b197294003b238a37da2fb55d8 P ba464e89e0f044a0a0ea3e6125cbf2a1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20250625 03:30:54.157203 2636 log.cc:1199] T d50c52b197294003b238a37da2fb55d8 P ba464e89e0f044a0a0ea3e6125cbf2a1: Deleting WAL directory at /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/ts-2-root/wals/d50c52b197294003b238a37da2fb55d8
I20250625 03:30:54.157619 2341 raft_consensus.cc:2953] T d9038fc1ce0d4b528c02c68012e1277d P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:54.159183 1480 catalog_manager.cc:4928] TS ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): tablet d50c52b197294003b238a37da2fb55d8 (table test-workload [id=7f663eabec024fd1911b406c660fa838]) successfully deleted
I20250625 03:30:54.156955 2345 raft_consensus.cc:2953] T 31885ef6a0c64613ae6723c07f9400b0 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:54.171749 1589 raft_consensus.cc:2953] T 31885ef6a0c64613ae6723c07f9400b0 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:54.190999 1663 raft_consensus.cc:1273] T fb6e83db706647e28e491a02f1641980 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:30:54.191731 2343 raft_consensus.cc:1273] T fb6e83db706647e28e491a02f1641980 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:30:54.195595 2593 consensus_queue.cc:1035] T fb6e83db706647e28e491a02f1641980 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20250625 03:30:54.176374 1665 raft_consensus.cc:2953] T d9038fc1ce0d4b528c02c68012e1277d P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:54.198622 1591 raft_consensus.cc:1273] T fb6e83db706647e28e491a02f1641980 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:30:54.206835 2638 consensus_queue.cc:1035] T fb6e83db706647e28e491a02f1641980 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20250625 03:30:54.211808 2594 consensus_queue.cc:1035] T fb6e83db706647e28e491a02f1641980 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:30:54.211944 1493 catalog_manager.cc:5582] T 31885ef6a0c64613ae6723c07f9400b0 P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250625 03:30:54.229813 1492 catalog_manager.cc:5582] T d9038fc1ce0d4b528c02c68012e1277d P df8b9755d156478aafca552f9e9c539e reported cstate change: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:54.233309 1739 raft_consensus.cc:2953] T d9038fc1ce0d4b528c02c68012e1277d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:54.285305 1745 raft_consensus.cc:2953] T 31885ef6a0c64613ae6723c07f9400b0 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:54.287750 2638 raft_consensus.cc:2953] T fb6e83db706647e28e491a02f1641980 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:54.290659 1589 consensus_queue.cc:237] T d9038fc1ce0d4b528c02c68012e1277d P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:30:54.298943 1665 raft_consensus.cc:2953] T fb6e83db706647e28e491a02f1641980 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:54.306254 2343 raft_consensus.cc:1273] T d9038fc1ce0d4b528c02c68012e1277d P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250625 03:30:54.304872 2341 raft_consensus.cc:2953] T fb6e83db706647e28e491a02f1641980 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:54.308633 2605 consensus_queue.cc:1035] T d9038fc1ce0d4b528c02c68012e1277d P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:30:54.311208 1737 raft_consensus.cc:1273] T d9038fc1ce0d4b528c02c68012e1277d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250625 03:30:54.315237 2584 consensus_queue.cc:1035] T d9038fc1ce0d4b528c02c68012e1277d P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:30:54.323671 2605 raft_consensus.cc:2953] T d9038fc1ce0d4b528c02c68012e1277d P 7e9c4f2e01164f33b2e9034ed148398e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:54.328819 1663 consensus_queue.cc:237] T 31885ef6a0c64613ae6723c07f9400b0 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:30:54.328388 1737 raft_consensus.cc:2953] T d9038fc1ce0d4b528c02c68012e1277d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:54.324587 1591 raft_consensus.cc:2953] T fb6e83db706647e28e491a02f1641980 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:54.333180 1493 catalog_manager.cc:5582] T fb6e83db706647e28e491a02f1641980 P df8b9755d156478aafca552f9e9c539e reported cstate change: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:54.334831 2345 raft_consensus.cc:1273] T 31885ef6a0c64613ae6723c07f9400b0 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250625 03:30:54.335459 1739 raft_consensus.cc:1273] T 31885ef6a0c64613ae6723c07f9400b0 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250625 03:30:54.336659 2592 consensus_queue.cc:1035] T 31885ef6a0c64613ae6723c07f9400b0 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:30:54.338866 2592 consensus_queue.cc:1035] T 31885ef6a0c64613ae6723c07f9400b0 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:30:54.349416 2503 raft_consensus.cc:2953] T 31885ef6a0c64613ae6723c07f9400b0 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:54.357789 1745 raft_consensus.cc:2953] T 31885ef6a0c64613ae6723c07f9400b0 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:54.355871 2345 raft_consensus.cc:2953] T 31885ef6a0c64613ae6723c07f9400b0 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:54.373389 1479 catalog_manager.cc:5095] ChangeConfig:REMOVE_PEER RPC for tablet d9038fc1ce0d4b528c02c68012e1277d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250625 03:30:54.376976 2343 raft_consensus.cc:2953] T d9038fc1ce0d4b528c02c68012e1277d P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:54.380959 1478 catalog_manager.cc:5095] ChangeConfig:REMOVE_PEER RPC for tablet 31885ef6a0c64613ae6723c07f9400b0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250625 03:30:54.392413 1493 catalog_manager.cc:5582] T d9038fc1ce0d4b528c02c68012e1277d P 7e9c4f2e01164f33b2e9034ed148398e reported cstate change: config changed from index 3 to 4, VOTER 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) evicted. New cstate: current_term: 1 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250625 03:30:54.395308 1494 catalog_manager.cc:5582] T 31885ef6a0c64613ae6723c07f9400b0 P df8b9755d156478aafca552f9e9c539e reported cstate change: config changed from index 3 to 4, VOTER 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) evicted. New cstate: current_term: 1 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:54.413962 1658 tablet_service.cc:1515] Processing DeleteTablet for tablet d9038fc1ce0d4b528c02c68012e1277d with delete_type TABLET_DATA_TOMBSTONED (TS 3f2aa40978064c9e9983cf3745eed206 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53744
I20250625 03:30:54.423913 1737 consensus_queue.cc:237] T fb6e83db706647e28e491a02f1641980 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:30:54.429081 1582 tablet_service.cc:1515] Processing DeleteTablet for tablet 31885ef6a0c64613ae6723c07f9400b0 with delete_type TABLET_DATA_TOMBSTONED (TS 7e9c4f2e01164f33b2e9034ed148398e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52712
I20250625 03:30:54.437680 2345 raft_consensus.cc:1273] T fb6e83db706647e28e491a02f1641980 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250625 03:30:54.438957 1591 raft_consensus.cc:1273] T fb6e83db706647e28e491a02f1641980 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250625 03:30:54.440753 2649 consensus_queue.cc:1035] T fb6e83db706647e28e491a02f1641980 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:30:54.441653 2593 consensus_queue.cc:1035] T fb6e83db706647e28e491a02f1641980 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:30:54.452951 2638 raft_consensus.cc:2953] T fb6e83db706647e28e491a02f1641980 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:54.454386 2345 raft_consensus.cc:2953] T fb6e83db706647e28e491a02f1641980 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:54.464208 1480 catalog_manager.cc:5095] ChangeConfig:REMOVE_PEER RPC for tablet fb6e83db706647e28e491a02f1641980 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250625 03:30:54.471848 1589 raft_consensus.cc:2953] T fb6e83db706647e28e491a02f1641980 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:54.475052 1492 catalog_manager.cc:5582] T fb6e83db706647e28e491a02f1641980 P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: config changed from index 3 to 4, VOTER 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) evicted. New cstate: current_term: 1 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250625 03:30:54.483826 2654 tablet_replica.cc:331] T 31885ef6a0c64613ae6723c07f9400b0 P 7e9c4f2e01164f33b2e9034ed148398e: stopping tablet replica
I20250625 03:30:54.485457 2654 raft_consensus.cc:2241] T 31885ef6a0c64613ae6723c07f9400b0 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:30:54.478591 2653 tablet_replica.cc:331] T d9038fc1ce0d4b528c02c68012e1277d P 3f2aa40978064c9e9983cf3745eed206: stopping tablet replica
I20250625 03:30:54.486284 2654 raft_consensus.cc:2270] T 31885ef6a0c64613ae6723c07f9400b0 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:30:54.486763 2653 raft_consensus.cc:2241] T d9038fc1ce0d4b528c02c68012e1277d P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:30:54.487623 2653 raft_consensus.cc:2270] T d9038fc1ce0d4b528c02c68012e1277d P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:30:54.490021 2654 ts_tablet_manager.cc:1905] T 31885ef6a0c64613ae6723c07f9400b0 P 7e9c4f2e01164f33b2e9034ed148398e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250625 03:30:54.493180 2653 ts_tablet_manager.cc:1905] T d9038fc1ce0d4b528c02c68012e1277d P 3f2aa40978064c9e9983cf3745eed206: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250625 03:30:54.502266 1658 tablet_service.cc:1515] Processing DeleteTablet for tablet fb6e83db706647e28e491a02f1641980 with delete_type TABLET_DATA_TOMBSTONED (TS 3f2aa40978064c9e9983cf3745eed206 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53744
I20250625 03:30:54.521894 2653 ts_tablet_manager.cc:1918] T d9038fc1ce0d4b528c02c68012e1277d P 3f2aa40978064c9e9983cf3745eed206: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20250625 03:30:54.522454 2653 log.cc:1199] T d9038fc1ce0d4b528c02c68012e1277d P 3f2aa40978064c9e9983cf3745eed206: Deleting WAL directory at /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/ts-1-root/wals/d9038fc1ce0d4b528c02c68012e1277d
I20250625 03:30:54.524273 2653 tablet_replica.cc:331] T fb6e83db706647e28e491a02f1641980 P 3f2aa40978064c9e9983cf3745eed206: stopping tablet replica
I20250625 03:30:54.524190 1478 catalog_manager.cc:4928] TS 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): tablet d9038fc1ce0d4b528c02c68012e1277d (table test-workload [id=7f663eabec024fd1911b406c660fa838]) successfully deleted
I20250625 03:30:54.525082 2653 raft_consensus.cc:2241] T fb6e83db706647e28e491a02f1641980 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:30:54.525610 2653 raft_consensus.cc:2270] T fb6e83db706647e28e491a02f1641980 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:30:54.528456 2653 ts_tablet_manager.cc:1905] T fb6e83db706647e28e491a02f1641980 P 3f2aa40978064c9e9983cf3745eed206: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250625 03:30:54.533761 2654 ts_tablet_manager.cc:1918] T 31885ef6a0c64613ae6723c07f9400b0 P 7e9c4f2e01164f33b2e9034ed148398e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20250625 03:30:54.534163 2654 log.cc:1199] T 31885ef6a0c64613ae6723c07f9400b0 P 7e9c4f2e01164f33b2e9034ed148398e: Deleting WAL directory at /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/ts-0-root/wals/31885ef6a0c64613ae6723c07f9400b0
I20250625 03:30:54.535471 1479 catalog_manager.cc:4928] TS 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): tablet 31885ef6a0c64613ae6723c07f9400b0 (table test-workload [id=7f663eabec024fd1911b406c660fa838]) successfully deleted
I20250625 03:30:54.540376 2653 ts_tablet_manager.cc:1918] T fb6e83db706647e28e491a02f1641980 P 3f2aa40978064c9e9983cf3745eed206: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20250625 03:30:54.540761 2653 log.cc:1199] T fb6e83db706647e28e491a02f1641980 P 3f2aa40978064c9e9983cf3745eed206: Deleting WAL directory at /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/ts-1-root/wals/fb6e83db706647e28e491a02f1641980
I20250625 03:30:54.542261 1478 catalog_manager.cc:4928] TS 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): tablet fb6e83db706647e28e491a02f1641980 (table test-workload [id=7f663eabec024fd1911b406c660fa838]) successfully deleted
I20250625 03:30:55.537310 1663 consensus_queue.cc:237] T b3f18b9311894580bc336199d357df41 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:55.542475 1737 raft_consensus.cc:1273] T b3f18b9311894580bc336199d357df41 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 03:30:55.543332 1595 raft_consensus.cc:1273] T b3f18b9311894580bc336199d357df41 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20250625 03:30:55.543617 1634 consensus_peers.cc:487] T b3f18b9311894580bc336199d357df41 P 3f2aa40978064c9e9983cf3745eed206 -> Peer df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493): Couldn't send request to peer df8b9755d156478aafca552f9e9c539e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b3f18b9311894580bc336199d357df41. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:30:55.543850 2656 consensus_queue.cc:1035] T b3f18b9311894580bc336199d357df41 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:30:55.544741 2626 consensus_queue.cc:1035] T b3f18b9311894580bc336199d357df41 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:30:55.552958 2656 raft_consensus.cc:2953] T b3f18b9311894580bc336199d357df41 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:55.556550 1591 raft_consensus.cc:2953] T b3f18b9311894580bc336199d357df41 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:55.558141 1745 raft_consensus.cc:2953] T b3f18b9311894580bc336199d357df41 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:55.566113 1737 consensus_queue.cc:237] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:55.572083 1663 raft_consensus.cc:1273] T 85e02bb33a944989ada7f600c1e802da P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 03:30:55.576356 1494 catalog_manager.cc:5582] T b3f18b9311894580bc336199d357df41 P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New cstate: current_term: 1 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20250625 03:30:55.577482 2649 consensus_queue.cc:1035] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20250625 03:30:55.578976 1708 consensus_peers.cc:487] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493): Couldn't send request to peer df8b9755d156478aafca552f9e9c539e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 85e02bb33a944989ada7f600c1e802da. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:30:55.594606 1663 raft_consensus.cc:2953] T 85e02bb33a944989ada7f600c1e802da P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:55.592342 2649 raft_consensus.cc:2953] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:55.613998 1591 raft_consensus.cc:1273] T 85e02bb33a944989ada7f600c1e802da P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 03:30:55.616223 2660 consensus_queue.cc:1035] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:30:55.637311 1591 raft_consensus.cc:2953] T 85e02bb33a944989ada7f600c1e802da P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:55.646493 1745 consensus_queue.cc:237] T 64add559c121402aa1f7753538a50857 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:55.660198 1663 raft_consensus.cc:1273] T 64add559c121402aa1f7753538a50857 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20250625 03:30:55.660437 1708 consensus_peers.cc:487] T 64add559c121402aa1f7753538a50857 P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493): Couldn't send request to peer df8b9755d156478aafca552f9e9c539e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 64add559c121402aa1f7753538a50857. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:30:55.662897 2667 consensus_queue.cc:1035] T 64add559c121402aa1f7753538a50857 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:30:55.663584 1492 catalog_manager.cc:5582] T 85e02bb33a944989ada7f600c1e802da P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New cstate: current_term: 1 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:55.667318 1591 raft_consensus.cc:1273] T 64add559c121402aa1f7753538a50857 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 03:30:55.669435 2667 consensus_queue.cc:1035] T 64add559c121402aa1f7753538a50857 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20250625 03:30:55.684648 2660 raft_consensus.cc:2953] T 64add559c121402aa1f7753538a50857 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:55.686501 1665 raft_consensus.cc:2953] T 64add559c121402aa1f7753538a50857 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:55.686511 1595 raft_consensus.cc:2953] T 64add559c121402aa1f7753538a50857 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:55.704440 1665 consensus_queue.cc:237] T 390aa72f98414be291f01e4e4fec77f1 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:55.709888 1492 catalog_manager.cc:5582] T 64add559c121402aa1f7753538a50857 P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New cstate: current_term: 1 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:55.716498 1745 raft_consensus.cc:1273] T 390aa72f98414be291f01e4e4fec77f1 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 03:30:55.717042 1595 raft_consensus.cc:1273] T 390aa72f98414be291f01e4e4fec77f1 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20250625 03:30:55.717820 1634 consensus_peers.cc:487] T 390aa72f98414be291f01e4e4fec77f1 P 3f2aa40978064c9e9983cf3745eed206 -> Peer df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493): Couldn't send request to peer df8b9755d156478aafca552f9e9c539e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 390aa72f98414be291f01e4e4fec77f1. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:30:55.717969 2626 consensus_queue.cc:1035] T 390aa72f98414be291f01e4e4fec77f1 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:30:55.719966 2626 consensus_queue.cc:1035] T 390aa72f98414be291f01e4e4fec77f1 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:30:55.743259 2503 raft_consensus.cc:2953] T 390aa72f98414be291f01e4e4fec77f1 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:55.745399 1745 raft_consensus.cc:2953] T 390aa72f98414be291f01e4e4fec77f1 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:55.760897 1491 catalog_manager.cc:5582] T 390aa72f98414be291f01e4e4fec77f1 P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New cstate: current_term: 1 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20250625 03:30:55.761700 1595 raft_consensus.cc:2953] T 390aa72f98414be291f01e4e4fec77f1 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:56.010273 2675 ts_tablet_manager.cc:927] T 85e02bb33a944989ada7f600c1e802da P df8b9755d156478aafca552f9e9c539e: Initiating tablet copy from peer ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:56.012282 2675 tablet_copy_client.cc:323] T 85e02bb33a944989ada7f600c1e802da P df8b9755d156478aafca552f9e9c539e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.106.131:39359
I20250625 03:30:56.013986 1755 tablet_copy_service.cc:140] P ba464e89e0f044a0a0ea3e6125cbf2a1: Received BeginTabletCopySession request for tablet 85e02bb33a944989ada7f600c1e802da from peer df8b9755d156478aafca552f9e9c539e ({username='slave'} at 127.0.0.1:39774)
I20250625 03:30:56.014540 1755 tablet_copy_service.cc:161] P ba464e89e0f044a0a0ea3e6125cbf2a1: Beginning new tablet copy session on tablet 85e02bb33a944989ada7f600c1e802da from peer df8b9755d156478aafca552f9e9c539e at {username='slave'} at 127.0.0.1:39774: session id = df8b9755d156478aafca552f9e9c539e-85e02bb33a944989ada7f600c1e802da
I20250625 03:30:56.021179 1755 tablet_copy_source_session.cc:215] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1: Tablet Copy: opened 0 blocks and 1 log segments
I20250625 03:30:56.023939 2675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85e02bb33a944989ada7f600c1e802da. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:56.038952 2675 tablet_copy_client.cc:806] T 85e02bb33a944989ada7f600c1e802da P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 0 data blocks...
I20250625 03:30:56.039577 2675 tablet_copy_client.cc:670] T 85e02bb33a944989ada7f600c1e802da P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 1 WAL segments...
I20250625 03:30:56.047248 2675 tablet_copy_client.cc:538] T 85e02bb33a944989ada7f600c1e802da P df8b9755d156478aafca552f9e9c539e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250625 03:30:56.058362 2675 tablet_bootstrap.cc:492] T 85e02bb33a944989ada7f600c1e802da P df8b9755d156478aafca552f9e9c539e: Bootstrap starting.
I20250625 03:30:56.076671 2675 tablet_bootstrap.cc:492] T 85e02bb33a944989ada7f600c1e802da P df8b9755d156478aafca552f9e9c539e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:30:56.077512 2675 tablet_bootstrap.cc:492] T 85e02bb33a944989ada7f600c1e802da P df8b9755d156478aafca552f9e9c539e: Bootstrap complete.
I20250625 03:30:56.078092 2675 ts_tablet_manager.cc:1397] T 85e02bb33a944989ada7f600c1e802da P df8b9755d156478aafca552f9e9c539e: Time spent bootstrapping tablet: real 0.020s user 0.013s sys 0.008s
I20250625 03:30:56.080714 2675 raft_consensus.cc:357] T 85e02bb33a944989ada7f600c1e802da P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:56.081676 2675 raft_consensus.cc:738] T 85e02bb33a944989ada7f600c1e802da P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: df8b9755d156478aafca552f9e9c539e, State: Initialized, Role: LEARNER
I20250625 03:30:56.082397 2675 consensus_queue.cc:260] T 85e02bb33a944989ada7f600c1e802da P df8b9755d156478aafca552f9e9c539e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:56.088537 2675 ts_tablet_manager.cc:1428] T 85e02bb33a944989ada7f600c1e802da P df8b9755d156478aafca552f9e9c539e: Time spent starting tablet: real 0.010s user 0.006s sys 0.000s
I20250625 03:30:56.090539 2678 ts_tablet_manager.cc:927] T b3f18b9311894580bc336199d357df41 P df8b9755d156478aafca552f9e9c539e: Initiating tablet copy from peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:56.093107 1755 tablet_copy_service.cc:342] P ba464e89e0f044a0a0ea3e6125cbf2a1: Request end of tablet copy session df8b9755d156478aafca552f9e9c539e-85e02bb33a944989ada7f600c1e802da received from {username='slave'} at 127.0.0.1:39774
I20250625 03:30:56.093564 1755 tablet_copy_service.cc:434] P ba464e89e0f044a0a0ea3e6125cbf2a1: ending tablet copy session df8b9755d156478aafca552f9e9c539e-85e02bb33a944989ada7f600c1e802da on tablet 85e02bb33a944989ada7f600c1e802da with peer df8b9755d156478aafca552f9e9c539e
I20250625 03:30:56.099715 2678 tablet_copy_client.cc:323] T b3f18b9311894580bc336199d357df41 P df8b9755d156478aafca552f9e9c539e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.106.130:34293
I20250625 03:30:56.101366 1680 tablet_copy_service.cc:140] P 3f2aa40978064c9e9983cf3745eed206: Received BeginTabletCopySession request for tablet b3f18b9311894580bc336199d357df41 from peer df8b9755d156478aafca552f9e9c539e ({username='slave'} at 127.0.0.1:55766)
I20250625 03:30:56.101909 1680 tablet_copy_service.cc:161] P 3f2aa40978064c9e9983cf3745eed206: Beginning new tablet copy session on tablet b3f18b9311894580bc336199d357df41 from peer df8b9755d156478aafca552f9e9c539e at {username='slave'} at 127.0.0.1:55766: session id = df8b9755d156478aafca552f9e9c539e-b3f18b9311894580bc336199d357df41
I20250625 03:30:56.108335 1680 tablet_copy_source_session.cc:215] T b3f18b9311894580bc336199d357df41 P 3f2aa40978064c9e9983cf3745eed206: Tablet Copy: opened 0 blocks and 1 log segments
I20250625 03:30:56.111339 2678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3f18b9311894580bc336199d357df41. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:56.125949 2678 tablet_copy_client.cc:806] T b3f18b9311894580bc336199d357df41 P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 0 data blocks...
I20250625 03:30:56.126458 2678 tablet_copy_client.cc:670] T b3f18b9311894580bc336199d357df41 P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 1 WAL segments...
I20250625 03:30:56.129668 2678 tablet_copy_client.cc:538] T b3f18b9311894580bc336199d357df41 P df8b9755d156478aafca552f9e9c539e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250625 03:30:56.138059 2678 tablet_bootstrap.cc:492] T b3f18b9311894580bc336199d357df41 P df8b9755d156478aafca552f9e9c539e: Bootstrap starting.
I20250625 03:30:56.155483 2678 tablet_bootstrap.cc:492] T b3f18b9311894580bc336199d357df41 P df8b9755d156478aafca552f9e9c539e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:30:56.156414 2678 tablet_bootstrap.cc:492] T b3f18b9311894580bc336199d357df41 P df8b9755d156478aafca552f9e9c539e: Bootstrap complete.
I20250625 03:30:56.157063 2678 ts_tablet_manager.cc:1397] T b3f18b9311894580bc336199d357df41 P df8b9755d156478aafca552f9e9c539e: Time spent bootstrapping tablet: real 0.019s user 0.009s sys 0.010s
I20250625 03:30:56.159518 2678 raft_consensus.cc:357] T b3f18b9311894580bc336199d357df41 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:56.160349 2678 raft_consensus.cc:738] T b3f18b9311894580bc336199d357df41 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: df8b9755d156478aafca552f9e9c539e, State: Initialized, Role: LEARNER
I20250625 03:30:56.160924 2678 consensus_queue.cc:260] T b3f18b9311894580bc336199d357df41 P df8b9755d156478aafca552f9e9c539e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:56.163233 2678 ts_tablet_manager.cc:1428] T b3f18b9311894580bc336199d357df41 P df8b9755d156478aafca552f9e9c539e: Time spent starting tablet: real 0.006s user 0.004s sys 0.001s
I20250625 03:30:56.164625 1680 tablet_copy_service.cc:342] P 3f2aa40978064c9e9983cf3745eed206: Request end of tablet copy session df8b9755d156478aafca552f9e9c539e-b3f18b9311894580bc336199d357df41 received from {username='slave'} at 127.0.0.1:55766
I20250625 03:30:56.165033 1680 tablet_copy_service.cc:434] P 3f2aa40978064c9e9983cf3745eed206: ending tablet copy session df8b9755d156478aafca552f9e9c539e-b3f18b9311894580bc336199d357df41 on tablet b3f18b9311894580bc336199d357df41 with peer df8b9755d156478aafca552f9e9c539e
I20250625 03:30:56.175210 2678 ts_tablet_manager.cc:927] T 64add559c121402aa1f7753538a50857 P df8b9755d156478aafca552f9e9c539e: Initiating tablet copy from peer ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:30:56.176746 2678 tablet_copy_client.cc:323] T 64add559c121402aa1f7753538a50857 P df8b9755d156478aafca552f9e9c539e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.106.131:39359
I20250625 03:30:56.178056 1755 tablet_copy_service.cc:140] P ba464e89e0f044a0a0ea3e6125cbf2a1: Received BeginTabletCopySession request for tablet 64add559c121402aa1f7753538a50857 from peer df8b9755d156478aafca552f9e9c539e ({username='slave'} at 127.0.0.1:39774)
I20250625 03:30:56.178519 1755 tablet_copy_service.cc:161] P ba464e89e0f044a0a0ea3e6125cbf2a1: Beginning new tablet copy session on tablet 64add559c121402aa1f7753538a50857 from peer df8b9755d156478aafca552f9e9c539e at {username='slave'} at 127.0.0.1:39774: session id = df8b9755d156478aafca552f9e9c539e-64add559c121402aa1f7753538a50857
I20250625 03:30:56.184898 1755 tablet_copy_source_session.cc:215] T 64add559c121402aa1f7753538a50857 P ba464e89e0f044a0a0ea3e6125cbf2a1: Tablet Copy: opened 0 blocks and 1 log segments
I20250625 03:30:56.187568 2678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64add559c121402aa1f7753538a50857. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:56.202368 2678 tablet_copy_client.cc:806] T 64add559c121402aa1f7753538a50857 P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 0 data blocks...
I20250625 03:30:56.203078 2678 tablet_copy_client.cc:670] T 64add559c121402aa1f7753538a50857 P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 1 WAL segments...
I20250625 03:30:56.206564 2678 tablet_copy_client.cc:538] T 64add559c121402aa1f7753538a50857 P df8b9755d156478aafca552f9e9c539e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250625 03:30:56.214418 2678 tablet_bootstrap.cc:492] T 64add559c121402aa1f7753538a50857 P df8b9755d156478aafca552f9e9c539e: Bootstrap starting.
I20250625 03:30:56.238322 2678 tablet_bootstrap.cc:492] T 64add559c121402aa1f7753538a50857 P df8b9755d156478aafca552f9e9c539e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:30:56.239125 2678 tablet_bootstrap.cc:492] T 64add559c121402aa1f7753538a50857 P df8b9755d156478aafca552f9e9c539e: Bootstrap complete.
I20250625 03:30:56.239739 2678 ts_tablet_manager.cc:1397] T 64add559c121402aa1f7753538a50857 P df8b9755d156478aafca552f9e9c539e: Time spent bootstrapping tablet: real 0.026s user 0.008s sys 0.012s
I20250625 03:30:56.242167 2678 raft_consensus.cc:357] T 64add559c121402aa1f7753538a50857 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:56.243181 2678 raft_consensus.cc:738] T 64add559c121402aa1f7753538a50857 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: df8b9755d156478aafca552f9e9c539e, State: Initialized, Role: LEARNER
I20250625 03:30:56.243897 2678 consensus_queue.cc:260] T 64add559c121402aa1f7753538a50857 P df8b9755d156478aafca552f9e9c539e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:56.248201 2678 ts_tablet_manager.cc:1428] T 64add559c121402aa1f7753538a50857 P df8b9755d156478aafca552f9e9c539e: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20250625 03:30:56.249701 1755 tablet_copy_service.cc:342] P ba464e89e0f044a0a0ea3e6125cbf2a1: Request end of tablet copy session df8b9755d156478aafca552f9e9c539e-64add559c121402aa1f7753538a50857 received from {username='slave'} at 127.0.0.1:39774
I20250625 03:30:56.250160 1755 tablet_copy_service.cc:434] P ba464e89e0f044a0a0ea3e6125cbf2a1: ending tablet copy session df8b9755d156478aafca552f9e9c539e-64add559c121402aa1f7753538a50857 on tablet 64add559c121402aa1f7753538a50857 with peer df8b9755d156478aafca552f9e9c539e
I20250625 03:30:56.262132 2678 ts_tablet_manager.cc:927] T 390aa72f98414be291f01e4e4fec77f1 P df8b9755d156478aafca552f9e9c539e: Initiating tablet copy from peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:56.263726 2678 tablet_copy_client.cc:323] T 390aa72f98414be291f01e4e4fec77f1 P df8b9755d156478aafca552f9e9c539e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.106.130:34293
I20250625 03:30:56.265161 1680 tablet_copy_service.cc:140] P 3f2aa40978064c9e9983cf3745eed206: Received BeginTabletCopySession request for tablet 390aa72f98414be291f01e4e4fec77f1 from peer df8b9755d156478aafca552f9e9c539e ({username='slave'} at 127.0.0.1:55766)
I20250625 03:30:56.265589 1680 tablet_copy_service.cc:161] P 3f2aa40978064c9e9983cf3745eed206: Beginning new tablet copy session on tablet 390aa72f98414be291f01e4e4fec77f1 from peer df8b9755d156478aafca552f9e9c539e at {username='slave'} at 127.0.0.1:55766: session id = df8b9755d156478aafca552f9e9c539e-390aa72f98414be291f01e4e4fec77f1
I20250625 03:30:56.272327 1680 tablet_copy_source_session.cc:215] T 390aa72f98414be291f01e4e4fec77f1 P 3f2aa40978064c9e9983cf3745eed206: Tablet Copy: opened 0 blocks and 1 log segments
I20250625 03:30:56.274799 2678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 390aa72f98414be291f01e4e4fec77f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:56.290645 2678 tablet_copy_client.cc:806] T 390aa72f98414be291f01e4e4fec77f1 P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 0 data blocks...
I20250625 03:30:56.291189 2678 tablet_copy_client.cc:670] T 390aa72f98414be291f01e4e4fec77f1 P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 1 WAL segments...
I20250625 03:30:56.303584 2678 tablet_copy_client.cc:538] T 390aa72f98414be291f01e4e4fec77f1 P df8b9755d156478aafca552f9e9c539e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250625 03:30:56.310672 2678 tablet_bootstrap.cc:492] T 390aa72f98414be291f01e4e4fec77f1 P df8b9755d156478aafca552f9e9c539e: Bootstrap starting.
I20250625 03:30:56.328286 2678 tablet_bootstrap.cc:492] T 390aa72f98414be291f01e4e4fec77f1 P df8b9755d156478aafca552f9e9c539e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:30:56.329099 2678 tablet_bootstrap.cc:492] T 390aa72f98414be291f01e4e4fec77f1 P df8b9755d156478aafca552f9e9c539e: Bootstrap complete.
I20250625 03:30:56.329675 2678 ts_tablet_manager.cc:1397] T 390aa72f98414be291f01e4e4fec77f1 P df8b9755d156478aafca552f9e9c539e: Time spent bootstrapping tablet: real 0.019s user 0.016s sys 0.000s
I20250625 03:30:56.331568 2678 raft_consensus.cc:357] T 390aa72f98414be291f01e4e4fec77f1 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:56.332423 2678 raft_consensus.cc:738] T 390aa72f98414be291f01e4e4fec77f1 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: df8b9755d156478aafca552f9e9c539e, State: Initialized, Role: LEARNER
I20250625 03:30:56.333024 2678 consensus_queue.cc:260] T 390aa72f98414be291f01e4e4fec77f1 P df8b9755d156478aafca552f9e9c539e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:56.334903 2678 ts_tablet_manager.cc:1428] T 390aa72f98414be291f01e4e4fec77f1 P df8b9755d156478aafca552f9e9c539e: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20250625 03:30:56.338075 1680 tablet_copy_service.cc:342] P 3f2aa40978064c9e9983cf3745eed206: Request end of tablet copy session df8b9755d156478aafca552f9e9c539e-390aa72f98414be291f01e4e4fec77f1 received from {username='slave'} at 127.0.0.1:55766
I20250625 03:30:56.338481 1680 tablet_copy_service.cc:434] P 3f2aa40978064c9e9983cf3745eed206: ending tablet copy session df8b9755d156478aafca552f9e9c539e-390aa72f98414be291f01e4e4fec77f1 on tablet 390aa72f98414be291f01e4e4fec77f1 with peer df8b9755d156478aafca552f9e9c539e
I20250625 03:30:56.540691 2345 raft_consensus.cc:1215] T 85e02bb33a944989ada7f600c1e802da P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20250625 03:30:56.564458 2345 raft_consensus.cc:1215] T b3f18b9311894580bc336199d357df41 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20250625 03:30:56.735545 2345 raft_consensus.cc:1215] T 64add559c121402aa1f7753538a50857 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20250625 03:30:56.758270 2345 raft_consensus.cc:1215] T 390aa72f98414be291f01e4e4fec77f1 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20250625 03:30:56.985131 2674 raft_consensus.cc:1062] T b3f18b9311894580bc336199d357df41 P 3f2aa40978064c9e9983cf3745eed206: attempting to promote NON_VOTER df8b9755d156478aafca552f9e9c539e to VOTER
I20250625 03:30:56.987583 2674 consensus_queue.cc:237] T b3f18b9311894580bc336199d357df41 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:30:56.994328 2345 raft_consensus.cc:1273] T b3f18b9311894580bc336199d357df41 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:30:56.994848 1745 raft_consensus.cc:1273] T b3f18b9311894580bc336199d357df41 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:30:56.995532 1595 raft_consensus.cc:1273] T b3f18b9311894580bc336199d357df41 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:30:56.995532 2503 consensus_queue.cc:1035] T b3f18b9311894580bc336199d357df41 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20250625 03:30:56.998311 2503 consensus_queue.cc:1035] T b3f18b9311894580bc336199d357df41 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:30:56.999477 2656 consensus_queue.cc:1035] T b3f18b9311894580bc336199d357df41 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20250625 03:30:57.014242 2674 raft_consensus.cc:2953] T b3f18b9311894580bc336199d357df41 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:57.017691 1745 raft_consensus.cc:2953] T b3f18b9311894580bc336199d357df41 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:57.025655 2345 raft_consensus.cc:2953] T b3f18b9311894580bc336199d357df41 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:57.030676 1595 raft_consensus.cc:2953] T b3f18b9311894580bc336199d357df41 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:57.032449 1491 catalog_manager.cc:5582] T b3f18b9311894580bc336199d357df41 P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250625 03:30:57.081365 1664 consensus_queue.cc:237] T b3f18b9311894580bc336199d357df41 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:30:57.086804 2345 raft_consensus.cc:1273] T b3f18b9311894580bc336199d357df41 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250625 03:30:57.087602 1595 raft_consensus.cc:1273] T b3f18b9311894580bc336199d357df41 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250625 03:30:57.088883 2687 consensus_queue.cc:1035] T b3f18b9311894580bc336199d357df41 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:30:57.089975 2656 consensus_queue.cc:1035] T b3f18b9311894580bc336199d357df41 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:30:57.099161 2656 raft_consensus.cc:2953] T b3f18b9311894580bc336199d357df41 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:57.101352 1591 raft_consensus.cc:2953] T b3f18b9311894580bc336199d357df41 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:57.106375 2660 raft_consensus.cc:1062] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1: attempting to promote NON_VOTER df8b9755d156478aafca552f9e9c539e to VOTER
I20250625 03:30:57.109696 1478 catalog_manager.cc:5095] ChangeConfig:REMOVE_PEER RPC for tablet b3f18b9311894580bc336199d357df41 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250625 03:30:57.112222 2660 consensus_queue.cc:237] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:30:57.115233 2345 raft_consensus.cc:2953] T b3f18b9311894580bc336199d357df41 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:57.120725 1491 catalog_manager.cc:5582] T b3f18b9311894580bc336199d357df41 P 7e9c4f2e01164f33b2e9034ed148398e reported cstate change: config changed from index 3 to 4, VOTER ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) evicted. New cstate: current_term: 1 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:57.130514 2343 raft_consensus.cc:1273] T 85e02bb33a944989ada7f600c1e802da P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:30:57.131079 1664 raft_consensus.cc:1273] T 85e02bb33a944989ada7f600c1e802da P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:30:57.132036 2667 consensus_queue.cc:1035] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:30:57.134697 2667 consensus_queue.cc:1035] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:30:57.135708 1732 tablet_service.cc:1515] Processing DeleteTablet for tablet b3f18b9311894580bc336199d357df41 with delete_type TABLET_DATA_TOMBSTONED (TS ba464e89e0f044a0a0ea3e6125cbf2a1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43672
I20250625 03:30:57.137670 2697 tablet_replica.cc:331] T b3f18b9311894580bc336199d357df41 P ba464e89e0f044a0a0ea3e6125cbf2a1: stopping tablet replica
I20250625 03:30:57.138705 2697 raft_consensus.cc:2241] T b3f18b9311894580bc336199d357df41 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:30:57.139546 2697 raft_consensus.cc:2270] T b3f18b9311894580bc336199d357df41 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:30:57.140349 2667 raft_consensus.cc:1062] T 64add559c121402aa1f7753538a50857 P ba464e89e0f044a0a0ea3e6125cbf2a1: attempting to promote NON_VOTER df8b9755d156478aafca552f9e9c539e to VOTER
I20250625 03:30:57.142716 2667 consensus_queue.cc:237] T 64add559c121402aa1f7753538a50857 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:30:57.145016 2697 ts_tablet_manager.cc:1905] T b3f18b9311894580bc336199d357df41 P ba464e89e0f044a0a0ea3e6125cbf2a1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250625 03:30:57.147830 1591 raft_consensus.cc:1273] T 85e02bb33a944989ada7f600c1e802da P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:30:57.153461 2649 consensus_queue.cc:1035] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:30:57.165486 2697 ts_tablet_manager.cc:1918] T b3f18b9311894580bc336199d357df41 P ba464e89e0f044a0a0ea3e6125cbf2a1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20250625 03:30:57.166086 2697 log.cc:1199] T b3f18b9311894580bc336199d357df41 P ba464e89e0f044a0a0ea3e6125cbf2a1: Deleting WAL directory at /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/ts-2-root/wals/b3f18b9311894580bc336199d357df41
I20250625 03:30:57.168205 1480 catalog_manager.cc:4928] TS ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): tablet b3f18b9311894580bc336199d357df41 (table test-workload [id=7f663eabec024fd1911b406c660fa838]) successfully deleted
I20250625 03:30:57.195873 1665 raft_consensus.cc:1273] T 64add559c121402aa1f7753538a50857 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:30:57.196538 2343 raft_consensus.cc:1273] T 64add559c121402aa1f7753538a50857 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:30:57.199434 2649 consensus_queue.cc:1035] T 64add559c121402aa1f7753538a50857 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:30:57.202600 2649 consensus_queue.cc:1035] T 64add559c121402aa1f7753538a50857 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:30:57.203202 1591 raft_consensus.cc:1273] T 64add559c121402aa1f7753538a50857 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:30:57.205113 2649 raft_consensus.cc:2953] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:57.207122 2700 consensus_queue.cc:1035] T 64add559c121402aa1f7753538a50857 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20250625 03:30:57.207877 1664 raft_consensus.cc:2953] T 85e02bb33a944989ada7f600c1e802da P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:57.217700 1595 raft_consensus.cc:2953] T 85e02bb33a944989ada7f600c1e802da P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:57.225154 1493 catalog_manager.cc:5582] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20250625 03:30:57.230669 2706 raft_consensus.cc:2953] T 64add559c121402aa1f7753538a50857 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:57.237077 1663 raft_consensus.cc:2953] T 64add559c121402aa1f7753538a50857 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:57.240685 1589 raft_consensus.cc:2953] T 64add559c121402aa1f7753538a50857 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:57.256247 2343 raft_consensus.cc:2953] T 64add559c121402aa1f7753538a50857 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:57.259125 1492 catalog_manager.cc:5582] T 64add559c121402aa1f7753538a50857 P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:57.262751 2345 raft_consensus.cc:2953] T 85e02bb33a944989ada7f600c1e802da P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:57.307894 1737 consensus_queue.cc:237] T 64add559c121402aa1f7753538a50857 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:30:57.313486 2343 raft_consensus.cc:1273] T 64add559c121402aa1f7753538a50857 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250625 03:30:57.313868 1595 raft_consensus.cc:1273] T 64add559c121402aa1f7753538a50857 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250625 03:30:57.314690 2706 consensus_queue.cc:1035] T 64add559c121402aa1f7753538a50857 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:30:57.315621 2701 consensus_queue.cc:1035] T 64add559c121402aa1f7753538a50857 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:30:57.323251 2660 raft_consensus.cc:2953] T 64add559c121402aa1f7753538a50857 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:57.325906 1589 raft_consensus.cc:2953] T 64add559c121402aa1f7753538a50857 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:57.334025 2687 raft_consensus.cc:1062] T 390aa72f98414be291f01e4e4fec77f1 P 3f2aa40978064c9e9983cf3745eed206: attempting to promote NON_VOTER df8b9755d156478aafca552f9e9c539e to VOTER
I20250625 03:30:57.336162 2687 consensus_queue.cc:237] T 390aa72f98414be291f01e4e4fec77f1 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:30:57.337746 2343 raft_consensus.cc:2953] T 64add559c121402aa1f7753538a50857 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:57.338764 1480 catalog_manager.cc:5095] ChangeConfig:REMOVE_PEER RPC for tablet 64add559c121402aa1f7753538a50857 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250625 03:30:57.348990 1745 consensus_queue.cc:237] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:30:57.355739 2343 raft_consensus.cc:1273] T 85e02bb33a944989ada7f600c1e802da P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250625 03:30:57.357196 2706 consensus_queue.cc:1035] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:30:57.362462 1492 catalog_manager.cc:5582] T 64add559c121402aa1f7753538a50857 P df8b9755d156478aafca552f9e9c539e reported cstate change: config changed from index 3 to 4, VOTER 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) evicted. New cstate: current_term: 1 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:57.371443 2700 raft_consensus.cc:2953] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:57.376682 1663 raft_consensus.cc:1273] T 85e02bb33a944989ada7f600c1e802da P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250625 03:30:57.380473 2701 consensus_queue.cc:1035] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:30:57.383309 2343 raft_consensus.cc:2953] T 85e02bb33a944989ada7f600c1e802da P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:57.389643 1658 tablet_service.cc:1515] Processing DeleteTablet for tablet 64add559c121402aa1f7753538a50857 with delete_type TABLET_DATA_TOMBSTONED (TS 3f2aa40978064c9e9983cf3745eed206 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53744
I20250625 03:30:57.438822 2345 raft_consensus.cc:1273] T 390aa72f98414be291f01e4e4fec77f1 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:30:57.440606 2674 consensus_queue.cc:1035] T 390aa72f98414be291f01e4e4fec77f1 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:30:57.452553 1589 raft_consensus.cc:1273] T 390aa72f98414be291f01e4e4fec77f1 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:30:57.460557 1745 raft_consensus.cc:1273] T 390aa72f98414be291f01e4e4fec77f1 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:30:57.462517 2674 consensus_queue.cc:1035] T 390aa72f98414be291f01e4e4fec77f1 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:30:57.464800 2674 consensus_queue.cc:1035] T 390aa72f98414be291f01e4e4fec77f1 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:30:57.465263 2712 tablet_replica.cc:331] T 64add559c121402aa1f7753538a50857 P 3f2aa40978064c9e9983cf3745eed206: stopping tablet replica
I20250625 03:30:57.385396 1663 raft_consensus.cc:2953] T 85e02bb33a944989ada7f600c1e802da P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:57.466310 2712 raft_consensus.cc:2241] T 64add559c121402aa1f7753538a50857 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:30:57.467176 2712 raft_consensus.cc:2270] T 64add559c121402aa1f7753538a50857 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:30:57.493348 2712 ts_tablet_manager.cc:1905] T 64add559c121402aa1f7753538a50857 P 3f2aa40978064c9e9983cf3745eed206: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250625 03:30:57.485337 1480 catalog_manager.cc:5095] ChangeConfig:REMOVE_PEER RPC for tablet 85e02bb33a944989ada7f600c1e802da with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250625 03:30:57.477174 1492 catalog_manager.cc:5582] T 85e02bb33a944989ada7f600c1e802da P df8b9755d156478aafca552f9e9c539e reported cstate change: config changed from index 3 to 4, VOTER 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) evicted. New cstate: current_term: 1 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:57.507987 2674 raft_consensus.cc:2953] T 390aa72f98414be291f01e4e4fec77f1 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:57.521974 2345 raft_consensus.cc:2953] T 390aa72f98414be291f01e4e4fec77f1 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:57.525718 1582 tablet_service.cc:1515] Processing DeleteTablet for tablet 85e02bb33a944989ada7f600c1e802da with delete_type TABLET_DATA_TOMBSTONED (TS 7e9c4f2e01164f33b2e9034ed148398e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52712
I20250625 03:30:57.525203 1745 raft_consensus.cc:2953] T 390aa72f98414be291f01e4e4fec77f1 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:57.544698 2717 tablet_replica.cc:331] T 85e02bb33a944989ada7f600c1e802da P 7e9c4f2e01164f33b2e9034ed148398e: stopping tablet replica
I20250625 03:30:57.545792 2717 raft_consensus.cc:2241] T 85e02bb33a944989ada7f600c1e802da P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:30:57.546614 2717 raft_consensus.cc:2270] T 85e02bb33a944989ada7f600c1e802da P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:30:57.551862 2717 ts_tablet_manager.cc:1905] T 85e02bb33a944989ada7f600c1e802da P 7e9c4f2e01164f33b2e9034ed148398e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250625 03:30:57.556062 2712 ts_tablet_manager.cc:1918] T 64add559c121402aa1f7753538a50857 P 3f2aa40978064c9e9983cf3745eed206: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20250625 03:30:57.556581 2712 log.cc:1199] T 64add559c121402aa1f7753538a50857 P 3f2aa40978064c9e9983cf3745eed206: Deleting WAL directory at /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/ts-1-root/wals/64add559c121402aa1f7753538a50857
I20250625 03:30:57.579392 1492 catalog_manager.cc:5582] T 390aa72f98414be291f01e4e4fec77f1 P df8b9755d156478aafca552f9e9c539e reported cstate change: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:57.611665 1478 catalog_manager.cc:4928] TS 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): tablet 64add559c121402aa1f7753538a50857 (table test-workload [id=7f663eabec024fd1911b406c660fa838]) successfully deleted
I20250625 03:30:57.633405 1590 raft_consensus.cc:2953] T 390aa72f98414be291f01e4e4fec77f1 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
W20250625 03:30:57.677258 1636 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.131:39359, user_credentials={real_user=slave}} blocked reactor thread for 86799.7us
W20250625 03:30:57.719928 1634 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.132:34493, user_credentials={real_user=slave}} blocked reactor thread for 121604us
I20250625 03:30:57.728781 2717 ts_tablet_manager.cc:1918] T 85e02bb33a944989ada7f600c1e802da P 7e9c4f2e01164f33b2e9034ed148398e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20250625 03:30:57.737352 2717 log.cc:1199] T 85e02bb33a944989ada7f600c1e802da P 7e9c4f2e01164f33b2e9034ed148398e: Deleting WAL directory at /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/ts-0-root/wals/85e02bb33a944989ada7f600c1e802da
I20250625 03:30:57.743865 1663 consensus_queue.cc:237] T 390aa72f98414be291f01e4e4fec77f1 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:30:57.745237 1479 catalog_manager.cc:4928] TS 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): tablet 85e02bb33a944989ada7f600c1e802da (table test-workload [id=7f663eabec024fd1911b406c660fa838]) successfully deleted
I20250625 03:30:57.766714 2343 raft_consensus.cc:1273] T 390aa72f98414be291f01e4e4fec77f1 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250625 03:30:57.766714 1595 raft_consensus.cc:1273] T 390aa72f98414be291f01e4e4fec77f1 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250625 03:30:57.769316 2674 consensus_queue.cc:1035] T 390aa72f98414be291f01e4e4fec77f1 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20250625 03:30:57.778178 2674 consensus_queue.cc:1035] T 390aa72f98414be291f01e4e4fec77f1 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:30:57.781093 2720 raft_consensus.cc:2953] T 390aa72f98414be291f01e4e4fec77f1 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:57.786955 2343 raft_consensus.cc:2953] T 390aa72f98414be291f01e4e4fec77f1 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:57.805017 1493 catalog_manager.cc:5582] T 390aa72f98414be291f01e4e4fec77f1 P df8b9755d156478aafca552f9e9c539e reported cstate change: config changed from index 3 to 4, VOTER ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) evicted. New cstate: current_term: 1 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:57.812175 1478 catalog_manager.cc:5095] ChangeConfig:REMOVE_PEER RPC for tablet 390aa72f98414be291f01e4e4fec77f1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250625 03:30:57.812896 1590 raft_consensus.cc:2953] T 390aa72f98414be291f01e4e4fec77f1 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:30:57.815192 1732 tablet_service.cc:1515] Processing DeleteTablet for tablet 390aa72f98414be291f01e4e4fec77f1 with delete_type TABLET_DATA_TOMBSTONED (TS ba464e89e0f044a0a0ea3e6125cbf2a1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43672
I20250625 03:30:57.836939 2723 tablet_replica.cc:331] T 390aa72f98414be291f01e4e4fec77f1 P ba464e89e0f044a0a0ea3e6125cbf2a1: stopping tablet replica
I20250625 03:30:57.838080 2723 raft_consensus.cc:2241] T 390aa72f98414be291f01e4e4fec77f1 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:30:57.838693 2723 raft_consensus.cc:2270] T 390aa72f98414be291f01e4e4fec77f1 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:30:57.841751 2723 ts_tablet_manager.cc:1905] T 390aa72f98414be291f01e4e4fec77f1 P ba464e89e0f044a0a0ea3e6125cbf2a1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250625 03:30:57.855986 2723 ts_tablet_manager.cc:1918] T 390aa72f98414be291f01e4e4fec77f1 P ba464e89e0f044a0a0ea3e6125cbf2a1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20250625 03:30:57.856348 2723 log.cc:1199] T 390aa72f98414be291f01e4e4fec77f1 P ba464e89e0f044a0a0ea3e6125cbf2a1: Deleting WAL directory at /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/ts-2-root/wals/390aa72f98414be291f01e4e4fec77f1
I20250625 03:30:57.857609 1480 catalog_manager.cc:4928] TS ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): tablet 390aa72f98414be291f01e4e4fec77f1 (table test-workload [id=7f663eabec024fd1911b406c660fa838]) successfully deleted
I20250625 03:30:58.895577 1663 consensus_queue.cc:237] T 44f429469440455593143983452a9fe3 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
W20250625 03:30:58.903128 1634 consensus_peers.cc:487] T 44f429469440455593143983452a9fe3 P 3f2aa40978064c9e9983cf3745eed206 -> Peer df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493): Couldn't send request to peer df8b9755d156478aafca552f9e9c539e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44f429469440455593143983452a9fe3. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:30:58.904623 1590 raft_consensus.cc:1273] T 44f429469440455593143983452a9fe3 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 03:30:58.904985 1745 raft_consensus.cc:1273] T 44f429469440455593143983452a9fe3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 03:30:58.906484 2724 consensus_queue.cc:1035] T 44f429469440455593143983452a9fe3 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:30:58.907763 2726 consensus_queue.cc:1035] T 44f429469440455593143983452a9fe3 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:30:58.916667 2724 raft_consensus.cc:2953] T 44f429469440455593143983452a9fe3 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:58.918057 1590 raft_consensus.cc:2953] T 44f429469440455593143983452a9fe3 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:58.932593 1663 consensus_queue.cc:237] T 6cc384f27ff041c0be70bb661ae610dd P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:58.934792 1493 catalog_manager.cc:5582] T 44f429469440455593143983452a9fe3 P 7e9c4f2e01164f33b2e9034ed148398e reported cstate change: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New cstate: current_term: 1 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:58.926640 1745 raft_consensus.cc:2953] T 44f429469440455593143983452a9fe3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:58.953251 1744 raft_consensus.cc:1273] T 6cc384f27ff041c0be70bb661ae610dd P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 03:30:58.954494 1590 raft_consensus.cc:1273] T 6cc384f27ff041c0be70bb661ae610dd P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 03:30:58.955868 2720 consensus_queue.cc:1035] T 6cc384f27ff041c0be70bb661ae610dd P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20250625 03:30:58.956753 1634 consensus_peers.cc:487] T 6cc384f27ff041c0be70bb661ae610dd P 3f2aa40978064c9e9983cf3745eed206 -> Peer df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493): Couldn't send request to peer df8b9755d156478aafca552f9e9c539e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6cc384f27ff041c0be70bb661ae610dd. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:30:58.957659 2720 consensus_queue.cc:1035] T 6cc384f27ff041c0be70bb661ae610dd P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:30:58.968406 1590 raft_consensus.cc:2953] T 6cc384f27ff041c0be70bb661ae610dd P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:58.971565 1745 raft_consensus.cc:2953] T 6cc384f27ff041c0be70bb661ae610dd P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:58.966486 2720 raft_consensus.cc:2953] T 6cc384f27ff041c0be70bb661ae610dd P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:58.989431 1590 consensus_queue.cc:237] T 615cebbffcfc44e19b8f7a1e842073a3 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:58.997450 1663 raft_consensus.cc:1273] T 615cebbffcfc44e19b8f7a1e842073a3 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 03:30:58.997609 1745 raft_consensus.cc:1273] T 615cebbffcfc44e19b8f7a1e842073a3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 03:30:59.002077 2721 consensus_queue.cc:1035] T 615cebbffcfc44e19b8f7a1e842073a3 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20250625 03:30:59.002291 1492 catalog_manager.cc:5582] T 6cc384f27ff041c0be70bb661ae610dd P 7e9c4f2e01164f33b2e9034ed148398e reported cstate change: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New cstate: current_term: 1 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
W20250625 03:30:59.004669 1559 consensus_peers.cc:487] T 615cebbffcfc44e19b8f7a1e842073a3 P 7e9c4f2e01164f33b2e9034ed148398e -> Peer df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493): Couldn't send request to peer df8b9755d156478aafca552f9e9c539e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 615cebbffcfc44e19b8f7a1e842073a3. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:30:59.006157 2721 consensus_queue.cc:1035] T 615cebbffcfc44e19b8f7a1e842073a3 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:30:59.012145 2722 raft_consensus.cc:2953] T 615cebbffcfc44e19b8f7a1e842073a3 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:59.015066 1671 raft_consensus.cc:2953] T 615cebbffcfc44e19b8f7a1e842073a3 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:59.027084 1744 raft_consensus.cc:2953] T 615cebbffcfc44e19b8f7a1e842073a3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:59.036765 1590 consensus_queue.cc:237] T 6d7a37b3448d468baa1b9422a6167c9a P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:59.036986 1493 catalog_manager.cc:5582] T 615cebbffcfc44e19b8f7a1e842073a3 P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New cstate: current_term: 1 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:59.046459 1744 raft_consensus.cc:1273] T 6d7a37b3448d468baa1b9422a6167c9a P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20250625 03:30:59.047333 1559 consensus_peers.cc:487] T 6d7a37b3448d468baa1b9422a6167c9a P 7e9c4f2e01164f33b2e9034ed148398e -> Peer df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493): Couldn't send request to peer df8b9755d156478aafca552f9e9c539e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6d7a37b3448d468baa1b9422a6167c9a. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:30:59.047770 1671 raft_consensus.cc:1273] T 6d7a37b3448d468baa1b9422a6167c9a P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 03:30:59.050552 2722 consensus_queue.cc:1035] T 6d7a37b3448d468baa1b9422a6167c9a P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:30:59.052893 2740 consensus_queue.cc:1035] T 6d7a37b3448d468baa1b9422a6167c9a P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:30:59.070595 2722 raft_consensus.cc:2953] T 6d7a37b3448d468baa1b9422a6167c9a P 7e9c4f2e01164f33b2e9034ed148398e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:59.073485 1744 raft_consensus.cc:2953] T 6d7a37b3448d468baa1b9422a6167c9a P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:59.074798 1671 raft_consensus.cc:2953] T 6d7a37b3448d468baa1b9422a6167c9a P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:30:59.102348 1491 catalog_manager.cc:5582] T 6d7a37b3448d468baa1b9422a6167c9a P 7e9c4f2e01164f33b2e9034ed148398e reported cstate change: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New cstate: current_term: 1 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20250625 03:30:59.337253 2743 ts_tablet_manager.cc:927] T 6cc384f27ff041c0be70bb661ae610dd P df8b9755d156478aafca552f9e9c539e: Initiating tablet copy from peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:59.338903 2743 tablet_copy_client.cc:323] T 6cc384f27ff041c0be70bb661ae610dd P df8b9755d156478aafca552f9e9c539e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.106.130:34293
I20250625 03:30:59.340639 1680 tablet_copy_service.cc:140] P 3f2aa40978064c9e9983cf3745eed206: Received BeginTabletCopySession request for tablet 6cc384f27ff041c0be70bb661ae610dd from peer df8b9755d156478aafca552f9e9c539e ({username='slave'} at 127.0.0.1:55766)
I20250625 03:30:59.341081 1680 tablet_copy_service.cc:161] P 3f2aa40978064c9e9983cf3745eed206: Beginning new tablet copy session on tablet 6cc384f27ff041c0be70bb661ae610dd from peer df8b9755d156478aafca552f9e9c539e at {username='slave'} at 127.0.0.1:55766: session id = df8b9755d156478aafca552f9e9c539e-6cc384f27ff041c0be70bb661ae610dd
I20250625 03:30:59.347172 1680 tablet_copy_source_session.cc:215] T 6cc384f27ff041c0be70bb661ae610dd P 3f2aa40978064c9e9983cf3745eed206: Tablet Copy: opened 0 blocks and 1 log segments
I20250625 03:30:59.350512 2743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cc384f27ff041c0be70bb661ae610dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:59.367405 2743 tablet_copy_client.cc:806] T 6cc384f27ff041c0be70bb661ae610dd P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 0 data blocks...
I20250625 03:30:59.368085 2743 tablet_copy_client.cc:670] T 6cc384f27ff041c0be70bb661ae610dd P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 1 WAL segments...
I20250625 03:30:59.371551 2743 tablet_copy_client.cc:538] T 6cc384f27ff041c0be70bb661ae610dd P df8b9755d156478aafca552f9e9c539e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250625 03:30:59.379616 2743 tablet_bootstrap.cc:492] T 6cc384f27ff041c0be70bb661ae610dd P df8b9755d156478aafca552f9e9c539e: Bootstrap starting.
I20250625 03:30:59.399866 2743 tablet_bootstrap.cc:492] T 6cc384f27ff041c0be70bb661ae610dd P df8b9755d156478aafca552f9e9c539e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:30:59.400775 2743 tablet_bootstrap.cc:492] T 6cc384f27ff041c0be70bb661ae610dd P df8b9755d156478aafca552f9e9c539e: Bootstrap complete.
I20250625 03:30:59.401445 2743 ts_tablet_manager.cc:1397] T 6cc384f27ff041c0be70bb661ae610dd P df8b9755d156478aafca552f9e9c539e: Time spent bootstrapping tablet: real 0.022s user 0.018s sys 0.004s
I20250625 03:30:59.405427 2743 raft_consensus.cc:357] T 6cc384f27ff041c0be70bb661ae610dd P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:59.406220 2743 raft_consensus.cc:738] T 6cc384f27ff041c0be70bb661ae610dd P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: df8b9755d156478aafca552f9e9c539e, State: Initialized, Role: LEARNER
I20250625 03:30:59.407716 2743 consensus_queue.cc:260] T 6cc384f27ff041c0be70bb661ae610dd P df8b9755d156478aafca552f9e9c539e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:59.414712 2743 ts_tablet_manager.cc:1428] T 6cc384f27ff041c0be70bb661ae610dd P df8b9755d156478aafca552f9e9c539e: Time spent starting tablet: real 0.013s user 0.008s sys 0.000s
I20250625 03:30:59.416936 1680 tablet_copy_service.cc:342] P 3f2aa40978064c9e9983cf3745eed206: Request end of tablet copy session df8b9755d156478aafca552f9e9c539e-6cc384f27ff041c0be70bb661ae610dd received from {username='slave'} at 127.0.0.1:55766
I20250625 03:30:59.417400 1680 tablet_copy_service.cc:434] P 3f2aa40978064c9e9983cf3745eed206: ending tablet copy session df8b9755d156478aafca552f9e9c539e-6cc384f27ff041c0be70bb661ae610dd on tablet 6cc384f27ff041c0be70bb661ae610dd with peer df8b9755d156478aafca552f9e9c539e
I20250625 03:30:59.420387 2743 ts_tablet_manager.cc:927] T 615cebbffcfc44e19b8f7a1e842073a3 P df8b9755d156478aafca552f9e9c539e: Initiating tablet copy from peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903)
I20250625 03:30:59.429682 2743 tablet_copy_client.cc:323] T 615cebbffcfc44e19b8f7a1e842073a3 P df8b9755d156478aafca552f9e9c539e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.106.129:39903
I20250625 03:30:59.431483 1606 tablet_copy_service.cc:140] P 7e9c4f2e01164f33b2e9034ed148398e: Received BeginTabletCopySession request for tablet 615cebbffcfc44e19b8f7a1e842073a3 from peer df8b9755d156478aafca552f9e9c539e ({username='slave'} at 127.0.0.1:44210)
I20250625 03:30:59.432000 1606 tablet_copy_service.cc:161] P 7e9c4f2e01164f33b2e9034ed148398e: Beginning new tablet copy session on tablet 615cebbffcfc44e19b8f7a1e842073a3 from peer df8b9755d156478aafca552f9e9c539e at {username='slave'} at 127.0.0.1:44210: session id = df8b9755d156478aafca552f9e9c539e-615cebbffcfc44e19b8f7a1e842073a3
I20250625 03:30:59.437490 1606 tablet_copy_source_session.cc:215] T 615cebbffcfc44e19b8f7a1e842073a3 P 7e9c4f2e01164f33b2e9034ed148398e: Tablet Copy: opened 0 blocks and 1 log segments
I20250625 03:30:59.439934 2743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 615cebbffcfc44e19b8f7a1e842073a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:59.453498 2743 tablet_copy_client.cc:806] T 615cebbffcfc44e19b8f7a1e842073a3 P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 0 data blocks...
I20250625 03:30:59.454072 2743 tablet_copy_client.cc:670] T 615cebbffcfc44e19b8f7a1e842073a3 P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 1 WAL segments...
I20250625 03:30:59.457063 2743 tablet_copy_client.cc:538] T 615cebbffcfc44e19b8f7a1e842073a3 P df8b9755d156478aafca552f9e9c539e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250625 03:30:59.466208 2743 tablet_bootstrap.cc:492] T 615cebbffcfc44e19b8f7a1e842073a3 P df8b9755d156478aafca552f9e9c539e: Bootstrap starting.
I20250625 03:30:59.484494 2743 tablet_bootstrap.cc:492] T 615cebbffcfc44e19b8f7a1e842073a3 P df8b9755d156478aafca552f9e9c539e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:30:59.485251 2743 tablet_bootstrap.cc:492] T 615cebbffcfc44e19b8f7a1e842073a3 P df8b9755d156478aafca552f9e9c539e: Bootstrap complete.
I20250625 03:30:59.485832 2743 ts_tablet_manager.cc:1397] T 615cebbffcfc44e19b8f7a1e842073a3 P df8b9755d156478aafca552f9e9c539e: Time spent bootstrapping tablet: real 0.020s user 0.014s sys 0.003s
I20250625 03:30:59.488166 2743 raft_consensus.cc:357] T 615cebbffcfc44e19b8f7a1e842073a3 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:59.488809 2743 raft_consensus.cc:738] T 615cebbffcfc44e19b8f7a1e842073a3 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: df8b9755d156478aafca552f9e9c539e, State: Initialized, Role: LEARNER
I20250625 03:30:59.489317 2743 consensus_queue.cc:260] T 615cebbffcfc44e19b8f7a1e842073a3 P df8b9755d156478aafca552f9e9c539e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:59.491750 2743 ts_tablet_manager.cc:1428] T 615cebbffcfc44e19b8f7a1e842073a3 P df8b9755d156478aafca552f9e9c539e: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20250625 03:30:59.493489 1606 tablet_copy_service.cc:342] P 7e9c4f2e01164f33b2e9034ed148398e: Request end of tablet copy session df8b9755d156478aafca552f9e9c539e-615cebbffcfc44e19b8f7a1e842073a3 received from {username='slave'} at 127.0.0.1:44210
I20250625 03:30:59.493856 1606 tablet_copy_service.cc:434] P 7e9c4f2e01164f33b2e9034ed148398e: ending tablet copy session df8b9755d156478aafca552f9e9c539e-615cebbffcfc44e19b8f7a1e842073a3 on tablet 615cebbffcfc44e19b8f7a1e842073a3 with peer df8b9755d156478aafca552f9e9c539e
I20250625 03:30:59.512252 2743 ts_tablet_manager.cc:927] T 44f429469440455593143983452a9fe3 P df8b9755d156478aafca552f9e9c539e: Initiating tablet copy from peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:30:59.514631 2743 tablet_copy_client.cc:323] T 44f429469440455593143983452a9fe3 P df8b9755d156478aafca552f9e9c539e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.106.130:34293
I20250625 03:30:59.516044 1680 tablet_copy_service.cc:140] P 3f2aa40978064c9e9983cf3745eed206: Received BeginTabletCopySession request for tablet 44f429469440455593143983452a9fe3 from peer df8b9755d156478aafca552f9e9c539e ({username='slave'} at 127.0.0.1:55766)
I20250625 03:30:59.516558 1680 tablet_copy_service.cc:161] P 3f2aa40978064c9e9983cf3745eed206: Beginning new tablet copy session on tablet 44f429469440455593143983452a9fe3 from peer df8b9755d156478aafca552f9e9c539e at {username='slave'} at 127.0.0.1:55766: session id = df8b9755d156478aafca552f9e9c539e-44f429469440455593143983452a9fe3
I20250625 03:30:59.524583 1680 tablet_copy_source_session.cc:215] T 44f429469440455593143983452a9fe3 P 3f2aa40978064c9e9983cf3745eed206: Tablet Copy: opened 0 blocks and 1 log segments
I20250625 03:30:59.527377 2743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44f429469440455593143983452a9fe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:59.542268 2743 tablet_copy_client.cc:806] T 44f429469440455593143983452a9fe3 P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 0 data blocks...
I20250625 03:30:59.542807 2743 tablet_copy_client.cc:670] T 44f429469440455593143983452a9fe3 P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 1 WAL segments...
I20250625 03:30:59.545747 2743 tablet_copy_client.cc:538] T 44f429469440455593143983452a9fe3 P df8b9755d156478aafca552f9e9c539e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250625 03:30:59.553289 2743 tablet_bootstrap.cc:492] T 44f429469440455593143983452a9fe3 P df8b9755d156478aafca552f9e9c539e: Bootstrap starting.
I20250625 03:30:59.568703 2743 tablet_bootstrap.cc:492] T 44f429469440455593143983452a9fe3 P df8b9755d156478aafca552f9e9c539e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:30:59.569422 2743 tablet_bootstrap.cc:492] T 44f429469440455593143983452a9fe3 P df8b9755d156478aafca552f9e9c539e: Bootstrap complete.
I20250625 03:30:59.569967 2743 ts_tablet_manager.cc:1397] T 44f429469440455593143983452a9fe3 P df8b9755d156478aafca552f9e9c539e: Time spent bootstrapping tablet: real 0.017s user 0.015s sys 0.000s
I20250625 03:30:59.571959 2743 raft_consensus.cc:357] T 44f429469440455593143983452a9fe3 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:59.572628 2743 raft_consensus.cc:738] T 44f429469440455593143983452a9fe3 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: df8b9755d156478aafca552f9e9c539e, State: Initialized, Role: LEARNER
I20250625 03:30:59.573163 2743 consensus_queue.cc:260] T 44f429469440455593143983452a9fe3 P df8b9755d156478aafca552f9e9c539e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:59.575290 2743 ts_tablet_manager.cc:1428] T 44f429469440455593143983452a9fe3 P df8b9755d156478aafca552f9e9c539e: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20250625 03:30:59.577757 1680 tablet_copy_service.cc:342] P 3f2aa40978064c9e9983cf3745eed206: Request end of tablet copy session df8b9755d156478aafca552f9e9c539e-44f429469440455593143983452a9fe3 received from {username='slave'} at 127.0.0.1:55766
I20250625 03:30:59.578166 1680 tablet_copy_service.cc:434] P 3f2aa40978064c9e9983cf3745eed206: ending tablet copy session df8b9755d156478aafca552f9e9c539e-44f429469440455593143983452a9fe3 on tablet 44f429469440455593143983452a9fe3 with peer df8b9755d156478aafca552f9e9c539e
I20250625 03:30:59.586441 2743 ts_tablet_manager.cc:927] T 6d7a37b3448d468baa1b9422a6167c9a P df8b9755d156478aafca552f9e9c539e: Initiating tablet copy from peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903)
I20250625 03:30:59.602564 2743 tablet_copy_client.cc:323] T 6d7a37b3448d468baa1b9422a6167c9a P df8b9755d156478aafca552f9e9c539e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.106.129:39903
I20250625 03:30:59.604198 1606 tablet_copy_service.cc:140] P 7e9c4f2e01164f33b2e9034ed148398e: Received BeginTabletCopySession request for tablet 6d7a37b3448d468baa1b9422a6167c9a from peer df8b9755d156478aafca552f9e9c539e ({username='slave'} at 127.0.0.1:44210)
I20250625 03:30:59.604756 1606 tablet_copy_service.cc:161] P 7e9c4f2e01164f33b2e9034ed148398e: Beginning new tablet copy session on tablet 6d7a37b3448d468baa1b9422a6167c9a from peer df8b9755d156478aafca552f9e9c539e at {username='slave'} at 127.0.0.1:44210: session id = df8b9755d156478aafca552f9e9c539e-6d7a37b3448d468baa1b9422a6167c9a
I20250625 03:30:59.612289 1606 tablet_copy_source_session.cc:215] T 6d7a37b3448d468baa1b9422a6167c9a P 7e9c4f2e01164f33b2e9034ed148398e: Tablet Copy: opened 0 blocks and 1 log segments
I20250625 03:30:59.615257 2743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d7a37b3448d468baa1b9422a6167c9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:30:59.633131 2743 tablet_copy_client.cc:806] T 6d7a37b3448d468baa1b9422a6167c9a P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 0 data blocks...
I20250625 03:30:59.633801 2743 tablet_copy_client.cc:670] T 6d7a37b3448d468baa1b9422a6167c9a P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 1 WAL segments...
I20250625 03:30:59.637068 2743 tablet_copy_client.cc:538] T 6d7a37b3448d468baa1b9422a6167c9a P df8b9755d156478aafca552f9e9c539e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250625 03:30:59.645537 2743 tablet_bootstrap.cc:492] T 6d7a37b3448d468baa1b9422a6167c9a P df8b9755d156478aafca552f9e9c539e: Bootstrap starting.
I20250625 03:30:59.663810 2743 tablet_bootstrap.cc:492] T 6d7a37b3448d468baa1b9422a6167c9a P df8b9755d156478aafca552f9e9c539e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:30:59.664655 2743 tablet_bootstrap.cc:492] T 6d7a37b3448d468baa1b9422a6167c9a P df8b9755d156478aafca552f9e9c539e: Bootstrap complete.
I20250625 03:30:59.665331 2743 ts_tablet_manager.cc:1397] T 6d7a37b3448d468baa1b9422a6167c9a P df8b9755d156478aafca552f9e9c539e: Time spent bootstrapping tablet: real 0.020s user 0.015s sys 0.004s
I20250625 03:30:59.667354 2743 raft_consensus.cc:357] T 6d7a37b3448d468baa1b9422a6167c9a P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:59.668218 2743 raft_consensus.cc:738] T 6d7a37b3448d468baa1b9422a6167c9a P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: df8b9755d156478aafca552f9e9c539e, State: Initialized, Role: LEARNER
I20250625 03:30:59.668809 2743 consensus_queue.cc:260] T 6d7a37b3448d468baa1b9422a6167c9a P df8b9755d156478aafca552f9e9c539e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:30:59.670846 2743 ts_tablet_manager.cc:1428] T 6d7a37b3448d468baa1b9422a6167c9a P df8b9755d156478aafca552f9e9c539e: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20250625 03:30:59.673219 1606 tablet_copy_service.cc:342] P 7e9c4f2e01164f33b2e9034ed148398e: Request end of tablet copy session df8b9755d156478aafca552f9e9c539e-6d7a37b3448d468baa1b9422a6167c9a received from {username='slave'} at 127.0.0.1:44210
I20250625 03:30:59.673676 1606 tablet_copy_service.cc:434] P 7e9c4f2e01164f33b2e9034ed148398e: ending tablet copy session df8b9755d156478aafca552f9e9c539e-6d7a37b3448d468baa1b9422a6167c9a on tablet 6d7a37b3448d468baa1b9422a6167c9a with peer df8b9755d156478aafca552f9e9c539e
I20250625 03:30:59.742956 2341 raft_consensus.cc:1215] T 6cc384f27ff041c0be70bb661ae610dd P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20250625 03:30:59.977475 2343 raft_consensus.cc:1215] T 615cebbffcfc44e19b8f7a1e842073a3 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20250625 03:30:59.990906 2343 raft_consensus.cc:1215] T 6d7a37b3448d468baa1b9422a6167c9a P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20250625 03:31:00.072238 2343 raft_consensus.cc:1215] T 44f429469440455593143983452a9fe3 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20250625 03:31:00.318697 2750 raft_consensus.cc:1062] T 6cc384f27ff041c0be70bb661ae610dd P 3f2aa40978064c9e9983cf3745eed206: attempting to promote NON_VOTER df8b9755d156478aafca552f9e9c539e to VOTER
I20250625 03:31:00.321250 2750 consensus_queue.cc:237] T 6cc384f27ff041c0be70bb661ae610dd P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:00.330008 2341 raft_consensus.cc:1273] T 6cc384f27ff041c0be70bb661ae610dd P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:31:00.333230 1744 raft_consensus.cc:1273] T 6cc384f27ff041c0be70bb661ae610dd P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:31:00.333849 2758 consensus_queue.cc:1035] T 6cc384f27ff041c0be70bb661ae610dd P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:31:00.334877 2724 consensus_queue.cc:1035] T 6cc384f27ff041c0be70bb661ae610dd P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:31:00.335320 1590 raft_consensus.cc:1273] T 6cc384f27ff041c0be70bb661ae610dd P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:31:00.339884 2726 consensus_queue.cc:1035] T 6cc384f27ff041c0be70bb661ae610dd P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:31:00.356376 2726 raft_consensus.cc:2953] T 6cc384f27ff041c0be70bb661ae610dd P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:00.357628 1744 raft_consensus.cc:2953] T 6cc384f27ff041c0be70bb661ae610dd P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:00.365073 2341 raft_consensus.cc:2953] T 6cc384f27ff041c0be70bb661ae610dd P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:00.370447 1591 raft_consensus.cc:2953] T 6cc384f27ff041c0be70bb661ae610dd P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:00.375804 1492 catalog_manager.cc:5582] T 6cc384f27ff041c0be70bb661ae610dd P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250625 03:31:00.427752 1671 consensus_queue.cc:237] T 6cc384f27ff041c0be70bb661ae610dd P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:00.437453 2341 raft_consensus.cc:1273] T 6cc384f27ff041c0be70bb661ae610dd P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250625 03:31:00.439657 1744 raft_consensus.cc:1273] T 6cc384f27ff041c0be70bb661ae610dd P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250625 03:31:00.441617 2724 consensus_queue.cc:1035] T 6cc384f27ff041c0be70bb661ae610dd P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:31:00.444216 2758 consensus_queue.cc:1035] T 6cc384f27ff041c0be70bb661ae610dd P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:31:00.451876 2726 raft_consensus.cc:2953] T 6cc384f27ff041c0be70bb661ae610dd P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:00.455247 2341 raft_consensus.cc:2953] T 6cc384f27ff041c0be70bb661ae610dd P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:00.456763 1744 raft_consensus.cc:2953] T 6cc384f27ff041c0be70bb661ae610dd P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:00.459985 1478 catalog_manager.cc:5095] ChangeConfig:REMOVE_PEER RPC for tablet 6cc384f27ff041c0be70bb661ae610dd with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250625 03:31:00.470001 1491 catalog_manager.cc:5582] T 6cc384f27ff041c0be70bb661ae610dd P df8b9755d156478aafca552f9e9c539e reported cstate change: config changed from index 3 to 4, VOTER 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) evicted. New cstate: current_term: 1 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:00.485756 1582 tablet_service.cc:1515] Processing DeleteTablet for tablet 6cc384f27ff041c0be70bb661ae610dd with delete_type TABLET_DATA_TOMBSTONED (TS 7e9c4f2e01164f33b2e9034ed148398e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52712
I20250625 03:31:00.487612 2767 tablet_replica.cc:331] T 6cc384f27ff041c0be70bb661ae610dd P 7e9c4f2e01164f33b2e9034ed148398e: stopping tablet replica
I20250625 03:31:00.488713 2767 raft_consensus.cc:2241] T 6cc384f27ff041c0be70bb661ae610dd P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:00.489584 2767 raft_consensus.cc:2270] T 6cc384f27ff041c0be70bb661ae610dd P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:00.492839 2767 ts_tablet_manager.cc:1905] T 6cc384f27ff041c0be70bb661ae610dd P 7e9c4f2e01164f33b2e9034ed148398e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250625 03:31:00.509868 2756 raft_consensus.cc:1062] T 615cebbffcfc44e19b8f7a1e842073a3 P 7e9c4f2e01164f33b2e9034ed148398e: attempting to promote NON_VOTER df8b9755d156478aafca552f9e9c539e to VOTER
I20250625 03:31:00.511371 2767 ts_tablet_manager.cc:1918] T 6cc384f27ff041c0be70bb661ae610dd P 7e9c4f2e01164f33b2e9034ed148398e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20250625 03:31:00.511967 2767 log.cc:1199] T 6cc384f27ff041c0be70bb661ae610dd P 7e9c4f2e01164f33b2e9034ed148398e: Deleting WAL directory at /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/ts-0-root/wals/6cc384f27ff041c0be70bb661ae610dd
I20250625 03:31:00.512393 2756 consensus_queue.cc:237] T 615cebbffcfc44e19b8f7a1e842073a3 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:00.513427 1479 catalog_manager.cc:4928] TS 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): tablet 6cc384f27ff041c0be70bb661ae610dd (table test-workload [id=7f663eabec024fd1911b406c660fa838]) successfully deleted
I20250625 03:31:00.520303 2740 raft_consensus.cc:1062] T 6d7a37b3448d468baa1b9422a6167c9a P 7e9c4f2e01164f33b2e9034ed148398e: attempting to promote NON_VOTER df8b9755d156478aafca552f9e9c539e to VOTER
I20250625 03:31:00.525707 1744 raft_consensus.cc:1273] T 615cebbffcfc44e19b8f7a1e842073a3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:31:00.527523 2770 consensus_queue.cc:1035] T 615cebbffcfc44e19b8f7a1e842073a3 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20250625 03:31:00.527912 2341 raft_consensus.cc:1273] T 615cebbffcfc44e19b8f7a1e842073a3 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:31:00.529079 1665 raft_consensus.cc:1273] T 615cebbffcfc44e19b8f7a1e842073a3 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:31:00.529271 2756 consensus_queue.cc:1035] T 615cebbffcfc44e19b8f7a1e842073a3 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:31:00.530175 2740 consensus_queue.cc:237] T 6d7a37b3448d468baa1b9422a6167c9a P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:00.530929 2756 consensus_queue.cc:1035] T 615cebbffcfc44e19b8f7a1e842073a3 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:31:00.539932 2770 raft_consensus.cc:2953] T 615cebbffcfc44e19b8f7a1e842073a3 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:00.542716 2726 raft_consensus.cc:1062] T 44f429469440455593143983452a9fe3 P 3f2aa40978064c9e9983cf3745eed206: attempting to promote NON_VOTER df8b9755d156478aafca552f9e9c539e to VOTER
I20250625 03:31:00.554114 1744 raft_consensus.cc:1273] T 6d7a37b3448d468baa1b9422a6167c9a P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:31:00.554945 2343 raft_consensus.cc:1273] T 6d7a37b3448d468baa1b9422a6167c9a P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:31:00.557610 2769 consensus_queue.cc:1035] T 6d7a37b3448d468baa1b9422a6167c9a P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20250625 03:31:00.556952 1744 raft_consensus.cc:2953] T 615cebbffcfc44e19b8f7a1e842073a3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:00.563194 2769 consensus_queue.cc:1035] T 6d7a37b3448d468baa1b9422a6167c9a P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20250625 03:31:00.569011 2726 consensus_queue.cc:237] T 44f429469440455593143983452a9fe3 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:00.577164 2343 raft_consensus.cc:2953] T 615cebbffcfc44e19b8f7a1e842073a3 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:00.586190 1665 raft_consensus.cc:2953] T 615cebbffcfc44e19b8f7a1e842073a3 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:00.587253 1491 catalog_manager.cc:5582] T 615cebbffcfc44e19b8f7a1e842073a3 P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:00.589964 1663 raft_consensus.cc:1273] T 6d7a37b3448d468baa1b9422a6167c9a P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:31:00.594764 2770 consensus_queue.cc:1035] T 6d7a37b3448d468baa1b9422a6167c9a P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:31:00.633410 2776 raft_consensus.cc:2953] T 6d7a37b3448d468baa1b9422a6167c9a P 7e9c4f2e01164f33b2e9034ed148398e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:00.639051 2345 raft_consensus.cc:1273] T 44f429469440455593143983452a9fe3 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:31:00.640643 2758 consensus_queue.cc:1035] T 44f429469440455593143983452a9fe3 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:31:00.641150 1671 raft_consensus.cc:2953] T 6d7a37b3448d468baa1b9422a6167c9a P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:00.639767 1744 raft_consensus.cc:1273] T 44f429469440455593143983452a9fe3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:31:00.644837 2750 consensus_queue.cc:1035] T 44f429469440455593143983452a9fe3 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20250625 03:31:00.652527 1590 consensus_queue.cc:237] T 615cebbffcfc44e19b8f7a1e842073a3 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
W20250625 03:31:00.656157 1708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.130:34293, user_credentials={real_user=slave}} blocked reactor thread for 48444.2us
I20250625 03:31:00.657473 1590 raft_consensus.cc:1273] T 44f429469440455593143983452a9fe3 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:31:00.663793 1745 raft_consensus.cc:1273] T 615cebbffcfc44e19b8f7a1e842073a3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250625 03:31:00.664234 2758 consensus_queue.cc:1035] T 44f429469440455593143983452a9fe3 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20250625 03:31:00.665946 2740 consensus_queue.cc:1035] T 615cebbffcfc44e19b8f7a1e842073a3 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:31:00.670195 2343 raft_consensus.cc:1273] T 615cebbffcfc44e19b8f7a1e842073a3 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250625 03:31:00.671984 2775 consensus_queue.cc:1035] T 615cebbffcfc44e19b8f7a1e842073a3 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20250625 03:31:00.673934 2769 raft_consensus.cc:2953] T 615cebbffcfc44e19b8f7a1e842073a3 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:00.685928 1745 raft_consensus.cc:2953] T 615cebbffcfc44e19b8f7a1e842073a3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:00.691103 2758 raft_consensus.cc:2953] T 44f429469440455593143983452a9fe3 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:00.696206 2345 raft_consensus.cc:2953] T 615cebbffcfc44e19b8f7a1e842073a3 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:00.698428 1479 catalog_manager.cc:5095] ChangeConfig:REMOVE_PEER RPC for tablet 615cebbffcfc44e19b8f7a1e842073a3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250625 03:31:00.699240 1744 raft_consensus.cc:2953] T 44f429469440455593143983452a9fe3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:00.712329 2343 raft_consensus.cc:2953] T 6d7a37b3448d468baa1b9422a6167c9a P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:00.712904 1491 catalog_manager.cc:5582] T 615cebbffcfc44e19b8f7a1e842073a3 P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: config changed from index 3 to 4, VOTER 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) evicted. New cstate: current_term: 1 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:00.696573 1590 raft_consensus.cc:2953] T 44f429469440455593143983452a9fe3 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:00.728806 1737 raft_consensus.cc:2953] T 6d7a37b3448d468baa1b9422a6167c9a P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:00.729645 1494 catalog_manager.cc:5582] T 6d7a37b3448d468baa1b9422a6167c9a P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:00.742054 1658 tablet_service.cc:1515] Processing DeleteTablet for tablet 615cebbffcfc44e19b8f7a1e842073a3 with delete_type TABLET_DATA_TOMBSTONED (TS 3f2aa40978064c9e9983cf3745eed206 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53744
I20250625 03:31:00.744817 2341 raft_consensus.cc:2953] T 44f429469440455593143983452a9fe3 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:00.761173 1493 catalog_manager.cc:5582] T 44f429469440455593143983452a9fe3 P df8b9755d156478aafca552f9e9c539e reported cstate change: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:00.762051 1595 consensus_queue.cc:237] T 6d7a37b3448d468baa1b9422a6167c9a P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:00.777559 1671 raft_consensus.cc:1273] T 6d7a37b3448d468baa1b9422a6167c9a P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250625 03:31:00.780987 2769 consensus_queue.cc:1035] T 6d7a37b3448d468baa1b9422a6167c9a P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20250625 03:31:00.792249 2776 raft_consensus.cc:2953] T 6d7a37b3448d468baa1b9422a6167c9a P 7e9c4f2e01164f33b2e9034ed148398e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:00.797168 1663 raft_consensus.cc:2953] T 6d7a37b3448d468baa1b9422a6167c9a P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:00.806586 2345 raft_consensus.cc:1273] T 6d7a37b3448d468baa1b9422a6167c9a P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250625 03:31:00.814253 2740 consensus_queue.cc:1035] T 6d7a37b3448d468baa1b9422a6167c9a P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:31:00.817512 1479 catalog_manager.cc:5095] ChangeConfig:REMOVE_PEER RPC for tablet 6d7a37b3448d468baa1b9422a6167c9a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250625 03:31:00.821375 2786 tablet_replica.cc:331] T 615cebbffcfc44e19b8f7a1e842073a3 P 3f2aa40978064c9e9983cf3745eed206: stopping tablet replica
I20250625 03:31:00.821110 2343 raft_consensus.cc:2953] T 6d7a37b3448d468baa1b9422a6167c9a P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:00.824259 1671 consensus_queue.cc:237] T 44f429469440455593143983452a9fe3 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:00.830296 1737 raft_consensus.cc:1273] T 44f429469440455593143983452a9fe3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250625 03:31:00.832259 2724 consensus_queue.cc:1035] T 44f429469440455593143983452a9fe3 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:31:00.822548 2786 raft_consensus.cc:2241] T 615cebbffcfc44e19b8f7a1e842073a3 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:00.835661 2786 raft_consensus.cc:2270] T 615cebbffcfc44e19b8f7a1e842073a3 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:00.836475 2345 raft_consensus.cc:1273] T 44f429469440455593143983452a9fe3 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250625 03:31:00.838663 2726 consensus_queue.cc:1035] T 44f429469440455593143983452a9fe3 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:31:00.839804 1491 catalog_manager.cc:5582] T 6d7a37b3448d468baa1b9422a6167c9a P 7e9c4f2e01164f33b2e9034ed148398e reported cstate change: config changed from index 3 to 4, VOTER ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) evicted. New cstate: current_term: 1 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:00.847147 2782 raft_consensus.cc:2953] T 44f429469440455593143983452a9fe3 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:00.849745 2786 ts_tablet_manager.cc:1905] T 615cebbffcfc44e19b8f7a1e842073a3 P 3f2aa40978064c9e9983cf3745eed206: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250625 03:31:00.854097 1737 raft_consensus.cc:2953] T 44f429469440455593143983452a9fe3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:00.859730 2343 raft_consensus.cc:2953] T 44f429469440455593143983452a9fe3 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:00.860752 1478 catalog_manager.cc:5095] ChangeConfig:REMOVE_PEER RPC for tablet 44f429469440455593143983452a9fe3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250625 03:31:00.866748 2786 ts_tablet_manager.cc:1918] T 615cebbffcfc44e19b8f7a1e842073a3 P 3f2aa40978064c9e9983cf3745eed206: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20250625 03:31:00.867276 2786 log.cc:1199] T 615cebbffcfc44e19b8f7a1e842073a3 P 3f2aa40978064c9e9983cf3745eed206: Deleting WAL directory at /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/ts-1-root/wals/615cebbffcfc44e19b8f7a1e842073a3
I20250625 03:31:00.868225 1732 tablet_service.cc:1515] Processing DeleteTablet for tablet 6d7a37b3448d468baa1b9422a6167c9a with delete_type TABLET_DATA_TOMBSTONED (TS ba464e89e0f044a0a0ea3e6125cbf2a1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43672
I20250625 03:31:00.869243 1478 catalog_manager.cc:4928] TS 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): tablet 615cebbffcfc44e19b8f7a1e842073a3 (table test-workload [id=7f663eabec024fd1911b406c660fa838]) successfully deleted
I20250625 03:31:00.874539 1494 catalog_manager.cc:5582] T 44f429469440455593143983452a9fe3 P df8b9755d156478aafca552f9e9c539e reported cstate change: config changed from index 3 to 4, VOTER 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) evicted. New cstate: current_term: 1 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:00.882735 2787 tablet_replica.cc:331] T 6d7a37b3448d468baa1b9422a6167c9a P ba464e89e0f044a0a0ea3e6125cbf2a1: stopping tablet replica
I20250625 03:31:00.883635 2787 raft_consensus.cc:2241] T 6d7a37b3448d468baa1b9422a6167c9a P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:00.884214 2787 raft_consensus.cc:2270] T 6d7a37b3448d468baa1b9422a6167c9a P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:00.887791 2787 ts_tablet_manager.cc:1905] T 6d7a37b3448d468baa1b9422a6167c9a P ba464e89e0f044a0a0ea3e6125cbf2a1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250625 03:31:00.890071 1582 tablet_service.cc:1515] Processing DeleteTablet for tablet 44f429469440455593143983452a9fe3 with delete_type TABLET_DATA_TOMBSTONED (TS 7e9c4f2e01164f33b2e9034ed148398e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52712
I20250625 03:31:00.891206 2767 tablet_replica.cc:331] T 44f429469440455593143983452a9fe3 P 7e9c4f2e01164f33b2e9034ed148398e: stopping tablet replica
I20250625 03:31:00.892210 2767 raft_consensus.cc:2241] T 44f429469440455593143983452a9fe3 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:00.892794 2767 raft_consensus.cc:2270] T 44f429469440455593143983452a9fe3 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:00.899441 2767 ts_tablet_manager.cc:1905] T 44f429469440455593143983452a9fe3 P 7e9c4f2e01164f33b2e9034ed148398e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250625 03:31:00.905320 2787 ts_tablet_manager.cc:1918] T 6d7a37b3448d468baa1b9422a6167c9a P ba464e89e0f044a0a0ea3e6125cbf2a1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20250625 03:31:00.909922 2787 log.cc:1199] T 6d7a37b3448d468baa1b9422a6167c9a P ba464e89e0f044a0a0ea3e6125cbf2a1: Deleting WAL directory at /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/ts-2-root/wals/6d7a37b3448d468baa1b9422a6167c9a
I20250625 03:31:00.911818 1480 catalog_manager.cc:4928] TS ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): tablet 6d7a37b3448d468baa1b9422a6167c9a (table test-workload [id=7f663eabec024fd1911b406c660fa838]) successfully deleted
I20250625 03:31:00.920040 2767 ts_tablet_manager.cc:1918] T 44f429469440455593143983452a9fe3 P 7e9c4f2e01164f33b2e9034ed148398e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20250625 03:31:00.920419 2767 log.cc:1199] T 44f429469440455593143983452a9fe3 P 7e9c4f2e01164f33b2e9034ed148398e: Deleting WAL directory at /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/ts-0-root/wals/44f429469440455593143983452a9fe3
I20250625 03:31:00.921521 1479 catalog_manager.cc:4928] TS 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): tablet 44f429469440455593143983452a9fe3 (table test-workload [id=7f663eabec024fd1911b406c660fa838]) successfully deleted
I20250625 03:31:01.929473 1665 consensus_queue.cc:237] T 70328d972b5943009ef0c7d92cbae349 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:31:01.936107 1737 raft_consensus.cc:1273] T 70328d972b5943009ef0c7d92cbae349 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20250625 03:31:01.936251 1634 consensus_peers.cc:487] T 70328d972b5943009ef0c7d92cbae349 P 3f2aa40978064c9e9983cf3745eed206 -> Peer df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493): Couldn't send request to peer df8b9755d156478aafca552f9e9c539e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 70328d972b5943009ef0c7d92cbae349. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:01.937279 2724 consensus_queue.cc:1035] T 70328d972b5943009ef0c7d92cbae349 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:01.937469 1587 raft_consensus.cc:1273] T 70328d972b5943009ef0c7d92cbae349 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 03:31:01.938799 2750 consensus_queue.cc:1035] T 70328d972b5943009ef0c7d92cbae349 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:01.945673 2724 raft_consensus.cc:2953] T 70328d972b5943009ef0c7d92cbae349 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:01.947065 1744 raft_consensus.cc:2953] T 70328d972b5943009ef0c7d92cbae349 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:01.957245 1587 raft_consensus.cc:2953] T 70328d972b5943009ef0c7d92cbae349 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:01.958242 1737 consensus_queue.cc:237] T 93ecdce2da094dc9a80ac04828771fbd P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:31:01.964462 1492 catalog_manager.cc:5582] T 70328d972b5943009ef0c7d92cbae349 P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New cstate: current_term: 1 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
W20250625 03:31:01.977818 1708 consensus_peers.cc:487] T 93ecdce2da094dc9a80ac04828771fbd P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493): Couldn't send request to peer df8b9755d156478aafca552f9e9c539e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 93ecdce2da094dc9a80ac04828771fbd. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:01.978597 1671 raft_consensus.cc:1273] T 93ecdce2da094dc9a80ac04828771fbd P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 03:31:01.979085 1587 raft_consensus.cc:1273] T 93ecdce2da094dc9a80ac04828771fbd P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 03:31:01.980752 2705 consensus_queue.cc:1035] T 93ecdce2da094dc9a80ac04828771fbd P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:02.005084 2794 raft_consensus.cc:2953] T 93ecdce2da094dc9a80ac04828771fbd P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:02.009444 1595 raft_consensus.cc:2953] T 93ecdce2da094dc9a80ac04828771fbd P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:02.011359 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:31:02.017264 2705 consensus_queue.cc:1035] T 93ecdce2da094dc9a80ac04828771fbd P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:02.049986 1665 raft_consensus.cc:2953] T 93ecdce2da094dc9a80ac04828771fbd P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:02.050966 1494 catalog_manager.cc:5582] T 93ecdce2da094dc9a80ac04828771fbd P 7e9c4f2e01164f33b2e9034ed148398e reported cstate change: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New cstate: current_term: 1 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:02.068166 1665 consensus_queue.cc:237] T e38dc50880914156805b07aa82e30863 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
W20250625 03:31:02.086555 1634 consensus_peers.cc:487] T e38dc50880914156805b07aa82e30863 P 3f2aa40978064c9e9983cf3745eed206 -> Peer df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493): Couldn't send request to peer df8b9755d156478aafca552f9e9c539e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e38dc50880914156805b07aa82e30863. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:02.088393 1744 raft_consensus.cc:1273] T e38dc50880914156805b07aa82e30863 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 03:31:02.090559 2791 consensus_queue.cc:1035] T e38dc50880914156805b07aa82e30863 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:02.092293 1587 raft_consensus.cc:1273] T e38dc50880914156805b07aa82e30863 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 03:31:02.097126 2724 consensus_queue.cc:1035] T e38dc50880914156805b07aa82e30863 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:02.101155 2791 raft_consensus.cc:2953] T e38dc50880914156805b07aa82e30863 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:02.104220 1737 raft_consensus.cc:2953] T e38dc50880914156805b07aa82e30863 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:02.121649 1589 raft_consensus.cc:2953] T e38dc50880914156805b07aa82e30863 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:02.122843 1587 consensus_queue.cc:237] T af4573692c104d67994dbb1bc518b568 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:31:02.130354 1494 catalog_manager.cc:5582] T e38dc50880914156805b07aa82e30863 P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New cstate: current_term: 1 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
W20250625 03:31:02.144245 1559 consensus_peers.cc:487] T af4573692c104d67994dbb1bc518b568 P 7e9c4f2e01164f33b2e9034ed148398e -> Peer df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493): Couldn't send request to peer df8b9755d156478aafca552f9e9c539e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: af4573692c104d67994dbb1bc518b568. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:02.145838 1665 raft_consensus.cc:1273] T af4573692c104d67994dbb1bc518b568 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 03:31:02.151273 2756 consensus_queue.cc:1035] T af4573692c104d67994dbb1bc518b568 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:02.156101 1737 raft_consensus.cc:1273] T af4573692c104d67994dbb1bc518b568 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 03:31:02.157413 2756 consensus_queue.cc:1035] T af4573692c104d67994dbb1bc518b568 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:02.165704 2769 raft_consensus.cc:2953] T af4573692c104d67994dbb1bc518b568 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:02.167701 1671 raft_consensus.cc:2953] T af4573692c104d67994dbb1bc518b568 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:02.190989 1745 raft_consensus.cc:2953] T af4573692c104d67994dbb1bc518b568 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:02.205888 1494 catalog_manager.cc:5582] T af4573692c104d67994dbb1bc518b568 P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New cstate: current_term: 1 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:02.227140 1665 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "0c2b6052daaa4c57aaa55361e8d6e01c"
dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
mode: GRACEFUL
new_leader_uuid: "df8b9755d156478aafca552f9e9c539e"
from {username='slave'} at 127.0.0.1:35370
I20250625 03:31:02.227721 1665 raft_consensus.cc:604] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206 [term 2 LEADER]: Received request to transfer leadership to TS df8b9755d156478aafca552f9e9c539e
I20250625 03:31:02.231170 1665 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "188e56b819ae44f9b72baefcbc749400"
dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
mode: GRACEFUL
new_leader_uuid: "df8b9755d156478aafca552f9e9c539e"
from {username='slave'} at 127.0.0.1:35370
I20250625 03:31:02.231719 1665 raft_consensus.cc:604] T 188e56b819ae44f9b72baefcbc749400 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Received request to transfer leadership to TS df8b9755d156478aafca552f9e9c539e
I20250625 03:31:02.234377 1671 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "3037be35f2054cbbabd8a47062f84244"
dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
mode: GRACEFUL
new_leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
from {username='slave'} at 127.0.0.1:35370
I20250625 03:31:02.235016 1671 raft_consensus.cc:604] T 3037be35f2054cbbabd8a47062f84244 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Received request to transfer leadership to TS 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:31:02.255056 1745 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "add8a729ea684e7eab256135c01309df"
dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
mode: GRACEFUL
new_leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
from {username='slave'} at 127.0.0.1:47496
I20250625 03:31:02.255635 1745 raft_consensus.cc:604] T add8a729ea684e7eab256135c01309df P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Received request to transfer leadership to TS 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:31:02.257974 1671 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "c4354f7ffc0e4eabbc92a141d46b7984"
dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
mode: GRACEFUL
new_leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
from {username='slave'} at 127.0.0.1:35370
I20250625 03:31:02.258440 1671 raft_consensus.cc:604] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Received request to transfer leadership to TS 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:31:02.260495 1671 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "e88f79ed06514e01a9bc48261a5acfbb"
dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
mode: GRACEFUL
new_leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
from {username='slave'} at 127.0.0.1:35370
I20250625 03:31:02.261862 1671 raft_consensus.cc:604] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Received request to transfer leadership to TS 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:31:02.265719 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20250625 03:31:02.266932 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:31:02.267782 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:31:02.313575 2813 ts_tablet_manager.cc:927] T 70328d972b5943009ef0c7d92cbae349 P df8b9755d156478aafca552f9e9c539e: Initiating tablet copy from peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:31:02.315297 2813 tablet_copy_client.cc:323] T 70328d972b5943009ef0c7d92cbae349 P df8b9755d156478aafca552f9e9c539e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.106.130:34293
I20250625 03:31:02.316797 1680 tablet_copy_service.cc:140] P 3f2aa40978064c9e9983cf3745eed206: Received BeginTabletCopySession request for tablet 70328d972b5943009ef0c7d92cbae349 from peer df8b9755d156478aafca552f9e9c539e ({username='slave'} at 127.0.0.1:55766)
I20250625 03:31:02.317322 1680 tablet_copy_service.cc:161] P 3f2aa40978064c9e9983cf3745eed206: Beginning new tablet copy session on tablet 70328d972b5943009ef0c7d92cbae349 from peer df8b9755d156478aafca552f9e9c539e at {username='slave'} at 127.0.0.1:55766: session id = df8b9755d156478aafca552f9e9c539e-70328d972b5943009ef0c7d92cbae349
I20250625 03:31:02.323199 1680 tablet_copy_source_session.cc:215] T 70328d972b5943009ef0c7d92cbae349 P 3f2aa40978064c9e9983cf3745eed206: Tablet Copy: opened 0 blocks and 1 log segments
I20250625 03:31:02.325855 2813 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70328d972b5943009ef0c7d92cbae349. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:02.331550 2724 raft_consensus.cc:991] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206: : Instructing follower 7e9c4f2e01164f33b2e9034ed148398e to start an election
I20250625 03:31:02.332299 2724 raft_consensus.cc:1079] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Signalling peer 7e9c4f2e01164f33b2e9034ed148398e to start an election
I20250625 03:31:02.333645 1589 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "e88f79ed06514e01a9bc48261a5acfbb"
dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
from {username='slave'} at 127.0.0.1:52738
I20250625 03:31:02.334156 1589 raft_consensus.cc:491] T e88f79ed06514e01a9bc48261a5acfbb P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:31:02.334517 1589 raft_consensus.cc:3058] T e88f79ed06514e01a9bc48261a5acfbb P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:02.347198 1589 raft_consensus.cc:513] T e88f79ed06514e01a9bc48261a5acfbb P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:02.349435 1589 leader_election.cc:290] T e88f79ed06514e01a9bc48261a5acfbb P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 2 election: Requested vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:31:02.349632 1745 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e88f79ed06514e01a9bc48261a5acfbb" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:31:02.350293 1745 raft_consensus.cc:3058] T e88f79ed06514e01a9bc48261a5acfbb P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:02.352041 1671 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e88f79ed06514e01a9bc48261a5acfbb" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:31:02.352612 1671 raft_consensus.cc:3053] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:31:02.352903 1671 raft_consensus.cc:738] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Running, Role: LEADER
I20250625 03:31:02.353536 1671 consensus_queue.cc:260] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:02.354660 1671 raft_consensus.cc:3058] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:02.355381 1745 raft_consensus.cc:2466] T e88f79ed06514e01a9bc48261a5acfbb P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 2.
I20250625 03:31:02.356990 1561 leader_election.cc:304] T e88f79ed06514e01a9bc48261a5acfbb P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters:
I20250625 03:31:02.357769 2809 raft_consensus.cc:2802] T e88f79ed06514e01a9bc48261a5acfbb P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:31:02.358234 2809 raft_consensus.cc:695] T e88f79ed06514e01a9bc48261a5acfbb P 7e9c4f2e01164f33b2e9034ed148398e [term 2 LEADER]: Becoming Leader. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Running, Role: LEADER
I20250625 03:31:02.359011 2809 consensus_queue.cc:237] T e88f79ed06514e01a9bc48261a5acfbb P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:02.364483 1671 raft_consensus.cc:2466] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 2.
I20250625 03:31:02.371114 2813 tablet_copy_client.cc:806] T 70328d972b5943009ef0c7d92cbae349 P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 0 data blocks...
I20250625 03:31:02.371711 2813 tablet_copy_client.cc:670] T 70328d972b5943009ef0c7d92cbae349 P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 1 WAL segments...
I20250625 03:31:02.376806 2813 tablet_copy_client.cc:538] T 70328d972b5943009ef0c7d92cbae349 P df8b9755d156478aafca552f9e9c539e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250625 03:31:02.384564 2813 tablet_bootstrap.cc:492] T 70328d972b5943009ef0c7d92cbae349 P df8b9755d156478aafca552f9e9c539e: Bootstrap starting.
I20250625 03:31:02.396466 1492 catalog_manager.cc:5582] T e88f79ed06514e01a9bc48261a5acfbb P 7e9c4f2e01164f33b2e9034ed148398e reported cstate change: term changed from 1 to 2, leader changed from 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) to 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129). New cstate: current_term: 2 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:02.409808 2813 tablet_bootstrap.cc:492] T 70328d972b5943009ef0c7d92cbae349 P df8b9755d156478aafca552f9e9c539e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:31:02.410717 2813 tablet_bootstrap.cc:492] T 70328d972b5943009ef0c7d92cbae349 P df8b9755d156478aafca552f9e9c539e: Bootstrap complete.
I20250625 03:31:02.411362 2813 ts_tablet_manager.cc:1397] T 70328d972b5943009ef0c7d92cbae349 P df8b9755d156478aafca552f9e9c539e: Time spent bootstrapping tablet: real 0.027s user 0.011s sys 0.008s
I20250625 03:31:02.414018 2813 raft_consensus.cc:357] T 70328d972b5943009ef0c7d92cbae349 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:31:02.414830 2813 raft_consensus.cc:738] T 70328d972b5943009ef0c7d92cbae349 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: df8b9755d156478aafca552f9e9c539e, State: Initialized, Role: LEARNER
I20250625 03:31:02.415474 2813 consensus_queue.cc:260] T 70328d972b5943009ef0c7d92cbae349 P df8b9755d156478aafca552f9e9c539e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:31:02.418869 2813 ts_tablet_manager.cc:1428] T 70328d972b5943009ef0c7d92cbae349 P df8b9755d156478aafca552f9e9c539e: Time spent starting tablet: real 0.007s user 0.005s sys 0.004s
I20250625 03:31:02.420436 1680 tablet_copy_service.cc:342] P 3f2aa40978064c9e9983cf3745eed206: Request end of tablet copy session df8b9755d156478aafca552f9e9c539e-70328d972b5943009ef0c7d92cbae349 received from {username='slave'} at 127.0.0.1:55766
I20250625 03:31:02.420861 1680 tablet_copy_service.cc:434] P 3f2aa40978064c9e9983cf3745eed206: ending tablet copy session df8b9755d156478aafca552f9e9c539e-70328d972b5943009ef0c7d92cbae349 on tablet 70328d972b5943009ef0c7d92cbae349 with peer df8b9755d156478aafca552f9e9c539e
I20250625 03:31:02.460928 2813 ts_tablet_manager.cc:927] T 93ecdce2da094dc9a80ac04828771fbd P df8b9755d156478aafca552f9e9c539e: Initiating tablet copy from peer ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:31:02.463176 2813 tablet_copy_client.cc:323] T 93ecdce2da094dc9a80ac04828771fbd P df8b9755d156478aafca552f9e9c539e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.106.131:39359
I20250625 03:31:02.464910 1755 tablet_copy_service.cc:140] P ba464e89e0f044a0a0ea3e6125cbf2a1: Received BeginTabletCopySession request for tablet 93ecdce2da094dc9a80ac04828771fbd from peer df8b9755d156478aafca552f9e9c539e ({username='slave'} at 127.0.0.1:39774)
I20250625 03:31:02.465462 1755 tablet_copy_service.cc:161] P ba464e89e0f044a0a0ea3e6125cbf2a1: Beginning new tablet copy session on tablet 93ecdce2da094dc9a80ac04828771fbd from peer df8b9755d156478aafca552f9e9c539e at {username='slave'} at 127.0.0.1:39774: session id = df8b9755d156478aafca552f9e9c539e-93ecdce2da094dc9a80ac04828771fbd
I20250625 03:31:02.471858 1755 tablet_copy_source_session.cc:215] T 93ecdce2da094dc9a80ac04828771fbd P ba464e89e0f044a0a0ea3e6125cbf2a1: Tablet Copy: opened 0 blocks and 1 log segments
I20250625 03:31:02.474608 2813 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93ecdce2da094dc9a80ac04828771fbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:02.489288 2813 tablet_copy_client.cc:806] T 93ecdce2da094dc9a80ac04828771fbd P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 0 data blocks...
I20250625 03:31:02.489848 2813 tablet_copy_client.cc:670] T 93ecdce2da094dc9a80ac04828771fbd P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 1 WAL segments...
I20250625 03:31:02.494673 2813 tablet_copy_client.cc:538] T 93ecdce2da094dc9a80ac04828771fbd P df8b9755d156478aafca552f9e9c539e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250625 03:31:02.501909 2813 tablet_bootstrap.cc:492] T 93ecdce2da094dc9a80ac04828771fbd P df8b9755d156478aafca552f9e9c539e: Bootstrap starting.
I20250625 03:31:02.514317 2819 ts_tablet_manager.cc:927] T e38dc50880914156805b07aa82e30863 P df8b9755d156478aafca552f9e9c539e: Initiating tablet copy from peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:31:02.520563 2819 tablet_copy_client.cc:323] T e38dc50880914156805b07aa82e30863 P df8b9755d156478aafca552f9e9c539e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.106.130:34293
I20250625 03:31:02.522145 1680 tablet_copy_service.cc:140] P 3f2aa40978064c9e9983cf3745eed206: Received BeginTabletCopySession request for tablet e38dc50880914156805b07aa82e30863 from peer df8b9755d156478aafca552f9e9c539e ({username='slave'} at 127.0.0.1:55766)
I20250625 03:31:02.522701 1680 tablet_copy_service.cc:161] P 3f2aa40978064c9e9983cf3745eed206: Beginning new tablet copy session on tablet e38dc50880914156805b07aa82e30863 from peer df8b9755d156478aafca552f9e9c539e at {username='slave'} at 127.0.0.1:55766: session id = df8b9755d156478aafca552f9e9c539e-e38dc50880914156805b07aa82e30863
I20250625 03:31:02.523689 2813 tablet_bootstrap.cc:492] T 93ecdce2da094dc9a80ac04828771fbd P df8b9755d156478aafca552f9e9c539e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:31:02.524665 2813 tablet_bootstrap.cc:492] T 93ecdce2da094dc9a80ac04828771fbd P df8b9755d156478aafca552f9e9c539e: Bootstrap complete.
I20250625 03:31:02.525373 2813 ts_tablet_manager.cc:1397] T 93ecdce2da094dc9a80ac04828771fbd P df8b9755d156478aafca552f9e9c539e: Time spent bootstrapping tablet: real 0.024s user 0.011s sys 0.011s
I20250625 03:31:02.528667 2813 raft_consensus.cc:357] T 93ecdce2da094dc9a80ac04828771fbd P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:31:02.529481 2813 raft_consensus.cc:738] T 93ecdce2da094dc9a80ac04828771fbd P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: df8b9755d156478aafca552f9e9c539e, State: Initialized, Role: LEARNER
I20250625 03:31:02.530093 2813 consensus_queue.cc:260] T 93ecdce2da094dc9a80ac04828771fbd P df8b9755d156478aafca552f9e9c539e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:31:02.532671 2813 ts_tablet_manager.cc:1428] T 93ecdce2da094dc9a80ac04828771fbd P df8b9755d156478aafca552f9e9c539e: Time spent starting tablet: real 0.007s user 0.007s sys 0.001s
I20250625 03:31:02.533397 1680 tablet_copy_source_session.cc:215] T e38dc50880914156805b07aa82e30863 P 3f2aa40978064c9e9983cf3745eed206: Tablet Copy: opened 0 blocks and 1 log segments
I20250625 03:31:02.534775 1755 tablet_copy_service.cc:342] P ba464e89e0f044a0a0ea3e6125cbf2a1: Request end of tablet copy session df8b9755d156478aafca552f9e9c539e-93ecdce2da094dc9a80ac04828771fbd received from {username='slave'} at 127.0.0.1:39774
I20250625 03:31:02.537717 1755 tablet_copy_service.cc:434] P ba464e89e0f044a0a0ea3e6125cbf2a1: ending tablet copy session df8b9755d156478aafca552f9e9c539e-93ecdce2da094dc9a80ac04828771fbd on tablet 93ecdce2da094dc9a80ac04828771fbd with peer df8b9755d156478aafca552f9e9c539e
I20250625 03:31:02.536866 2819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e38dc50880914156805b07aa82e30863. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:02.555395 2819 tablet_copy_client.cc:806] T e38dc50880914156805b07aa82e30863 P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 0 data blocks...
I20250625 03:31:02.556000 2819 tablet_copy_client.cc:670] T e38dc50880914156805b07aa82e30863 P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 1 WAL segments...
I20250625 03:31:02.560271 2819 tablet_copy_client.cc:538] T e38dc50880914156805b07aa82e30863 P df8b9755d156478aafca552f9e9c539e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250625 03:31:02.566900 2813 ts_tablet_manager.cc:927] T af4573692c104d67994dbb1bc518b568 P df8b9755d156478aafca552f9e9c539e: Initiating tablet copy from peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903)
I20250625 03:31:02.570719 2819 tablet_bootstrap.cc:492] T e38dc50880914156805b07aa82e30863 P df8b9755d156478aafca552f9e9c539e: Bootstrap starting.
I20250625 03:31:02.585016 2724 raft_consensus.cc:991] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206: : Instructing follower df8b9755d156478aafca552f9e9c539e to start an election
I20250625 03:31:02.585572 2724 raft_consensus.cc:1079] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206 [term 2 LEADER]: Signalling peer df8b9755d156478aafca552f9e9c539e to start an election
I20250625 03:31:02.587061 2813 tablet_copy_client.cc:323] T af4573692c104d67994dbb1bc518b568 P df8b9755d156478aafca552f9e9c539e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.106.129:39903
I20250625 03:31:02.592155 1606 tablet_copy_service.cc:140] P 7e9c4f2e01164f33b2e9034ed148398e: Received BeginTabletCopySession request for tablet af4573692c104d67994dbb1bc518b568 from peer df8b9755d156478aafca552f9e9c539e ({username='slave'} at 127.0.0.1:44210)
I20250625 03:31:02.592785 1606 tablet_copy_service.cc:161] P 7e9c4f2e01164f33b2e9034ed148398e: Beginning new tablet copy session on tablet af4573692c104d67994dbb1bc518b568 from peer df8b9755d156478aafca552f9e9c539e at {username='slave'} at 127.0.0.1:44210: session id = df8b9755d156478aafca552f9e9c539e-af4573692c104d67994dbb1bc518b568
I20250625 03:31:02.601007 1606 tablet_copy_source_session.cc:215] T af4573692c104d67994dbb1bc518b568 P 7e9c4f2e01164f33b2e9034ed148398e: Tablet Copy: opened 0 blocks and 1 log segments
I20250625 03:31:02.601697 2345 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "0c2b6052daaa4c57aaa55361e8d6e01c"
dest_uuid: "df8b9755d156478aafca552f9e9c539e"
from {username='slave'} at 127.0.0.1:33226
I20250625 03:31:02.602308 2345 raft_consensus.cc:491] T 0c2b6052daaa4c57aaa55361e8d6e01c P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:31:02.602983 2345 raft_consensus.cc:3058] T 0c2b6052daaa4c57aaa55361e8d6e01c P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:02.603070 2782 raft_consensus.cc:991] T 188e56b819ae44f9b72baefcbc749400 P 3f2aa40978064c9e9983cf3745eed206: : Instructing follower df8b9755d156478aafca552f9e9c539e to start an election
I20250625 03:31:02.603803 2782 raft_consensus.cc:1079] T 188e56b819ae44f9b72baefcbc749400 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Signalling peer df8b9755d156478aafca552f9e9c539e to start an election
I20250625 03:31:02.604718 2813 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af4573692c104d67994dbb1bc518b568. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:02.605536 2343 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "188e56b819ae44f9b72baefcbc749400"
dest_uuid: "df8b9755d156478aafca552f9e9c539e"
from {username='slave'} at 127.0.0.1:33226
I20250625 03:31:02.606089 2343 raft_consensus.cc:491] T 188e56b819ae44f9b72baefcbc749400 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:31:02.606391 2343 raft_consensus.cc:3058] T 188e56b819ae44f9b72baefcbc749400 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:02.611480 2345 raft_consensus.cc:513] T 0c2b6052daaa4c57aaa55361e8d6e01c P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:02.615067 1590 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0c2b6052daaa4c57aaa55361e8d6e01c" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
I20250625 03:31:02.615612 1665 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0c2b6052daaa4c57aaa55361e8d6e01c" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:31:02.616214 1665 raft_consensus.cc:3053] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206 [term 2 LEADER]: Stepping down as leader of term 2
I20250625 03:31:02.616724 1665 raft_consensus.cc:738] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Running, Role: LEADER
I20250625 03:31:02.617471 1665 consensus_queue.cc:260] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:02.615887 1590 raft_consensus.cc:3058] T 0c2b6052daaa4c57aaa55361e8d6e01c P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:02.628177 1665 raft_consensus.cc:3058] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:02.641041 1665 raft_consensus.cc:2466] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df8b9755d156478aafca552f9e9c539e in term 3.
I20250625 03:31:02.642596 1590 raft_consensus.cc:2466] T 0c2b6052daaa4c57aaa55361e8d6e01c P 7e9c4f2e01164f33b2e9034ed148398e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df8b9755d156478aafca552f9e9c539e in term 3.
I20250625 03:31:02.643527 2345 leader_election.cc:290] T 0c2b6052daaa4c57aaa55361e8d6e01c P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 3 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:31:02.645665 2819 tablet_bootstrap.cc:492] T e38dc50880914156805b07aa82e30863 P df8b9755d156478aafca552f9e9c539e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:31:02.645638 2307 leader_election.cc:304] T 0c2b6052daaa4c57aaa55361e8d6e01c P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e, df8b9755d156478aafca552f9e9c539e; no voters:
I20250625 03:31:02.646770 2819 tablet_bootstrap.cc:492] T e38dc50880914156805b07aa82e30863 P df8b9755d156478aafca552f9e9c539e: Bootstrap complete.
I20250625 03:31:02.647313 2817 raft_consensus.cc:2802] T 0c2b6052daaa4c57aaa55361e8d6e01c P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Leader election won for term 3
I20250625 03:31:02.647428 2819 ts_tablet_manager.cc:1397] T e38dc50880914156805b07aa82e30863 P df8b9755d156478aafca552f9e9c539e: Time spent bootstrapping tablet: real 0.077s user 0.022s sys 0.039s
I20250625 03:31:02.649000 2343 raft_consensus.cc:513] T 188e56b819ae44f9b72baefcbc749400 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:02.649860 2813 tablet_copy_client.cc:806] T af4573692c104d67994dbb1bc518b568 P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 0 data blocks...
I20250625 03:31:02.650363 2813 tablet_copy_client.cc:670] T af4573692c104d67994dbb1bc518b568 P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 1 WAL segments...
I20250625 03:31:02.652227 1589 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "188e56b819ae44f9b72baefcbc749400" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
I20250625 03:31:02.652815 1589 raft_consensus.cc:3058] T 188e56b819ae44f9b72baefcbc749400 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:02.652884 2819 raft_consensus.cc:357] T e38dc50880914156805b07aa82e30863 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:31:02.653821 2819 raft_consensus.cc:738] T e38dc50880914156805b07aa82e30863 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: df8b9755d156478aafca552f9e9c539e, State: Initialized, Role: LEARNER
I20250625 03:31:02.654441 2819 consensus_queue.cc:260] T e38dc50880914156805b07aa82e30863 P df8b9755d156478aafca552f9e9c539e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:31:02.658360 2343 leader_election.cc:290] T 188e56b819ae44f9b72baefcbc749400 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 2 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:31:02.659580 1663 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "188e56b819ae44f9b72baefcbc749400" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:31:02.660295 1663 raft_consensus.cc:3053] T 188e56b819ae44f9b72baefcbc749400 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:31:02.660674 1663 raft_consensus.cc:738] T 188e56b819ae44f9b72baefcbc749400 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Running, Role: LEADER
I20250625 03:31:02.661080 2817 raft_consensus.cc:695] T 0c2b6052daaa4c57aaa55361e8d6e01c P df8b9755d156478aafca552f9e9c539e [term 3 LEADER]: Becoming Leader. State: Replica: df8b9755d156478aafca552f9e9c539e, State: Running, Role: LEADER
I20250625 03:31:02.662124 2819 ts_tablet_manager.cc:1428] T e38dc50880914156805b07aa82e30863 P df8b9755d156478aafca552f9e9c539e: Time spent starting tablet: real 0.014s user 0.005s sys 0.005s
I20250625 03:31:02.662688 2817 consensus_queue.cc:237] T 0c2b6052daaa4c57aaa55361e8d6e01c P df8b9755d156478aafca552f9e9c539e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:02.665077 1680 tablet_copy_service.cc:342] P 3f2aa40978064c9e9983cf3745eed206: Request end of tablet copy session df8b9755d156478aafca552f9e9c539e-e38dc50880914156805b07aa82e30863 received from {username='slave'} at 127.0.0.1:55766
I20250625 03:31:02.665511 1680 tablet_copy_service.cc:434] P 3f2aa40978064c9e9983cf3745eed206: ending tablet copy session df8b9755d156478aafca552f9e9c539e-e38dc50880914156805b07aa82e30863 on tablet e38dc50880914156805b07aa82e30863 with peer df8b9755d156478aafca552f9e9c539e
I20250625 03:31:02.665390 1663 consensus_queue.cc:260] T 188e56b819ae44f9b72baefcbc749400 P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:02.667337 2813 tablet_copy_client.cc:538] T af4573692c104d67994dbb1bc518b568 P df8b9755d156478aafca552f9e9c539e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250625 03:31:02.674651 2791 raft_consensus.cc:991] T 3037be35f2054cbbabd8a47062f84244 P 3f2aa40978064c9e9983cf3745eed206: : Instructing follower 7e9c4f2e01164f33b2e9034ed148398e to start an election
I20250625 03:31:02.675179 2782 raft_consensus.cc:1079] T 3037be35f2054cbbabd8a47062f84244 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Signalling peer 7e9c4f2e01164f33b2e9034ed148398e to start an election
I20250625 03:31:02.675932 2813 tablet_bootstrap.cc:492] T af4573692c104d67994dbb1bc518b568 P df8b9755d156478aafca552f9e9c539e: Bootstrap starting.
I20250625 03:31:02.677953 2797 raft_consensus.cc:991] T add8a729ea684e7eab256135c01309df P ba464e89e0f044a0a0ea3e6125cbf2a1: : Instructing follower 7e9c4f2e01164f33b2e9034ed148398e to start an election
I20250625 03:31:02.679319 2800 raft_consensus.cc:1079] T add8a729ea684e7eab256135c01309df P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Signalling peer 7e9c4f2e01164f33b2e9034ed148398e to start an election
I20250625 03:31:02.678082 1663 raft_consensus.cc:3058] T 188e56b819ae44f9b72baefcbc749400 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:02.683064 1590 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "3037be35f2054cbbabd8a47062f84244"
dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
from {username='slave'} at 127.0.0.1:52738
I20250625 03:31:02.683823 1591 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "add8a729ea684e7eab256135c01309df"
dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
from {username='slave'} at 127.0.0.1:52726
I20250625 03:31:02.684340 1591 raft_consensus.cc:491] T add8a729ea684e7eab256135c01309df P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:31:02.677682 1589 raft_consensus.cc:2466] T 188e56b819ae44f9b72baefcbc749400 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df8b9755d156478aafca552f9e9c539e in term 2.
I20250625 03:31:02.684715 1591 raft_consensus.cc:3058] T add8a729ea684e7eab256135c01309df P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:02.687721 1663 raft_consensus.cc:2466] T 188e56b819ae44f9b72baefcbc749400 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df8b9755d156478aafca552f9e9c539e in term 2.
I20250625 03:31:02.689142 2307 leader_election.cc:304] T 188e56b819ae44f9b72baefcbc749400 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e, df8b9755d156478aafca552f9e9c539e; no voters:
I20250625 03:31:02.690729 2824 raft_consensus.cc:2802] T 188e56b819ae44f9b72baefcbc749400 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:31:02.691215 2824 raft_consensus.cc:695] T 188e56b819ae44f9b72baefcbc749400 P df8b9755d156478aafca552f9e9c539e [term 2 LEADER]: Becoming Leader. State: Replica: df8b9755d156478aafca552f9e9c539e, State: Running, Role: LEADER
I20250625 03:31:02.692373 2824 consensus_queue.cc:237] T 188e56b819ae44f9b72baefcbc749400 P df8b9755d156478aafca552f9e9c539e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:02.684342 1590 raft_consensus.cc:491] T 3037be35f2054cbbabd8a47062f84244 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:31:02.693866 1590 raft_consensus.cc:3058] T 3037be35f2054cbbabd8a47062f84244 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:02.700803 1590 raft_consensus.cc:513] T 3037be35f2054cbbabd8a47062f84244 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:02.703791 1745 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3037be35f2054cbbabd8a47062f84244" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:31:02.704380 1745 raft_consensus.cc:3058] T 3037be35f2054cbbabd8a47062f84244 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:02.706687 1591 raft_consensus.cc:513] T add8a729ea684e7eab256135c01309df P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:02.703790 1664 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3037be35f2054cbbabd8a47062f84244" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:31:02.708896 1664 raft_consensus.cc:3053] T 3037be35f2054cbbabd8a47062f84244 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:31:02.709080 1663 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "add8a729ea684e7eab256135c01309df" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:31:02.709805 1663 raft_consensus.cc:3058] T add8a729ea684e7eab256135c01309df P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:02.717955 1492 catalog_manager.cc:5582] T 0c2b6052daaa4c57aaa55361e8d6e01c P df8b9755d156478aafca552f9e9c539e reported cstate change: term changed from 2 to 3, leader changed from 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) to df8b9755d156478aafca552f9e9c539e (127.0.106.132). New cstate: current_term: 3 leader_uuid: "df8b9755d156478aafca552f9e9c539e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250625 03:31:02.709185 1664 raft_consensus.cc:738] T 3037be35f2054cbbabd8a47062f84244 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Running, Role: LEADER
I20250625 03:31:02.720866 1664 consensus_queue.cc:260] T 3037be35f2054cbbabd8a47062f84244 P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:02.721884 1664 raft_consensus.cc:3058] T 3037be35f2054cbbabd8a47062f84244 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:02.710359 1737 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "add8a729ea684e7eab256135c01309df" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:31:02.724454 1737 raft_consensus.cc:3053] T add8a729ea684e7eab256135c01309df P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:31:02.724756 1737 raft_consensus.cc:738] T add8a729ea684e7eab256135c01309df P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Running, Role: LEADER
I20250625 03:31:02.725406 1737 consensus_queue.cc:260] T add8a729ea684e7eab256135c01309df P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:02.726538 1737 raft_consensus.cc:3058] T add8a729ea684e7eab256135c01309df P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:02.728808 1663 raft_consensus.cc:2466] T add8a729ea684e7eab256135c01309df P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 2.
I20250625 03:31:02.729807 1559 leader_election.cc:304] T add8a729ea684e7eab256135c01309df P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e; no voters:
I20250625 03:31:02.730557 2769 raft_consensus.cc:2802] T add8a729ea684e7eab256135c01309df P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:31:02.731012 2769 raft_consensus.cc:695] T add8a729ea684e7eab256135c01309df P 7e9c4f2e01164f33b2e9034ed148398e [term 2 LEADER]: Becoming Leader. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Running, Role: LEADER
I20250625 03:31:02.731259 1745 raft_consensus.cc:2466] T 3037be35f2054cbbabd8a47062f84244 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 2.
I20250625 03:31:02.731796 2769 consensus_queue.cc:237] T add8a729ea684e7eab256135c01309df P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:02.732441 1561 leader_election.cc:304] T 3037be35f2054cbbabd8a47062f84244 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters:
I20250625 03:31:02.709386 1591 leader_election.cc:290] T add8a729ea684e7eab256135c01309df P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 2 election: Requested vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:31:02.735685 2808 raft_consensus.cc:2802] T 3037be35f2054cbbabd8a47062f84244 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:31:02.736186 2808 raft_consensus.cc:695] T 3037be35f2054cbbabd8a47062f84244 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 LEADER]: Becoming Leader. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Running, Role: LEADER
I20250625 03:31:02.737022 2808 consensus_queue.cc:237] T 3037be35f2054cbbabd8a47062f84244 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:02.740176 1590 leader_election.cc:290] T 3037be35f2054cbbabd8a47062f84244 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 2 election: Requested vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:31:02.745061 1664 raft_consensus.cc:2466] T 3037be35f2054cbbabd8a47062f84244 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 2.
I20250625 03:31:02.745349 1737 raft_consensus.cc:2466] T add8a729ea684e7eab256135c01309df P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 2.
I20250625 03:31:02.763151 2791 raft_consensus.cc:991] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206: : Instructing follower 7e9c4f2e01164f33b2e9034ed148398e to start an election
I20250625 03:31:02.763747 2782 raft_consensus.cc:1079] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Signalling peer 7e9c4f2e01164f33b2e9034ed148398e to start an election
I20250625 03:31:02.765413 1590 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "c4354f7ffc0e4eabbc92a141d46b7984"
dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
from {username='slave'} at 127.0.0.1:52738
I20250625 03:31:02.765942 1590 raft_consensus.cc:491] T c4354f7ffc0e4eabbc92a141d46b7984 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:31:02.766287 1590 raft_consensus.cc:3058] T c4354f7ffc0e4eabbc92a141d46b7984 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:02.766916 1492 catalog_manager.cc:5582] T 188e56b819ae44f9b72baefcbc749400 P df8b9755d156478aafca552f9e9c539e reported cstate change: term changed from 1 to 2, leader changed from 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) to df8b9755d156478aafca552f9e9c539e (127.0.106.132). New cstate: current_term: 2 leader_uuid: "df8b9755d156478aafca552f9e9c539e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250625 03:31:02.778312 1493 catalog_manager.cc:5582] T add8a729ea684e7eab256135c01309df P 7e9c4f2e01164f33b2e9034ed148398e reported cstate change: term changed from 1 to 2, leader changed from ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) to 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129). New cstate: current_term: 2 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:02.779585 1590 raft_consensus.cc:513] T c4354f7ffc0e4eabbc92a141d46b7984 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:02.782253 1665 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c4354f7ffc0e4eabbc92a141d46b7984" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:31:02.782840 1665 raft_consensus.cc:3053] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:31:02.783114 1665 raft_consensus.cc:738] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Running, Role: LEADER
I20250625 03:31:02.783843 1665 consensus_queue.cc:260] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:02.784842 1665 raft_consensus.cc:3058] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:02.794273 1737 raft_consensus.cc:1273] T e88f79ed06514e01a9bc48261a5acfbb P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:02.795714 2769 consensus_queue.cc:1035] T e88f79ed06514e01a9bc48261a5acfbb P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:02.792968 1665 raft_consensus.cc:2466] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 2.
I20250625 03:31:02.797013 1493 catalog_manager.cc:5582] T 3037be35f2054cbbabd8a47062f84244 P 7e9c4f2e01164f33b2e9034ed148398e reported cstate change: term changed from 1 to 2, leader changed from 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) to 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129). New cstate: current_term: 2 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:02.797899 1559 leader_election.cc:304] T c4354f7ffc0e4eabbc92a141d46b7984 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e; no voters:
I20250625 03:31:02.798580 2769 raft_consensus.cc:2802] T c4354f7ffc0e4eabbc92a141d46b7984 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:31:02.799121 2769 raft_consensus.cc:695] T c4354f7ffc0e4eabbc92a141d46b7984 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 LEADER]: Becoming Leader. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Running, Role: LEADER
I20250625 03:31:02.800103 2813 tablet_bootstrap.cc:492] T af4573692c104d67994dbb1bc518b568 P df8b9755d156478aafca552f9e9c539e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:31:02.800235 2769 consensus_queue.cc:237] T c4354f7ffc0e4eabbc92a141d46b7984 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:02.801082 2813 tablet_bootstrap.cc:492] T af4573692c104d67994dbb1bc518b568 P df8b9755d156478aafca552f9e9c539e: Bootstrap complete.
I20250625 03:31:02.801771 2813 ts_tablet_manager.cc:1397] T af4573692c104d67994dbb1bc518b568 P df8b9755d156478aafca552f9e9c539e: Time spent bootstrapping tablet: real 0.126s user 0.038s sys 0.027s
I20250625 03:31:02.799222 1590 leader_election.cc:290] T c4354f7ffc0e4eabbc92a141d46b7984 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 2 election: Requested vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:31:02.804425 1745 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c4354f7ffc0e4eabbc92a141d46b7984" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:31:02.804988 1745 raft_consensus.cc:3058] T c4354f7ffc0e4eabbc92a141d46b7984 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:02.812844 2813 raft_consensus.cc:357] T af4573692c104d67994dbb1bc518b568 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:31:02.814018 2813 raft_consensus.cc:738] T af4573692c104d67994dbb1bc518b568 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: df8b9755d156478aafca552f9e9c539e, State: Initialized, Role: LEARNER
I20250625 03:31:02.833626 1745 raft_consensus.cc:2466] T c4354f7ffc0e4eabbc92a141d46b7984 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 2.
I20250625 03:31:02.814827 2813 consensus_queue.cc:260] T af4573692c104d67994dbb1bc518b568 P df8b9755d156478aafca552f9e9c539e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:31:02.872502 2343 raft_consensus.cc:1215] T 70328d972b5943009ef0c7d92cbae349 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20250625 03:31:02.948697 2343 raft_consensus.cc:1215] T e38dc50880914156805b07aa82e30863 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20250625 03:31:02.951838 2813 ts_tablet_manager.cc:1428] T af4573692c104d67994dbb1bc518b568 P df8b9755d156478aafca552f9e9c539e: Time spent starting tablet: real 0.150s user 0.010s sys 0.000s
I20250625 03:31:02.953619 1606 tablet_copy_service.cc:342] P 7e9c4f2e01164f33b2e9034ed148398e: Request end of tablet copy session df8b9755d156478aafca552f9e9c539e-af4573692c104d67994dbb1bc518b568 received from {username='slave'} at 127.0.0.1:44210
I20250625 03:31:02.954082 1606 tablet_copy_service.cc:434] P 7e9c4f2e01164f33b2e9034ed148398e: ending tablet copy session df8b9755d156478aafca552f9e9c539e-af4573692c104d67994dbb1bc518b568 on tablet af4573692c104d67994dbb1bc518b568 with peer df8b9755d156478aafca552f9e9c539e
I20250625 03:31:02.959573 1492 catalog_manager.cc:5582] T c4354f7ffc0e4eabbc92a141d46b7984 P 7e9c4f2e01164f33b2e9034ed148398e reported cstate change: term changed from 1 to 2, leader changed from 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) to 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129). New cstate: current_term: 2 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:03.024266 2341 raft_consensus.cc:1215] T af4573692c104d67994dbb1bc518b568 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20250625 03:31:03.032614 1671 raft_consensus.cc:1273] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:03.038949 2756 consensus_queue.cc:1035] T e88f79ed06514e01a9bc48261a5acfbb P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:03.055771 2343 raft_consensus.cc:1215] T 93ecdce2da094dc9a80ac04828771fbd P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20250625 03:31:03.093515 1591 raft_consensus.cc:1273] T 0c2b6052daaa4c57aaa55361e8d6e01c P 7e9c4f2e01164f33b2e9034ed148398e [term 3 FOLLOWER]: Refusing update from remote peer df8b9755d156478aafca552f9e9c539e: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20250625 03:31:03.094725 2824 consensus_queue.cc:1035] T 0c2b6052daaa4c57aaa55361e8d6e01c P df8b9755d156478aafca552f9e9c539e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250625 03:31:03.105919 1671 raft_consensus.cc:1273] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Refusing update from remote peer df8b9755d156478aafca552f9e9c539e: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20250625 03:31:03.107126 2824 consensus_queue.cc:1035] T 0c2b6052daaa4c57aaa55361e8d6e01c P df8b9755d156478aafca552f9e9c539e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250625 03:31:03.127255 1665 raft_consensus.cc:1273] T 188e56b819ae44f9b72baefcbc749400 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Refusing update from remote peer df8b9755d156478aafca552f9e9c539e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250625 03:31:03.128736 2824 consensus_queue.cc:1035] T 188e56b819ae44f9b72baefcbc749400 P df8b9755d156478aafca552f9e9c539e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250625 03:31:03.150619 1591 raft_consensus.cc:1273] T 188e56b819ae44f9b72baefcbc749400 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Refusing update from remote peer df8b9755d156478aafca552f9e9c539e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250625 03:31:03.157107 2824 consensus_queue.cc:1035] T 188e56b819ae44f9b72baefcbc749400 P df8b9755d156478aafca552f9e9c539e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20250625 03:31:03.158914 1665 raft_consensus.cc:1273] T add8a729ea684e7eab256135c01309df P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:03.160351 2756 consensus_queue.cc:1035] T add8a729ea684e7eab256135c01309df P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:03.176084 1737 raft_consensus.cc:1273] T add8a729ea684e7eab256135c01309df P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:03.177708 2769 consensus_queue.cc:1035] T add8a729ea684e7eab256135c01309df P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:03.230674 1745 raft_consensus.cc:1273] T 3037be35f2054cbbabd8a47062f84244 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:03.232082 2769 consensus_queue.cc:1035] T 3037be35f2054cbbabd8a47062f84244 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:03.246069 1663 raft_consensus.cc:1273] T 3037be35f2054cbbabd8a47062f84244 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:03.249125 2769 consensus_queue.cc:1035] T 3037be35f2054cbbabd8a47062f84244 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:03.307838 1665 raft_consensus.cc:1273] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:03.309137 2769 consensus_queue.cc:1035] T c4354f7ffc0e4eabbc92a141d46b7984 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:03.313848 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:31:03.325039 1737 raft_consensus.cc:1273] T c4354f7ffc0e4eabbc92a141d46b7984 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:03.326697 2769 consensus_queue.cc:1035] T c4354f7ffc0e4eabbc92a141d46b7984 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:03.361076 2782 raft_consensus.cc:1062] T e38dc50880914156805b07aa82e30863 P 3f2aa40978064c9e9983cf3745eed206: attempting to promote NON_VOTER df8b9755d156478aafca552f9e9c539e to VOTER
I20250625 03:31:03.363309 2782 consensus_queue.cc:237] T e38dc50880914156805b07aa82e30863 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:03.372949 2343 raft_consensus.cc:1273] T e38dc50880914156805b07aa82e30863 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:31:03.374435 2791 consensus_queue.cc:1035] T e38dc50880914156805b07aa82e30863 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:31:03.375001 1737 raft_consensus.cc:1273] T e38dc50880914156805b07aa82e30863 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:31:03.376713 2836 consensus_queue.cc:1035] T e38dc50880914156805b07aa82e30863 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:31:03.384326 1590 raft_consensus.cc:1273] T e38dc50880914156805b07aa82e30863 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:31:03.385887 2724 consensus_queue.cc:1035] T e38dc50880914156805b07aa82e30863 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:31:03.409780 2791 raft_consensus.cc:2953] T e38dc50880914156805b07aa82e30863 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:03.414943 2341 raft_consensus.cc:2953] T e38dc50880914156805b07aa82e30863 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:03.438563 1494 catalog_manager.cc:5582] T e38dc50880914156805b07aa82e30863 P df8b9755d156478aafca552f9e9c539e reported cstate change: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:03.442410 1737 raft_consensus.cc:2953] T e38dc50880914156805b07aa82e30863 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:03.458199 2782 raft_consensus.cc:1062] T 70328d972b5943009ef0c7d92cbae349 P 3f2aa40978064c9e9983cf3745eed206: attempting to promote NON_VOTER df8b9755d156478aafca552f9e9c539e to VOTER
I20250625 03:31:03.462489 1590 raft_consensus.cc:2953] T e38dc50880914156805b07aa82e30863 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:03.460852 2782 consensus_queue.cc:237] T 70328d972b5943009ef0c7d92cbae349 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:03.477241 1591 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "40b74a261fdd495f84ceb0690f0b30ba"
dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
mode: GRACEFUL
new_leader_uuid: "3f2aa40978064c9e9983cf3745eed206"
from {username='slave'} at 127.0.0.1:47018
I20250625 03:31:03.478029 1591 raft_consensus.cc:604] T 40b74a261fdd495f84ceb0690f0b30ba P 7e9c4f2e01164f33b2e9034ed148398e [term 1 LEADER]: Received request to transfer leadership to TS 3f2aa40978064c9e9983cf3745eed206
I20250625 03:31:03.478193 1665 consensus_queue.cc:237] T e38dc50880914156805b07aa82e30863 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:03.481205 1591 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "542f85d76df8432593ee963669155a9d"
dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
mode: GRACEFUL
new_leader_uuid: "3f2aa40978064c9e9983cf3745eed206"
from {username='slave'} at 127.0.0.1:47018
I20250625 03:31:03.481773 1591 raft_consensus.cc:604] T 542f85d76df8432593ee963669155a9d P 7e9c4f2e01164f33b2e9034ed148398e [term 1 LEADER]: Received request to transfer leadership to TS 3f2aa40978064c9e9983cf3745eed206
I20250625 03:31:03.484414 2838 raft_consensus.cc:1062] T af4573692c104d67994dbb1bc518b568 P 7e9c4f2e01164f33b2e9034ed148398e: attempting to promote NON_VOTER df8b9755d156478aafca552f9e9c539e to VOTER
I20250625 03:31:03.486969 2838 consensus_queue.cc:237] T af4573692c104d67994dbb1bc518b568 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:03.490751 1671 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "b3f18b9311894580bc336199d357df41"
dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
mode: GRACEFUL
new_leader_uuid: "df8b9755d156478aafca552f9e9c539e"
from {username='slave'} at 127.0.0.1:35370
I20250625 03:31:03.491354 1671 raft_consensus.cc:604] T b3f18b9311894580bc336199d357df41 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Received request to transfer leadership to TS df8b9755d156478aafca552f9e9c539e
I20250625 03:31:03.493106 2341 raft_consensus.cc:1273] T 70328d972b5943009ef0c7d92cbae349 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:31:03.493121 1591 raft_consensus.cc:1273] T 70328d972b5943009ef0c7d92cbae349 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:31:03.494400 2791 consensus_queue.cc:1035] T 70328d972b5943009ef0c7d92cbae349 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:31:03.495478 2724 consensus_queue.cc:1035] T 70328d972b5943009ef0c7d92cbae349 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:31:03.497795 1745 raft_consensus.cc:1273] T 70328d972b5943009ef0c7d92cbae349 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:31:03.498689 1744 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "cc3b100d6d574a68b79e6a8f23d77201"
dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
mode: GRACEFUL
new_leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
from {username='slave'} at 127.0.0.1:47496
I20250625 03:31:03.499243 1744 raft_consensus.cc:604] T cc3b100d6d574a68b79e6a8f23d77201 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Received request to transfer leadership to TS 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:31:03.505050 2836 consensus_queue.cc:1035] T 70328d972b5943009ef0c7d92cbae349 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:31:03.508673 2342 raft_consensus.cc:1273] T e38dc50880914156805b07aa82e30863 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250625 03:31:03.509877 2835 raft_consensus.cc:991] T b3f18b9311894580bc336199d357df41 P 3f2aa40978064c9e9983cf3745eed206: : Instructing follower df8b9755d156478aafca552f9e9c539e to start an election
I20250625 03:31:03.510385 2835 raft_consensus.cc:1079] T b3f18b9311894580bc336199d357df41 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Signalling peer df8b9755d156478aafca552f9e9c539e to start an election
I20250625 03:31:03.512167 1745 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "fb6e83db706647e28e491a02f1641980"
dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
mode: GRACEFUL
new_leader_uuid: "df8b9755d156478aafca552f9e9c539e"
from {username='slave'} at 127.0.0.1:47496
I20250625 03:31:03.512799 1745 raft_consensus.cc:604] T fb6e83db706647e28e491a02f1641980 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Received request to transfer leadership to TS df8b9755d156478aafca552f9e9c539e
I20250625 03:31:03.514613 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20250625 03:31:03.516196 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:31:03.516888 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:31:03.517392 2836 consensus_queue.cc:1035] T e38dc50880914156805b07aa82e30863 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:31:03.518256 2345 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "b3f18b9311894580bc336199d357df41"
dest_uuid: "df8b9755d156478aafca552f9e9c539e"
from {username='slave'} at 127.0.0.1:33226
I20250625 03:31:03.518759 2345 raft_consensus.cc:491] T b3f18b9311894580bc336199d357df41 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:31:03.519097 2345 raft_consensus.cc:3058] T b3f18b9311894580bc336199d357df41 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:03.546703 1737 raft_consensus.cc:1273] T e38dc50880914156805b07aa82e30863 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250625 03:31:03.548437 2791 consensus_queue.cc:1035] T e38dc50880914156805b07aa82e30863 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:31:03.560037 2750 raft_consensus.cc:2953] T 70328d972b5943009ef0c7d92cbae349 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:03.555495 2345 raft_consensus.cc:513] T b3f18b9311894580bc336199d357df41 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:03.564271 2836 raft_consensus.cc:2953] T e38dc50880914156805b07aa82e30863 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:03.566706 1589 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b3f18b9311894580bc336199d357df41" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
I20250625 03:31:03.567137 1663 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b3f18b9311894580bc336199d357df41" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:31:03.567335 1589 raft_consensus.cc:3058] T b3f18b9311894580bc336199d357df41 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:03.567710 1663 raft_consensus.cc:3053] T b3f18b9311894580bc336199d357df41 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:31:03.567936 1663 raft_consensus.cc:738] T b3f18b9311894580bc336199d357df41 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Running, Role: LEADER
I20250625 03:31:03.568462 2345 leader_election.cc:290] T b3f18b9311894580bc336199d357df41 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 2 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:31:03.569693 1663 consensus_queue.cc:260] T b3f18b9311894580bc336199d357df41 P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:03.569968 2341 raft_consensus.cc:2953] T 70328d972b5943009ef0c7d92cbae349 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:03.570911 1663 raft_consensus.cc:3058] T b3f18b9311894580bc336199d357df41 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:03.573897 2800 raft_consensus.cc:1062] T 93ecdce2da094dc9a80ac04828771fbd P ba464e89e0f044a0a0ea3e6125cbf2a1: attempting to promote NON_VOTER df8b9755d156478aafca552f9e9c539e to VOTER
I20250625 03:31:03.576721 2800 consensus_queue.cc:237] T 93ecdce2da094dc9a80ac04828771fbd P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:03.581511 1589 raft_consensus.cc:2466] T b3f18b9311894580bc336199d357df41 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df8b9755d156478aafca552f9e9c539e in term 2.
I20250625 03:31:03.582819 2307 leader_election.cc:304] T b3f18b9311894580bc336199d357df41 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e, df8b9755d156478aafca552f9e9c539e; no voters:
I20250625 03:31:03.588032 2824 raft_consensus.cc:2802] T b3f18b9311894580bc336199d357df41 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:31:03.588532 2824 raft_consensus.cc:695] T b3f18b9311894580bc336199d357df41 P df8b9755d156478aafca552f9e9c539e [term 2 LEADER]: Becoming Leader. State: Replica: df8b9755d156478aafca552f9e9c539e, State: Running, Role: LEADER
I20250625 03:31:03.589032 1478 catalog_manager.cc:5095] ChangeConfig:REMOVE_PEER RPC for tablet e38dc50880914156805b07aa82e30863 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250625 03:31:03.589350 2824 consensus_queue.cc:237] T b3f18b9311894580bc336199d357df41 P df8b9755d156478aafca552f9e9c539e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:03.594962 1737 raft_consensus.cc:2953] T 70328d972b5943009ef0c7d92cbae349 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:03.635028 1494 catalog_manager.cc:5582] T b3f18b9311894580bc336199d357df41 P df8b9755d156478aafca552f9e9c539e reported cstate change: term changed from 1 to 2, leader changed from 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) to df8b9755d156478aafca552f9e9c539e (127.0.106.132). New cstate: current_term: 2 leader_uuid: "df8b9755d156478aafca552f9e9c539e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250625 03:31:03.638162 1663 raft_consensus.cc:2466] T b3f18b9311894580bc336199d357df41 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df8b9755d156478aafca552f9e9c539e in term 2.
I20250625 03:31:03.648180 1741 raft_consensus.cc:2953] T e38dc50880914156805b07aa82e30863 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:03.653559 1744 raft_consensus.cc:1273] T af4573692c104d67994dbb1bc518b568 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:31:03.655253 2808 consensus_queue.cc:1035] T af4573692c104d67994dbb1bc518b568 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:31:03.661080 2341 raft_consensus.cc:2953] T e38dc50880914156805b07aa82e30863 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:03.671550 1493 catalog_manager.cc:5582] T 70328d972b5943009ef0c7d92cbae349 P df8b9755d156478aafca552f9e9c539e reported cstate change: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:03.668279 2342 raft_consensus.cc:1273] T af4573692c104d67994dbb1bc518b568 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:31:03.714473 1663 raft_consensus.cc:1273] T af4573692c104d67994dbb1bc518b568 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:31:03.717142 2809 consensus_queue.cc:1035] T af4573692c104d67994dbb1bc518b568 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:31:03.699468 1494 catalog_manager.cc:5582] T e38dc50880914156805b07aa82e30863 P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: config changed from index 3 to 4, VOTER 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) evicted. New cstate: current_term: 1 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:03.722640 2838 consensus_queue.cc:1035] T af4573692c104d67994dbb1bc518b568 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20250625 03:31:03.768304 2838 raft_consensus.cc:991] T 40b74a261fdd495f84ceb0690f0b30ba P 7e9c4f2e01164f33b2e9034ed148398e: : Instructing follower 3f2aa40978064c9e9983cf3745eed206 to start an election
I20250625 03:31:03.768958 2838 raft_consensus.cc:1079] T 40b74a261fdd495f84ceb0690f0b30ba P 7e9c4f2e01164f33b2e9034ed148398e [term 1 LEADER]: Signalling peer 3f2aa40978064c9e9983cf3745eed206 to start an election
I20250625 03:31:03.771705 1590 raft_consensus.cc:2953] T 70328d972b5943009ef0c7d92cbae349 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:03.778584 1665 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "40b74a261fdd495f84ceb0690f0b30ba"
dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
from {username='slave'} at 127.0.0.1:53758
I20250625 03:31:03.779202 1665 raft_consensus.cc:491] T 40b74a261fdd495f84ceb0690f0b30ba P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:31:03.779547 1665 raft_consensus.cc:3058] T 40b74a261fdd495f84ceb0690f0b30ba P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Advancing to term 2
W20250625 03:31:03.787846 1708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.130:34293, user_credentials={real_user=slave}} blocked reactor thread for 120064us
I20250625 03:31:03.797600 1671 raft_consensus.cc:1273] T 93ecdce2da094dc9a80ac04828771fbd P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:31:03.803133 2345 raft_consensus.cc:1273] T 93ecdce2da094dc9a80ac04828771fbd P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:31:03.854679 1665 raft_consensus.cc:513] T 40b74a261fdd495f84ceb0690f0b30ba P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:03.863513 1665 leader_election.cc:290] T 40b74a261fdd495f84ceb0690f0b30ba P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 2 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:31:03.872490 1589 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "40b74a261fdd495f84ceb0690f0b30ba" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
I20250625 03:31:03.873050 1589 raft_consensus.cc:3053] T 40b74a261fdd495f84ceb0690f0b30ba P 7e9c4f2e01164f33b2e9034ed148398e [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:31:03.873355 1589 raft_consensus.cc:738] T 40b74a261fdd495f84ceb0690f0b30ba P 7e9c4f2e01164f33b2e9034ed148398e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Running, Role: LEADER
I20250625 03:31:03.874845 1744 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "40b74a261fdd495f84ceb0690f0b30ba" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:31:03.877632 1744 raft_consensus.cc:3058] T 40b74a261fdd495f84ceb0690f0b30ba P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:03.873987 1589 consensus_queue.cc:260] T 40b74a261fdd495f84ceb0690f0b30ba P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:03.898829 1589 raft_consensus.cc:3058] T 40b74a261fdd495f84ceb0690f0b30ba P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:03.927681 1582 tablet_service.cc:1515] Processing DeleteTablet for tablet e38dc50880914156805b07aa82e30863 with delete_type TABLET_DATA_TOMBSTONED (TS 7e9c4f2e01164f33b2e9034ed148398e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52712
I20250625 03:31:03.928722 1589 raft_consensus.cc:2466] T 40b74a261fdd495f84ceb0690f0b30ba P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 2.
I20250625 03:31:03.929935 1635 leader_election.cc:304] T 40b74a261fdd495f84ceb0690f0b30ba P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e; no voters:
I20250625 03:31:03.931161 1744 raft_consensus.cc:2466] T 40b74a261fdd495f84ceb0690f0b30ba P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 2.
I20250625 03:31:03.931516 2877 raft_consensus.cc:2802] T 40b74a261fdd495f84ceb0690f0b30ba P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:31:03.932076 2877 raft_consensus.cc:695] T 40b74a261fdd495f84ceb0690f0b30ba P 3f2aa40978064c9e9983cf3745eed206 [term 2 LEADER]: Becoming Leader. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Running, Role: LEADER
I20250625 03:31:03.933252 2877 consensus_queue.cc:237] T 40b74a261fdd495f84ceb0690f0b30ba P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:03.938036 2875 raft_consensus.cc:2953] T af4573692c104d67994dbb1bc518b568 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:03.941766 1587 raft_consensus.cc:1273] T 93ecdce2da094dc9a80ac04828771fbd P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:31:03.945024 1663 raft_consensus.cc:2953] T af4573692c104d67994dbb1bc518b568 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:03.957917 2764 consensus_queue.cc:1035] T 93ecdce2da094dc9a80ac04828771fbd P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20250625 03:31:03.958312 2342 raft_consensus.cc:2953] T af4573692c104d67994dbb1bc518b568 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:03.977578 2880 tablet_replica.cc:331] T e38dc50880914156805b07aa82e30863 P 7e9c4f2e01164f33b2e9034ed148398e: stopping tablet replica
I20250625 03:31:03.987946 2809 raft_consensus.cc:991] T 542f85d76df8432593ee963669155a9d P 7e9c4f2e01164f33b2e9034ed148398e: : Instructing follower 3f2aa40978064c9e9983cf3745eed206 to start an election
I20250625 03:31:03.989398 2808 raft_consensus.cc:1079] T 542f85d76df8432593ee963669155a9d P 7e9c4f2e01164f33b2e9034ed148398e [term 1 LEADER]: Signalling peer 3f2aa40978064c9e9983cf3745eed206 to start an election
I20250625 03:31:04.005903 2864 consensus_queue.cc:1035] T 93ecdce2da094dc9a80ac04828771fbd P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20250625 03:31:04.009826 2879 raft_consensus.cc:991] T cc3b100d6d574a68b79e6a8f23d77201 P ba464e89e0f044a0a0ea3e6125cbf2a1: : Instructing follower 7e9c4f2e01164f33b2e9034ed148398e to start an election
I20250625 03:31:04.010318 2879 raft_consensus.cc:1079] T cc3b100d6d574a68b79e6a8f23d77201 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Signalling peer 7e9c4f2e01164f33b2e9034ed148398e to start an election
I20250625 03:31:04.011931 1587 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "cc3b100d6d574a68b79e6a8f23d77201"
dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
from {username='slave'} at 127.0.0.1:52726
I20250625 03:31:04.011981 2880 raft_consensus.cc:2241] T e38dc50880914156805b07aa82e30863 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:04.012620 1587 raft_consensus.cc:491] T cc3b100d6d574a68b79e6a8f23d77201 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:31:04.013005 2880 raft_consensus.cc:2270] T e38dc50880914156805b07aa82e30863 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:04.013046 1587 raft_consensus.cc:3058] T cc3b100d6d574a68b79e6a8f23d77201 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:04.016187 2864 consensus_queue.cc:1035] T 93ecdce2da094dc9a80ac04828771fbd P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:31:04.017009 2880 ts_tablet_manager.cc:1905] T e38dc50880914156805b07aa82e30863 P 7e9c4f2e01164f33b2e9034ed148398e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250625 03:31:04.018129 1492 catalog_manager.cc:5582] T 40b74a261fdd495f84ceb0690f0b30ba P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: term changed from 1 to 2, leader changed from 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) to 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130). New cstate: current_term: 2 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:04.019724 1492 catalog_manager.cc:5582] T af4573692c104d67994dbb1bc518b568 P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:04.025146 1587 raft_consensus.cc:513] T cc3b100d6d574a68b79e6a8f23d77201 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:04.026518 2864 raft_consensus.cc:991] T fb6e83db706647e28e491a02f1641980 P ba464e89e0f044a0a0ea3e6125cbf2a1: : Instructing follower df8b9755d156478aafca552f9e9c539e to start an election
I20250625 03:31:04.027165 2879 raft_consensus.cc:1079] T fb6e83db706647e28e491a02f1641980 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Signalling peer df8b9755d156478aafca552f9e9c539e to start an election
I20250625 03:31:03.993022 1745 raft_consensus.cc:2953] T af4573692c104d67994dbb1bc518b568 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:04.030303 2343 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "fb6e83db706647e28e491a02f1641980"
dest_uuid: "df8b9755d156478aafca552f9e9c539e"
from {username='slave'} at 127.0.0.1:54692
I20250625 03:31:04.030889 2343 raft_consensus.cc:491] T fb6e83db706647e28e491a02f1641980 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:31:04.031240 2343 raft_consensus.cc:3058] T fb6e83db706647e28e491a02f1641980 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:04.032799 1587 leader_election.cc:290] T cc3b100d6d574a68b79e6a8f23d77201 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 2 election: Requested vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:31:04.016611 1671 consensus_queue.cc:237] T 70328d972b5943009ef0c7d92cbae349 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:04.039860 2343 raft_consensus.cc:513] T fb6e83db706647e28e491a02f1641980 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:04.046866 1741 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cc3b100d6d574a68b79e6a8f23d77201" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:31:04.047528 1741 raft_consensus.cc:3053] T cc3b100d6d574a68b79e6a8f23d77201 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:31:04.047845 1741 raft_consensus.cc:738] T cc3b100d6d574a68b79e6a8f23d77201 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Running, Role: LEADER
I20250625 03:31:04.048632 1741 consensus_queue.cc:260] T cc3b100d6d574a68b79e6a8f23d77201 P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:04.049763 1741 raft_consensus.cc:3058] T cc3b100d6d574a68b79e6a8f23d77201 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:04.051090 1587 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fb6e83db706647e28e491a02f1641980" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
I20250625 03:31:04.053189 2343 leader_election.cc:290] T fb6e83db706647e28e491a02f1641980 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 2 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:31:04.054193 1587 raft_consensus.cc:3058] T fb6e83db706647e28e491a02f1641980 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:04.061573 1745 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fb6e83db706647e28e491a02f1641980" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:31:04.062201 1745 raft_consensus.cc:3053] T fb6e83db706647e28e491a02f1641980 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:31:04.062501 1745 raft_consensus.cc:738] T fb6e83db706647e28e491a02f1641980 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Running, Role: LEADER
I20250625 03:31:04.063210 1745 consensus_queue.cc:260] T fb6e83db706647e28e491a02f1641980 P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:04.064389 1745 raft_consensus.cc:3058] T fb6e83db706647e28e491a02f1641980 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:04.065506 1591 consensus_queue.cc:237] T af4573692c104d67994dbb1bc518b568 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:04.066669 1663 raft_consensus.cc:1273] T b3f18b9311894580bc336199d357df41 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Refusing update from remote peer df8b9755d156478aafca552f9e9c539e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250625 03:31:04.066980 1587 raft_consensus.cc:2466] T fb6e83db706647e28e491a02f1641980 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df8b9755d156478aafca552f9e9c539e in term 2.
I20250625 03:31:04.068037 2307 leader_election.cc:304] T fb6e83db706647e28e491a02f1641980 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e, df8b9755d156478aafca552f9e9c539e; no voters:
I20250625 03:31:04.068161 2867 consensus_queue.cc:1035] T b3f18b9311894580bc336199d357df41 P df8b9755d156478aafca552f9e9c539e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20250625 03:31:04.069500 2825 raft_consensus.cc:2802] T fb6e83db706647e28e491a02f1641980 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:31:04.069999 2825 raft_consensus.cc:695] T fb6e83db706647e28e491a02f1641980 P df8b9755d156478aafca552f9e9c539e [term 2 LEADER]: Becoming Leader. State: Replica: df8b9755d156478aafca552f9e9c539e, State: Running, Role: LEADER
I20250625 03:31:04.070842 2825 consensus_queue.cc:237] T fb6e83db706647e28e491a02f1641980 P df8b9755d156478aafca552f9e9c539e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:04.075232 1741 raft_consensus.cc:2466] T cc3b100d6d574a68b79e6a8f23d77201 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 2.
I20250625 03:31:04.076503 2343 raft_consensus.cc:1273] T af4573692c104d67994dbb1bc518b568 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250625 03:31:04.076912 1745 raft_consensus.cc:2466] T fb6e83db706647e28e491a02f1641980 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df8b9755d156478aafca552f9e9c539e in term 2.
I20250625 03:31:04.079659 2809 consensus_queue.cc:1035] T af4573692c104d67994dbb1bc518b568 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20250625 03:31:04.087329 2341 raft_consensus.cc:1273] T 70328d972b5943009ef0c7d92cbae349 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250625 03:31:04.087065 1494 catalog_manager.cc:5582] T fb6e83db706647e28e491a02f1641980 P df8b9755d156478aafca552f9e9c539e reported cstate change: term changed from 1 to 2, leader changed from ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) to df8b9755d156478aafca552f9e9c539e (127.0.106.132). New cstate: current_term: 2 leader_uuid: "df8b9755d156478aafca552f9e9c539e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250625 03:31:04.090634 2809 raft_consensus.cc:2953] T af4573692c104d67994dbb1bc518b568 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:04.092412 2343 raft_consensus.cc:2953] T af4573692c104d67994dbb1bc518b568 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:04.095366 2791 consensus_queue.cc:1035] T 70328d972b5943009ef0c7d92cbae349 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:31:04.108901 2880 ts_tablet_manager.cc:1918] T e38dc50880914156805b07aa82e30863 P 7e9c4f2e01164f33b2e9034ed148398e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20250625 03:31:04.109516 2880 log.cc:1199] T e38dc50880914156805b07aa82e30863 P 7e9c4f2e01164f33b2e9034ed148398e: Deleting WAL directory at /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/ts-0-root/wals/e38dc50880914156805b07aa82e30863
I20250625 03:31:04.110680 2877 raft_consensus.cc:2953] T 70328d972b5943009ef0c7d92cbae349 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:04.113332 2341 raft_consensus.cc:2953] T 70328d972b5943009ef0c7d92cbae349 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:04.114115 1494 catalog_manager.cc:5582] T af4573692c104d67994dbb1bc518b568 P df8b9755d156478aafca552f9e9c539e reported cstate change: config changed from index 3 to 4, VOTER 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) evicted. New cstate: current_term: 1 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:04.116183 1479 catalog_manager.cc:5095] ChangeConfig:REMOVE_PEER RPC for tablet af4573692c104d67994dbb1bc518b568 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250625 03:31:04.116912 1479 catalog_manager.cc:4928] TS 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): tablet e38dc50880914156805b07aa82e30863 (table test-workload [id=7f663eabec024fd1911b406c660fa838]) successfully deleted
I20250625 03:31:04.127249 1587 raft_consensus.cc:1273] T b3f18b9311894580bc336199d357df41 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Refusing update from remote peer df8b9755d156478aafca552f9e9c539e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250625 03:31:04.128333 1658 tablet_service.cc:1515] Processing DeleteTablet for tablet af4573692c104d67994dbb1bc518b568 with delete_type TABLET_DATA_TOMBSTONED (TS 3f2aa40978064c9e9983cf3745eed206 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53744
I20250625 03:31:04.128583 2824 consensus_queue.cc:1035] T b3f18b9311894580bc336199d357df41 P df8b9755d156478aafca552f9e9c539e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250625 03:31:04.137023 1745 raft_consensus.cc:1273] T af4573692c104d67994dbb1bc518b568 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250625 03:31:04.135387 1493 catalog_manager.cc:5582] T 70328d972b5943009ef0c7d92cbae349 P df8b9755d156478aafca552f9e9c539e reported cstate change: config changed from index 3 to 4, VOTER ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) evicted. New cstate: current_term: 1 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:04.137879 1561 leader_election.cc:304] T cc3b100d6d574a68b79e6a8f23d77201 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters:
I20250625 03:31:04.138779 2838 raft_consensus.cc:2802] T cc3b100d6d574a68b79e6a8f23d77201 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:31:04.139236 2838 raft_consensus.cc:695] T cc3b100d6d574a68b79e6a8f23d77201 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 LEADER]: Becoming Leader. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Running, Role: LEADER
I20250625 03:31:04.140076 2809 consensus_queue.cc:1035] T af4573692c104d67994dbb1bc518b568 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:31:04.142585 1589 raft_consensus.cc:1273] T 70328d972b5943009ef0c7d92cbae349 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250625 03:31:04.144450 2838 consensus_queue.cc:237] T cc3b100d6d574a68b79e6a8f23d77201 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:04.158886 2791 consensus_queue.cc:1035] T 70328d972b5943009ef0c7d92cbae349 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:31:04.159323 1732 tablet_service.cc:1515] Processing DeleteTablet for tablet 70328d972b5943009ef0c7d92cbae349 with delete_type TABLET_DATA_TOMBSTONED (TS ba464e89e0f044a0a0ea3e6125cbf2a1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43672
I20250625 03:31:04.163581 1741 raft_consensus.cc:2953] T af4573692c104d67994dbb1bc518b568 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:04.169111 2872 raft_consensus.cc:2953] T 93ecdce2da094dc9a80ac04828771fbd P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:04.175984 1591 raft_consensus.cc:2953] T 70328d972b5943009ef0c7d92cbae349 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:04.222204 1669 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "542f85d76df8432593ee963669155a9d"
dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
from {username='slave'} at 127.0.0.1:53758
I20250625 03:31:04.225399 2345 raft_consensus.cc:2953] T 93ecdce2da094dc9a80ac04828771fbd P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:04.229859 1666 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cc3b100d6d574a68b79e6a8f23d77201" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:31:04.230458 1666 raft_consensus.cc:3058] T cc3b100d6d574a68b79e6a8f23d77201 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:04.235100 1494 catalog_manager.cc:5582] T cc3b100d6d574a68b79e6a8f23d77201 P 7e9c4f2e01164f33b2e9034ed148398e reported cstate change: term changed from 1 to 2, leader changed from ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) to 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129). New cstate: current_term: 2 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:04.249397 1493 catalog_manager.cc:5582] T 93ecdce2da094dc9a80ac04828771fbd P df8b9755d156478aafca552f9e9c539e reported cstate change: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:04.251313 1478 catalog_manager.cc:5095] ChangeConfig:REMOVE_PEER RPC for tablet 70328d972b5943009ef0c7d92cbae349 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250625 03:31:04.254302 1670 raft_consensus.cc:2953] T 93ecdce2da094dc9a80ac04828771fbd P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:04.233073 1669 raft_consensus.cc:491] T 542f85d76df8432593ee963669155a9d P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:31:04.263111 1669 raft_consensus.cc:3058] T 542f85d76df8432593ee963669155a9d P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:04.260690 2891 tablet_replica.cc:331] T 70328d972b5943009ef0c7d92cbae349 P ba464e89e0f044a0a0ea3e6125cbf2a1: stopping tablet replica
I20250625 03:31:04.266768 2888 tablet_replica.cc:331] T af4573692c104d67994dbb1bc518b568 P 3f2aa40978064c9e9983cf3745eed206: stopping tablet replica
I20250625 03:31:04.272447 2888 raft_consensus.cc:2241] T af4573692c104d67994dbb1bc518b568 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:04.273351 2888 raft_consensus.cc:2270] T af4573692c104d67994dbb1bc518b568 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:04.272536 2891 raft_consensus.cc:2241] T 70328d972b5943009ef0c7d92cbae349 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:04.282991 2888 ts_tablet_manager.cc:1905] T af4573692c104d67994dbb1bc518b568 P 3f2aa40978064c9e9983cf3745eed206: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250625 03:31:04.292358 2891 raft_consensus.cc:2270] T 70328d972b5943009ef0c7d92cbae349 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:04.290361 1666 raft_consensus.cc:2466] T cc3b100d6d574a68b79e6a8f23d77201 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 2.
I20250625 03:31:04.295192 1591 raft_consensus.cc:2953] T 93ecdce2da094dc9a80ac04828771fbd P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:04.306680 2888 ts_tablet_manager.cc:1918] T af4573692c104d67994dbb1bc518b568 P 3f2aa40978064c9e9983cf3745eed206: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20250625 03:31:04.307301 2888 log.cc:1199] T af4573692c104d67994dbb1bc518b568 P 3f2aa40978064c9e9983cf3745eed206: Deleting WAL directory at /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/ts-1-root/wals/af4573692c104d67994dbb1bc518b568
I20250625 03:31:04.309262 1478 catalog_manager.cc:4928] TS 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): tablet af4573692c104d67994dbb1bc518b568 (table test-workload [id=7f663eabec024fd1911b406c660fa838]) successfully deleted
I20250625 03:31:04.314247 1669 raft_consensus.cc:513] T 542f85d76df8432593ee963669155a9d P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:04.317198 1591 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "542f85d76df8432593ee963669155a9d" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
I20250625 03:31:04.317783 1591 raft_consensus.cc:3053] T 542f85d76df8432593ee963669155a9d P 7e9c4f2e01164f33b2e9034ed148398e [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:31:04.318086 1591 raft_consensus.cc:738] T 542f85d76df8432593ee963669155a9d P 7e9c4f2e01164f33b2e9034ed148398e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Running, Role: LEADER
I20250625 03:31:04.320384 2891 ts_tablet_manager.cc:1905] T 70328d972b5943009ef0c7d92cbae349 P ba464e89e0f044a0a0ea3e6125cbf2a1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250625 03:31:04.321383 1669 leader_election.cc:290] T 542f85d76df8432593ee963669155a9d P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 2 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:31:04.318779 1591 consensus_queue.cc:260] T 542f85d76df8432593ee963669155a9d P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:04.323676 1737 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "542f85d76df8432593ee963669155a9d" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:31:04.324095 1591 raft_consensus.cc:3058] T 542f85d76df8432593ee963669155a9d P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:04.324339 1737 raft_consensus.cc:3058] T 542f85d76df8432593ee963669155a9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:04.332516 1590 raft_consensus.cc:1273] T 40b74a261fdd495f84ceb0690f0b30ba P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:04.334187 2878 consensus_queue.cc:1035] T 40b74a261fdd495f84ceb0690f0b30ba P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20250625 03:31:04.336681 1591 raft_consensus.cc:2466] T 542f85d76df8432593ee963669155a9d P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 2.
I20250625 03:31:04.337643 1635 leader_election.cc:304] T 542f85d76df8432593ee963669155a9d P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e; no voters:
I20250625 03:31:04.338634 2835 raft_consensus.cc:2802] T 542f85d76df8432593ee963669155a9d P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:31:04.339267 2835 raft_consensus.cc:695] T 542f85d76df8432593ee963669155a9d P 3f2aa40978064c9e9983cf3745eed206 [term 2 LEADER]: Becoming Leader. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Running, Role: LEADER
I20250625 03:31:04.339475 1737 raft_consensus.cc:2466] T 542f85d76df8432593ee963669155a9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 2.
I20250625 03:31:04.340490 2835 consensus_queue.cc:237] T 542f85d76df8432593ee963669155a9d P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:04.326216 1744 consensus_queue.cc:237] T 93ecdce2da094dc9a80ac04828771fbd P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:04.358695 1739 raft_consensus.cc:1273] T 40b74a261fdd495f84ceb0690f0b30ba P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:04.360255 2836 consensus_queue.cc:1035] T 40b74a261fdd495f84ceb0690f0b30ba P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:04.366410 1589 raft_consensus.cc:1273] T 93ecdce2da094dc9a80ac04828771fbd P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250625 03:31:04.368029 2345 raft_consensus.cc:1273] T 93ecdce2da094dc9a80ac04828771fbd P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250625 03:31:04.367955 2872 consensus_queue.cc:1035] T 93ecdce2da094dc9a80ac04828771fbd P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:31:04.371378 2797 consensus_queue.cc:1035] T 93ecdce2da094dc9a80ac04828771fbd P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:31:04.379228 2891 ts_tablet_manager.cc:1918] T 70328d972b5943009ef0c7d92cbae349 P ba464e89e0f044a0a0ea3e6125cbf2a1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20250625 03:31:04.379719 2891 log.cc:1199] T 70328d972b5943009ef0c7d92cbae349 P ba464e89e0f044a0a0ea3e6125cbf2a1: Deleting WAL directory at /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/ts-2-root/wals/70328d972b5943009ef0c7d92cbae349
I20250625 03:31:04.380307 1493 catalog_manager.cc:5582] T 542f85d76df8432593ee963669155a9d P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: term changed from 1 to 2, leader changed from 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) to 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130). New cstate: current_term: 2 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:04.385100 2764 raft_consensus.cc:2953] T 93ecdce2da094dc9a80ac04828771fbd P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:04.388536 1480 catalog_manager.cc:4928] TS ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): tablet 70328d972b5943009ef0c7d92cbae349 (table test-workload [id=7f663eabec024fd1911b406c660fa838]) successfully deleted
I20250625 03:31:04.399909 2345 raft_consensus.cc:2953] T 93ecdce2da094dc9a80ac04828771fbd P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:04.407280 1591 raft_consensus.cc:2953] T 93ecdce2da094dc9a80ac04828771fbd P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:04.436810 1480 catalog_manager.cc:5095] ChangeConfig:REMOVE_PEER RPC for tablet 93ecdce2da094dc9a80ac04828771fbd with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250625 03:31:04.450064 1492 catalog_manager.cc:5582] T 93ecdce2da094dc9a80ac04828771fbd P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: config changed from index 3 to 4, VOTER 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) evicted. New cstate: current_term: 1 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250625 03:31:04.466169 1658 tablet_service.cc:1515] Processing DeleteTablet for tablet 93ecdce2da094dc9a80ac04828771fbd with delete_type TABLET_DATA_TOMBSTONED (TS 3f2aa40978064c9e9983cf3745eed206 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53744
I20250625 03:31:04.467103 2888 tablet_replica.cc:331] T 93ecdce2da094dc9a80ac04828771fbd P 3f2aa40978064c9e9983cf3745eed206: stopping tablet replica
I20250625 03:31:04.468317 2888 raft_consensus.cc:2241] T 93ecdce2da094dc9a80ac04828771fbd P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:04.468866 2888 raft_consensus.cc:2270] T 93ecdce2da094dc9a80ac04828771fbd P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:04.472393 2888 ts_tablet_manager.cc:1905] T 93ecdce2da094dc9a80ac04828771fbd P 3f2aa40978064c9e9983cf3745eed206: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250625 03:31:04.486105 2888 ts_tablet_manager.cc:1918] T 93ecdce2da094dc9a80ac04828771fbd P 3f2aa40978064c9e9983cf3745eed206: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20250625 03:31:04.486415 2888 log.cc:1199] T 93ecdce2da094dc9a80ac04828771fbd P 3f2aa40978064c9e9983cf3745eed206: Deleting WAL directory at /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/ts-1-root/wals/93ecdce2da094dc9a80ac04828771fbd
I20250625 03:31:04.487754 1478 catalog_manager.cc:4928] TS 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): tablet 93ecdce2da094dc9a80ac04828771fbd (table test-workload [id=7f663eabec024fd1911b406c660fa838]) successfully deleted
I20250625 03:31:04.672091 1669 raft_consensus.cc:1273] T cc3b100d6d574a68b79e6a8f23d77201 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:04.673578 2838 consensus_queue.cc:1035] T cc3b100d6d574a68b79e6a8f23d77201 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:04.684144 1591 raft_consensus.cc:1273] T fb6e83db706647e28e491a02f1641980 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Refusing update from remote peer df8b9755d156478aafca552f9e9c539e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250625 03:31:04.684240 1741 raft_consensus.cc:1273] T cc3b100d6d574a68b79e6a8f23d77201 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:04.685424 2824 consensus_queue.cc:1035] T fb6e83db706647e28e491a02f1641980 P df8b9755d156478aafca552f9e9c539e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250625 03:31:04.686265 2837 consensus_queue.cc:1035] T cc3b100d6d574a68b79e6a8f23d77201 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:04.697865 1741 raft_consensus.cc:1273] T fb6e83db706647e28e491a02f1641980 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Refusing update from remote peer df8b9755d156478aafca552f9e9c539e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250625 03:31:04.699249 2824 consensus_queue.cc:1035] T fb6e83db706647e28e491a02f1641980 P df8b9755d156478aafca552f9e9c539e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250625 03:31:04.739830 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:31:04.814862 1666 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "70328d972b5943009ef0c7d92cbae349"
dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
mode: GRACEFUL
new_leader_uuid: "df8b9755d156478aafca552f9e9c539e"
from {username='slave'} at 127.0.0.1:35370
I20250625 03:31:04.815424 1666 raft_consensus.cc:604] T 70328d972b5943009ef0c7d92cbae349 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Received request to transfer leadership to TS df8b9755d156478aafca552f9e9c539e
I20250625 03:31:04.817893 1737 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "7553473daeb342ceaf782ddee8e4fc4d"
dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
mode: GRACEFUL
new_leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
from {username='slave'} at 127.0.0.1:47496
I20250625 03:31:04.818488 1737 raft_consensus.cc:604] T 7553473daeb342ceaf782ddee8e4fc4d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Received request to transfer leadership to TS 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:31:04.820714 1737 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "96030b80e1f340afa81659faaaf68755"
dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
mode: GRACEFUL
new_leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
from {username='slave'} at 127.0.0.1:47496
I20250625 03:31:04.821112 1737 raft_consensus.cc:604] T 96030b80e1f340afa81659faaaf68755 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Received request to transfer leadership to TS 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:31:04.823194 1666 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "9643cfd400804eb8b9037c5e9efddfba"
dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
mode: GRACEFUL
new_leader_uuid: "df8b9755d156478aafca552f9e9c539e"
from {username='slave'} at 127.0.0.1:35370
I20250625 03:31:04.823662 1666 raft_consensus.cc:604] T 9643cfd400804eb8b9037c5e9efddfba P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Received request to transfer leadership to TS df8b9755d156478aafca552f9e9c539e
I20250625 03:31:04.825654 1589 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "a5a18934cc3f490288432ee1cb30b278"
dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
mode: GRACEFUL
new_leader_uuid: "3f2aa40978064c9e9983cf3745eed206"
from {username='slave'} at 127.0.0.1:47018
I20250625 03:31:04.826205 1589 raft_consensus.cc:604] T a5a18934cc3f490288432ee1cb30b278 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 LEADER]: Received request to transfer leadership to TS 3f2aa40978064c9e9983cf3745eed206
I20250625 03:31:04.827368 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20250625 03:31:04.828505 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:31:04.829048 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:31:04.868521 2838 raft_consensus.cc:991] T a5a18934cc3f490288432ee1cb30b278 P 7e9c4f2e01164f33b2e9034ed148398e: : Instructing follower 3f2aa40978064c9e9983cf3745eed206 to start an election
I20250625 03:31:04.869011 2769 raft_consensus.cc:1079] T a5a18934cc3f490288432ee1cb30b278 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 LEADER]: Signalling peer 3f2aa40978064c9e9983cf3745eed206 to start an election
I20250625 03:31:04.870296 1670 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "a5a18934cc3f490288432ee1cb30b278"
dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
from {username='slave'} at 127.0.0.1:53758
I20250625 03:31:04.870749 1670 raft_consensus.cc:491] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:31:04.871016 1670 raft_consensus.cc:3058] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:04.875818 1737 raft_consensus.cc:1273] T 542f85d76df8432593ee963669155a9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:04.877125 2782 consensus_queue.cc:1035] T 542f85d76df8432593ee963669155a9d P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:04.877723 1670 raft_consensus.cc:513] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:04.879608 1670 leader_election.cc:290] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 2 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:31:04.880796 1744 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a5a18934cc3f490288432ee1cb30b278" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:31:04.884256 1744 raft_consensus.cc:3058] T a5a18934cc3f490288432ee1cb30b278 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:04.891402 1589 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a5a18934cc3f490288432ee1cb30b278" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
I20250625 03:31:04.892040 1589 raft_consensus.cc:3053] T a5a18934cc3f490288432ee1cb30b278 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:31:04.892366 1589 raft_consensus.cc:738] T a5a18934cc3f490288432ee1cb30b278 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Running, Role: LEADER
I20250625 03:31:04.893079 1589 consensus_queue.cc:260] T a5a18934cc3f490288432ee1cb30b278 P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:04.894268 1589 raft_consensus.cc:3058] T a5a18934cc3f490288432ee1cb30b278 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:04.894861 1591 raft_consensus.cc:1273] T 542f85d76df8432593ee963669155a9d P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:04.896101 2835 consensus_queue.cc:1035] T 542f85d76df8432593ee963669155a9d P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:04.903240 1589 raft_consensus.cc:2466] T a5a18934cc3f490288432ee1cb30b278 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 2.
I20250625 03:31:04.903523 1744 raft_consensus.cc:2466] T a5a18934cc3f490288432ee1cb30b278 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 2.
I20250625 03:31:04.904482 1635 leader_election.cc:304] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e; no voters:
I20250625 03:31:04.906176 2835 raft_consensus.cc:2802] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:31:04.906827 2835 raft_consensus.cc:695] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206 [term 2 LEADER]: Becoming Leader. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Running, Role: LEADER
I20250625 03:31:04.919409 2835 consensus_queue.cc:237] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:04.938483 1493 catalog_manager.cc:5582] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: term changed from 1 to 2, leader changed from 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) to 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130). New cstate: current_term: 2 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:05.156126 2797 raft_consensus.cc:991] T 96030b80e1f340afa81659faaaf68755 P ba464e89e0f044a0a0ea3e6125cbf2a1: : Instructing follower 7e9c4f2e01164f33b2e9034ed148398e to start an election
I20250625 03:31:05.156548 2864 raft_consensus.cc:1079] T 96030b80e1f340afa81659faaaf68755 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Signalling peer 7e9c4f2e01164f33b2e9034ed148398e to start an election
I20250625 03:31:05.157724 1587 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "96030b80e1f340afa81659faaaf68755"
dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
from {username='slave'} at 127.0.0.1:52726
I20250625 03:31:05.158118 1587 raft_consensus.cc:491] T 96030b80e1f340afa81659faaaf68755 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:31:05.158355 1587 raft_consensus.cc:3058] T 96030b80e1f340afa81659faaaf68755 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:05.163233 1587 raft_consensus.cc:513] T 96030b80e1f340afa81659faaaf68755 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:05.164597 1587 leader_election.cc:290] T 96030b80e1f340afa81659faaaf68755 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 2 election: Requested vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:31:05.165310 1666 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "96030b80e1f340afa81659faaaf68755" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:31:05.165504 1737 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "96030b80e1f340afa81659faaaf68755" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:31:05.165899 1666 raft_consensus.cc:3058] T 96030b80e1f340afa81659faaaf68755 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:05.166011 1737 raft_consensus.cc:3053] T 96030b80e1f340afa81659faaaf68755 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:31:05.166424 1737 raft_consensus.cc:738] T 96030b80e1f340afa81659faaaf68755 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Running, Role: LEADER
I20250625 03:31:05.167244 1737 consensus_queue.cc:260] T 96030b80e1f340afa81659faaaf68755 P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:05.168445 1737 raft_consensus.cc:3058] T 96030b80e1f340afa81659faaaf68755 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:05.170697 1666 raft_consensus.cc:2466] T 96030b80e1f340afa81659faaaf68755 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 2.
I20250625 03:31:05.171720 1559 leader_election.cc:304] T 96030b80e1f340afa81659faaaf68755 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e; no voters:
I20250625 03:31:05.172473 2769 raft_consensus.cc:2802] T 96030b80e1f340afa81659faaaf68755 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:31:05.172927 2769 raft_consensus.cc:695] T 96030b80e1f340afa81659faaaf68755 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 LEADER]: Becoming Leader. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Running, Role: LEADER
I20250625 03:31:05.173815 2769 consensus_queue.cc:237] T 96030b80e1f340afa81659faaaf68755 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:05.172974 1737 raft_consensus.cc:2466] T 96030b80e1f340afa81659faaaf68755 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 2.
I20250625 03:31:05.192435 1493 catalog_manager.cc:5582] T 96030b80e1f340afa81659faaaf68755 P 7e9c4f2e01164f33b2e9034ed148398e reported cstate change: term changed from 1 to 2, leader changed from ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) to 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129). New cstate: current_term: 2 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:05.230459 2835 raft_consensus.cc:991] T 70328d972b5943009ef0c7d92cbae349 P 3f2aa40978064c9e9983cf3745eed206: : Instructing follower df8b9755d156478aafca552f9e9c539e to start an election
I20250625 03:31:05.230945 2782 raft_consensus.cc:1079] T 70328d972b5943009ef0c7d92cbae349 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Signalling peer df8b9755d156478aafca552f9e9c539e to start an election
I20250625 03:31:05.232301 2343 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "70328d972b5943009ef0c7d92cbae349"
dest_uuid: "df8b9755d156478aafca552f9e9c539e"
from {username='slave'} at 127.0.0.1:33226
I20250625 03:31:05.232831 2343 raft_consensus.cc:491] T 70328d972b5943009ef0c7d92cbae349 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:31:05.233170 2343 raft_consensus.cc:3058] T 70328d972b5943009ef0c7d92cbae349 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:05.241261 2343 raft_consensus.cc:513] T 70328d972b5943009ef0c7d92cbae349 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:05.242681 2343 leader_election.cc:290] T 70328d972b5943009ef0c7d92cbae349 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 2 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:31:05.243520 1587 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "70328d972b5943009ef0c7d92cbae349" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
I20250625 03:31:05.243575 1666 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "70328d972b5943009ef0c7d92cbae349" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:31:05.244221 1587 raft_consensus.cc:3058] T 70328d972b5943009ef0c7d92cbae349 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:05.244290 1666 raft_consensus.cc:3053] T 70328d972b5943009ef0c7d92cbae349 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:31:05.244714 1666 raft_consensus.cc:738] T 70328d972b5943009ef0c7d92cbae349 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Running, Role: LEADER
I20250625 03:31:05.245441 1666 consensus_queue.cc:260] T 70328d972b5943009ef0c7d92cbae349 P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:05.246551 1666 raft_consensus.cc:3058] T 70328d972b5943009ef0c7d92cbae349 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:05.250757 2797 raft_consensus.cc:991] T 7553473daeb342ceaf782ddee8e4fc4d P ba464e89e0f044a0a0ea3e6125cbf2a1: : Instructing follower 7e9c4f2e01164f33b2e9034ed148398e to start an election
I20250625 03:31:05.251371 2869 raft_consensus.cc:1079] T 7553473daeb342ceaf782ddee8e4fc4d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Signalling peer 7e9c4f2e01164f33b2e9034ed148398e to start an election
I20250625 03:31:05.252563 1587 raft_consensus.cc:2466] T 70328d972b5943009ef0c7d92cbae349 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df8b9755d156478aafca552f9e9c539e in term 2.
I20250625 03:31:05.252777 1589 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "7553473daeb342ceaf782ddee8e4fc4d"
dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
from {username='slave'} at 127.0.0.1:52726
I20250625 03:31:05.252964 1666 raft_consensus.cc:2466] T 70328d972b5943009ef0c7d92cbae349 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df8b9755d156478aafca552f9e9c539e in term 2.
I20250625 03:31:05.253304 1589 raft_consensus.cc:491] T 7553473daeb342ceaf782ddee8e4fc4d P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:31:05.253700 1589 raft_consensus.cc:3058] T 7553473daeb342ceaf782ddee8e4fc4d P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:05.253729 2307 leader_election.cc:304] T 70328d972b5943009ef0c7d92cbae349 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e, df8b9755d156478aafca552f9e9c539e; no voters:
I20250625 03:31:05.254518 2904 raft_consensus.cc:2802] T 70328d972b5943009ef0c7d92cbae349 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:31:05.254899 2904 raft_consensus.cc:695] T 70328d972b5943009ef0c7d92cbae349 P df8b9755d156478aafca552f9e9c539e [term 2 LEADER]: Becoming Leader. State: Replica: df8b9755d156478aafca552f9e9c539e, State: Running, Role: LEADER
I20250625 03:31:05.255649 2904 consensus_queue.cc:237] T 70328d972b5943009ef0c7d92cbae349 P df8b9755d156478aafca552f9e9c539e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:05.258744 1589 raft_consensus.cc:513] T 7553473daeb342ceaf782ddee8e4fc4d P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:05.261101 1670 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7553473daeb342ceaf782ddee8e4fc4d" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:31:05.261655 1670 raft_consensus.cc:3058] T 7553473daeb342ceaf782ddee8e4fc4d P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:05.262183 1589 leader_election.cc:290] T 7553473daeb342ceaf782ddee8e4fc4d P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 2 election: Requested vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:31:05.268786 1670 raft_consensus.cc:2466] T 7553473daeb342ceaf782ddee8e4fc4d P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 2.
I20250625 03:31:05.270486 1559 leader_election.cc:304] T 7553473daeb342ceaf782ddee8e4fc4d P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e; no voters:
I20250625 03:31:05.271560 1744 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7553473daeb342ceaf782ddee8e4fc4d" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:31:05.271983 2838 raft_consensus.cc:2802] T 7553473daeb342ceaf782ddee8e4fc4d P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:31:05.272159 1744 raft_consensus.cc:3053] T 7553473daeb342ceaf782ddee8e4fc4d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:31:05.272541 1744 raft_consensus.cc:738] T 7553473daeb342ceaf782ddee8e4fc4d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Running, Role: LEADER
I20250625 03:31:05.272491 1493 catalog_manager.cc:5582] T 70328d972b5943009ef0c7d92cbae349 P df8b9755d156478aafca552f9e9c539e reported cstate change: term changed from 1 to 2, leader changed from 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) to df8b9755d156478aafca552f9e9c539e (127.0.106.132). New cstate: current_term: 2 leader_uuid: "df8b9755d156478aafca552f9e9c539e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250625 03:31:05.273382 1744 consensus_queue.cc:260] T 7553473daeb342ceaf782ddee8e4fc4d P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:05.274549 1744 raft_consensus.cc:3058] T 7553473daeb342ceaf782ddee8e4fc4d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:05.272563 2838 raft_consensus.cc:695] T 7553473daeb342ceaf782ddee8e4fc4d P 7e9c4f2e01164f33b2e9034ed148398e [term 2 LEADER]: Becoming Leader. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Running, Role: LEADER
I20250625 03:31:05.277875 2838 consensus_queue.cc:237] T 7553473daeb342ceaf782ddee8e4fc4d P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:05.283912 1744 raft_consensus.cc:2466] T 7553473daeb342ceaf782ddee8e4fc4d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 2.
I20250625 03:31:05.307363 1493 catalog_manager.cc:5582] T 7553473daeb342ceaf782ddee8e4fc4d P 7e9c4f2e01164f33b2e9034ed148398e reported cstate change: term changed from 1 to 2, leader changed from ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) to 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129). New cstate: current_term: 2 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:05.349191 2782 raft_consensus.cc:991] T 9643cfd400804eb8b9037c5e9efddfba P 3f2aa40978064c9e9983cf3745eed206: : Instructing follower df8b9755d156478aafca552f9e9c539e to start an election
I20250625 03:31:05.349694 2782 raft_consensus.cc:1079] T 9643cfd400804eb8b9037c5e9efddfba P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Signalling peer df8b9755d156478aafca552f9e9c539e to start an election
I20250625 03:31:05.351181 2343 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "9643cfd400804eb8b9037c5e9efddfba"
dest_uuid: "df8b9755d156478aafca552f9e9c539e"
from {username='slave'} at 127.0.0.1:33226
I20250625 03:31:05.351696 2343 raft_consensus.cc:491] T 9643cfd400804eb8b9037c5e9efddfba P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:31:05.352056 2343 raft_consensus.cc:3058] T 9643cfd400804eb8b9037c5e9efddfba P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:05.354315 1587 raft_consensus.cc:1273] T a5a18934cc3f490288432ee1cb30b278 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:05.358150 2343 raft_consensus.cc:513] T 9643cfd400804eb8b9037c5e9efddfba P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:05.359604 2908 consensus_queue.cc:1035] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:05.360601 2343 leader_election.cc:290] T 9643cfd400804eb8b9037c5e9efddfba P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 2 election: Requested vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:31:05.361932 1670 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9643cfd400804eb8b9037c5e9efddfba" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:31:05.362533 1744 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9643cfd400804eb8b9037c5e9efddfba" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:31:05.362592 1670 raft_consensus.cc:3053] T 9643cfd400804eb8b9037c5e9efddfba P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:31:05.363143 1670 raft_consensus.cc:738] T 9643cfd400804eb8b9037c5e9efddfba P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Running, Role: LEADER
I20250625 03:31:05.363929 1670 consensus_queue.cc:260] T 9643cfd400804eb8b9037c5e9efddfba P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:05.365149 1670 raft_consensus.cc:3058] T 9643cfd400804eb8b9037c5e9efddfba P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:05.371966 1670 raft_consensus.cc:2466] T 9643cfd400804eb8b9037c5e9efddfba P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df8b9755d156478aafca552f9e9c539e in term 2.
I20250625 03:31:05.372947 2306 leader_election.cc:304] T 9643cfd400804eb8b9037c5e9efddfba P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, df8b9755d156478aafca552f9e9c539e; no voters:
I20250625 03:31:05.373811 2904 raft_consensus.cc:2802] T 9643cfd400804eb8b9037c5e9efddfba P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:31:05.374296 2904 raft_consensus.cc:695] T 9643cfd400804eb8b9037c5e9efddfba P df8b9755d156478aafca552f9e9c539e [term 2 LEADER]: Becoming Leader. State: Replica: df8b9755d156478aafca552f9e9c539e, State: Running, Role: LEADER
I20250625 03:31:05.375113 2904 consensus_queue.cc:237] T 9643cfd400804eb8b9037c5e9efddfba P df8b9755d156478aafca552f9e9c539e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:05.375672 1737 raft_consensus.cc:1273] T a5a18934cc3f490288432ee1cb30b278 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:05.380491 2908 consensus_queue.cc:1035] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:05.363155 1744 raft_consensus.cc:3058] T 9643cfd400804eb8b9037c5e9efddfba P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:05.386920 1744 raft_consensus.cc:2466] T 9643cfd400804eb8b9037c5e9efddfba P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df8b9755d156478aafca552f9e9c539e in term 2.
I20250625 03:31:05.402588 1492 catalog_manager.cc:5582] T 9643cfd400804eb8b9037c5e9efddfba P df8b9755d156478aafca552f9e9c539e reported cstate change: term changed from 1 to 2, leader changed from 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) to df8b9755d156478aafca552f9e9c539e (127.0.106.132). New cstate: current_term: 2 leader_uuid: "df8b9755d156478aafca552f9e9c539e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250625 03:31:05.502909 1587 consensus_queue.cc:237] T cc3b100d6d574a68b79e6a8f23d77201 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:31:05.507371 1737 raft_consensus.cc:1273] T cc3b100d6d574a68b79e6a8f23d77201 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20250625 03:31:05.507584 1666 raft_consensus.cc:1273] T cc3b100d6d574a68b79e6a8f23d77201 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20250625 03:31:05.507858 1559 consensus_peers.cc:487] T cc3b100d6d574a68b79e6a8f23d77201 P 7e9c4f2e01164f33b2e9034ed148398e -> Peer df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493): Couldn't send request to peer df8b9755d156478aafca552f9e9c539e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cc3b100d6d574a68b79e6a8f23d77201. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:05.508688 2808 consensus_queue.cc:1035] T cc3b100d6d574a68b79e6a8f23d77201 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:31:05.509502 2912 consensus_queue.cc:1035] T cc3b100d6d574a68b79e6a8f23d77201 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:31:05.519151 2912 raft_consensus.cc:2953] T cc3b100d6d574a68b79e6a8f23d77201 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:05.521050 1666 raft_consensus.cc:2953] T cc3b100d6d574a68b79e6a8f23d77201 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:05.522085 1737 raft_consensus.cc:2953] T cc3b100d6d574a68b79e6a8f23d77201 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:05.537688 1493 catalog_manager.cc:5582] T cc3b100d6d574a68b79e6a8f23d77201 P 7e9c4f2e01164f33b2e9034ed148398e reported cstate change: config changed from index -1 to 3, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New cstate: current_term: 2 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:05.561760 1737 consensus_queue.cc:237] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:31:05.568346 1666 raft_consensus.cc:1273] T b31026f89f1e49949acec419db9649d3 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20250625 03:31:05.568954 1708 consensus_peers.cc:487] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493): Couldn't send request to peer df8b9755d156478aafca552f9e9c539e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b31026f89f1e49949acec419db9649d3. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:05.570183 2914 consensus_queue.cc:1035] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:05.572588 1587 raft_consensus.cc:1273] T b31026f89f1e49949acec419db9649d3 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 03:31:05.573964 2914 consensus_queue.cc:1035] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:05.581307 2915 raft_consensus.cc:2953] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:05.582983 1666 raft_consensus.cc:2953] T b31026f89f1e49949acec419db9649d3 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:05.583472 1587 raft_consensus.cc:2953] T b31026f89f1e49949acec419db9649d3 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:05.594535 1666 consensus_queue.cc:237] T 58c56cde04014b85b662a9b4cbaa726f P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:31:05.604466 1494 catalog_manager.cc:5582] T b31026f89f1e49949acec419db9649d3 P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New cstate: current_term: 1 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:05.614625 1737 raft_consensus.cc:1273] T 96030b80e1f340afa81659faaaf68755 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:05.616271 2808 consensus_queue.cc:1035] T 96030b80e1f340afa81659faaaf68755 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20250625 03:31:05.619227 1744 raft_consensus.cc:1273] T 58c56cde04014b85b662a9b4cbaa726f P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 03:31:05.620254 1587 raft_consensus.cc:1273] T 58c56cde04014b85b662a9b4cbaa726f P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20250625 03:31:05.620579 1634 consensus_peers.cc:487] T 58c56cde04014b85b662a9b4cbaa726f P 3f2aa40978064c9e9983cf3745eed206 -> Peer df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493): Couldn't send request to peer df8b9755d156478aafca552f9e9c539e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 58c56cde04014b85b662a9b4cbaa726f. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:05.621551 2782 consensus_queue.cc:1035] T 58c56cde04014b85b662a9b4cbaa726f P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:05.623356 2908 consensus_queue.cc:1035] T 58c56cde04014b85b662a9b4cbaa726f P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:05.634724 1666 raft_consensus.cc:1273] T 96030b80e1f340afa81659faaaf68755 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:05.636138 2838 consensus_queue.cc:1035] T 96030b80e1f340afa81659faaaf68755 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20250625 03:31:05.698540 1741 raft_consensus.cc:1273] T 7553473daeb342ceaf782ddee8e4fc4d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:05.697659 2835 raft_consensus.cc:2953] T 58c56cde04014b85b662a9b4cbaa726f P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:05.702261 2808 consensus_queue.cc:1035] T 7553473daeb342ceaf782ddee8e4fc4d P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:05.709340 1587 raft_consensus.cc:2953] T 58c56cde04014b85b662a9b4cbaa726f P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:05.707504 1737 raft_consensus.cc:2953] T 58c56cde04014b85b662a9b4cbaa726f P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:05.720927 1666 raft_consensus.cc:1273] T 7553473daeb342ceaf782ddee8e4fc4d P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:05.737586 1492 catalog_manager.cc:5582] T 58c56cde04014b85b662a9b4cbaa726f P 7e9c4f2e01164f33b2e9034ed148398e reported cstate change: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New cstate: current_term: 1 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:05.740446 2808 consensus_queue.cc:1035] T 7553473daeb342ceaf782ddee8e4fc4d P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:05.769992 1587 consensus_queue.cc:237] T 6e7283d035e1429f946d8ebb98978656 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
W20250625 03:31:05.777240 1559 consensus_peers.cc:487] T 6e7283d035e1429f946d8ebb98978656 P 7e9c4f2e01164f33b2e9034ed148398e -> Peer df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493): Couldn't send request to peer df8b9755d156478aafca552f9e9c539e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6e7283d035e1429f946d8ebb98978656. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:05.779539 1741 raft_consensus.cc:1273] T 6e7283d035e1429f946d8ebb98978656 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250625 03:31:05.781603 2769 consensus_queue.cc:1035] T 6e7283d035e1429f946d8ebb98978656 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:31:05.780890 1670 raft_consensus.cc:1273] T 6e7283d035e1429f946d8ebb98978656 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250625 03:31:05.788714 2769 consensus_queue.cc:1035] T 6e7283d035e1429f946d8ebb98978656 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:31:05.798316 1587 raft_consensus.cc:1273] T 70328d972b5943009ef0c7d92cbae349 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Refusing update from remote peer df8b9755d156478aafca552f9e9c539e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250625 03:31:05.799906 2904 consensus_queue.cc:1035] T 70328d972b5943009ef0c7d92cbae349 P df8b9755d156478aafca552f9e9c539e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250625 03:31:05.804463 2769 raft_consensus.cc:2953] T 6e7283d035e1429f946d8ebb98978656 P 7e9c4f2e01164f33b2e9034ed148398e [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:05.806376 1737 raft_consensus.cc:2953] T 6e7283d035e1429f946d8ebb98978656 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:05.819022 1670 raft_consensus.cc:2953] T 6e7283d035e1429f946d8ebb98978656 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:05.836601 1494 catalog_manager.cc:5582] T 6e7283d035e1429f946d8ebb98978656 P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: config changed from index -1 to 3, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New cstate: current_term: 3 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:05.857697 1670 raft_consensus.cc:1273] T 70328d972b5943009ef0c7d92cbae349 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Refusing update from remote peer df8b9755d156478aafca552f9e9c539e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250625 03:31:05.861234 2904 consensus_queue.cc:1035] T 70328d972b5943009ef0c7d92cbae349 P df8b9755d156478aafca552f9e9c539e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250625 03:31:05.870640 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:31:05.946998 1741 raft_consensus.cc:1273] T 9643cfd400804eb8b9037c5e9efddfba P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Refusing update from remote peer df8b9755d156478aafca552f9e9c539e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250625 03:31:05.950647 2938 ts_tablet_manager.cc:927] T cc3b100d6d574a68b79e6a8f23d77201 P df8b9755d156478aafca552f9e9c539e: Initiating tablet copy from peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903)
I20250625 03:31:05.951946 2903 consensus_queue.cc:1035] T 9643cfd400804eb8b9037c5e9efddfba P df8b9755d156478aafca552f9e9c539e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20250625 03:31:05.963253 2938 tablet_copy_client.cc:323] T cc3b100d6d574a68b79e6a8f23d77201 P df8b9755d156478aafca552f9e9c539e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.106.129:39903
I20250625 03:31:05.965595 1606 tablet_copy_service.cc:140] P 7e9c4f2e01164f33b2e9034ed148398e: Received BeginTabletCopySession request for tablet cc3b100d6d574a68b79e6a8f23d77201 from peer df8b9755d156478aafca552f9e9c539e ({username='slave'} at 127.0.0.1:44210)
I20250625 03:31:05.966159 1606 tablet_copy_service.cc:161] P 7e9c4f2e01164f33b2e9034ed148398e: Beginning new tablet copy session on tablet cc3b100d6d574a68b79e6a8f23d77201 from peer df8b9755d156478aafca552f9e9c539e at {username='slave'} at 127.0.0.1:44210: session id = df8b9755d156478aafca552f9e9c539e-cc3b100d6d574a68b79e6a8f23d77201
I20250625 03:31:05.975111 1606 tablet_copy_source_session.cc:215] T cc3b100d6d574a68b79e6a8f23d77201 P 7e9c4f2e01164f33b2e9034ed148398e: Tablet Copy: opened 0 blocks and 1 log segments
I20250625 03:31:05.978224 2938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc3b100d6d574a68b79e6a8f23d77201. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:05.998219 1666 raft_consensus.cc:1273] T 9643cfd400804eb8b9037c5e9efddfba P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Refusing update from remote peer df8b9755d156478aafca552f9e9c539e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250625 03:31:06.000032 2903 consensus_queue.cc:1035] T 9643cfd400804eb8b9037c5e9efddfba P df8b9755d156478aafca552f9e9c539e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250625 03:31:06.015126 2938 tablet_copy_client.cc:806] T cc3b100d6d574a68b79e6a8f23d77201 P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 0 data blocks...
I20250625 03:31:06.015818 2938 tablet_copy_client.cc:670] T cc3b100d6d574a68b79e6a8f23d77201 P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 1 WAL segments...
I20250625 03:31:06.020020 2938 tablet_copy_client.cc:538] T cc3b100d6d574a68b79e6a8f23d77201 P df8b9755d156478aafca552f9e9c539e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250625 03:31:06.029455 2938 tablet_bootstrap.cc:492] T cc3b100d6d574a68b79e6a8f23d77201 P df8b9755d156478aafca552f9e9c539e: Bootstrap starting.
I20250625 03:31:06.039587 1670 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "390aa72f98414be291f01e4e4fec77f1"
dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
mode: GRACEFUL
new_leader_uuid: "df8b9755d156478aafca552f9e9c539e"
from {username='slave'} at 127.0.0.1:35370
I20250625 03:31:06.040282 1670 raft_consensus.cc:604] T 390aa72f98414be291f01e4e4fec77f1 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Received request to transfer leadership to TS df8b9755d156478aafca552f9e9c539e
I20250625 03:31:06.046732 1741 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "afe48b30a4e64a4d8faf2a5b42d5c706"
dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
mode: GRACEFUL
new_leader_uuid: "df8b9755d156478aafca552f9e9c539e"
from {username='slave'} at 127.0.0.1:47496
I20250625 03:31:06.047343 1741 raft_consensus.cc:604] T afe48b30a4e64a4d8faf2a5b42d5c706 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Received request to transfer leadership to TS df8b9755d156478aafca552f9e9c539e
I20250625 03:31:06.050518 1741 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "b31026f89f1e49949acec419db9649d3"
dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
mode: GRACEFUL
new_leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
from {username='slave'} at 127.0.0.1:47496
I20250625 03:31:06.051096 1741 raft_consensus.cc:604] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Received request to transfer leadership to TS 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:31:06.056293 1587 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "c4354f7ffc0e4eabbc92a141d46b7984"
dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
mode: GRACEFUL
new_leader_uuid: "3f2aa40978064c9e9983cf3745eed206"
from {username='slave'} at 127.0.0.1:47018
I20250625 03:31:06.057037 1587 raft_consensus.cc:604] T c4354f7ffc0e4eabbc92a141d46b7984 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 LEADER]: Received request to transfer leadership to TS 3f2aa40978064c9e9983cf3745eed206
I20250625 03:31:06.070916 1587 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "e58b1ae66ee14c6f8d6f2db8dda2b842"
dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
mode: GRACEFUL
new_leader_uuid: "df8b9755d156478aafca552f9e9c539e"
from {username='slave'} at 127.0.0.1:47018
I20250625 03:31:06.071676 1587 raft_consensus.cc:604] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 LEADER]: Received request to transfer leadership to TS df8b9755d156478aafca552f9e9c539e
I20250625 03:31:06.080456 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20250625 03:31:06.082079 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:31:06.082795 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:31:06.087864 2938 tablet_bootstrap.cc:492] T cc3b100d6d574a68b79e6a8f23d77201 P df8b9755d156478aafca552f9e9c539e: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:31:06.088907 2938 tablet_bootstrap.cc:492] T cc3b100d6d574a68b79e6a8f23d77201 P df8b9755d156478aafca552f9e9c539e: Bootstrap complete.
I20250625 03:31:06.089653 2938 ts_tablet_manager.cc:1397] T cc3b100d6d574a68b79e6a8f23d77201 P df8b9755d156478aafca552f9e9c539e: Time spent bootstrapping tablet: real 0.060s user 0.031s sys 0.023s
I20250625 03:31:06.092558 2938 raft_consensus.cc:357] T cc3b100d6d574a68b79e6a8f23d77201 P df8b9755d156478aafca552f9e9c539e [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:31:06.093502 2938 raft_consensus.cc:738] T cc3b100d6d574a68b79e6a8f23d77201 P df8b9755d156478aafca552f9e9c539e [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: df8b9755d156478aafca552f9e9c539e, State: Initialized, Role: LEARNER
I20250625 03:31:06.094480 2864 raft_consensus.cc:991] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1: : Instructing follower 7e9c4f2e01164f33b2e9034ed148398e to start an election
I20250625 03:31:06.094209 2938 consensus_queue.cc:260] T cc3b100d6d574a68b79e6a8f23d77201 P df8b9755d156478aafca552f9e9c539e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:31:06.094954 2864 raft_consensus.cc:1079] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Signalling peer 7e9c4f2e01164f33b2e9034ed148398e to start an election
I20250625 03:31:06.096992 1587 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "b31026f89f1e49949acec419db9649d3"
dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
from {username='slave'} at 127.0.0.1:52726
I20250625 03:31:06.097506 1587 raft_consensus.cc:491] T b31026f89f1e49949acec419db9649d3 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:31:06.097815 1587 raft_consensus.cc:3058] T b31026f89f1e49949acec419db9649d3 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:06.098953 2938 ts_tablet_manager.cc:1428] T cc3b100d6d574a68b79e6a8f23d77201 P df8b9755d156478aafca552f9e9c539e: Time spent starting tablet: real 0.009s user 0.006s sys 0.000s
I20250625 03:31:06.107071 1606 tablet_copy_service.cc:342] P 7e9c4f2e01164f33b2e9034ed148398e: Request end of tablet copy session df8b9755d156478aafca552f9e9c539e-cc3b100d6d574a68b79e6a8f23d77201 received from {username='slave'} at 127.0.0.1:44210
I20250625 03:31:06.107529 1606 tablet_copy_service.cc:434] P 7e9c4f2e01164f33b2e9034ed148398e: ending tablet copy session df8b9755d156478aafca552f9e9c539e-cc3b100d6d574a68b79e6a8f23d77201 on tablet cc3b100d6d574a68b79e6a8f23d77201 with peer df8b9755d156478aafca552f9e9c539e
I20250625 03:31:06.116094 1587 raft_consensus.cc:513] T b31026f89f1e49949acec419db9649d3 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:31:06.117959 1587 leader_election.cc:290] T b31026f89f1e49949acec419db9649d3 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 2 election: Requested vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:31:06.119211 1741 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b31026f89f1e49949acec419db9649d3" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:31:06.119807 1741 raft_consensus.cc:3053] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:31:06.120149 1741 raft_consensus.cc:738] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Running, Role: LEADER
I20250625 03:31:06.120891 1741 consensus_queue.cc:260] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:31:06.121882 1741 raft_consensus.cc:3058] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:06.125886 1670 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b31026f89f1e49949acec419db9649d3" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:31:06.126472 1670 raft_consensus.cc:3058] T b31026f89f1e49949acec419db9649d3 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:06.129861 1741 raft_consensus.cc:2466] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 2.
I20250625 03:31:06.131049 1561 leader_election.cc:304] T b31026f89f1e49949acec419db9649d3 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters:
I20250625 03:31:06.132797 2931 raft_consensus.cc:2802] T b31026f89f1e49949acec419db9649d3 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:31:06.133270 2931 raft_consensus.cc:695] T b31026f89f1e49949acec419db9649d3 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 LEADER]: Becoming Leader. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Running, Role: LEADER
I20250625 03:31:06.134121 2931 consensus_queue.cc:237] T b31026f89f1e49949acec419db9649d3 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:31:06.140744 2769 raft_consensus.cc:991] T c4354f7ffc0e4eabbc92a141d46b7984 P 7e9c4f2e01164f33b2e9034ed148398e: : Instructing follower 3f2aa40978064c9e9983cf3745eed206 to start an election
I20250625 03:31:06.141479 1670 raft_consensus.cc:2466] T b31026f89f1e49949acec419db9649d3 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 2.
I20250625 03:31:06.142127 2864 raft_consensus.cc:991] T afe48b30a4e64a4d8faf2a5b42d5c706 P ba464e89e0f044a0a0ea3e6125cbf2a1: : Instructing follower df8b9755d156478aafca552f9e9c539e to start an election
I20250625 03:31:06.142258 2912 raft_consensus.cc:1079] T c4354f7ffc0e4eabbc92a141d46b7984 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 LEADER]: Signalling peer 3f2aa40978064c9e9983cf3745eed206 to start an election
I20250625 03:31:06.142694 2864 raft_consensus.cc:1079] T afe48b30a4e64a4d8faf2a5b42d5c706 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Signalling peer df8b9755d156478aafca552f9e9c539e to start an election
I20250625 03:31:06.144335 2343 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "afe48b30a4e64a4d8faf2a5b42d5c706"
dest_uuid: "df8b9755d156478aafca552f9e9c539e"
from {username='slave'} at 127.0.0.1:54692
I20250625 03:31:06.146730 2343 raft_consensus.cc:491] T afe48b30a4e64a4d8faf2a5b42d5c706 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:31:06.147195 2343 raft_consensus.cc:3058] T afe48b30a4e64a4d8faf2a5b42d5c706 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:06.153672 2343 raft_consensus.cc:513] T afe48b30a4e64a4d8faf2a5b42d5c706 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:06.155702 2938 ts_tablet_manager.cc:927] T 6e7283d035e1429f946d8ebb98978656 P df8b9755d156478aafca552f9e9c539e: Initiating tablet copy from peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903)
I20250625 03:31:06.156174 1666 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "afe48b30a4e64a4d8faf2a5b42d5c706" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:31:06.156716 1666 raft_consensus.cc:3058] T afe48b30a4e64a4d8faf2a5b42d5c706 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:06.157919 1670 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "c4354f7ffc0e4eabbc92a141d46b7984"
dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
from {username='slave'} at 127.0.0.1:53758
I20250625 03:31:06.158484 1670 raft_consensus.cc:491] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:31:06.158841 1670 raft_consensus.cc:3058] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:06.160948 1493 catalog_manager.cc:5582] T b31026f89f1e49949acec419db9649d3 P 7e9c4f2e01164f33b2e9034ed148398e reported cstate change: term changed from 1 to 2, leader changed from ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) to 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129). New cstate: current_term: 2 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:06.169377 1666 raft_consensus.cc:2466] T afe48b30a4e64a4d8faf2a5b42d5c706 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df8b9755d156478aafca552f9e9c539e in term 2.
I20250625 03:31:06.170430 2306 leader_election.cc:304] T afe48b30a4e64a4d8faf2a5b42d5c706 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, df8b9755d156478aafca552f9e9c539e; no voters:
I20250625 03:31:06.171237 2942 raft_consensus.cc:2802] T afe48b30a4e64a4d8faf2a5b42d5c706 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:31:06.171691 2942 raft_consensus.cc:695] T afe48b30a4e64a4d8faf2a5b42d5c706 P df8b9755d156478aafca552f9e9c539e [term 2 LEADER]: Becoming Leader. State: Replica: df8b9755d156478aafca552f9e9c539e, State: Running, Role: LEADER
I20250625 03:31:06.172485 2942 consensus_queue.cc:237] T afe48b30a4e64a4d8faf2a5b42d5c706 P df8b9755d156478aafca552f9e9c539e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:06.181213 1737 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "afe48b30a4e64a4d8faf2a5b42d5c706" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:31:06.181841 1737 raft_consensus.cc:3053] T afe48b30a4e64a4d8faf2a5b42d5c706 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:31:06.182161 1737 raft_consensus.cc:738] T afe48b30a4e64a4d8faf2a5b42d5c706 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Running, Role: LEADER
I20250625 03:31:06.182900 1737 consensus_queue.cc:260] T afe48b30a4e64a4d8faf2a5b42d5c706 P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:06.183928 1737 raft_consensus.cc:3058] T afe48b30a4e64a4d8faf2a5b42d5c706 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:06.187157 2343 leader_election.cc:290] T afe48b30a4e64a4d8faf2a5b42d5c706 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 2 election: Requested vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:31:06.189750 1670 raft_consensus.cc:513] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:06.192765 2938 tablet_copy_client.cc:323] T 6e7283d035e1429f946d8ebb98978656 P df8b9755d156478aafca552f9e9c539e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.106.129:39903
I20250625 03:31:06.196621 1606 tablet_copy_service.cc:140] P 7e9c4f2e01164f33b2e9034ed148398e: Received BeginTabletCopySession request for tablet 6e7283d035e1429f946d8ebb98978656 from peer df8b9755d156478aafca552f9e9c539e ({username='slave'} at 127.0.0.1:44210)
I20250625 03:31:06.197182 1606 tablet_copy_service.cc:161] P 7e9c4f2e01164f33b2e9034ed148398e: Beginning new tablet copy session on tablet 6e7283d035e1429f946d8ebb98978656 from peer df8b9755d156478aafca552f9e9c539e at {username='slave'} at 127.0.0.1:44210: session id = df8b9755d156478aafca552f9e9c539e-6e7283d035e1429f946d8ebb98978656
I20250625 03:31:06.197702 1737 raft_consensus.cc:2466] T afe48b30a4e64a4d8faf2a5b42d5c706 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df8b9755d156478aafca552f9e9c539e in term 2.
I20250625 03:31:06.198192 1590 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "b31026f89f1e49949acec419db9649d3"
dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:52712
I20250625 03:31:06.198745 1590 raft_consensus.cc:604] T b31026f89f1e49949acec419db9649d3 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 LEADER]: Received request to transfer leadership
I20250625 03:31:06.198657 1494 catalog_manager.cc:5582] T afe48b30a4e64a4d8faf2a5b42d5c706 P df8b9755d156478aafca552f9e9c539e reported cstate change: term changed from 1 to 2, leader changed from ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) to df8b9755d156478aafca552f9e9c539e (127.0.106.132). New cstate: current_term: 2 leader_uuid: "df8b9755d156478aafca552f9e9c539e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250625 03:31:06.206264 2782 raft_consensus.cc:991] T 390aa72f98414be291f01e4e4fec77f1 P 3f2aa40978064c9e9983cf3745eed206: : Instructing follower df8b9755d156478aafca552f9e9c539e to start an election
I20250625 03:31:06.206693 2782 raft_consensus.cc:1079] T 390aa72f98414be291f01e4e4fec77f1 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Signalling peer df8b9755d156478aafca552f9e9c539e to start an election
I20250625 03:31:06.208415 2343 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "390aa72f98414be291f01e4e4fec77f1"
dest_uuid: "df8b9755d156478aafca552f9e9c539e"
from {username='slave'} at 127.0.0.1:33226
I20250625 03:31:06.209117 2343 raft_consensus.cc:491] T 390aa72f98414be291f01e4e4fec77f1 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:31:06.209559 2343 raft_consensus.cc:3058] T 390aa72f98414be291f01e4e4fec77f1 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:06.215302 1606 tablet_copy_source_session.cc:215] T 6e7283d035e1429f946d8ebb98978656 P 7e9c4f2e01164f33b2e9034ed148398e: Tablet Copy: opened 0 blocks and 1 log segments
I20250625 03:31:06.215878 2343 raft_consensus.cc:513] T 390aa72f98414be291f01e4e4fec77f1 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:06.218290 1737 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c4354f7ffc0e4eabbc92a141d46b7984" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:31:06.218994 1737 raft_consensus.cc:3058] T c4354f7ffc0e4eabbc92a141d46b7984 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:06.219091 1589 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c4354f7ffc0e4eabbc92a141d46b7984" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
I20250625 03:31:06.219681 1589 raft_consensus.cc:3053] T c4354f7ffc0e4eabbc92a141d46b7984 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 LEADER]: Stepping down as leader of term 2
I20250625 03:31:06.219955 1589 raft_consensus.cc:738] T c4354f7ffc0e4eabbc92a141d46b7984 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Running, Role: LEADER
I20250625 03:31:06.220605 1596 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "390aa72f98414be291f01e4e4fec77f1" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
I20250625 03:31:06.220754 1589 consensus_queue.cc:260] T c4354f7ffc0e4eabbc92a141d46b7984 P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:06.221410 1666 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "390aa72f98414be291f01e4e4fec77f1" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:31:06.221745 1589 raft_consensus.cc:3058] T c4354f7ffc0e4eabbc92a141d46b7984 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:06.221921 1666 raft_consensus.cc:3053] T 390aa72f98414be291f01e4e4fec77f1 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:31:06.222293 1666 raft_consensus.cc:738] T 390aa72f98414be291f01e4e4fec77f1 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Running, Role: LEADER
I20250625 03:31:06.222877 2343 leader_election.cc:290] T 390aa72f98414be291f01e4e4fec77f1 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 2 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:31:06.221130 1596 raft_consensus.cc:3058] T 390aa72f98414be291f01e4e4fec77f1 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:06.226401 2938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e7283d035e1429f946d8ebb98978656. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:06.226459 1737 raft_consensus.cc:2466] T c4354f7ffc0e4eabbc92a141d46b7984 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 3.
I20250625 03:31:06.227676 1636 leader_election.cc:304] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters:
I20250625 03:31:06.228536 2836 raft_consensus.cc:2802] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Leader election won for term 3
I20250625 03:31:06.228533 1589 raft_consensus.cc:2466] T c4354f7ffc0e4eabbc92a141d46b7984 P 7e9c4f2e01164f33b2e9034ed148398e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 3.
I20250625 03:31:06.229264 2836 raft_consensus.cc:695] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206 [term 3 LEADER]: Becoming Leader. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Running, Role: LEADER
I20250625 03:31:06.230122 2836 consensus_queue.cc:237] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:06.230789 2946 ts_tablet_manager.cc:927] T 58c56cde04014b85b662a9b4cbaa726f P df8b9755d156478aafca552f9e9c539e: Initiating tablet copy from peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:31:06.232597 1590 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "b31026f89f1e49949acec419db9649d3"
dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:52712
I20250625 03:31:06.233119 1590 raft_consensus.cc:604] T b31026f89f1e49949acec419db9649d3 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 LEADER]: Received request to transfer leadership
W20250625 03:31:06.234120 1479 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for b31026f89f1e49949acec419db9649d3 already in progress [suppressed 2 similar messages]
I20250625 03:31:06.234229 1670 leader_election.cc:290] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 3 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:31:06.235617 1596 raft_consensus.cc:2466] T 390aa72f98414be291f01e4e4fec77f1 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df8b9755d156478aafca552f9e9c539e in term 2.
I20250625 03:31:06.237298 2307 leader_election.cc:304] T 390aa72f98414be291f01e4e4fec77f1 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e, df8b9755d156478aafca552f9e9c539e; no voters:
I20250625 03:31:06.237192 1666 consensus_queue.cc:260] T 390aa72f98414be291f01e4e4fec77f1 P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:06.238586 2942 raft_consensus.cc:2802] T 390aa72f98414be291f01e4e4fec77f1 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:31:06.239013 1666 raft_consensus.cc:3058] T 390aa72f98414be291f01e4e4fec77f1 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:06.239225 2942 raft_consensus.cc:695] T 390aa72f98414be291f01e4e4fec77f1 P df8b9755d156478aafca552f9e9c539e [term 2 LEADER]: Becoming Leader. State: Replica: df8b9755d156478aafca552f9e9c539e, State: Running, Role: LEADER
I20250625 03:31:06.240479 2942 consensus_queue.cc:237] T 390aa72f98414be291f01e4e4fec77f1 P df8b9755d156478aafca552f9e9c539e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:06.257100 2938 tablet_copy_client.cc:806] T 6e7283d035e1429f946d8ebb98978656 P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 0 data blocks...
I20250625 03:31:06.257746 2938 tablet_copy_client.cc:670] T 6e7283d035e1429f946d8ebb98978656 P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 1 WAL segments...
I20250625 03:31:06.261705 2938 tablet_copy_client.cc:538] T 6e7283d035e1429f946d8ebb98978656 P df8b9755d156478aafca552f9e9c539e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250625 03:31:06.265862 1666 raft_consensus.cc:2466] T 390aa72f98414be291f01e4e4fec77f1 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df8b9755d156478aafca552f9e9c539e in term 2.
I20250625 03:31:06.267169 2946 tablet_copy_client.cc:323] T 58c56cde04014b85b662a9b4cbaa726f P df8b9755d156478aafca552f9e9c539e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.106.130:34293
I20250625 03:31:06.267266 1596 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "b31026f89f1e49949acec419db9649d3"
dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:52712
I20250625 03:31:06.268036 1596 raft_consensus.cc:604] T b31026f89f1e49949acec419db9649d3 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 LEADER]: Received request to transfer leadership
I20250625 03:31:06.268836 1680 tablet_copy_service.cc:140] P 3f2aa40978064c9e9983cf3745eed206: Received BeginTabletCopySession request for tablet 58c56cde04014b85b662a9b4cbaa726f from peer df8b9755d156478aafca552f9e9c539e ({username='slave'} at 127.0.0.1:55766)
I20250625 03:31:06.269462 1680 tablet_copy_service.cc:161] P 3f2aa40978064c9e9983cf3745eed206: Beginning new tablet copy session on tablet 58c56cde04014b85b662a9b4cbaa726f from peer df8b9755d156478aafca552f9e9c539e at {username='slave'} at 127.0.0.1:55766: session id = df8b9755d156478aafca552f9e9c539e-58c56cde04014b85b662a9b4cbaa726f
W20250625 03:31:06.273077 1542 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: leadership transfer for b31026f89f1e49949acec419db9649d3 already in progress
W20250625 03:31:06.273449 1542 auto_rebalancer.cc:264] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for b31026f89f1e49949acec419db9649d3 already in progress
I20250625 03:31:06.274950 2938 tablet_bootstrap.cc:492] T 6e7283d035e1429f946d8ebb98978656 P df8b9755d156478aafca552f9e9c539e: Bootstrap starting.
I20250625 03:31:06.277630 1494 catalog_manager.cc:5582] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: term changed from 2 to 3, leader changed from 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) to 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130). New cstate: current_term: 3 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:06.280599 1493 catalog_manager.cc:5582] T 390aa72f98414be291f01e4e4fec77f1 P df8b9755d156478aafca552f9e9c539e reported cstate change: term changed from 1 to 2, leader changed from 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) to df8b9755d156478aafca552f9e9c539e (127.0.106.132). New cstate: current_term: 2 leader_uuid: "df8b9755d156478aafca552f9e9c539e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250625 03:31:06.297786 1680 tablet_copy_source_session.cc:215] T 58c56cde04014b85b662a9b4cbaa726f P 3f2aa40978064c9e9983cf3745eed206: Tablet Copy: opened 0 blocks and 1 log segments
I20250625 03:31:06.307689 2946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58c56cde04014b85b662a9b4cbaa726f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:06.316871 2938 tablet_bootstrap.cc:492] T 6e7283d035e1429f946d8ebb98978656 P df8b9755d156478aafca552f9e9c539e: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:31:06.317859 2938 tablet_bootstrap.cc:492] T 6e7283d035e1429f946d8ebb98978656 P df8b9755d156478aafca552f9e9c539e: Bootstrap complete.
I20250625 03:31:06.318596 2938 ts_tablet_manager.cc:1397] T 6e7283d035e1429f946d8ebb98978656 P df8b9755d156478aafca552f9e9c539e: Time spent bootstrapping tablet: real 0.044s user 0.015s sys 0.015s
I20250625 03:31:06.321319 2938 raft_consensus.cc:357] T 6e7283d035e1429f946d8ebb98978656 P df8b9755d156478aafca552f9e9c539e [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:31:06.321970 2938 raft_consensus.cc:738] T 6e7283d035e1429f946d8ebb98978656 P df8b9755d156478aafca552f9e9c539e [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: df8b9755d156478aafca552f9e9c539e, State: Initialized, Role: LEARNER
I20250625 03:31:06.322610 2938 consensus_queue.cc:260] T 6e7283d035e1429f946d8ebb98978656 P df8b9755d156478aafca552f9e9c539e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:31:06.325275 2938 ts_tablet_manager.cc:1428] T 6e7283d035e1429f946d8ebb98978656 P df8b9755d156478aafca552f9e9c539e: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20250625 03:31:06.330791 2946 tablet_copy_client.cc:806] T 58c56cde04014b85b662a9b4cbaa726f P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 0 data blocks...
I20250625 03:31:06.331550 1606 tablet_copy_service.cc:342] P 7e9c4f2e01164f33b2e9034ed148398e: Request end of tablet copy session df8b9755d156478aafca552f9e9c539e-6e7283d035e1429f946d8ebb98978656 received from {username='slave'} at 127.0.0.1:44210
I20250625 03:31:06.332036 1606 tablet_copy_service.cc:434] P 7e9c4f2e01164f33b2e9034ed148398e: ending tablet copy session df8b9755d156478aafca552f9e9c539e-6e7283d035e1429f946d8ebb98978656 on tablet 6e7283d035e1429f946d8ebb98978656 with peer df8b9755d156478aafca552f9e9c539e
I20250625 03:31:06.332216 2946 tablet_copy_client.cc:670] T 58c56cde04014b85b662a9b4cbaa726f P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 1 WAL segments...
I20250625 03:31:06.336198 2946 tablet_copy_client.cc:538] T 58c56cde04014b85b662a9b4cbaa726f P df8b9755d156478aafca552f9e9c539e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250625 03:31:06.345263 2946 tablet_bootstrap.cc:492] T 58c56cde04014b85b662a9b4cbaa726f P df8b9755d156478aafca552f9e9c539e: Bootstrap starting.
I20250625 03:31:06.363838 2946 tablet_bootstrap.cc:492] T 58c56cde04014b85b662a9b4cbaa726f P df8b9755d156478aafca552f9e9c539e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:31:06.364820 2946 tablet_bootstrap.cc:492] T 58c56cde04014b85b662a9b4cbaa726f P df8b9755d156478aafca552f9e9c539e: Bootstrap complete.
I20250625 03:31:06.365525 2946 ts_tablet_manager.cc:1397] T 58c56cde04014b85b662a9b4cbaa726f P df8b9755d156478aafca552f9e9c539e: Time spent bootstrapping tablet: real 0.021s user 0.020s sys 0.000s
I20250625 03:31:06.368127 2946 raft_consensus.cc:357] T 58c56cde04014b85b662a9b4cbaa726f P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:31:06.368741 2946 raft_consensus.cc:738] T 58c56cde04014b85b662a9b4cbaa726f P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: df8b9755d156478aafca552f9e9c539e, State: Initialized, Role: LEARNER
I20250625 03:31:06.369221 2946 consensus_queue.cc:260] T 58c56cde04014b85b662a9b4cbaa726f P df8b9755d156478aafca552f9e9c539e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:31:06.374337 2946 ts_tablet_manager.cc:1428] T 58c56cde04014b85b662a9b4cbaa726f P df8b9755d156478aafca552f9e9c539e: Time spent starting tablet: real 0.008s user 0.004s sys 0.000s
I20250625 03:31:06.376749 1680 tablet_copy_service.cc:342] P 3f2aa40978064c9e9983cf3745eed206: Request end of tablet copy session df8b9755d156478aafca552f9e9c539e-58c56cde04014b85b662a9b4cbaa726f received from {username='slave'} at 127.0.0.1:55766
I20250625 03:31:06.377202 1680 tablet_copy_service.cc:434] P 3f2aa40978064c9e9983cf3745eed206: ending tablet copy session df8b9755d156478aafca552f9e9c539e-58c56cde04014b85b662a9b4cbaa726f on tablet 58c56cde04014b85b662a9b4cbaa726f with peer df8b9755d156478aafca552f9e9c539e
I20250625 03:31:06.423254 2343 raft_consensus.cc:1215] T cc3b100d6d574a68b79e6a8f23d77201 P df8b9755d156478aafca552f9e9c539e [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3] Dedup: 2.3->[]
I20250625 03:31:06.527310 2808 raft_consensus.cc:991] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e: : Instructing follower df8b9755d156478aafca552f9e9c539e to start an election
I20250625 03:31:06.527789 2808 raft_consensus.cc:1079] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 LEADER]: Signalling peer df8b9755d156478aafca552f9e9c539e to start an election
I20250625 03:31:06.529196 2343 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "e58b1ae66ee14c6f8d6f2db8dda2b842"
dest_uuid: "df8b9755d156478aafca552f9e9c539e"
from {username='slave'} at 127.0.0.1:54676
I20250625 03:31:06.529676 2343 raft_consensus.cc:491] T e58b1ae66ee14c6f8d6f2db8dda2b842 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:31:06.530004 2343 raft_consensus.cc:3058] T e58b1ae66ee14c6f8d6f2db8dda2b842 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:06.537832 2343 raft_consensus.cc:513] T e58b1ae66ee14c6f8d6f2db8dda2b842 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:06.539709 2343 leader_election.cc:290] T e58b1ae66ee14c6f8d6f2db8dda2b842 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 2 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:31:06.540244 1590 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e58b1ae66ee14c6f8d6f2db8dda2b842" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
I20250625 03:31:06.540601 1737 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e58b1ae66ee14c6f8d6f2db8dda2b842" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:31:06.540830 1590 raft_consensus.cc:3053] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:31:06.541098 1737 raft_consensus.cc:3058] T e58b1ae66ee14c6f8d6f2db8dda2b842 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:06.541234 1590 raft_consensus.cc:738] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Running, Role: LEADER
I20250625 03:31:06.541899 1590 consensus_queue.cc:260] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:06.542798 1590 raft_consensus.cc:3058] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:06.547384 1737 raft_consensus.cc:2466] T e58b1ae66ee14c6f8d6f2db8dda2b842 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df8b9755d156478aafca552f9e9c539e in term 2.
I20250625 03:31:06.548419 2308 leader_election.cc:304] T e58b1ae66ee14c6f8d6f2db8dda2b842 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1, df8b9755d156478aafca552f9e9c539e; no voters:
I20250625 03:31:06.549049 2903 raft_consensus.cc:2802] T e58b1ae66ee14c6f8d6f2db8dda2b842 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:31:06.549523 2903 raft_consensus.cc:695] T e58b1ae66ee14c6f8d6f2db8dda2b842 P df8b9755d156478aafca552f9e9c539e [term 2 LEADER]: Becoming Leader. State: Replica: df8b9755d156478aafca552f9e9c539e, State: Running, Role: LEADER
I20250625 03:31:06.550324 2903 consensus_queue.cc:237] T e58b1ae66ee14c6f8d6f2db8dda2b842 P df8b9755d156478aafca552f9e9c539e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:06.554894 1590 raft_consensus.cc:2466] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df8b9755d156478aafca552f9e9c539e in term 2.
I20250625 03:31:06.560585 1494 catalog_manager.cc:5582] T e58b1ae66ee14c6f8d6f2db8dda2b842 P df8b9755d156478aafca552f9e9c539e reported cstate change: term changed from 1 to 2, leader changed from 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) to df8b9755d156478aafca552f9e9c539e (127.0.106.132). New cstate: current_term: 2 leader_uuid: "df8b9755d156478aafca552f9e9c539e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20250625 03:31:06.570048 1559 consensus_peers.cc:487] T b31026f89f1e49949acec419db9649d3 P 7e9c4f2e01164f33b2e9034ed148398e -> Peer df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493): Couldn't send request to peer df8b9755d156478aafca552f9e9c539e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b31026f89f1e49949acec419db9649d3. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:06.583057 1669 raft_consensus.cc:1273] T b31026f89f1e49949acec419db9649d3 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20250625 03:31:06.584600 2769 consensus_queue.cc:1035] T b31026f89f1e49949acec419db9649d3 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:31:06.589432 2931 raft_consensus.cc:991] T b31026f89f1e49949acec419db9649d3 P 7e9c4f2e01164f33b2e9034ed148398e: : Instructing follower 3f2aa40978064c9e9983cf3745eed206 to start an election
I20250625 03:31:06.589926 2808 raft_consensus.cc:1079] T b31026f89f1e49949acec419db9649d3 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 LEADER]: Signalling peer 3f2aa40978064c9e9983cf3745eed206 to start an election
I20250625 03:31:06.591853 1666 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "b31026f89f1e49949acec419db9649d3"
dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
from {username='slave'} at 127.0.0.1:53758
I20250625 03:31:06.592417 1666 raft_consensus.cc:491] T b31026f89f1e49949acec419db9649d3 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:31:06.592772 1666 raft_consensus.cc:3058] T b31026f89f1e49949acec419db9649d3 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:06.599049 1737 raft_consensus.cc:1273] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20250625 03:31:06.600859 1666 raft_consensus.cc:513] T b31026f89f1e49949acec419db9649d3 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:31:06.602025 1669 raft_consensus.cc:1238] T b31026f89f1e49949acec419db9649d3 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Rejecting Update request from peer 7e9c4f2e01164f33b2e9034ed148398e for earlier term 2. Current term is 3. Ops: []
I20250625 03:31:06.603590 2345 raft_consensus.cc:1215] T 6e7283d035e1429f946d8ebb98978656 P df8b9755d156478aafca552f9e9c539e [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3] Dedup: 3.3->[]
I20250625 03:31:06.604743 1666 leader_election.cc:290] T b31026f89f1e49949acec419db9649d3 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 3 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:31:06.605973 1737 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b31026f89f1e49949acec419db9649d3" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:31:06.606000 1590 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b31026f89f1e49949acec419db9649d3" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
I20250625 03:31:06.606630 1737 raft_consensus.cc:3058] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:06.606705 1590 raft_consensus.cc:3053] T b31026f89f1e49949acec419db9649d3 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 LEADER]: Stepping down as leader of term 2
I20250625 03:31:06.607266 1590 raft_consensus.cc:738] T b31026f89f1e49949acec419db9649d3 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Running, Role: LEADER
I20250625 03:31:06.608582 2931 consensus_queue.cc:1035] T b31026f89f1e49949acec419db9649d3 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:31:06.609817 2931 consensus_queue.cc:1046] T b31026f89f1e49949acec419db9649d3 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:31:06.611145 1590 consensus_queue.cc:260] T b31026f89f1e49949acec419db9649d3 P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:31:06.612488 1590 raft_consensus.cc:3058] T b31026f89f1e49949acec419db9649d3 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:06.613593 1744 raft_consensus.cc:1273] T c4354f7ffc0e4eabbc92a141d46b7984 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250625 03:31:06.615525 2835 consensus_queue.cc:1035] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20250625 03:31:06.622807 1590 raft_consensus.cc:2466] T b31026f89f1e49949acec419db9649d3 P 7e9c4f2e01164f33b2e9034ed148398e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 3.
I20250625 03:31:06.624099 1635 leader_election.cc:304] T b31026f89f1e49949acec419db9649d3 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e; no voters:
I20250625 03:31:06.625684 2836 raft_consensus.cc:2802] T b31026f89f1e49949acec419db9649d3 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Leader election won for term 3
I20250625 03:31:06.626170 2836 raft_consensus.cc:695] T b31026f89f1e49949acec419db9649d3 P 3f2aa40978064c9e9983cf3745eed206 [term 3 LEADER]: Becoming Leader. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Running, Role: LEADER
I20250625 03:31:06.627059 2836 consensus_queue.cc:237] T b31026f89f1e49949acec419db9649d3 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:31:06.629216 1745 raft_consensus.cc:1273] T afe48b30a4e64a4d8faf2a5b42d5c706 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Refusing update from remote peer df8b9755d156478aafca552f9e9c539e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250625 03:31:06.632721 2903 consensus_queue.cc:1035] T afe48b30a4e64a4d8faf2a5b42d5c706 P df8b9755d156478aafca552f9e9c539e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250625 03:31:06.644153 1589 raft_consensus.cc:1273] T c4354f7ffc0e4eabbc92a141d46b7984 P 7e9c4f2e01164f33b2e9034ed148398e [term 3 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250625 03:31:06.645313 1737 raft_consensus.cc:2466] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 3.
I20250625 03:31:06.646037 1741 raft_consensus.cc:1238] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Rejecting Update request from peer 7e9c4f2e01164f33b2e9034ed148398e for earlier term 2. Current term is 3. Ops: [2.3-2.3]
I20250625 03:31:06.646566 2782 consensus_queue.cc:1035] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:31:06.649094 1666 raft_consensus.cc:1273] T 390aa72f98414be291f01e4e4fec77f1 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Refusing update from remote peer df8b9755d156478aafca552f9e9c539e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250625 03:31:06.654420 2903 consensus_queue.cc:1035] T 390aa72f98414be291f01e4e4fec77f1 P df8b9755d156478aafca552f9e9c539e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20250625 03:31:06.673112 1589 raft_consensus.cc:1273] T 390aa72f98414be291f01e4e4fec77f1 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Refusing update from remote peer df8b9755d156478aafca552f9e9c539e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250625 03:31:06.675559 2904 consensus_queue.cc:1035] T 390aa72f98414be291f01e4e4fec77f1 P df8b9755d156478aafca552f9e9c539e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250625 03:31:06.683720 1669 raft_consensus.cc:1273] T afe48b30a4e64a4d8faf2a5b42d5c706 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Refusing update from remote peer df8b9755d156478aafca552f9e9c539e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250625 03:31:06.686767 2942 consensus_queue.cc:1035] T afe48b30a4e64a4d8faf2a5b42d5c706 P df8b9755d156478aafca552f9e9c539e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20250625 03:31:06.690347 2345 raft_consensus.cc:1215] T 58c56cde04014b85b662a9b4cbaa726f P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20250625 03:31:06.702494 1494 catalog_manager.cc:5582] T b31026f89f1e49949acec419db9649d3 P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: term changed from 2 to 3, leader changed from 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) to 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130). New cstate: current_term: 3 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:06.885615 2912 raft_consensus.cc:1062] T cc3b100d6d574a68b79e6a8f23d77201 P 7e9c4f2e01164f33b2e9034ed148398e: attempting to promote NON_VOTER df8b9755d156478aafca552f9e9c539e to VOTER
I20250625 03:31:06.887876 2912 consensus_queue.cc:237] T cc3b100d6d574a68b79e6a8f23d77201 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:06.895167 2343 raft_consensus.cc:1273] T cc3b100d6d574a68b79e6a8f23d77201 P df8b9755d156478aafca552f9e9c539e [term 2 LEARNER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20250625 03:31:06.895388 1670 raft_consensus.cc:1273] T cc3b100d6d574a68b79e6a8f23d77201 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20250625 03:31:06.895571 1745 raft_consensus.cc:1273] T cc3b100d6d574a68b79e6a8f23d77201 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20250625 03:31:06.897284 2769 consensus_queue.cc:1035] T cc3b100d6d574a68b79e6a8f23d77201 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:31:06.898190 2808 consensus_queue.cc:1035] T cc3b100d6d574a68b79e6a8f23d77201 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:31:06.899150 2912 consensus_queue.cc:1035] T cc3b100d6d574a68b79e6a8f23d77201 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:31:06.934384 2808 raft_consensus.cc:2953] T cc3b100d6d574a68b79e6a8f23d77201 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:06.938410 1745 raft_consensus.cc:2953] T cc3b100d6d574a68b79e6a8f23d77201 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:06.939664 1666 raft_consensus.cc:2953] T cc3b100d6d574a68b79e6a8f23d77201 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:06.948501 2343 raft_consensus.cc:2953] T cc3b100d6d574a68b79e6a8f23d77201 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:06.953843 1491 catalog_manager.cc:5582] T cc3b100d6d574a68b79e6a8f23d77201 P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: config changed from index 3 to 4, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:06.977897 1590 consensus_queue.cc:237] T cc3b100d6d574a68b79e6a8f23d77201 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:06.982661 2345 raft_consensus.cc:1273] T cc3b100d6d574a68b79e6a8f23d77201 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250625 03:31:06.984666 1666 raft_consensus.cc:1273] T cc3b100d6d574a68b79e6a8f23d77201 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250625 03:31:06.985028 2912 consensus_queue.cc:1035] T cc3b100d6d574a68b79e6a8f23d77201 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250625 03:31:06.986138 2769 consensus_queue.cc:1035] T cc3b100d6d574a68b79e6a8f23d77201 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20250625 03:31:06.993805 2769 raft_consensus.cc:2953] T cc3b100d6d574a68b79e6a8f23d77201 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:06.995383 2345 raft_consensus.cc:2953] T cc3b100d6d574a68b79e6a8f23d77201 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:07.000072 1666 raft_consensus.cc:2953] T cc3b100d6d574a68b79e6a8f23d77201 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:07.004424 1479 catalog_manager.cc:5095] ChangeConfig:REMOVE_PEER RPC for tablet cc3b100d6d574a68b79e6a8f23d77201 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250625 03:31:07.010167 1494 catalog_manager.cc:5582] T cc3b100d6d574a68b79e6a8f23d77201 P df8b9755d156478aafca552f9e9c539e reported cstate change: config changed from index 4 to 5, VOTER ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) evicted. New cstate: current_term: 2 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:07.024449 1732 tablet_service.cc:1515] Processing DeleteTablet for tablet cc3b100d6d574a68b79e6a8f23d77201 with delete_type TABLET_DATA_TOMBSTONED (TS ba464e89e0f044a0a0ea3e6125cbf2a1 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:43672
I20250625 03:31:07.026113 2971 tablet_replica.cc:331] T cc3b100d6d574a68b79e6a8f23d77201 P ba464e89e0f044a0a0ea3e6125cbf2a1: stopping tablet replica
I20250625 03:31:07.027251 2971 raft_consensus.cc:2241] T cc3b100d6d574a68b79e6a8f23d77201 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:07.028630 2971 raft_consensus.cc:2270] T cc3b100d6d574a68b79e6a8f23d77201 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:07.031991 2971 ts_tablet_manager.cc:1905] T cc3b100d6d574a68b79e6a8f23d77201 P ba464e89e0f044a0a0ea3e6125cbf2a1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250625 03:31:07.036366 1745 raft_consensus.cc:1273] T e58b1ae66ee14c6f8d6f2db8dda2b842 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Refusing update from remote peer df8b9755d156478aafca552f9e9c539e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250625 03:31:07.038901 2965 consensus_queue.cc:1035] T e58b1ae66ee14c6f8d6f2db8dda2b842 P df8b9755d156478aafca552f9e9c539e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20250625 03:31:07.062408 2971 ts_tablet_manager.cc:1918] T cc3b100d6d574a68b79e6a8f23d77201 P ba464e89e0f044a0a0ea3e6125cbf2a1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20250625 03:31:07.065960 2971 log.cc:1199] T cc3b100d6d574a68b79e6a8f23d77201 P ba464e89e0f044a0a0ea3e6125cbf2a1: Deleting WAL directory at /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/ts-2-root/wals/cc3b100d6d574a68b79e6a8f23d77201
I20250625 03:31:07.071174 1745 raft_consensus.cc:1273] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20250625 03:31:07.071501 1589 raft_consensus.cc:1273] T b31026f89f1e49949acec419db9649d3 P 7e9c4f2e01164f33b2e9034ed148398e [term 3 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20250625 03:31:07.073071 2835 consensus_queue.cc:1035] T b31026f89f1e49949acec419db9649d3 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:31:07.073868 2836 consensus_queue.cc:1035] T b31026f89f1e49949acec419db9649d3 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:31:07.067827 1480 catalog_manager.cc:4928] TS ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): tablet cc3b100d6d574a68b79e6a8f23d77201 (table test-workload [id=7f663eabec024fd1911b406c660fa838]) successfully deleted
I20250625 03:31:07.078611 1589 raft_consensus.cc:1273] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Refusing update from remote peer df8b9755d156478aafca552f9e9c539e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250625 03:31:07.081833 2904 consensus_queue.cc:1035] T e58b1ae66ee14c6f8d6f2db8dda2b842 P df8b9755d156478aafca552f9e9c539e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20250625 03:31:07.094203 1634 consensus_peers.cc:487] T b31026f89f1e49949acec419db9649d3 P 3f2aa40978064c9e9983cf3745eed206 -> Peer df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493): Couldn't send request to peer df8b9755d156478aafca552f9e9c539e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b31026f89f1e49949acec419db9649d3. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:07.116485 2769 raft_consensus.cc:1062] T 6e7283d035e1429f946d8ebb98978656 P 7e9c4f2e01164f33b2e9034ed148398e: attempting to promote NON_VOTER df8b9755d156478aafca552f9e9c539e to VOTER
I20250625 03:31:07.118746 2769 consensus_queue.cc:237] T 6e7283d035e1429f946d8ebb98978656 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:07.137323 2343 raft_consensus.cc:1273] T 6e7283d035e1429f946d8ebb98978656 P df8b9755d156478aafca552f9e9c539e [term 3 LEARNER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20250625 03:31:07.138305 1666 raft_consensus.cc:1273] T 6e7283d035e1429f946d8ebb98978656 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20250625 03:31:07.138787 2912 consensus_queue.cc:1035] T 6e7283d035e1429f946d8ebb98978656 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:31:07.139813 2931 consensus_queue.cc:1035] T 6e7283d035e1429f946d8ebb98978656 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:31:07.140681 1737 raft_consensus.cc:1273] T 6e7283d035e1429f946d8ebb98978656 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20250625 03:31:07.142100 2808 consensus_queue.cc:1035] T 6e7283d035e1429f946d8ebb98978656 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:31:07.172413 2931 raft_consensus.cc:2953] T 6e7283d035e1429f946d8ebb98978656 P 7e9c4f2e01164f33b2e9034ed148398e [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:07.177471 1670 raft_consensus.cc:2953] T 6e7283d035e1429f946d8ebb98978656 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:07.182700 1737 raft_consensus.cc:2953] T 6e7283d035e1429f946d8ebb98978656 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:07.185144 2345 raft_consensus.cc:2953] T 6e7283d035e1429f946d8ebb98978656 P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:07.187788 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:31:07.203419 1491 catalog_manager.cc:5582] T 6e7283d035e1429f946d8ebb98978656 P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: config changed from index 3 to 4, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:07.229480 1589 consensus_queue.cc:237] T 6e7283d035e1429f946d8ebb98978656 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:07.239463 2345 raft_consensus.cc:1273] T 6e7283d035e1429f946d8ebb98978656 P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20250625 03:31:07.239463 1666 raft_consensus.cc:1273] T 6e7283d035e1429f946d8ebb98978656 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20250625 03:31:07.240836 2931 consensus_queue.cc:1035] T 6e7283d035e1429f946d8ebb98978656 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250625 03:31:07.247066 2912 consensus_queue.cc:1035] T 6e7283d035e1429f946d8ebb98978656 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250625 03:31:07.252135 2967 raft_consensus.cc:2953] T 6e7283d035e1429f946d8ebb98978656 P 7e9c4f2e01164f33b2e9034ed148398e [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:07.260392 2345 raft_consensus.cc:2953] T 6e7283d035e1429f946d8ebb98978656 P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:07.261773 1479 catalog_manager.cc:5095] ChangeConfig:REMOVE_PEER RPC for tablet 6e7283d035e1429f946d8ebb98978656 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250625 03:31:07.265054 1666 raft_consensus.cc:2953] T 6e7283d035e1429f946d8ebb98978656 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:07.289597 1737 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "393f73bcf106475cbee7a645b0d9660c"
dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
mode: GRACEFUL
new_leader_uuid: "3f2aa40978064c9e9983cf3745eed206"
from {username='slave'} at 127.0.0.1:47496
I20250625 03:31:07.290290 1737 raft_consensus.cc:604] T 393f73bcf106475cbee7a645b0d9660c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Received request to transfer leadership to TS 3f2aa40978064c9e9983cf3745eed206
I20250625 03:31:07.295913 1670 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "a5a18934cc3f490288432ee1cb30b278"
dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
mode: GRACEFUL
new_leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
from {username='slave'} at 127.0.0.1:35370
I20250625 03:31:07.296708 1670 raft_consensus.cc:604] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206 [term 2 LEADER]: Received request to transfer leadership to TS 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:31:07.291872 1492 catalog_manager.cc:5582] T 6e7283d035e1429f946d8ebb98978656 P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: config changed from index 4 to 5, VOTER ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) evicted. New cstate: current_term: 3 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:07.302023 2782 raft_consensus.cc:1062] T 58c56cde04014b85b662a9b4cbaa726f P 3f2aa40978064c9e9983cf3745eed206: attempting to promote NON_VOTER df8b9755d156478aafca552f9e9c539e to VOTER
I20250625 03:31:07.304308 2782 consensus_queue.cc:237] T 58c56cde04014b85b662a9b4cbaa726f P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:07.306521 1737 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "b15eb94b9d3d4f6987b5fa5e20193655"
dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
mode: GRACEFUL
new_leader_uuid: "df8b9755d156478aafca552f9e9c539e"
from {username='slave'} at 127.0.0.1:47496
I20250625 03:31:07.307161 1737 raft_consensus.cc:604] T b15eb94b9d3d4f6987b5fa5e20193655 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Received request to transfer leadership to TS df8b9755d156478aafca552f9e9c539e
I20250625 03:31:07.311586 1669 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "c04f7c2d00994557b1cb83234b36fceb"
dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
mode: GRACEFUL
new_leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
from {username='slave'} at 127.0.0.1:35370
I20250625 03:31:07.312264 1669 raft_consensus.cc:604] T c04f7c2d00994557b1cb83234b36fceb P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Received request to transfer leadership to TS 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:31:07.314703 1732 tablet_service.cc:1515] Processing DeleteTablet for tablet 6e7283d035e1429f946d8ebb98978656 with delete_type TABLET_DATA_TOMBSTONED (TS ba464e89e0f044a0a0ea3e6125cbf2a1 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:43672
I20250625 03:31:07.315654 2971 tablet_replica.cc:331] T 6e7283d035e1429f946d8ebb98978656 P ba464e89e0f044a0a0ea3e6125cbf2a1: stopping tablet replica
I20250625 03:31:07.316454 1737 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "c977876716a0400a9482dd8e0ad33b86"
dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
mode: GRACEFUL
new_leader_uuid: "3f2aa40978064c9e9983cf3745eed206"
from {username='slave'} at 127.0.0.1:47496
I20250625 03:31:07.317051 1737 raft_consensus.cc:604] T c977876716a0400a9482dd8e0ad33b86 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Received request to transfer leadership to TS 3f2aa40978064c9e9983cf3745eed206
I20250625 03:31:07.317309 2971 raft_consensus.cc:2241] T 6e7283d035e1429f946d8ebb98978656 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:07.318414 2971 raft_consensus.cc:2270] T 6e7283d035e1429f946d8ebb98978656 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:07.318750 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20250625 03:31:07.324427 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:31:07.325271 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:31:07.330051 2971 ts_tablet_manager.cc:1905] T 6e7283d035e1429f946d8ebb98978656 P ba464e89e0f044a0a0ea3e6125cbf2a1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250625 03:31:07.334955 2345 raft_consensus.cc:1273] T 58c56cde04014b85b662a9b4cbaa726f P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:31:07.346387 1737 raft_consensus.cc:1273] T 58c56cde04014b85b662a9b4cbaa726f P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:31:07.348667 2835 consensus_queue.cc:1035] T 58c56cde04014b85b662a9b4cbaa726f P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:31:07.350432 1596 raft_consensus.cc:1273] T 58c56cde04014b85b662a9b4cbaa726f P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:31:07.352046 2782 consensus_queue.cc:1035] T 58c56cde04014b85b662a9b4cbaa726f P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20250625 03:31:07.363783 2836 consensus_queue.cc:1035] T 58c56cde04014b85b662a9b4cbaa726f P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20250625 03:31:07.381157 2915 raft_consensus.cc:991] T c977876716a0400a9482dd8e0ad33b86 P ba464e89e0f044a0a0ea3e6125cbf2a1: : Instructing follower 3f2aa40978064c9e9983cf3745eed206 to start an election
I20250625 03:31:07.381625 2915 raft_consensus.cc:1079] T c977876716a0400a9482dd8e0ad33b86 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Signalling peer 3f2aa40978064c9e9983cf3745eed206 to start an election
I20250625 03:31:07.396710 1666 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "c977876716a0400a9482dd8e0ad33b86"
dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
from {username='slave'} at 127.0.0.1:53770
I20250625 03:31:07.397287 1666 raft_consensus.cc:491] T c977876716a0400a9482dd8e0ad33b86 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:31:07.397658 1666 raft_consensus.cc:3058] T c977876716a0400a9482dd8e0ad33b86 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:07.402971 2980 raft_consensus.cc:991] T c04f7c2d00994557b1cb83234b36fceb P 3f2aa40978064c9e9983cf3745eed206: : Instructing follower 7e9c4f2e01164f33b2e9034ed148398e to start an election
I20250625 03:31:07.403750 2836 raft_consensus.cc:1079] T c04f7c2d00994557b1cb83234b36fceb P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Signalling peer 7e9c4f2e01164f33b2e9034ed148398e to start an election
I20250625 03:31:07.405674 1589 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "c04f7c2d00994557b1cb83234b36fceb"
dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
from {username='slave'} at 127.0.0.1:52738
I20250625 03:31:07.406925 1589 raft_consensus.cc:491] T c04f7c2d00994557b1cb83234b36fceb P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:31:07.404513 1666 raft_consensus.cc:513] T c977876716a0400a9482dd8e0ad33b86 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:07.407876 1589 raft_consensus.cc:3058] T c04f7c2d00994557b1cb83234b36fceb P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:07.412453 1666 leader_election.cc:290] T c977876716a0400a9482dd8e0ad33b86 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 2 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:31:07.416730 1590 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c977876716a0400a9482dd8e0ad33b86" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
I20250625 03:31:07.417331 1590 raft_consensus.cc:3058] T c977876716a0400a9482dd8e0ad33b86 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:07.426453 1590 raft_consensus.cc:2466] T c977876716a0400a9482dd8e0ad33b86 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 2.
I20250625 03:31:07.427665 1635 leader_election.cc:304] T c977876716a0400a9482dd8e0ad33b86 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e; no voters:
I20250625 03:31:07.429147 2836 raft_consensus.cc:2802] T c977876716a0400a9482dd8e0ad33b86 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:31:07.429654 2836 raft_consensus.cc:695] T c977876716a0400a9482dd8e0ad33b86 P 3f2aa40978064c9e9983cf3745eed206 [term 2 LEADER]: Becoming Leader. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Running, Role: LEADER
I20250625 03:31:07.430486 2836 consensus_queue.cc:237] T c977876716a0400a9482dd8e0ad33b86 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:07.450933 1745 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c977876716a0400a9482dd8e0ad33b86" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:31:07.451562 1745 raft_consensus.cc:3053] T c977876716a0400a9482dd8e0ad33b86 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:31:07.451916 1745 raft_consensus.cc:738] T c977876716a0400a9482dd8e0ad33b86 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Running, Role: LEADER
I20250625 03:31:07.452695 1745 consensus_queue.cc:260] T c977876716a0400a9482dd8e0ad33b86 P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:07.453918 1589 raft_consensus.cc:513] T c04f7c2d00994557b1cb83234b36fceb P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:07.456701 1669 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c04f7c2d00994557b1cb83234b36fceb" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:31:07.456882 2971 ts_tablet_manager.cc:1918] T 6e7283d035e1429f946d8ebb98978656 P ba464e89e0f044a0a0ea3e6125cbf2a1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20250625 03:31:07.454357 1745 raft_consensus.cc:3058] T c977876716a0400a9482dd8e0ad33b86 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:07.457302 1669 raft_consensus.cc:3053] T c04f7c2d00994557b1cb83234b36fceb P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:31:07.457758 1669 raft_consensus.cc:738] T c04f7c2d00994557b1cb83234b36fceb P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Running, Role: LEADER
I20250625 03:31:07.457305 2971 log.cc:1199] T 6e7283d035e1429f946d8ebb98978656 P ba464e89e0f044a0a0ea3e6125cbf2a1: Deleting WAL directory at /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/ts-2-root/wals/6e7283d035e1429f946d8ebb98978656
I20250625 03:31:07.459640 1480 catalog_manager.cc:4928] TS ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): tablet 6e7283d035e1429f946d8ebb98978656 (table test-workload [id=7f663eabec024fd1911b406c660fa838]) successfully deleted
I20250625 03:31:07.459718 2782 raft_consensus.cc:2953] T 58c56cde04014b85b662a9b4cbaa726f P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:07.460724 1669 consensus_queue.cc:260] T c04f7c2d00994557b1cb83234b36fceb P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:07.461920 1737 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c04f7c2d00994557b1cb83234b36fceb" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:31:07.462591 1737 raft_consensus.cc:3058] T c04f7c2d00994557b1cb83234b36fceb P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:07.466033 1669 raft_consensus.cc:3058] T c04f7c2d00994557b1cb83234b36fceb P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:07.467291 1589 leader_election.cc:290] T c04f7c2d00994557b1cb83234b36fceb P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 2 election: Requested vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:31:07.473090 1669 raft_consensus.cc:2466] T c04f7c2d00994557b1cb83234b36fceb P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 2.
I20250625 03:31:07.473448 1737 raft_consensus.cc:2466] T c04f7c2d00994557b1cb83234b36fceb P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 2.
I20250625 03:31:07.474023 1745 raft_consensus.cc:2466] T c977876716a0400a9482dd8e0ad33b86 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 2.
I20250625 03:31:07.474620 1559 leader_election.cc:304] T c04f7c2d00994557b1cb83234b36fceb P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e; no voters:
I20250625 03:31:07.476847 2912 raft_consensus.cc:2802] T c04f7c2d00994557b1cb83234b36fceb P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:31:07.478380 2912 raft_consensus.cc:695] T c04f7c2d00994557b1cb83234b36fceb P 7e9c4f2e01164f33b2e9034ed148398e [term 2 LEADER]: Becoming Leader. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Running, Role: LEADER
I20250625 03:31:07.479327 2912 consensus_queue.cc:237] T c04f7c2d00994557b1cb83234b36fceb P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:07.484372 2345 raft_consensus.cc:2953] T 58c56cde04014b85b662a9b4cbaa726f P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:07.488744 1745 raft_consensus.cc:2953] T 58c56cde04014b85b662a9b4cbaa726f P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:07.498997 1596 raft_consensus.cc:2953] T 58c56cde04014b85b662a9b4cbaa726f P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:07.506992 1493 catalog_manager.cc:5582] T 58c56cde04014b85b662a9b4cbaa726f P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:07.507221 1494 catalog_manager.cc:5582] T c04f7c2d00994557b1cb83234b36fceb P 7e9c4f2e01164f33b2e9034ed148398e reported cstate change: term changed from 1 to 2, leader changed from 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) to 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129). New cstate: current_term: 2 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:07.517891 1492 catalog_manager.cc:5582] T c977876716a0400a9482dd8e0ad33b86 P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: term changed from 1 to 2, leader changed from ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) to 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130). New cstate: current_term: 2 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:07.556100 1670 consensus_queue.cc:237] T 58c56cde04014b85b662a9b4cbaa726f P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:07.563156 1744 raft_consensus.cc:1273] T 58c56cde04014b85b662a9b4cbaa726f P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250625 03:31:07.564731 2835 consensus_queue.cc:1035] T 58c56cde04014b85b662a9b4cbaa726f P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:31:07.572475 2345 raft_consensus.cc:1273] T 58c56cde04014b85b662a9b4cbaa726f P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250625 03:31:07.571480 2980 raft_consensus.cc:2953] T 58c56cde04014b85b662a9b4cbaa726f P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:07.573630 2835 consensus_queue.cc:1035] T 58c56cde04014b85b662a9b4cbaa726f P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:31:07.578353 2345 raft_consensus.cc:2953] T 58c56cde04014b85b662a9b4cbaa726f P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:07.579974 1744 raft_consensus.cc:2953] T 58c56cde04014b85b662a9b4cbaa726f P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:07.586920 2864 raft_consensus.cc:991] T 393f73bcf106475cbee7a645b0d9660c P ba464e89e0f044a0a0ea3e6125cbf2a1: : Instructing follower 3f2aa40978064c9e9983cf3745eed206 to start an election
I20250625 03:31:07.587430 2915 raft_consensus.cc:1079] T 393f73bcf106475cbee7a645b0d9660c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Signalling peer 3f2aa40978064c9e9983cf3745eed206 to start an election
I20250625 03:31:07.588974 1670 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "393f73bcf106475cbee7a645b0d9660c"
dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
from {username='slave'} at 127.0.0.1:53770
I20250625 03:31:07.589588 1670 raft_consensus.cc:491] T 393f73bcf106475cbee7a645b0d9660c P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:31:07.589663 1478 catalog_manager.cc:5095] ChangeConfig:REMOVE_PEER RPC for tablet 58c56cde04014b85b662a9b4cbaa726f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250625 03:31:07.590051 1670 raft_consensus.cc:3058] T 393f73bcf106475cbee7a645b0d9660c P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:07.596972 1670 raft_consensus.cc:513] T 393f73bcf106475cbee7a645b0d9660c P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:07.599346 1596 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "393f73bcf106475cbee7a645b0d9660c" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
I20250625 03:31:07.599912 1596 raft_consensus.cc:3058] T 393f73bcf106475cbee7a645b0d9660c P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:07.602568 1491 catalog_manager.cc:5582] T 58c56cde04014b85b662a9b4cbaa726f P df8b9755d156478aafca552f9e9c539e reported cstate change: config changed from index 3 to 4, VOTER 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) evicted. New cstate: current_term: 1 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:07.604651 1670 leader_election.cc:290] T 393f73bcf106475cbee7a645b0d9660c P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 2 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:31:07.605692 1744 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "393f73bcf106475cbee7a645b0d9660c" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:31:07.606211 1744 raft_consensus.cc:3053] T 393f73bcf106475cbee7a645b0d9660c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:31:07.606448 1744 raft_consensus.cc:738] T 393f73bcf106475cbee7a645b0d9660c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Running, Role: LEADER
I20250625 03:31:07.607174 1744 consensus_queue.cc:260] T 393f73bcf106475cbee7a645b0d9660c P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:07.607921 1596 raft_consensus.cc:2466] T 393f73bcf106475cbee7a645b0d9660c P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 2.
I20250625 03:31:07.608414 1744 raft_consensus.cc:3058] T 393f73bcf106475cbee7a645b0d9660c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:07.611133 1635 leader_election.cc:304] T 393f73bcf106475cbee7a645b0d9660c P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e; no voters:
I20250625 03:31:07.612172 2980 raft_consensus.cc:2802] T 393f73bcf106475cbee7a645b0d9660c P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:31:07.612871 2980 raft_consensus.cc:695] T 393f73bcf106475cbee7a645b0d9660c P 3f2aa40978064c9e9983cf3745eed206 [term 2 LEADER]: Becoming Leader. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Running, Role: LEADER
I20250625 03:31:07.613936 2980 consensus_queue.cc:237] T 393f73bcf106475cbee7a645b0d9660c P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:07.615988 1744 raft_consensus.cc:2466] T 393f73bcf106475cbee7a645b0d9660c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 2.
I20250625 03:31:07.618467 2987 ts_tablet_manager.cc:927] T b31026f89f1e49949acec419db9649d3 P df8b9755d156478aafca552f9e9c539e: Initiating tablet copy from peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:31:07.623334 1582 tablet_service.cc:1515] Processing DeleteTablet for tablet 58c56cde04014b85b662a9b4cbaa726f with delete_type TABLET_DATA_TOMBSTONED (TS 7e9c4f2e01164f33b2e9034ed148398e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52712
I20250625 03:31:07.625011 2987 tablet_copy_client.cc:323] T b31026f89f1e49949acec419db9649d3 P df8b9755d156478aafca552f9e9c539e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.106.130:34293
I20250625 03:31:07.626972 1680 tablet_copy_service.cc:140] P 3f2aa40978064c9e9983cf3745eed206: Received BeginTabletCopySession request for tablet b31026f89f1e49949acec419db9649d3 from peer df8b9755d156478aafca552f9e9c539e ({username='slave'} at 127.0.0.1:55766)
I20250625 03:31:07.627535 1680 tablet_copy_service.cc:161] P 3f2aa40978064c9e9983cf3745eed206: Beginning new tablet copy session on tablet b31026f89f1e49949acec419db9649d3 from peer df8b9755d156478aafca552f9e9c539e at {username='slave'} at 127.0.0.1:55766: session id = df8b9755d156478aafca552f9e9c539e-b31026f89f1e49949acec419db9649d3
I20250625 03:31:07.633777 2782 raft_consensus.cc:991] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206: : Instructing follower 7e9c4f2e01164f33b2e9034ed148398e to start an election
I20250625 03:31:07.634639 2782 raft_consensus.cc:1079] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206 [term 2 LEADER]: Signalling peer 7e9c4f2e01164f33b2e9034ed148398e to start an election
I20250625 03:31:07.634806 1680 tablet_copy_source_session.cc:215] T b31026f89f1e49949acec419db9649d3 P 3f2aa40978064c9e9983cf3745eed206: Tablet Copy: opened 0 blocks and 1 log segments
I20250625 03:31:07.636658 1596 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "a5a18934cc3f490288432ee1cb30b278"
dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
from {username='slave'} at 127.0.0.1:52738
I20250625 03:31:07.637344 1596 raft_consensus.cc:491] T a5a18934cc3f490288432ee1cb30b278 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:31:07.637795 1596 raft_consensus.cc:3058] T a5a18934cc3f490288432ee1cb30b278 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:07.638561 1492 catalog_manager.cc:5582] T 393f73bcf106475cbee7a645b0d9660c P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: term changed from 1 to 2, leader changed from ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) to 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130). New cstate: current_term: 2 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:07.643740 2990 tablet_replica.cc:331] T 58c56cde04014b85b662a9b4cbaa726f P 7e9c4f2e01164f33b2e9034ed148398e: stopping tablet replica
I20250625 03:31:07.644863 2990 raft_consensus.cc:2241] T 58c56cde04014b85b662a9b4cbaa726f P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:07.644956 2987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b31026f89f1e49949acec419db9649d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:07.645658 2990 raft_consensus.cc:2270] T 58c56cde04014b85b662a9b4cbaa726f P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:07.651115 1596 raft_consensus.cc:513] T a5a18934cc3f490288432ee1cb30b278 P 7e9c4f2e01164f33b2e9034ed148398e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:07.651495 2990 ts_tablet_manager.cc:1905] T 58c56cde04014b85b662a9b4cbaa726f P 7e9c4f2e01164f33b2e9034ed148398e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250625 03:31:07.653723 1745 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a5a18934cc3f490288432ee1cb30b278" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:31:07.653740 1670 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a5a18934cc3f490288432ee1cb30b278" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:31:07.654387 1745 raft_consensus.cc:3058] T a5a18934cc3f490288432ee1cb30b278 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:07.654466 1670 raft_consensus.cc:3053] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206 [term 2 LEADER]: Stepping down as leader of term 2
I20250625 03:31:07.654879 1670 raft_consensus.cc:738] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Running, Role: LEADER
I20250625 03:31:07.655571 1670 consensus_queue.cc:260] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:07.656648 1670 raft_consensus.cc:3058] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:07.662408 1596 leader_election.cc:290] T a5a18934cc3f490288432ee1cb30b278 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 3 election: Requested vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:31:07.659641 1745 raft_consensus.cc:2466] T a5a18934cc3f490288432ee1cb30b278 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 3.
I20250625 03:31:07.666887 1561 leader_election.cc:304] T a5a18934cc3f490288432ee1cb30b278 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters:
I20250625 03:31:07.667706 2967 raft_consensus.cc:2802] T a5a18934cc3f490288432ee1cb30b278 P 7e9c4f2e01164f33b2e9034ed148398e [term 3 FOLLOWER]: Leader election won for term 3
I20250625 03:31:07.668201 2967 raft_consensus.cc:695] T a5a18934cc3f490288432ee1cb30b278 P 7e9c4f2e01164f33b2e9034ed148398e [term 3 LEADER]: Becoming Leader. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Running, Role: LEADER
I20250625 03:31:07.668684 1670 raft_consensus.cc:2466] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 3.
I20250625 03:31:07.668870 2990 ts_tablet_manager.cc:1918] T 58c56cde04014b85b662a9b4cbaa726f P 7e9c4f2e01164f33b2e9034ed148398e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20250625 03:31:07.669414 2990 log.cc:1199] T 58c56cde04014b85b662a9b4cbaa726f P 7e9c4f2e01164f33b2e9034ed148398e: Deleting WAL directory at /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/ts-0-root/wals/58c56cde04014b85b662a9b4cbaa726f
I20250625 03:31:07.669018 2967 consensus_queue.cc:237] T a5a18934cc3f490288432ee1cb30b278 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:07.671682 1479 catalog_manager.cc:4928] TS 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): tablet 58c56cde04014b85b662a9b4cbaa726f (table test-workload [id=7f663eabec024fd1911b406c660fa838]) successfully deleted
I20250625 03:31:07.677356 2987 tablet_copy_client.cc:806] T b31026f89f1e49949acec419db9649d3 P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 0 data blocks...
I20250625 03:31:07.690719 2987 tablet_copy_client.cc:670] T b31026f89f1e49949acec419db9649d3 P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 1 WAL segments...
I20250625 03:31:07.687685 1492 catalog_manager.cc:5582] T a5a18934cc3f490288432ee1cb30b278 P 7e9c4f2e01164f33b2e9034ed148398e reported cstate change: term changed from 2 to 3, leader changed from 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) to 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129). New cstate: current_term: 3 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:07.694911 2987 tablet_copy_client.cc:538] T b31026f89f1e49949acec419db9649d3 P df8b9755d156478aafca552f9e9c539e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250625 03:31:07.703400 2987 tablet_bootstrap.cc:492] T b31026f89f1e49949acec419db9649d3 P df8b9755d156478aafca552f9e9c539e: Bootstrap starting.
I20250625 03:31:07.731634 2987 tablet_bootstrap.cc:492] T b31026f89f1e49949acec419db9649d3 P df8b9755d156478aafca552f9e9c539e: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:31:07.732600 2987 tablet_bootstrap.cc:492] T b31026f89f1e49949acec419db9649d3 P df8b9755d156478aafca552f9e9c539e: Bootstrap complete.
I20250625 03:31:07.733299 2987 ts_tablet_manager.cc:1397] T b31026f89f1e49949acec419db9649d3 P df8b9755d156478aafca552f9e9c539e: Time spent bootstrapping tablet: real 0.030s user 0.020s sys 0.012s
I20250625 03:31:07.763049 2987 raft_consensus.cc:357] T b31026f89f1e49949acec419db9649d3 P df8b9755d156478aafca552f9e9c539e [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:31:07.765272 2987 raft_consensus.cc:738] T b31026f89f1e49949acec419db9649d3 P df8b9755d156478aafca552f9e9c539e [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: df8b9755d156478aafca552f9e9c539e, State: Initialized, Role: LEARNER
I20250625 03:31:07.766425 2987 consensus_queue.cc:260] T b31026f89f1e49949acec419db9649d3 P df8b9755d156478aafca552f9e9c539e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:31:07.774467 2987 ts_tablet_manager.cc:1428] T b31026f89f1e49949acec419db9649d3 P df8b9755d156478aafca552f9e9c539e: Time spent starting tablet: real 0.018s user 0.013s sys 0.004s
I20250625 03:31:07.794749 1680 tablet_copy_service.cc:342] P 3f2aa40978064c9e9983cf3745eed206: Request end of tablet copy session df8b9755d156478aafca552f9e9c539e-b31026f89f1e49949acec419db9649d3 received from {username='slave'} at 127.0.0.1:55766
I20250625 03:31:07.795722 1680 tablet_copy_service.cc:434] P 3f2aa40978064c9e9983cf3745eed206: ending tablet copy session df8b9755d156478aafca552f9e9c539e-b31026f89f1e49949acec419db9649d3 on tablet b31026f89f1e49949acec419db9649d3 with peer df8b9755d156478aafca552f9e9c539e
W20250625 03:31:07.824790 1708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.130:34293, user_credentials={real_user=slave}} blocked reactor thread for 45349.2us
I20250625 03:31:07.831884 2864 raft_consensus.cc:991] T b15eb94b9d3d4f6987b5fa5e20193655 P ba464e89e0f044a0a0ea3e6125cbf2a1: : Instructing follower df8b9755d156478aafca552f9e9c539e to start an election
I20250625 03:31:07.835453 2996 raft_consensus.cc:1079] T b15eb94b9d3d4f6987b5fa5e20193655 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Signalling peer df8b9755d156478aafca552f9e9c539e to start an election
I20250625 03:31:07.839988 2343 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "b15eb94b9d3d4f6987b5fa5e20193655"
dest_uuid: "df8b9755d156478aafca552f9e9c539e"
from {username='slave'} at 127.0.0.1:54692
I20250625 03:31:07.840893 2343 raft_consensus.cc:491] T b15eb94b9d3d4f6987b5fa5e20193655 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:31:07.841423 2343 raft_consensus.cc:3058] T b15eb94b9d3d4f6987b5fa5e20193655 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:07.844274 1596 raft_consensus.cc:1273] T c977876716a0400a9482dd8e0ad33b86 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:07.846050 2835 consensus_queue.cc:1035] T c977876716a0400a9482dd8e0ad33b86 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20250625 03:31:07.856731 2343 raft_consensus.cc:513] T b15eb94b9d3d4f6987b5fa5e20193655 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:07.859730 2343 leader_election.cc:290] T b15eb94b9d3d4f6987b5fa5e20193655 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 2 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:31:07.860286 1596 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b15eb94b9d3d4f6987b5fa5e20193655" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
I20250625 03:31:07.860608 1737 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b15eb94b9d3d4f6987b5fa5e20193655" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:31:07.861150 1596 raft_consensus.cc:3058] T b15eb94b9d3d4f6987b5fa5e20193655 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:07.861459 1737 raft_consensus.cc:3053] T b15eb94b9d3d4f6987b5fa5e20193655 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:31:07.861925 1737 raft_consensus.cc:738] T b15eb94b9d3d4f6987b5fa5e20193655 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Running, Role: LEADER
I20250625 03:31:07.862934 1737 consensus_queue.cc:260] T b15eb94b9d3d4f6987b5fa5e20193655 P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:07.864603 1737 raft_consensus.cc:3058] T b15eb94b9d3d4f6987b5fa5e20193655 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:07.877558 1737 raft_consensus.cc:2466] T b15eb94b9d3d4f6987b5fa5e20193655 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df8b9755d156478aafca552f9e9c539e in term 2.
I20250625 03:31:07.879649 2308 leader_election.cc:304] T b15eb94b9d3d4f6987b5fa5e20193655 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1, df8b9755d156478aafca552f9e9c539e; no voters:
I20250625 03:31:07.880296 1596 raft_consensus.cc:2466] T b15eb94b9d3d4f6987b5fa5e20193655 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df8b9755d156478aafca552f9e9c539e in term 2.
I20250625 03:31:07.880856 2997 raft_consensus.cc:2802] T b15eb94b9d3d4f6987b5fa5e20193655 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:31:07.881462 2997 raft_consensus.cc:695] T b15eb94b9d3d4f6987b5fa5e20193655 P df8b9755d156478aafca552f9e9c539e [term 2 LEADER]: Becoming Leader. State: Replica: df8b9755d156478aafca552f9e9c539e, State: Running, Role: LEADER
I20250625 03:31:07.884445 2997 consensus_queue.cc:237] T b15eb94b9d3d4f6987b5fa5e20193655 P df8b9755d156478aafca552f9e9c539e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:07.901543 1745 raft_consensus.cc:1273] T c977876716a0400a9482dd8e0ad33b86 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:07.909307 2835 consensus_queue.cc:1035] T c977876716a0400a9482dd8e0ad33b86 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20250625 03:31:07.955896 1491 catalog_manager.cc:5582] T b15eb94b9d3d4f6987b5fa5e20193655 P df8b9755d156478aafca552f9e9c539e reported cstate change: term changed from 1 to 2, leader changed from ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) to df8b9755d156478aafca552f9e9c539e (127.0.106.132). New cstate: current_term: 2 leader_uuid: "df8b9755d156478aafca552f9e9c539e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250625 03:31:08.005714 1669 raft_consensus.cc:1273] T c04f7c2d00994557b1cb83234b36fceb P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:08.007400 2967 consensus_queue.cc:1035] T c04f7c2d00994557b1cb83234b36fceb P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20250625 03:31:08.013083 1744 raft_consensus.cc:1273] T c04f7c2d00994557b1cb83234b36fceb P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:08.014307 2931 consensus_queue.cc:1035] T c04f7c2d00994557b1cb83234b36fceb P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20250625 03:31:08.058147 1744 raft_consensus.cc:1273] T a5a18934cc3f490288432ee1cb30b278 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250625 03:31:08.059343 2967 consensus_queue.cc:1035] T a5a18934cc3f490288432ee1cb30b278 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:31:08.071209 1666 raft_consensus.cc:1273] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250625 03:31:08.072751 2967 consensus_queue.cc:1035] T a5a18934cc3f490288432ee1cb30b278 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:31:08.137885 1596 raft_consensus.cc:1273] T 393f73bcf106475cbee7a645b0d9660c P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:08.139143 2782 consensus_queue.cc:1035] T 393f73bcf106475cbee7a645b0d9660c P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:08.149003 1744 raft_consensus.cc:1273] T 393f73bcf106475cbee7a645b0d9660c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:08.150605 2980 consensus_queue.cc:1035] T 393f73bcf106475cbee7a645b0d9660c P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:08.192704 2345 raft_consensus.cc:1215] T b31026f89f1e49949acec419db9649d3 P df8b9755d156478aafca552f9e9c539e [term 3 LEARNER]: Deduplicated request from leader. Original: 2.3->[3.4-3.4] Dedup: 3.4->[]
I20250625 03:31:08.413615 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:31:08.417340 1596 raft_consensus.cc:1273] T b15eb94b9d3d4f6987b5fa5e20193655 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Refusing update from remote peer df8b9755d156478aafca552f9e9c539e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250625 03:31:08.418733 2903 consensus_queue.cc:1035] T b15eb94b9d3d4f6987b5fa5e20193655 P df8b9755d156478aafca552f9e9c539e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20250625 03:31:08.439375 1744 raft_consensus.cc:1273] T b15eb94b9d3d4f6987b5fa5e20193655 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Refusing update from remote peer df8b9755d156478aafca552f9e9c539e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250625 03:31:08.442271 2903 consensus_queue.cc:1035] T b15eb94b9d3d4f6987b5fa5e20193655 P df8b9755d156478aafca552f9e9c539e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250625 03:31:08.474556 1669 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "58c56cde04014b85b662a9b4cbaa726f"
dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
mode: GRACEFUL
new_leader_uuid: "df8b9755d156478aafca552f9e9c539e"
from {username='slave'} at 127.0.0.1:35370
I20250625 03:31:08.475080 1669 raft_consensus.cc:604] T 58c56cde04014b85b662a9b4cbaa726f P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Received request to transfer leadership to TS df8b9755d156478aafca552f9e9c539e
I20250625 03:31:08.477448 1596 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "6d7a37b3448d468baa1b9422a6167c9a"
dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
mode: GRACEFUL
new_leader_uuid: "3f2aa40978064c9e9983cf3745eed206"
from {username='slave'} at 127.0.0.1:47018
I20250625 03:31:08.477918 1596 raft_consensus.cc:604] T 6d7a37b3448d468baa1b9422a6167c9a P 7e9c4f2e01164f33b2e9034ed148398e [term 1 LEADER]: Received request to transfer leadership to TS 3f2aa40978064c9e9983cf3745eed206
I20250625 03:31:08.480150 1596 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "7553473daeb342ceaf782ddee8e4fc4d"
dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
mode: GRACEFUL
new_leader_uuid: "3f2aa40978064c9e9983cf3745eed206"
from {username='slave'} at 127.0.0.1:47018
I20250625 03:31:08.480587 1596 raft_consensus.cc:604] T 7553473daeb342ceaf782ddee8e4fc4d P 7e9c4f2e01164f33b2e9034ed148398e [term 2 LEADER]: Received request to transfer leadership to TS 3f2aa40978064c9e9983cf3745eed206
I20250625 03:31:08.482686 1669 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "c977876716a0400a9482dd8e0ad33b86"
dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
mode: GRACEFUL
new_leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
from {username='slave'} at 127.0.0.1:35370
I20250625 03:31:08.483227 1669 raft_consensus.cc:604] T c977876716a0400a9482dd8e0ad33b86 P 3f2aa40978064c9e9983cf3745eed206 [term 2 LEADER]: Received request to transfer leadership to TS ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:31:08.484247 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 4
I20250625 03:31:08.485407 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:31:08.486217 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:31:08.562872 2931 raft_consensus.cc:991] T 6d7a37b3448d468baa1b9422a6167c9a P 7e9c4f2e01164f33b2e9034ed148398e: : Instructing follower 3f2aa40978064c9e9983cf3745eed206 to start an election
I20250625 03:31:08.563581 2808 raft_consensus.cc:1079] T 6d7a37b3448d468baa1b9422a6167c9a P 7e9c4f2e01164f33b2e9034ed148398e [term 1 LEADER]: Signalling peer 3f2aa40978064c9e9983cf3745eed206 to start an election
I20250625 03:31:08.564973 1666 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "6d7a37b3448d468baa1b9422a6167c9a"
dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
from {username='slave'} at 127.0.0.1:53758
I20250625 03:31:08.565434 1666 raft_consensus.cc:491] T 6d7a37b3448d468baa1b9422a6167c9a P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:31:08.565689 1666 raft_consensus.cc:3058] T 6d7a37b3448d468baa1b9422a6167c9a P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:08.572259 1666 raft_consensus.cc:513] T 6d7a37b3448d468baa1b9422a6167c9a P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:08.573704 1666 leader_election.cc:290] T 6d7a37b3448d468baa1b9422a6167c9a P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 2 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493)
I20250625 03:31:08.574581 1596 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6d7a37b3448d468baa1b9422a6167c9a" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
I20250625 03:31:08.574708 2343 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6d7a37b3448d468baa1b9422a6167c9a" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "df8b9755d156478aafca552f9e9c539e"
I20250625 03:31:08.575198 1596 raft_consensus.cc:3053] T 6d7a37b3448d468baa1b9422a6167c9a P 7e9c4f2e01164f33b2e9034ed148398e [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:31:08.575244 2343 raft_consensus.cc:3058] T 6d7a37b3448d468baa1b9422a6167c9a P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:08.575532 1596 raft_consensus.cc:738] T 6d7a37b3448d468baa1b9422a6167c9a P 7e9c4f2e01164f33b2e9034ed148398e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Running, Role: LEADER
I20250625 03:31:08.576421 1596 consensus_queue.cc:260] T 6d7a37b3448d468baa1b9422a6167c9a P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:08.578056 1596 raft_consensus.cc:3058] T 6d7a37b3448d468baa1b9422a6167c9a P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:08.581264 2343 raft_consensus.cc:2466] T 6d7a37b3448d468baa1b9422a6167c9a P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 2.
I20250625 03:31:08.582407 1634 leader_election.cc:304] T 6d7a37b3448d468baa1b9422a6167c9a P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, df8b9755d156478aafca552f9e9c539e; no voters:
I20250625 03:31:08.583180 2782 raft_consensus.cc:2802] T 6d7a37b3448d468baa1b9422a6167c9a P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:31:08.583458 1596 raft_consensus.cc:2466] T 6d7a37b3448d468baa1b9422a6167c9a P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 2.
I20250625 03:31:08.583595 2782 raft_consensus.cc:695] T 6d7a37b3448d468baa1b9422a6167c9a P 3f2aa40978064c9e9983cf3745eed206 [term 2 LEADER]: Becoming Leader. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Running, Role: LEADER
I20250625 03:31:08.584519 2782 consensus_queue.cc:237] T 6d7a37b3448d468baa1b9422a6167c9a P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:08.597623 1491 catalog_manager.cc:5582] T 6d7a37b3448d468baa1b9422a6167c9a P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: term changed from 1 to 2, leader changed from 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) to 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130). New cstate: current_term: 2 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:08.668282 1666 consensus_queue.cc:237] T 542f85d76df8432593ee963669155a9d P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:31:08.670796 2835 raft_consensus.cc:1062] T b31026f89f1e49949acec419db9649d3 P 3f2aa40978064c9e9983cf3745eed206: attempting to promote NON_VOTER df8b9755d156478aafca552f9e9c539e to VOTER
I20250625 03:31:08.673234 2835 consensus_queue.cc:237] T b31026f89f1e49949acec419db9649d3 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
W20250625 03:31:08.683409 1634 consensus_peers.cc:487] T 542f85d76df8432593ee963669155a9d P 3f2aa40978064c9e9983cf3745eed206 -> Peer df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493): Couldn't send request to peer df8b9755d156478aafca552f9e9c539e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 542f85d76df8432593ee963669155a9d. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:08.685657 2343 raft_consensus.cc:1273] T b31026f89f1e49949acec419db9649d3 P df8b9755d156478aafca552f9e9c539e [term 3 LEARNER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20250625 03:31:08.686852 2835 consensus_queue.cc:1035] T b31026f89f1e49949acec419db9649d3 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250625 03:31:08.688056 1744 raft_consensus.cc:1273] T 542f85d76df8432593ee963669155a9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20250625 03:31:08.687140 1589 raft_consensus.cc:1273] T 542f85d76df8432593ee963669155a9d P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20250625 03:31:08.688555 1596 raft_consensus.cc:1273] T b31026f89f1e49949acec419db9649d3 P 7e9c4f2e01164f33b2e9034ed148398e [term 3 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20250625 03:31:08.690276 2835 consensus_queue.cc:1035] T 542f85d76df8432593ee963669155a9d P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:31:08.690552 1737 raft_consensus.cc:1273] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20250625 03:31:08.692595 2782 consensus_queue.cc:1035] T 542f85d76df8432593ee963669155a9d P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:31:08.692816 2980 consensus_queue.cc:1035] T b31026f89f1e49949acec419db9649d3 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250625 03:31:08.694449 3010 consensus_queue.cc:1035] T b31026f89f1e49949acec419db9649d3 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250625 03:31:08.714026 2835 raft_consensus.cc:2953] T b31026f89f1e49949acec419db9649d3 P 3f2aa40978064c9e9983cf3745eed206 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 2 to 5, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:08.716892 1744 raft_consensus.cc:2953] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:08.720691 2980 raft_consensus.cc:2953] T 542f85d76df8432593ee963669155a9d P 3f2aa40978064c9e9983cf3745eed206 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:08.730466 1589 raft_consensus.cc:2953] T 542f85d76df8432593ee963669155a9d P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:08.742363 1744 raft_consensus.cc:2953] T 542f85d76df8432593ee963669155a9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:08.742347 2343 raft_consensus.cc:2953] T b31026f89f1e49949acec419db9649d3 P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:08.750851 2782 raft_consensus.cc:991] T c977876716a0400a9482dd8e0ad33b86 P 3f2aa40978064c9e9983cf3745eed206: : Instructing follower ba464e89e0f044a0a0ea3e6125cbf2a1 to start an election
I20250625 03:31:08.751461 2782 raft_consensus.cc:1079] T c977876716a0400a9482dd8e0ad33b86 P 3f2aa40978064c9e9983cf3745eed206 [term 2 LEADER]: Signalling peer ba464e89e0f044a0a0ea3e6125cbf2a1 to start an election
I20250625 03:31:08.746106 1491 catalog_manager.cc:5582] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: config changed from index 2 to 5, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:08.753300 1741 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "c977876716a0400a9482dd8e0ad33b86"
dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
from {username='slave'} at 127.0.0.1:43678
I20250625 03:31:08.753880 1741 raft_consensus.cc:491] T c977876716a0400a9482dd8e0ad33b86 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:31:08.754226 1741 raft_consensus.cc:3058] T c977876716a0400a9482dd8e0ad33b86 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:08.757089 1596 raft_consensus.cc:2953] T b31026f89f1e49949acec419db9649d3 P 7e9c4f2e01164f33b2e9034ed148398e [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:08.768957 1737 consensus_queue.cc:237] T 9b7de80fbd7d4625aac41dea0457fd3e P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:31:08.767982 1741 raft_consensus.cc:513] T c977876716a0400a9482dd8e0ad33b86 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:08.786098 1590 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c977876716a0400a9482dd8e0ad33b86" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
I20250625 03:31:08.786739 1590 raft_consensus.cc:3058] T c977876716a0400a9482dd8e0ad33b86 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:08.788661 1666 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c977876716a0400a9482dd8e0ad33b86" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:31:08.789976 1666 raft_consensus.cc:3053] T c977876716a0400a9482dd8e0ad33b86 P 3f2aa40978064c9e9983cf3745eed206 [term 2 LEADER]: Stepping down as leader of term 2
I20250625 03:31:08.790365 1666 raft_consensus.cc:738] T c977876716a0400a9482dd8e0ad33b86 P 3f2aa40978064c9e9983cf3745eed206 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Running, Role: LEADER
I20250625 03:31:08.788641 1492 catalog_manager.cc:5582] T 542f85d76df8432593ee963669155a9d P 7e9c4f2e01164f33b2e9034ed148398e reported cstate change: config changed from index -1 to 3, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New cstate: current_term: 2 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:08.791287 1666 consensus_queue.cc:260] T c977876716a0400a9482dd8e0ad33b86 P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:08.796729 1666 raft_consensus.cc:3058] T c977876716a0400a9482dd8e0ad33b86 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:08.807745 2967 raft_consensus.cc:991] T 7553473daeb342ceaf782ddee8e4fc4d P 7e9c4f2e01164f33b2e9034ed148398e: : Instructing follower 3f2aa40978064c9e9983cf3745eed206 to start an election
I20250625 03:31:08.808449 2967 raft_consensus.cc:1079] T 7553473daeb342ceaf782ddee8e4fc4d P 7e9c4f2e01164f33b2e9034ed148398e [term 2 LEADER]: Signalling peer 3f2aa40978064c9e9983cf3745eed206 to start an election
I20250625 03:31:08.809994 1669 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "7553473daeb342ceaf782ddee8e4fc4d"
dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
from {username='slave'} at 127.0.0.1:53758
I20250625 03:31:08.810535 1669 raft_consensus.cc:491] T 7553473daeb342ceaf782ddee8e4fc4d P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:31:08.810897 1669 raft_consensus.cc:3058] T 7553473daeb342ceaf782ddee8e4fc4d P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:08.783215 1741 leader_election.cc:290] T c977876716a0400a9482dd8e0ad33b86 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 3 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:31:08.816540 1666 raft_consensus.cc:2466] T c977876716a0400a9482dd8e0ad33b86 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 3.
I20250625 03:31:08.821076 1708 leader_election.cc:304] T c977876716a0400a9482dd8e0ad33b86 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters:
I20250625 03:31:08.823693 3027 raft_consensus.cc:2802] T c977876716a0400a9482dd8e0ad33b86 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Leader election won for term 3
I20250625 03:31:08.824468 3027 raft_consensus.cc:695] T c977876716a0400a9482dd8e0ad33b86 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 LEADER]: Becoming Leader. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Running, Role: LEADER
I20250625 03:31:08.825577 3027 consensus_queue.cc:237] T c977876716a0400a9482dd8e0ad33b86 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:08.830833 1590 raft_consensus.cc:2466] T c977876716a0400a9482dd8e0ad33b86 P 7e9c4f2e01164f33b2e9034ed148398e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 3.
I20250625 03:31:08.818156 1669 raft_consensus.cc:513] T 7553473daeb342ceaf782ddee8e4fc4d P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:08.838016 1670 consensus_queue.cc:237] T b31026f89f1e49949acec419db9649d3 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:08.842751 1739 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7553473daeb342ceaf782ddee8e4fc4d" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:31:08.842891 1587 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7553473daeb342ceaf782ddee8e4fc4d" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
I20250625 03:31:08.843377 1739 raft_consensus.cc:3058] T 7553473daeb342ceaf782ddee8e4fc4d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:08.843731 1587 raft_consensus.cc:3053] T 7553473daeb342ceaf782ddee8e4fc4d P 7e9c4f2e01164f33b2e9034ed148398e [term 2 LEADER]: Stepping down as leader of term 2
I20250625 03:31:08.844183 1587 raft_consensus.cc:738] T 7553473daeb342ceaf782ddee8e4fc4d P 7e9c4f2e01164f33b2e9034ed148398e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Running, Role: LEADER
I20250625 03:31:08.845157 1587 consensus_queue.cc:260] T 7553473daeb342ceaf782ddee8e4fc4d P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:08.846613 1587 raft_consensus.cc:3058] T 7553473daeb342ceaf782ddee8e4fc4d P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:08.848932 2343 raft_consensus.cc:1273] T b31026f89f1e49949acec419db9649d3 P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20250625 03:31:08.850729 1745 raft_consensus.cc:1273] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20250625 03:31:08.851233 1739 raft_consensus.cc:2466] T 7553473daeb342ceaf782ddee8e4fc4d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 3.
I20250625 03:31:08.841228 1669 leader_election.cc:290] T 7553473daeb342ceaf782ddee8e4fc4d P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 3 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:31:08.855234 2782 consensus_queue.cc:1035] T b31026f89f1e49949acec419db9649d3 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20250625 03:31:08.856299 1636 leader_election.cc:304] T 7553473daeb342ceaf782ddee8e4fc4d P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters:
I20250625 03:31:08.857580 3010 consensus_queue.cc:1035] T b31026f89f1e49949acec419db9649d3 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20250625 03:31:08.857784 2782 raft_consensus.cc:2802] T 7553473daeb342ceaf782ddee8e4fc4d P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Leader election won for term 3
I20250625 03:31:08.860495 2782 raft_consensus.cc:695] T 7553473daeb342ceaf782ddee8e4fc4d P 3f2aa40978064c9e9983cf3745eed206 [term 3 LEADER]: Becoming Leader. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Running, Role: LEADER
I20250625 03:31:08.861441 2782 consensus_queue.cc:237] T 7553473daeb342ceaf782ddee8e4fc4d P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:08.863984 3029 raft_consensus.cc:2953] T b31026f89f1e49949acec419db9649d3 P 3f2aa40978064c9e9983cf3745eed206 [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:08.873378 2345 raft_consensus.cc:2953] T b31026f89f1e49949acec419db9649d3 P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:08.909869 1669 raft_consensus.cc:1273] T 9b7de80fbd7d4625aac41dea0457fd3e P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 03:31:08.911645 2996 consensus_queue.cc:1035] T 9b7de80fbd7d4625aac41dea0457fd3e P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20250625 03:31:08.914753 1591 raft_consensus.cc:1273] T 9b7de80fbd7d4625aac41dea0457fd3e P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 03:31:08.915712 1587 raft_consensus.cc:2466] T 7553473daeb342ceaf782ddee8e4fc4d P 7e9c4f2e01164f33b2e9034ed148398e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 3.
I20250625 03:31:08.916515 2996 consensus_queue.cc:1035] T 9b7de80fbd7d4625aac41dea0457fd3e P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20250625 03:31:08.930902 1708 consensus_peers.cc:487] T 9b7de80fbd7d4625aac41dea0457fd3e P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493): Couldn't send request to peer df8b9755d156478aafca552f9e9c539e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9b7de80fbd7d4625aac41dea0457fd3e. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:08.938665 3027 raft_consensus.cc:2953] T 9b7de80fbd7d4625aac41dea0457fd3e P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:08.940073 1478 catalog_manager.cc:5095] ChangeConfig:REMOVE_PEER RPC for tablet b31026f89f1e49949acec419db9649d3 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250625 03:31:08.937907 1739 raft_consensus.cc:2953] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:08.943009 1587 raft_consensus.cc:2953] T 9b7de80fbd7d4625aac41dea0457fd3e P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:08.948323 1492 catalog_manager.cc:5582] T c977876716a0400a9482dd8e0ad33b86 P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: term changed from 2 to 3, leader changed from 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) to ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131). New cstate: current_term: 3 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: HEALTHY } } }
I20250625 03:31:08.951375 1669 raft_consensus.cc:2953] T 9b7de80fbd7d4625aac41dea0457fd3e P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:08.952813 2835 raft_consensus.cc:991] T 58c56cde04014b85b662a9b4cbaa726f P 3f2aa40978064c9e9983cf3745eed206: : Instructing follower df8b9755d156478aafca552f9e9c539e to start an election
I20250625 03:31:08.953298 2782 raft_consensus.cc:1079] T 58c56cde04014b85b662a9b4cbaa726f P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Signalling peer df8b9755d156478aafca552f9e9c539e to start an election
I20250625 03:31:08.955106 2343 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "58c56cde04014b85b662a9b4cbaa726f"
dest_uuid: "df8b9755d156478aafca552f9e9c539e"
from {username='slave'} at 127.0.0.1:33226
I20250625 03:31:08.955631 2343 raft_consensus.cc:491] T 58c56cde04014b85b662a9b4cbaa726f P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:31:08.955977 2343 raft_consensus.cc:3058] T 58c56cde04014b85b662a9b4cbaa726f P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:08.968031 2343 raft_consensus.cc:513] T 58c56cde04014b85b662a9b4cbaa726f P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:08.968160 1490 catalog_manager.cc:5582] T b31026f89f1e49949acec419db9649d3 P df8b9755d156478aafca552f9e9c539e reported cstate change: config changed from index 5 to 6, VOTER 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) evicted. New cstate: current_term: 3 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:08.972510 2343 leader_election.cc:290] T 58c56cde04014b85b662a9b4cbaa726f P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 2 election: Requested vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:31:08.973490 1669 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "58c56cde04014b85b662a9b4cbaa726f" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:31:08.974164 1669 raft_consensus.cc:3053] T 58c56cde04014b85b662a9b4cbaa726f P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:31:08.974485 1739 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "58c56cde04014b85b662a9b4cbaa726f" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:31:08.975078 1739 raft_consensus.cc:3058] T 58c56cde04014b85b662a9b4cbaa726f P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:08.974512 1669 raft_consensus.cc:738] T 58c56cde04014b85b662a9b4cbaa726f P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Running, Role: LEADER
I20250625 03:31:08.977022 1669 consensus_queue.cc:260] T 58c56cde04014b85b662a9b4cbaa726f P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:08.976575 1491 catalog_manager.cc:5582] T 9b7de80fbd7d4625aac41dea0457fd3e P 7e9c4f2e01164f33b2e9034ed148398e reported cstate change: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New cstate: current_term: 1 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:08.978679 1669 raft_consensus.cc:3058] T 58c56cde04014b85b662a9b4cbaa726f P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:08.985302 1669 raft_consensus.cc:2466] T 58c56cde04014b85b662a9b4cbaa726f P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df8b9755d156478aafca552f9e9c539e in term 2.
I20250625 03:31:08.986442 2306 leader_election.cc:304] T 58c56cde04014b85b662a9b4cbaa726f P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, df8b9755d156478aafca552f9e9c539e; no voters:
I20250625 03:31:08.990274 1739 raft_consensus.cc:2466] T 58c56cde04014b85b662a9b4cbaa726f P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df8b9755d156478aafca552f9e9c539e in term 2.
I20250625 03:31:08.991139 1587 consensus_queue.cc:237] T df29d87d804d44438345052a5902052f P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:31:08.994566 2997 raft_consensus.cc:2802] T 58c56cde04014b85b662a9b4cbaa726f P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:31:08.995093 2997 raft_consensus.cc:695] T 58c56cde04014b85b662a9b4cbaa726f P df8b9755d156478aafca552f9e9c539e [term 2 LEADER]: Becoming Leader. State: Replica: df8b9755d156478aafca552f9e9c539e, State: Running, Role: LEADER
I20250625 03:31:08.995913 2997 consensus_queue.cc:237] T 58c56cde04014b85b662a9b4cbaa726f P df8b9755d156478aafca552f9e9c539e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:08.993085 1582 tablet_service.cc:1515] Processing DeleteTablet for tablet b31026f89f1e49949acec419db9649d3 with delete_type TABLET_DATA_TOMBSTONED (TS 7e9c4f2e01164f33b2e9034ed148398e not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:52712
I20250625 03:31:09.014182 1490 catalog_manager.cc:5582] T 7553473daeb342ceaf782ddee8e4fc4d P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: term changed from 2 to 3, leader changed from 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) to 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130). New cstate: current_term: 3 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } }
W20250625 03:31:09.022851 1559 consensus_peers.cc:487] T df29d87d804d44438345052a5902052f P 7e9c4f2e01164f33b2e9034ed148398e -> Peer df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493): Couldn't send request to peer df8b9755d156478aafca552f9e9c539e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: df29d87d804d44438345052a5902052f. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:09.023186 1491 catalog_manager.cc:5582] T 58c56cde04014b85b662a9b4cbaa726f P df8b9755d156478aafca552f9e9c539e reported cstate change: term changed from 1 to 2, leader changed from 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) to df8b9755d156478aafca552f9e9c539e (127.0.106.132). New cstate: current_term: 2 leader_uuid: "df8b9755d156478aafca552f9e9c539e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250625 03:31:09.025563 1739 raft_consensus.cc:1273] T df29d87d804d44438345052a5902052f P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 03:31:09.026955 2808 consensus_queue.cc:1035] T df29d87d804d44438345052a5902052f P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:09.031220 1669 raft_consensus.cc:1273] T df29d87d804d44438345052a5902052f P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 03:31:09.033291 2808 consensus_queue.cc:1035] T df29d87d804d44438345052a5902052f P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:09.051044 3035 tablet_replica.cc:331] T b31026f89f1e49949acec419db9649d3 P 7e9c4f2e01164f33b2e9034ed148398e: stopping tablet replica
I20250625 03:31:09.050168 2808 raft_consensus.cc:2953] T df29d87d804d44438345052a5902052f P 7e9c4f2e01164f33b2e9034ed148398e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:09.052165 1669 raft_consensus.cc:2953] T df29d87d804d44438345052a5902052f P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:09.053874 3035 raft_consensus.cc:2241] T b31026f89f1e49949acec419db9649d3 P 7e9c4f2e01164f33b2e9034ed148398e [term 3 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:09.054895 3035 raft_consensus.cc:2270] T b31026f89f1e49949acec419db9649d3 P 7e9c4f2e01164f33b2e9034ed148398e [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:09.059424 1739 raft_consensus.cc:2953] T df29d87d804d44438345052a5902052f P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:09.060791 3035 ts_tablet_manager.cc:1905] T b31026f89f1e49949acec419db9649d3 P 7e9c4f2e01164f33b2e9034ed148398e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250625 03:31:09.076148 1490 catalog_manager.cc:5582] T df29d87d804d44438345052a5902052f P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New cstate: current_term: 1 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:09.082124 1587 consensus_queue.cc:237] T 3037be35f2054cbbabd8a47062f84244 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:31:09.088886 3039 ts_tablet_manager.cc:927] T 542f85d76df8432593ee963669155a9d P df8b9755d156478aafca552f9e9c539e: Initiating tablet copy from peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
W20250625 03:31:09.093858 1559 consensus_peers.cc:487] T 3037be35f2054cbbabd8a47062f84244 P 7e9c4f2e01164f33b2e9034ed148398e -> Peer df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493): Couldn't send request to peer df8b9755d156478aafca552f9e9c539e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3037be35f2054cbbabd8a47062f84244. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:09.097687 3035 ts_tablet_manager.cc:1918] T b31026f89f1e49949acec419db9649d3 P 7e9c4f2e01164f33b2e9034ed148398e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20250625 03:31:09.098282 3035 log.cc:1199] T b31026f89f1e49949acec419db9649d3 P 7e9c4f2e01164f33b2e9034ed148398e: Deleting WAL directory at /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/ts-0-root/wals/b31026f89f1e49949acec419db9649d3
I20250625 03:31:09.098842 1739 raft_consensus.cc:1273] T 3037be35f2054cbbabd8a47062f84244 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20250625 03:31:09.100602 2808 consensus_queue.cc:1035] T 3037be35f2054cbbabd8a47062f84244 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:31:09.102136 1669 raft_consensus.cc:1273] T 3037be35f2054cbbabd8a47062f84244 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20250625 03:31:09.100684 3039 tablet_copy_client.cc:323] T 542f85d76df8432593ee963669155a9d P df8b9755d156478aafca552f9e9c539e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.106.130:34293
I20250625 03:31:09.105250 1680 tablet_copy_service.cc:140] P 3f2aa40978064c9e9983cf3745eed206: Received BeginTabletCopySession request for tablet 542f85d76df8432593ee963669155a9d from peer df8b9755d156478aafca552f9e9c539e ({username='slave'} at 127.0.0.1:55766)
I20250625 03:31:09.105793 1680 tablet_copy_service.cc:161] P 3f2aa40978064c9e9983cf3745eed206: Beginning new tablet copy session on tablet 542f85d76df8432593ee963669155a9d from peer df8b9755d156478aafca552f9e9c539e at {username='slave'} at 127.0.0.1:55766: session id = df8b9755d156478aafca552f9e9c539e-542f85d76df8432593ee963669155a9d
I20250625 03:31:09.105955 2808 consensus_queue.cc:1035] T 3037be35f2054cbbabd8a47062f84244 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:31:09.108929 1479 catalog_manager.cc:4928] TS 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): tablet b31026f89f1e49949acec419db9649d3 (table test-workload [id=7f663eabec024fd1911b406c660fa838]) successfully deleted
I20250625 03:31:09.117410 1680 tablet_copy_source_session.cc:215] T 542f85d76df8432593ee963669155a9d P 3f2aa40978064c9e9983cf3745eed206: Tablet Copy: opened 0 blocks and 1 log segments
I20250625 03:31:09.121369 3039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 542f85d76df8432593ee963669155a9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:09.121194 2931 raft_consensus.cc:2953] T 3037be35f2054cbbabd8a47062f84244 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:09.124079 1739 raft_consensus.cc:2953] T 3037be35f2054cbbabd8a47062f84244 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:09.135818 1669 raft_consensus.cc:2953] T 3037be35f2054cbbabd8a47062f84244 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:09.138103 3039 tablet_copy_client.cc:806] T 542f85d76df8432593ee963669155a9d P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 0 data blocks...
I20250625 03:31:09.138757 3039 tablet_copy_client.cc:670] T 542f85d76df8432593ee963669155a9d P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 1 WAL segments...
I20250625 03:31:09.149262 2345 raft_consensus.cc:1273] T 6d7a37b3448d468baa1b9422a6167c9a P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250625 03:31:09.152066 2782 consensus_queue.cc:1035] T 6d7a37b3448d468baa1b9422a6167c9a P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250625 03:31:09.153787 1491 catalog_manager.cc:5582] T 3037be35f2054cbbabd8a47062f84244 P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: config changed from index -1 to 3, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New cstate: current_term: 2 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:09.157555 3039 tablet_copy_client.cc:538] T 542f85d76df8432593ee963669155a9d P df8b9755d156478aafca552f9e9c539e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250625 03:31:09.169987 1587 raft_consensus.cc:1273] T 6d7a37b3448d468baa1b9422a6167c9a P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250625 03:31:09.172547 2782 consensus_queue.cc:1035] T 6d7a37b3448d468baa1b9422a6167c9a P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250625 03:31:09.218962 3039 tablet_bootstrap.cc:492] T 542f85d76df8432593ee963669155a9d P df8b9755d156478aafca552f9e9c539e: Bootstrap starting.
I20250625 03:31:09.266902 3039 tablet_bootstrap.cc:492] T 542f85d76df8432593ee963669155a9d P df8b9755d156478aafca552f9e9c539e: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:31:09.268136 3039 tablet_bootstrap.cc:492] T 542f85d76df8432593ee963669155a9d P df8b9755d156478aafca552f9e9c539e: Bootstrap complete.
I20250625 03:31:09.268901 3039 ts_tablet_manager.cc:1397] T 542f85d76df8432593ee963669155a9d P df8b9755d156478aafca552f9e9c539e: Time spent bootstrapping tablet: real 0.050s user 0.021s sys 0.011s
I20250625 03:31:09.272282 3039 raft_consensus.cc:357] T 542f85d76df8432593ee963669155a9d P df8b9755d156478aafca552f9e9c539e [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:31:09.273844 3039 raft_consensus.cc:738] T 542f85d76df8432593ee963669155a9d P df8b9755d156478aafca552f9e9c539e [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: df8b9755d156478aafca552f9e9c539e, State: Initialized, Role: LEARNER
I20250625 03:31:09.274556 3039 consensus_queue.cc:260] T 542f85d76df8432593ee963669155a9d P df8b9755d156478aafca552f9e9c539e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:31:09.272614 1737 raft_consensus.cc:1273] T 7553473daeb342ceaf782ddee8e4fc4d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250625 03:31:09.278985 2835 consensus_queue.cc:1035] T 7553473daeb342ceaf782ddee8e4fc4d P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:31:09.281083 3039 ts_tablet_manager.cc:1428] T 542f85d76df8432593ee963669155a9d P df8b9755d156478aafca552f9e9c539e: Time spent starting tablet: real 0.012s user 0.006s sys 0.000s
I20250625 03:31:09.282948 1680 tablet_copy_service.cc:342] P 3f2aa40978064c9e9983cf3745eed206: Request end of tablet copy session df8b9755d156478aafca552f9e9c539e-542f85d76df8432593ee963669155a9d received from {username='slave'} at 127.0.0.1:55766
I20250625 03:31:09.283398 1680 tablet_copy_service.cc:434] P 3f2aa40978064c9e9983cf3745eed206: ending tablet copy session df8b9755d156478aafca552f9e9c539e-542f85d76df8432593ee963669155a9d on tablet 542f85d76df8432593ee963669155a9d with peer df8b9755d156478aafca552f9e9c539e
I20250625 03:31:09.301263 1671 raft_consensus.cc:1273] T c977876716a0400a9482dd8e0ad33b86 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250625 03:31:09.302007 1589 raft_consensus.cc:1273] T 7553473daeb342ceaf782ddee8e4fc4d P 7e9c4f2e01164f33b2e9034ed148398e [term 3 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250625 03:31:09.303606 3029 consensus_queue.cc:1035] T 7553473daeb342ceaf782ddee8e4fc4d P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:31:09.303978 3027 consensus_queue.cc:1035] T c977876716a0400a9482dd8e0ad33b86 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:31:09.340555 1587 raft_consensus.cc:1273] T c977876716a0400a9482dd8e0ad33b86 P 7e9c4f2e01164f33b2e9034ed148398e [term 3 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250625 03:31:09.345077 2915 consensus_queue.cc:1035] T c977876716a0400a9482dd8e0ad33b86 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20250625 03:31:09.419736 3039 ts_tablet_manager.cc:927] T 9b7de80fbd7d4625aac41dea0457fd3e P df8b9755d156478aafca552f9e9c539e: Initiating tablet copy from peer ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:31:09.422813 3039 tablet_copy_client.cc:323] T 9b7de80fbd7d4625aac41dea0457fd3e P df8b9755d156478aafca552f9e9c539e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.106.131:39359
I20250625 03:31:09.424674 1755 tablet_copy_service.cc:140] P ba464e89e0f044a0a0ea3e6125cbf2a1: Received BeginTabletCopySession request for tablet 9b7de80fbd7d4625aac41dea0457fd3e from peer df8b9755d156478aafca552f9e9c539e ({username='slave'} at 127.0.0.1:39774)
I20250625 03:31:09.425254 1755 tablet_copy_service.cc:161] P ba464e89e0f044a0a0ea3e6125cbf2a1: Beginning new tablet copy session on tablet 9b7de80fbd7d4625aac41dea0457fd3e from peer df8b9755d156478aafca552f9e9c539e at {username='slave'} at 127.0.0.1:39774: session id = df8b9755d156478aafca552f9e9c539e-9b7de80fbd7d4625aac41dea0457fd3e
I20250625 03:31:09.433457 1755 tablet_copy_source_session.cc:215] T 9b7de80fbd7d4625aac41dea0457fd3e P ba464e89e0f044a0a0ea3e6125cbf2a1: Tablet Copy: opened 0 blocks and 1 log segments
I20250625 03:31:09.437060 3057 ts_tablet_manager.cc:927] T df29d87d804d44438345052a5902052f P df8b9755d156478aafca552f9e9c539e: Initiating tablet copy from peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903)
I20250625 03:31:09.438122 3039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b7de80fbd7d4625aac41dea0457fd3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:09.438951 3057 tablet_copy_client.cc:323] T df29d87d804d44438345052a5902052f P df8b9755d156478aafca552f9e9c539e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.106.129:39903
I20250625 03:31:09.441385 1606 tablet_copy_service.cc:140] P 7e9c4f2e01164f33b2e9034ed148398e: Received BeginTabletCopySession request for tablet df29d87d804d44438345052a5902052f from peer df8b9755d156478aafca552f9e9c539e ({username='slave'} at 127.0.0.1:44210)
I20250625 03:31:09.441953 1606 tablet_copy_service.cc:161] P 7e9c4f2e01164f33b2e9034ed148398e: Beginning new tablet copy session on tablet df29d87d804d44438345052a5902052f from peer df8b9755d156478aafca552f9e9c539e at {username='slave'} at 127.0.0.1:44210: session id = df8b9755d156478aafca552f9e9c539e-df29d87d804d44438345052a5902052f
I20250625 03:31:09.452071 1606 tablet_copy_source_session.cc:215] T df29d87d804d44438345052a5902052f P 7e9c4f2e01164f33b2e9034ed148398e: Tablet Copy: opened 0 blocks and 1 log segments
I20250625 03:31:09.454399 3039 tablet_copy_client.cc:806] T 9b7de80fbd7d4625aac41dea0457fd3e P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 0 data blocks...
I20250625 03:31:09.455138 3039 tablet_copy_client.cc:670] T 9b7de80fbd7d4625aac41dea0457fd3e P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 1 WAL segments...
I20250625 03:31:09.457799 3057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df29d87d804d44438345052a5902052f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:09.459133 3039 tablet_copy_client.cc:538] T 9b7de80fbd7d4625aac41dea0457fd3e P df8b9755d156478aafca552f9e9c539e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250625 03:31:09.469923 3039 tablet_bootstrap.cc:492] T 9b7de80fbd7d4625aac41dea0457fd3e P df8b9755d156478aafca552f9e9c539e: Bootstrap starting.
I20250625 03:31:09.476924 3057 tablet_copy_client.cc:806] T df29d87d804d44438345052a5902052f P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 0 data blocks...
I20250625 03:31:09.477563 3057 tablet_copy_client.cc:670] T df29d87d804d44438345052a5902052f P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 1 WAL segments...
I20250625 03:31:09.481454 3057 tablet_copy_client.cc:538] T df29d87d804d44438345052a5902052f P df8b9755d156478aafca552f9e9c539e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250625 03:31:09.492110 3057 tablet_bootstrap.cc:492] T df29d87d804d44438345052a5902052f P df8b9755d156478aafca552f9e9c539e: Bootstrap starting.
I20250625 03:31:09.513846 3039 tablet_bootstrap.cc:492] T 9b7de80fbd7d4625aac41dea0457fd3e P df8b9755d156478aafca552f9e9c539e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:31:09.514837 3039 tablet_bootstrap.cc:492] T 9b7de80fbd7d4625aac41dea0457fd3e P df8b9755d156478aafca552f9e9c539e: Bootstrap complete.
I20250625 03:31:09.515512 3039 ts_tablet_manager.cc:1397] T 9b7de80fbd7d4625aac41dea0457fd3e P df8b9755d156478aafca552f9e9c539e: Time spent bootstrapping tablet: real 0.046s user 0.015s sys 0.008s
I20250625 03:31:09.517748 3039 raft_consensus.cc:357] T 9b7de80fbd7d4625aac41dea0457fd3e P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:31:09.518378 3039 raft_consensus.cc:738] T 9b7de80fbd7d4625aac41dea0457fd3e P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: df8b9755d156478aafca552f9e9c539e, State: Initialized, Role: LEARNER
I20250625 03:31:09.519752 3039 consensus_queue.cc:260] T 9b7de80fbd7d4625aac41dea0457fd3e P df8b9755d156478aafca552f9e9c539e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:31:09.522711 3039 ts_tablet_manager.cc:1428] T 9b7de80fbd7d4625aac41dea0457fd3e P df8b9755d156478aafca552f9e9c539e: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20250625 03:31:09.525570 1755 tablet_copy_service.cc:342] P ba464e89e0f044a0a0ea3e6125cbf2a1: Request end of tablet copy session df8b9755d156478aafca552f9e9c539e-9b7de80fbd7d4625aac41dea0457fd3e received from {username='slave'} at 127.0.0.1:39774
I20250625 03:31:09.526206 1755 tablet_copy_service.cc:434] P ba464e89e0f044a0a0ea3e6125cbf2a1: ending tablet copy session df8b9755d156478aafca552f9e9c539e-9b7de80fbd7d4625aac41dea0457fd3e on tablet 9b7de80fbd7d4625aac41dea0457fd3e with peer df8b9755d156478aafca552f9e9c539e
I20250625 03:31:09.530673 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:31:09.554814 3057 tablet_bootstrap.cc:492] T df29d87d804d44438345052a5902052f P df8b9755d156478aafca552f9e9c539e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:31:09.555825 3057 tablet_bootstrap.cc:492] T df29d87d804d44438345052a5902052f P df8b9755d156478aafca552f9e9c539e: Bootstrap complete.
I20250625 03:31:09.556720 3057 ts_tablet_manager.cc:1397] T df29d87d804d44438345052a5902052f P df8b9755d156478aafca552f9e9c539e: Time spent bootstrapping tablet: real 0.065s user 0.025s sys 0.027s
I20250625 03:31:09.559271 3057 raft_consensus.cc:357] T df29d87d804d44438345052a5902052f P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:31:09.560173 3057 raft_consensus.cc:738] T df29d87d804d44438345052a5902052f P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: df8b9755d156478aafca552f9e9c539e, State: Initialized, Role: LEARNER
I20250625 03:31:09.560786 3057 consensus_queue.cc:260] T df29d87d804d44438345052a5902052f P df8b9755d156478aafca552f9e9c539e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:31:09.563853 3057 ts_tablet_manager.cc:1428] T df29d87d804d44438345052a5902052f P df8b9755d156478aafca552f9e9c539e: Time spent starting tablet: real 0.007s user 0.004s sys 0.002s
I20250625 03:31:09.568616 2345 raft_consensus.cc:1215] T 542f85d76df8432593ee963669155a9d P df8b9755d156478aafca552f9e9c539e [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3] Dedup: 2.3->[]
I20250625 03:31:09.573137 1606 tablet_copy_service.cc:342] P 7e9c4f2e01164f33b2e9034ed148398e: Request end of tablet copy session df8b9755d156478aafca552f9e9c539e-df29d87d804d44438345052a5902052f received from {username='slave'} at 127.0.0.1:44210
I20250625 03:31:09.573625 1606 tablet_copy_service.cc:434] P 7e9c4f2e01164f33b2e9034ed148398e: ending tablet copy session df8b9755d156478aafca552f9e9c539e-df29d87d804d44438345052a5902052f on tablet df29d87d804d44438345052a5902052f with peer df8b9755d156478aafca552f9e9c539e
I20250625 03:31:09.581868 1671 raft_consensus.cc:1273] T 58c56cde04014b85b662a9b4cbaa726f P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Refusing update from remote peer df8b9755d156478aafca552f9e9c539e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250625 03:31:09.584515 3013 consensus_queue.cc:1035] T 58c56cde04014b85b662a9b4cbaa726f P df8b9755d156478aafca552f9e9c539e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20250625 03:31:09.602532 1737 raft_consensus.cc:1273] T 58c56cde04014b85b662a9b4cbaa726f P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Refusing update from remote peer df8b9755d156478aafca552f9e9c539e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250625 03:31:09.604038 3013 consensus_queue.cc:1035] T 58c56cde04014b85b662a9b4cbaa726f P df8b9755d156478aafca552f9e9c539e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250625 03:31:09.641578 1669 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "59ac1803c12d43448ef566f886cc22e6"
dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
mode: GRACEFUL
new_leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
from {username='slave'} at 127.0.0.1:35370
I20250625 03:31:09.642201 1669 raft_consensus.cc:604] T 59ac1803c12d43448ef566f886cc22e6 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Received request to transfer leadership to TS 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:31:09.651508 1737 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "a1d83fca2b484feeaff6f350fe749b24"
dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
mode: GRACEFUL
new_leader_uuid: "3f2aa40978064c9e9983cf3745eed206"
from {username='slave'} at 127.0.0.1:47496
I20250625 03:31:09.652112 1737 raft_consensus.cc:604] T a1d83fca2b484feeaff6f350fe749b24 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Received request to transfer leadership to TS 3f2aa40978064c9e9983cf3745eed206
I20250625 03:31:09.653827 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20250625 03:31:09.655344 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:31:09.658036 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:31:09.711879 3057 ts_tablet_manager.cc:927] T 3037be35f2054cbbabd8a47062f84244 P df8b9755d156478aafca552f9e9c539e: Initiating tablet copy from peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903)
I20250625 03:31:09.713506 3057 tablet_copy_client.cc:323] T 3037be35f2054cbbabd8a47062f84244 P df8b9755d156478aafca552f9e9c539e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.106.129:39903
I20250625 03:31:09.714784 1606 tablet_copy_service.cc:140] P 7e9c4f2e01164f33b2e9034ed148398e: Received BeginTabletCopySession request for tablet 3037be35f2054cbbabd8a47062f84244 from peer df8b9755d156478aafca552f9e9c539e ({username='slave'} at 127.0.0.1:44210)
I20250625 03:31:09.715304 1606 tablet_copy_service.cc:161] P 7e9c4f2e01164f33b2e9034ed148398e: Beginning new tablet copy session on tablet 3037be35f2054cbbabd8a47062f84244 from peer df8b9755d156478aafca552f9e9c539e at {username='slave'} at 127.0.0.1:44210: session id = df8b9755d156478aafca552f9e9c539e-3037be35f2054cbbabd8a47062f84244
I20250625 03:31:09.723274 1606 tablet_copy_source_session.cc:215] T 3037be35f2054cbbabd8a47062f84244 P 7e9c4f2e01164f33b2e9034ed148398e: Tablet Copy: opened 0 blocks and 1 log segments
I20250625 03:31:09.726051 3057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3037be35f2054cbbabd8a47062f84244. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:09.741293 3057 tablet_copy_client.cc:806] T 3037be35f2054cbbabd8a47062f84244 P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 0 data blocks...
I20250625 03:31:09.741953 3057 tablet_copy_client.cc:670] T 3037be35f2054cbbabd8a47062f84244 P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 1 WAL segments...
I20250625 03:31:09.747428 3057 tablet_copy_client.cc:538] T 3037be35f2054cbbabd8a47062f84244 P df8b9755d156478aafca552f9e9c539e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250625 03:31:09.756598 3057 tablet_bootstrap.cc:492] T 3037be35f2054cbbabd8a47062f84244 P df8b9755d156478aafca552f9e9c539e: Bootstrap starting.
I20250625 03:31:09.786062 2915 raft_consensus.cc:991] T a1d83fca2b484feeaff6f350fe749b24 P ba464e89e0f044a0a0ea3e6125cbf2a1: : Instructing follower 3f2aa40978064c9e9983cf3745eed206 to start an election
I20250625 03:31:09.786518 3033 raft_consensus.cc:1079] T a1d83fca2b484feeaff6f350fe749b24 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Signalling peer 3f2aa40978064c9e9983cf3745eed206 to start an election
I20250625 03:31:09.787815 1670 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "a1d83fca2b484feeaff6f350fe749b24"
dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
from {username='slave'} at 127.0.0.1:53770
I20250625 03:31:09.788301 1670 raft_consensus.cc:491] T a1d83fca2b484feeaff6f350fe749b24 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:31:09.788569 1670 raft_consensus.cc:3058] T a1d83fca2b484feeaff6f350fe749b24 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:09.789878 3057 tablet_bootstrap.cc:492] T 3037be35f2054cbbabd8a47062f84244 P df8b9755d156478aafca552f9e9c539e: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:31:09.790841 3057 tablet_bootstrap.cc:492] T 3037be35f2054cbbabd8a47062f84244 P df8b9755d156478aafca552f9e9c539e: Bootstrap complete.
I20250625 03:31:09.791505 3057 ts_tablet_manager.cc:1397] T 3037be35f2054cbbabd8a47062f84244 P df8b9755d156478aafca552f9e9c539e: Time spent bootstrapping tablet: real 0.035s user 0.018s sys 0.011s
I20250625 03:31:09.794114 1670 raft_consensus.cc:513] T a1d83fca2b484feeaff6f350fe749b24 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:09.794169 3057 raft_consensus.cc:357] T 3037be35f2054cbbabd8a47062f84244 P df8b9755d156478aafca552f9e9c539e [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:31:09.795960 3057 raft_consensus.cc:738] T 3037be35f2054cbbabd8a47062f84244 P df8b9755d156478aafca552f9e9c539e [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: df8b9755d156478aafca552f9e9c539e, State: Initialized, Role: LEARNER
I20250625 03:31:09.796557 3057 consensus_queue.cc:260] T 3037be35f2054cbbabd8a47062f84244 P df8b9755d156478aafca552f9e9c539e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:31:09.797987 1589 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a1d83fca2b484feeaff6f350fe749b24" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
I20250625 03:31:09.798695 1589 raft_consensus.cc:3058] T a1d83fca2b484feeaff6f350fe749b24 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:09.800490 1670 leader_election.cc:290] T a1d83fca2b484feeaff6f350fe749b24 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 2 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:31:09.798816 3057 ts_tablet_manager.cc:1428] T 3037be35f2054cbbabd8a47062f84244 P df8b9755d156478aafca552f9e9c539e: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20250625 03:31:09.802794 1606 tablet_copy_service.cc:342] P 7e9c4f2e01164f33b2e9034ed148398e: Request end of tablet copy session df8b9755d156478aafca552f9e9c539e-3037be35f2054cbbabd8a47062f84244 received from {username='slave'} at 127.0.0.1:44210
I20250625 03:31:09.803242 1606 tablet_copy_service.cc:434] P 7e9c4f2e01164f33b2e9034ed148398e: ending tablet copy session df8b9755d156478aafca552f9e9c539e-3037be35f2054cbbabd8a47062f84244 on tablet 3037be35f2054cbbabd8a47062f84244 with peer df8b9755d156478aafca552f9e9c539e
I20250625 03:31:09.808454 1737 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a1d83fca2b484feeaff6f350fe749b24" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:31:09.809070 1737 raft_consensus.cc:3053] T a1d83fca2b484feeaff6f350fe749b24 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:31:09.809314 1737 raft_consensus.cc:738] T a1d83fca2b484feeaff6f350fe749b24 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Running, Role: LEADER
I20250625 03:31:09.813174 1737 consensus_queue.cc:260] T a1d83fca2b484feeaff6f350fe749b24 P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:09.814293 1737 raft_consensus.cc:3058] T a1d83fca2b484feeaff6f350fe749b24 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:09.822871 1589 raft_consensus.cc:2466] T a1d83fca2b484feeaff6f350fe749b24 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 2.
I20250625 03:31:09.823768 1737 raft_consensus.cc:2466] T a1d83fca2b484feeaff6f350fe749b24 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 2.
I20250625 03:31:09.824537 1635 leader_election.cc:304] T a1d83fca2b484feeaff6f350fe749b24 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e; no voters:
I20250625 03:31:09.825693 3010 raft_consensus.cc:2802] T a1d83fca2b484feeaff6f350fe749b24 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:31:09.826226 3010 raft_consensus.cc:695] T a1d83fca2b484feeaff6f350fe749b24 P 3f2aa40978064c9e9983cf3745eed206 [term 2 LEADER]: Becoming Leader. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Running, Role: LEADER
I20250625 03:31:09.827091 3010 consensus_queue.cc:237] T a1d83fca2b484feeaff6f350fe749b24 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:09.837670 1493 catalog_manager.cc:5582] T a1d83fca2b484feeaff6f350fe749b24 P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: term changed from 1 to 2, leader changed from ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) to 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130). New cstate: current_term: 2 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:09.850590 3029 raft_consensus.cc:991] T 59ac1803c12d43448ef566f886cc22e6 P 3f2aa40978064c9e9983cf3745eed206: : Instructing follower 7e9c4f2e01164f33b2e9034ed148398e to start an election
I20250625 03:31:09.851090 3029 raft_consensus.cc:1079] T 59ac1803c12d43448ef566f886cc22e6 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Signalling peer 7e9c4f2e01164f33b2e9034ed148398e to start an election
I20250625 03:31:09.852523 1589 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "59ac1803c12d43448ef566f886cc22e6"
dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
from {username='slave'} at 127.0.0.1:52738
I20250625 03:31:09.853003 1589 raft_consensus.cc:491] T 59ac1803c12d43448ef566f886cc22e6 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:31:09.853435 1589 raft_consensus.cc:3058] T 59ac1803c12d43448ef566f886cc22e6 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:09.871299 1589 raft_consensus.cc:513] T 59ac1803c12d43448ef566f886cc22e6 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:09.873056 1589 leader_election.cc:290] T 59ac1803c12d43448ef566f886cc22e6 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 2 election: Requested vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:31:09.874269 1739 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "59ac1803c12d43448ef566f886cc22e6" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:31:09.874549 1670 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "59ac1803c12d43448ef566f886cc22e6" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:31:09.874910 1739 raft_consensus.cc:3058] T 59ac1803c12d43448ef566f886cc22e6 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:09.875104 1670 raft_consensus.cc:3053] T 59ac1803c12d43448ef566f886cc22e6 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:31:09.875406 1670 raft_consensus.cc:738] T 59ac1803c12d43448ef566f886cc22e6 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Running, Role: LEADER
I20250625 03:31:09.876135 1670 consensus_queue.cc:260] T 59ac1803c12d43448ef566f886cc22e6 P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:09.877342 1670 raft_consensus.cc:3058] T 59ac1803c12d43448ef566f886cc22e6 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:09.882311 2341 raft_consensus.cc:1215] T df29d87d804d44438345052a5902052f P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20250625 03:31:09.883792 1670 raft_consensus.cc:2466] T 59ac1803c12d43448ef566f886cc22e6 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 2.
I20250625 03:31:09.885399 1559 leader_election.cc:304] T 59ac1803c12d43448ef566f886cc22e6 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e; no voters:
I20250625 03:31:09.886490 3044 raft_consensus.cc:2802] T 59ac1803c12d43448ef566f886cc22e6 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:31:09.886969 3044 raft_consensus.cc:695] T 59ac1803c12d43448ef566f886cc22e6 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 LEADER]: Becoming Leader. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Running, Role: LEADER
I20250625 03:31:09.887794 3044 consensus_queue.cc:237] T 59ac1803c12d43448ef566f886cc22e6 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:09.894153 2341 raft_consensus.cc:1215] T 9b7de80fbd7d4625aac41dea0457fd3e P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20250625 03:31:09.898610 1739 raft_consensus.cc:2466] T 59ac1803c12d43448ef566f886cc22e6 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 2.
I20250625 03:31:09.912808 1491 catalog_manager.cc:5582] T 59ac1803c12d43448ef566f886cc22e6 P 7e9c4f2e01164f33b2e9034ed148398e reported cstate change: term changed from 1 to 2, leader changed from 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) to 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129). New cstate: current_term: 2 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:10.140980 2341 raft_consensus.cc:1215] T 3037be35f2054cbbabd8a47062f84244 P df8b9755d156478aafca552f9e9c539e [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3] Dedup: 2.3->[]
I20250625 03:31:10.169804 3010 raft_consensus.cc:1062] T 542f85d76df8432593ee963669155a9d P 3f2aa40978064c9e9983cf3745eed206: attempting to promote NON_VOTER df8b9755d156478aafca552f9e9c539e to VOTER
I20250625 03:31:10.172441 3010 consensus_queue.cc:237] T 542f85d76df8432593ee963669155a9d P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:10.178783 2341 raft_consensus.cc:1273] T 542f85d76df8432593ee963669155a9d P df8b9755d156478aafca552f9e9c539e [term 2 LEARNER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20250625 03:31:10.180819 1737 raft_consensus.cc:1273] T 542f85d76df8432593ee963669155a9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20250625 03:31:10.180981 1589 raft_consensus.cc:1273] T 542f85d76df8432593ee963669155a9d P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20250625 03:31:10.182706 3029 consensus_queue.cc:1035] T 542f85d76df8432593ee963669155a9d P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:31:10.184281 3029 consensus_queue.cc:1035] T 542f85d76df8432593ee963669155a9d P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:31:10.194226 3029 consensus_queue.cc:1035] T 542f85d76df8432593ee963669155a9d P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20250625 03:31:10.206698 3073 raft_consensus.cc:2953] T 542f85d76df8432593ee963669155a9d P 3f2aa40978064c9e9983cf3745eed206 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:10.210986 1737 raft_consensus.cc:2953] T 542f85d76df8432593ee963669155a9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:10.217427 2343 raft_consensus.cc:2953] T 542f85d76df8432593ee963669155a9d P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:10.221140 1590 raft_consensus.cc:2953] T 542f85d76df8432593ee963669155a9d P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:10.226208 1493 catalog_manager.cc:5582] T 542f85d76df8432593ee963669155a9d P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: config changed from index 3 to 4, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250625 03:31:10.237075 1737 raft_consensus.cc:1273] T a1d83fca2b484feeaff6f350fe749b24 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:10.238193 3077 consensus_queue.cc:1035] T a1d83fca2b484feeaff6f350fe749b24 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:10.265619 1670 consensus_queue.cc:237] T 542f85d76df8432593ee963669155a9d P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:10.272214 3033 raft_consensus.cc:1062] T 9b7de80fbd7d4625aac41dea0457fd3e P ba464e89e0f044a0a0ea3e6125cbf2a1: attempting to promote NON_VOTER df8b9755d156478aafca552f9e9c539e to VOTER
I20250625 03:31:10.286487 2341 raft_consensus.cc:1273] T 542f85d76df8432593ee963669155a9d P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250625 03:31:10.275718 3033 consensus_queue.cc:237] T 9b7de80fbd7d4625aac41dea0457fd3e P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:10.287462 1741 raft_consensus.cc:1273] T 542f85d76df8432593ee963669155a9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250625 03:31:10.289875 3029 consensus_queue.cc:1035] T 542f85d76df8432593ee963669155a9d P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250625 03:31:10.291828 3029 consensus_queue.cc:1035] T 542f85d76df8432593ee963669155a9d P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20250625 03:31:10.325876 1590 raft_consensus.cc:1273] T a1d83fca2b484feeaff6f350fe749b24 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:10.333004 1670 raft_consensus.cc:1273] T 9b7de80fbd7d4625aac41dea0457fd3e P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:31:10.330093 3077 consensus_queue.cc:1035] T a1d83fca2b484feeaff6f350fe749b24 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20250625 03:31:10.337410 1669 raft_consensus.cc:1273] T 59ac1803c12d43448ef566f886cc22e6 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:10.339255 3073 raft_consensus.cc:2953] T 542f85d76df8432593ee963669155a9d P 3f2aa40978064c9e9983cf3745eed206 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:10.342749 2915 consensus_queue.cc:1035] T 9b7de80fbd7d4625aac41dea0457fd3e P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:31:10.345136 2343 raft_consensus.cc:2953] T 542f85d76df8432593ee963669155a9d P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:10.340624 1589 raft_consensus.cc:1273] T 9b7de80fbd7d4625aac41dea0457fd3e P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:31:10.340642 2341 raft_consensus.cc:1273] T 9b7de80fbd7d4625aac41dea0457fd3e P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:31:10.354434 2915 consensus_queue.cc:1035] T 9b7de80fbd7d4625aac41dea0457fd3e P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:31:10.387470 3027 consensus_queue.cc:1035] T 9b7de80fbd7d4625aac41dea0457fd3e P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20250625 03:31:10.358112 2931 consensus_queue.cc:1035] T 59ac1803c12d43448ef566f886cc22e6 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20250625 03:31:10.413465 1737 raft_consensus.cc:1273] T 59ac1803c12d43448ef566f886cc22e6 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:10.412817 1739 raft_consensus.cc:2953] T 542f85d76df8432593ee963669155a9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:10.430696 3044 consensus_queue.cc:1035] T 59ac1803c12d43448ef566f886cc22e6 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20250625 03:31:10.447036 1478 catalog_manager.cc:5095] ChangeConfig:REMOVE_PEER RPC for tablet 542f85d76df8432593ee963669155a9d with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250625 03:31:10.457430 3082 raft_consensus.cc:2953] T 9b7de80fbd7d4625aac41dea0457fd3e P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:10.473392 2343 raft_consensus.cc:2953] T 9b7de80fbd7d4625aac41dea0457fd3e P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:10.478688 1493 catalog_manager.cc:5582] T 542f85d76df8432593ee963669155a9d P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: config changed from index 4 to 5, VOTER 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) evicted. New cstate: current_term: 2 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250625 03:31:10.479091 1671 raft_consensus.cc:2953] T 9b7de80fbd7d4625aac41dea0457fd3e P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:10.566308 3095 raft_consensus.cc:1062] T df29d87d804d44438345052a5902052f P 7e9c4f2e01164f33b2e9034ed148398e: attempting to promote NON_VOTER df8b9755d156478aafca552f9e9c539e to VOTER
I20250625 03:31:10.600881 1493 catalog_manager.cc:5582] T 9b7de80fbd7d4625aac41dea0457fd3e P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
W20250625 03:31:10.608134 1559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.130:34293, user_credentials={real_user=slave}} blocked reactor thread for 106401us
I20250625 03:31:10.606674 1582 tablet_service.cc:1515] Processing DeleteTablet for tablet 542f85d76df8432593ee963669155a9d with delete_type TABLET_DATA_TOMBSTONED (TS 7e9c4f2e01164f33b2e9034ed148398e not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:52712
W20250625 03:31:10.675294 3093 log.cc:927] Time spent T 59ac1803c12d43448ef566f886cc22e6 P ba464e89e0f044a0a0ea3e6125cbf2a1: Append to log took a long time: real 0.069s user 0.001s sys 0.000s
I20250625 03:31:10.607314 1589 raft_consensus.cc:2953] T 9b7de80fbd7d4625aac41dea0457fd3e P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:10.765340 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:31:10.771116 3105 tablet_replica.cc:331] T 542f85d76df8432593ee963669155a9d P 7e9c4f2e01164f33b2e9034ed148398e: stopping tablet replica
I20250625 03:31:10.779974 3095 consensus_queue.cc:237] T df29d87d804d44438345052a5902052f P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
W20250625 03:31:10.862679 1559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.132:34493, user_credentials={real_user=slave}} blocked reactor thread for 69708.4us
W20250625 03:31:10.866533 1709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:39903, user_credentials={real_user=slave}} blocked reactor thread for 51403.7us
I20250625 03:31:10.879581 1737 raft_consensus.cc:1273] T df29d87d804d44438345052a5902052f P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:31:10.883461 3095 consensus_queue.cc:1035] T df29d87d804d44438345052a5902052f P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20250625 03:31:10.890714 3100 raft_consensus.cc:1062] T 3037be35f2054cbbabd8a47062f84244 P 7e9c4f2e01164f33b2e9034ed148398e: attempting to promote NON_VOTER df8b9755d156478aafca552f9e9c539e to VOTER
W20250625 03:31:10.999574 1636 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.131:39359, user_credentials={real_user=slave}} blocked reactor thread for 99446.6us
I20250625 03:31:11.004774 3105 raft_consensus.cc:2241] T 542f85d76df8432593ee963669155a9d P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:11.017377 3105 raft_consensus.cc:2270] T 542f85d76df8432593ee963669155a9d P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:11.017549 3100 consensus_queue.cc:237] T 3037be35f2054cbbabd8a47062f84244 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:11.021831 3105 ts_tablet_manager.cc:1905] T 542f85d76df8432593ee963669155a9d P 7e9c4f2e01164f33b2e9034ed148398e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250625 03:31:10.927480 1741 consensus_queue.cc:237] T 9b7de80fbd7d4625aac41dea0457fd3e P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
W20250625 03:31:11.006168 1559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.132:34493, user_credentials={real_user=slave}} blocked reactor thread for 84605.4us
W20250625 03:31:11.007803 1709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:39903, user_credentials={real_user=slave}} blocked reactor thread for 106302us
W20250625 03:31:11.014348 1561 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.131:39359, user_credentials={real_user=slave}} blocked reactor thread for 110590us
I20250625 03:31:11.041888 2342 raft_consensus.cc:1273] T df29d87d804d44438345052a5902052f P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:31:11.051214 3095 consensus_queue.cc:1035] T df29d87d804d44438345052a5902052f P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:31:11.055370 1666 raft_consensus.cc:1273] T df29d87d804d44438345052a5902052f P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:31:11.061383 3044 consensus_queue.cc:1035] T df29d87d804d44438345052a5902052f P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:31:11.082726 1587 raft_consensus.cc:1273] T 9b7de80fbd7d4625aac41dea0457fd3e P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250625 03:31:11.084545 3027 consensus_queue.cc:1035] T 9b7de80fbd7d4625aac41dea0457fd3e P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:31:11.090977 2342 raft_consensus.cc:1273] T 9b7de80fbd7d4625aac41dea0457fd3e P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250625 03:31:11.093730 3105 ts_tablet_manager.cc:1918] T 542f85d76df8432593ee963669155a9d P 7e9c4f2e01164f33b2e9034ed148398e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20250625 03:31:11.093518 3027 raft_consensus.cc:2953] T 9b7de80fbd7d4625aac41dea0457fd3e P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:11.097023 1589 raft_consensus.cc:2953] T 9b7de80fbd7d4625aac41dea0457fd3e P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:11.094602 3105 log.cc:1199] T 542f85d76df8432593ee963669155a9d P 7e9c4f2e01164f33b2e9034ed148398e: Deleting WAL directory at /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/ts-0-root/wals/542f85d76df8432593ee963669155a9d
I20250625 03:31:11.111249 3083 raft_consensus.cc:2953] T df29d87d804d44438345052a5902052f P 7e9c4f2e01164f33b2e9034ed148398e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:11.117738 2342 raft_consensus.cc:2953] T df29d87d804d44438345052a5902052f P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:11.121869 1479 catalog_manager.cc:4928] TS 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): tablet 542f85d76df8432593ee963669155a9d (table test-workload [id=7f663eabec024fd1911b406c660fa838]) successfully deleted
I20250625 03:31:11.135597 1737 raft_consensus.cc:1273] T 3037be35f2054cbbabd8a47062f84244 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20250625 03:31:11.138626 1480 catalog_manager.cc:5095] ChangeConfig:REMOVE_PEER RPC for tablet 9b7de80fbd7d4625aac41dea0457fd3e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250625 03:31:11.139026 1491 catalog_manager.cc:5582] T df29d87d804d44438345052a5902052f P df8b9755d156478aafca552f9e9c539e reported cstate change: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:11.144505 3027 consensus_queue.cc:1035] T 9b7de80fbd7d4625aac41dea0457fd3e P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:31:11.146826 1490 catalog_manager.cc:5582] T 9b7de80fbd7d4625aac41dea0457fd3e P 7e9c4f2e01164f33b2e9034ed148398e reported cstate change: config changed from index 3 to 4, VOTER 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) evicted. New cstate: current_term: 1 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:11.148093 2342 raft_consensus.cc:1273] T 3037be35f2054cbbabd8a47062f84244 P df8b9755d156478aafca552f9e9c539e [term 2 LEARNER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20250625 03:31:11.150818 3044 consensus_queue.cc:1035] T 3037be35f2054cbbabd8a47062f84244 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:31:11.150856 2345 raft_consensus.cc:2953] T 9b7de80fbd7d4625aac41dea0457fd3e P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:11.157208 3044 consensus_queue.cc:1035] T 3037be35f2054cbbabd8a47062f84244 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20250625 03:31:11.166244 1658 tablet_service.cc:1515] Processing DeleteTablet for tablet 9b7de80fbd7d4625aac41dea0457fd3e with delete_type TABLET_DATA_TOMBSTONED (TS 3f2aa40978064c9e9983cf3745eed206 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53744
I20250625 03:31:11.178929 1737 raft_consensus.cc:2953] T df29d87d804d44438345052a5902052f P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:11.183876 1670 raft_consensus.cc:1273] T 3037be35f2054cbbabd8a47062f84244 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20250625 03:31:11.185477 1666 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "31885ef6a0c64613ae6723c07f9400b0"
dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
mode: GRACEFUL
new_leader_uuid: "df8b9755d156478aafca552f9e9c539e"
from {username='slave'} at 127.0.0.1:35370
I20250625 03:31:11.186183 1666 raft_consensus.cc:604] T 31885ef6a0c64613ae6723c07f9400b0 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Received request to transfer leadership to TS df8b9755d156478aafca552f9e9c539e
I20250625 03:31:11.187079 3044 consensus_queue.cc:1035] T 3037be35f2054cbbabd8a47062f84244 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:31:11.201591 3114 tablet_replica.cc:331] T 9b7de80fbd7d4625aac41dea0457fd3e P 3f2aa40978064c9e9983cf3745eed206: stopping tablet replica
I20250625 03:31:11.201480 1589 consensus_queue.cc:237] T df29d87d804d44438345052a5902052f P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:11.202850 3114 raft_consensus.cc:2241] T 9b7de80fbd7d4625aac41dea0457fd3e P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:11.204160 3114 raft_consensus.cc:2270] T 9b7de80fbd7d4625aac41dea0457fd3e P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:11.207811 3114 ts_tablet_manager.cc:1905] T 9b7de80fbd7d4625aac41dea0457fd3e P 3f2aa40978064c9e9983cf3745eed206: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250625 03:31:11.214499 2345 raft_consensus.cc:1273] T df29d87d804d44438345052a5902052f P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250625 03:31:11.217181 1666 raft_consensus.cc:2953] T df29d87d804d44438345052a5902052f P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:11.221726 3044 consensus_queue.cc:1035] T df29d87d804d44438345052a5902052f P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:31:11.225492 1589 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "615cebbffcfc44e19b8f7a1e842073a3"
dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
mode: GRACEFUL
new_leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
from {username='slave'} at 127.0.0.1:47018
I20250625 03:31:11.226104 1589 raft_consensus.cc:604] T 615cebbffcfc44e19b8f7a1e842073a3 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 LEADER]: Received request to transfer leadership to TS ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:31:11.231308 1671 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "e38dc50880914156805b07aa82e30863"
dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
mode: GRACEFUL
new_leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
from {username='slave'} at 127.0.0.1:35370
I20250625 03:31:11.231899 1671 raft_consensus.cc:604] T e38dc50880914156805b07aa82e30863 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Received request to transfer leadership to TS ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:31:11.233132 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 3
I20250625 03:31:11.234730 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:31:11.235507 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:31:11.240648 1741 raft_consensus.cc:1273] T df29d87d804d44438345052a5902052f P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250625 03:31:11.244690 3083 consensus_queue.cc:1035] T df29d87d804d44438345052a5902052f P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20250625 03:31:11.246956 3094 raft_consensus.cc:2953] T df29d87d804d44438345052a5902052f P 7e9c4f2e01164f33b2e9034ed148398e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:11.252887 3100 raft_consensus.cc:2953] T 3037be35f2054cbbabd8a47062f84244 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:11.254684 1741 raft_consensus.cc:2953] T 3037be35f2054cbbabd8a47062f84244 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:11.259796 1479 catalog_manager.cc:5095] ChangeConfig:REMOVE_PEER RPC for tablet df29d87d804d44438345052a5902052f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250625 03:31:11.261193 2345 raft_consensus.cc:2953] T df29d87d804d44438345052a5902052f P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:11.262976 3114 ts_tablet_manager.cc:1918] T 9b7de80fbd7d4625aac41dea0457fd3e P 3f2aa40978064c9e9983cf3745eed206: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20250625 03:31:11.265012 3114 log.cc:1199] T 9b7de80fbd7d4625aac41dea0457fd3e P 3f2aa40978064c9e9983cf3745eed206: Deleting WAL directory at /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/ts-1-root/wals/9b7de80fbd7d4625aac41dea0457fd3e
I20250625 03:31:11.266935 1478 catalog_manager.cc:4928] TS 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): tablet 9b7de80fbd7d4625aac41dea0457fd3e (table test-workload [id=7f663eabec024fd1911b406c660fa838]) successfully deleted
I20250625 03:31:11.273731 3044 raft_consensus.cc:991] T 615cebbffcfc44e19b8f7a1e842073a3 P 7e9c4f2e01164f33b2e9034ed148398e: : Instructing follower ba464e89e0f044a0a0ea3e6125cbf2a1 to start an election
I20250625 03:31:11.274385 3097 raft_consensus.cc:1079] T 615cebbffcfc44e19b8f7a1e842073a3 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 LEADER]: Signalling peer ba464e89e0f044a0a0ea3e6125cbf2a1 to start an election
I20250625 03:31:11.276950 1737 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "615cebbffcfc44e19b8f7a1e842073a3"
dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
from {username='slave'} at 127.0.0.1:43674
I20250625 03:31:11.277489 1737 raft_consensus.cc:491] T 615cebbffcfc44e19b8f7a1e842073a3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:31:11.277855 1737 raft_consensus.cc:3058] T 615cebbffcfc44e19b8f7a1e842073a3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:11.278640 1490 catalog_manager.cc:5582] T df29d87d804d44438345052a5902052f P df8b9755d156478aafca552f9e9c539e reported cstate change: config changed from index 3 to 4, VOTER 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) evicted. New cstate: current_term: 1 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:11.281795 1739 raft_consensus.cc:2953] T df29d87d804d44438345052a5902052f P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:11.286718 1737 raft_consensus.cc:513] T 615cebbffcfc44e19b8f7a1e842073a3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:11.291383 1590 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "615cebbffcfc44e19b8f7a1e842073a3" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
I20250625 03:31:11.291481 1737 leader_election.cc:290] T 615cebbffcfc44e19b8f7a1e842073a3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 2 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493)
I20250625 03:31:11.292070 1590 raft_consensus.cc:3053] T 615cebbffcfc44e19b8f7a1e842073a3 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:31:11.292421 1590 raft_consensus.cc:738] T 615cebbffcfc44e19b8f7a1e842073a3 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Running, Role: LEADER
I20250625 03:31:11.293136 1590 consensus_queue.cc:260] T 615cebbffcfc44e19b8f7a1e842073a3 P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:11.294417 1590 raft_consensus.cc:3058] T 615cebbffcfc44e19b8f7a1e842073a3 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:11.294411 2343 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "615cebbffcfc44e19b8f7a1e842073a3" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "df8b9755d156478aafca552f9e9c539e"
I20250625 03:31:11.295159 2343 raft_consensus.cc:3058] T 615cebbffcfc44e19b8f7a1e842073a3 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:11.300841 1666 raft_consensus.cc:2953] T 3037be35f2054cbbabd8a47062f84244 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:11.302735 1590 raft_consensus.cc:2466] T 615cebbffcfc44e19b8f7a1e842073a3 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 2.
I20250625 03:31:11.302765 2343 raft_consensus.cc:2466] T 615cebbffcfc44e19b8f7a1e842073a3 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 2.
I20250625 03:31:11.312269 1709 leader_election.cc:304] T 615cebbffcfc44e19b8f7a1e842073a3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters:
I20250625 03:31:11.313244 3106 raft_consensus.cc:2802] T 615cebbffcfc44e19b8f7a1e842073a3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:31:11.313757 3106 raft_consensus.cc:695] T 615cebbffcfc44e19b8f7a1e842073a3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 LEADER]: Becoming Leader. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Running, Role: LEADER
I20250625 03:31:11.314641 3106 consensus_queue.cc:237] T 615cebbffcfc44e19b8f7a1e842073a3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:11.325348 1658 tablet_service.cc:1515] Processing DeleteTablet for tablet df29d87d804d44438345052a5902052f with delete_type TABLET_DATA_TOMBSTONED (TS 3f2aa40978064c9e9983cf3745eed206 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53744
I20250625 03:31:11.326417 3114 tablet_replica.cc:331] T df29d87d804d44438345052a5902052f P 3f2aa40978064c9e9983cf3745eed206: stopping tablet replica
I20250625 03:31:11.327426 3114 raft_consensus.cc:2241] T df29d87d804d44438345052a5902052f P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:11.328213 3114 raft_consensus.cc:2270] T df29d87d804d44438345052a5902052f P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:11.331405 3114 ts_tablet_manager.cc:1905] T df29d87d804d44438345052a5902052f P 3f2aa40978064c9e9983cf3745eed206: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250625 03:31:11.335167 2343 raft_consensus.cc:2953] T 3037be35f2054cbbabd8a47062f84244 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:11.342312 1493 catalog_manager.cc:5582] T 3037be35f2054cbbabd8a47062f84244 P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: config changed from index 3 to 4, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:11.369880 3114 ts_tablet_manager.cc:1918] T df29d87d804d44438345052a5902052f P 3f2aa40978064c9e9983cf3745eed206: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20250625 03:31:11.376055 3114 log.cc:1199] T df29d87d804d44438345052a5902052f P 3f2aa40978064c9e9983cf3745eed206: Deleting WAL directory at /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/ts-1-root/wals/df29d87d804d44438345052a5902052f
I20250625 03:31:11.377736 1478 catalog_manager.cc:4928] TS 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): tablet df29d87d804d44438345052a5902052f (table test-workload [id=7f663eabec024fd1911b406c660fa838]) successfully deleted
I20250625 03:31:11.374717 1490 catalog_manager.cc:5582] T 615cebbffcfc44e19b8f7a1e842073a3 P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: term changed from 1 to 2, leader changed from 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) to ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131). New cstate: current_term: 2 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:11.404173 3104 raft_consensus.cc:991] T e38dc50880914156805b07aa82e30863 P 3f2aa40978064c9e9983cf3745eed206: : Instructing follower ba464e89e0f044a0a0ea3e6125cbf2a1 to start an election
I20250625 03:31:11.405097 3104 raft_consensus.cc:1079] T e38dc50880914156805b07aa82e30863 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Signalling peer ba464e89e0f044a0a0ea3e6125cbf2a1 to start an election
I20250625 03:31:11.408736 1737 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "e38dc50880914156805b07aa82e30863"
dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
from {username='slave'} at 127.0.0.1:43678
I20250625 03:31:11.409317 1737 raft_consensus.cc:491] T e38dc50880914156805b07aa82e30863 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:31:11.409677 1737 raft_consensus.cc:3058] T e38dc50880914156805b07aa82e30863 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:11.420382 1589 consensus_queue.cc:237] T 3037be35f2054cbbabd8a47062f84244 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:11.425303 1737 raft_consensus.cc:513] T e38dc50880914156805b07aa82e30863 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:11.428427 2345 raft_consensus.cc:1273] T 3037be35f2054cbbabd8a47062f84244 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250625 03:31:11.430064 1665 raft_consensus.cc:1273] T 3037be35f2054cbbabd8a47062f84244 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250625 03:31:11.433156 3044 consensus_queue.cc:1035] T 3037be35f2054cbbabd8a47062f84244 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250625 03:31:11.434608 3100 consensus_queue.cc:1035] T 3037be35f2054cbbabd8a47062f84244 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250625 03:31:11.439359 1737 leader_election.cc:290] T e38dc50880914156805b07aa82e30863 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 2 election: Requested vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493)
I20250625 03:31:11.440786 1666 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e38dc50880914156805b07aa82e30863" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:31:11.441103 2345 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e38dc50880914156805b07aa82e30863" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "df8b9755d156478aafca552f9e9c539e"
I20250625 03:31:11.441354 1666 raft_consensus.cc:3053] T e38dc50880914156805b07aa82e30863 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:31:11.441629 1666 raft_consensus.cc:738] T e38dc50880914156805b07aa82e30863 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Running, Role: LEADER
I20250625 03:31:11.440608 3083 raft_consensus.cc:2953] T 3037be35f2054cbbabd8a47062f84244 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:11.441661 2345 raft_consensus.cc:3058] T e38dc50880914156805b07aa82e30863 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:11.442165 1666 consensus_queue.cc:260] T e38dc50880914156805b07aa82e30863 P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:11.442898 1666 raft_consensus.cc:3058] T e38dc50880914156805b07aa82e30863 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:11.448235 1666 raft_consensus.cc:2466] T e38dc50880914156805b07aa82e30863 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 2.
I20250625 03:31:11.448933 1665 raft_consensus.cc:2953] T 3037be35f2054cbbabd8a47062f84244 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:11.451613 2345 raft_consensus.cc:2466] T e38dc50880914156805b07aa82e30863 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 2.
I20250625 03:31:11.452991 1708 leader_election.cc:304] T e38dc50880914156805b07aa82e30863 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1, df8b9755d156478aafca552f9e9c539e; no voters:
I20250625 03:31:11.452685 2343 raft_consensus.cc:2953] T 3037be35f2054cbbabd8a47062f84244 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:11.454360 1479 catalog_manager.cc:5095] ChangeConfig:REMOVE_PEER RPC for tablet 3037be35f2054cbbabd8a47062f84244 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250625 03:31:11.454032 3027 raft_consensus.cc:2802] T e38dc50880914156805b07aa82e30863 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:31:11.456336 3027 raft_consensus.cc:695] T e38dc50880914156805b07aa82e30863 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 LEADER]: Becoming Leader. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Running, Role: LEADER
I20250625 03:31:11.457218 3027 consensus_queue.cc:237] T e38dc50880914156805b07aa82e30863 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:11.471514 1493 catalog_manager.cc:5582] T 3037be35f2054cbbabd8a47062f84244 P df8b9755d156478aafca552f9e9c539e reported cstate change: config changed from index 4 to 5, VOTER ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) evicted. New cstate: current_term: 2 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:11.476966 1490 catalog_manager.cc:5582] T e38dc50880914156805b07aa82e30863 P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: term changed from 1 to 2, leader changed from 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) to ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131). New cstate: current_term: 2 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:11.486183 1732 tablet_service.cc:1515] Processing DeleteTablet for tablet 3037be35f2054cbbabd8a47062f84244 with delete_type TABLET_DATA_TOMBSTONED (TS ba464e89e0f044a0a0ea3e6125cbf2a1 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:43672
I20250625 03:31:11.489789 3120 tablet_replica.cc:331] T 3037be35f2054cbbabd8a47062f84244 P ba464e89e0f044a0a0ea3e6125cbf2a1: stopping tablet replica
I20250625 03:31:11.490639 3120 raft_consensus.cc:2241] T 3037be35f2054cbbabd8a47062f84244 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:11.491448 3120 raft_consensus.cc:2270] T 3037be35f2054cbbabd8a47062f84244 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:11.494585 3120 ts_tablet_manager.cc:1905] T 3037be35f2054cbbabd8a47062f84244 P ba464e89e0f044a0a0ea3e6125cbf2a1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250625 03:31:11.511204 3120 ts_tablet_manager.cc:1918] T 3037be35f2054cbbabd8a47062f84244 P ba464e89e0f044a0a0ea3e6125cbf2a1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20250625 03:31:11.511544 3120 log.cc:1199] T 3037be35f2054cbbabd8a47062f84244 P ba464e89e0f044a0a0ea3e6125cbf2a1: Deleting WAL directory at /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/ts-2-root/wals/3037be35f2054cbbabd8a47062f84244
I20250625 03:31:11.513312 1480 catalog_manager.cc:4928] TS ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): tablet 3037be35f2054cbbabd8a47062f84244 (table test-workload [id=7f663eabec024fd1911b406c660fa838]) successfully deleted
I20250625 03:31:11.523542 3102 raft_consensus.cc:991] T 31885ef6a0c64613ae6723c07f9400b0 P 3f2aa40978064c9e9983cf3745eed206: : Instructing follower df8b9755d156478aafca552f9e9c539e to start an election
I20250625 03:31:11.524089 3102 raft_consensus.cc:1079] T 31885ef6a0c64613ae6723c07f9400b0 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Signalling peer df8b9755d156478aafca552f9e9c539e to start an election
I20250625 03:31:11.525346 2343 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "31885ef6a0c64613ae6723c07f9400b0"
dest_uuid: "df8b9755d156478aafca552f9e9c539e"
from {username='slave'} at 127.0.0.1:33226
I20250625 03:31:11.525761 2343 raft_consensus.cc:491] T 31885ef6a0c64613ae6723c07f9400b0 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:31:11.526041 2343 raft_consensus.cc:3058] T 31885ef6a0c64613ae6723c07f9400b0 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:11.531751 2343 raft_consensus.cc:513] T 31885ef6a0c64613ae6723c07f9400b0 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:11.534317 2343 leader_election.cc:290] T 31885ef6a0c64613ae6723c07f9400b0 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 2 election: Requested vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:31:11.534495 1741 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "31885ef6a0c64613ae6723c07f9400b0" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:31:11.535141 1741 raft_consensus.cc:3058] T 31885ef6a0c64613ae6723c07f9400b0 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:11.535555 1665 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "31885ef6a0c64613ae6723c07f9400b0" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:31:11.536150 1665 raft_consensus.cc:3053] T 31885ef6a0c64613ae6723c07f9400b0 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:31:11.536422 1665 raft_consensus.cc:738] T 31885ef6a0c64613ae6723c07f9400b0 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Running, Role: LEADER
I20250625 03:31:11.537202 1665 consensus_queue.cc:260] T 31885ef6a0c64613ae6723c07f9400b0 P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:11.538311 1665 raft_consensus.cc:3058] T 31885ef6a0c64613ae6723c07f9400b0 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:11.541352 1741 raft_consensus.cc:2466] T 31885ef6a0c64613ae6723c07f9400b0 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df8b9755d156478aafca552f9e9c539e in term 2.
I20250625 03:31:11.542493 2308 leader_election.cc:304] T 31885ef6a0c64613ae6723c07f9400b0 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1, df8b9755d156478aafca552f9e9c539e; no voters:
I20250625 03:31:11.543236 3118 raft_consensus.cc:2802] T 31885ef6a0c64613ae6723c07f9400b0 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:31:11.543723 3118 raft_consensus.cc:695] T 31885ef6a0c64613ae6723c07f9400b0 P df8b9755d156478aafca552f9e9c539e [term 2 LEADER]: Becoming Leader. State: Replica: df8b9755d156478aafca552f9e9c539e, State: Running, Role: LEADER
I20250625 03:31:11.544126 1665 raft_consensus.cc:2466] T 31885ef6a0c64613ae6723c07f9400b0 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df8b9755d156478aafca552f9e9c539e in term 2.
I20250625 03:31:11.544665 3118 consensus_queue.cc:237] T 31885ef6a0c64613ae6723c07f9400b0 P df8b9755d156478aafca552f9e9c539e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:11.553344 1493 catalog_manager.cc:5582] T 31885ef6a0c64613ae6723c07f9400b0 P df8b9755d156478aafca552f9e9c539e reported cstate change: term changed from 1 to 2, leader changed from 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) to df8b9755d156478aafca552f9e9c539e (127.0.106.132). New cstate: current_term: 2 leader_uuid: "df8b9755d156478aafca552f9e9c539e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250625 03:31:11.785425 1589 raft_consensus.cc:1273] T 615cebbffcfc44e19b8f7a1e842073a3 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250625 03:31:11.786634 3033 consensus_queue.cc:1035] T 615cebbffcfc44e19b8f7a1e842073a3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250625 03:31:11.798838 2343 raft_consensus.cc:1273] T 615cebbffcfc44e19b8f7a1e842073a3 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250625 03:31:11.803435 3033 consensus_queue.cc:1035] T 615cebbffcfc44e19b8f7a1e842073a3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250625 03:31:11.911406 1665 raft_consensus.cc:1273] T e38dc50880914156805b07aa82e30863 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250625 03:31:11.912578 3033 consensus_queue.cc:1035] T e38dc50880914156805b07aa82e30863 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250625 03:31:11.920892 2343 raft_consensus.cc:1273] T e38dc50880914156805b07aa82e30863 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250625 03:31:11.925164 3106 consensus_queue.cc:1035] T e38dc50880914156805b07aa82e30863 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250625 03:31:12.044551 1737 raft_consensus.cc:1273] T 31885ef6a0c64613ae6723c07f9400b0 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Refusing update from remote peer df8b9755d156478aafca552f9e9c539e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250625 03:31:12.046126 3088 consensus_queue.cc:1035] T 31885ef6a0c64613ae6723c07f9400b0 P df8b9755d156478aafca552f9e9c539e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250625 03:31:12.055975 1665 raft_consensus.cc:1273] T 31885ef6a0c64613ae6723c07f9400b0 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Refusing update from remote peer df8b9755d156478aafca552f9e9c539e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250625 03:31:12.057289 3131 consensus_queue.cc:1035] T 31885ef6a0c64613ae6723c07f9400b0 P df8b9755d156478aafca552f9e9c539e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250625 03:31:12.392297 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:31:12.427351 1737 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "85e02bb33a944989ada7f600c1e802da"
dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
mode: GRACEFUL
new_leader_uuid: "3f2aa40978064c9e9983cf3745eed206"
from {username='slave'} at 127.0.0.1:47496
I20250625 03:31:12.427953 1737 raft_consensus.cc:604] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Received request to transfer leadership to TS 3f2aa40978064c9e9983cf3745eed206
I20250625 03:31:12.430469 1737 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "dea2dcc26f144802a16f0884fdd99063"
dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
mode: GRACEFUL
new_leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
from {username='slave'} at 127.0.0.1:47496
I20250625 03:31:12.430915 1737 raft_consensus.cc:604] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Received request to transfer leadership to TS 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:31:12.431800 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20250625 03:31:12.432904 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:31:12.433451 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:31:12.540668 1589 consensus_queue.cc:237] T a5a18934cc3f490288432ee1cb30b278 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
W20250625 03:31:12.546947 1559 consensus_peers.cc:487] T a5a18934cc3f490288432ee1cb30b278 P 7e9c4f2e01164f33b2e9034ed148398e -> Peer df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493): Couldn't send request to peer df8b9755d156478aafca552f9e9c539e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a5a18934cc3f490288432ee1cb30b278. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:12.548204 3027 raft_consensus.cc:991] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1: : Instructing follower 3f2aa40978064c9e9983cf3745eed206 to start an election
I20250625 03:31:12.547672 1737 raft_consensus.cc:1273] T a5a18934cc3f490288432ee1cb30b278 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20250625 03:31:12.548669 3027 raft_consensus.cc:1079] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Signalling peer 3f2aa40978064c9e9983cf3745eed206 to start an election
I20250625 03:31:12.548735 1665 raft_consensus.cc:1273] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20250625 03:31:12.549810 3083 consensus_queue.cc:1035] T a5a18934cc3f490288432ee1cb30b278 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:31:12.550408 1666 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "85e02bb33a944989ada7f600c1e802da"
dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
from {username='slave'} at 127.0.0.1:53770
I20250625 03:31:12.550990 1666 raft_consensus.cc:491] T 85e02bb33a944989ada7f600c1e802da P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:31:12.550884 3094 consensus_queue.cc:1035] T a5a18934cc3f490288432ee1cb30b278 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:31:12.551443 1666 raft_consensus.cc:3058] T 85e02bb33a944989ada7f600c1e802da P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:12.559827 1666 raft_consensus.cc:513] T 85e02bb33a944989ada7f600c1e802da P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:12.561918 1666 leader_election.cc:290] T 85e02bb33a944989ada7f600c1e802da P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 2 election: Requested vote from peers ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359), df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493)
I20250625 03:31:12.562745 1741 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "85e02bb33a944989ada7f600c1e802da" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:31:12.563426 1741 raft_consensus.cc:3053] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:31:12.563725 1741 raft_consensus.cc:738] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Running, Role: LEADER
I20250625 03:31:12.564461 1741 consensus_queue.cc:260] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:12.565716 1741 raft_consensus.cc:3058] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:12.564489 2342 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "85e02bb33a944989ada7f600c1e802da" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "df8b9755d156478aafca552f9e9c539e"
I20250625 03:31:12.568773 2342 raft_consensus.cc:3058] T 85e02bb33a944989ada7f600c1e802da P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:12.577148 3083 raft_consensus.cc:2953] T a5a18934cc3f490288432ee1cb30b278 P 7e9c4f2e01164f33b2e9034ed148398e [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:12.580138 1741 raft_consensus.cc:2466] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 2.
I20250625 03:31:12.581405 1636 leader_election.cc:304] T 85e02bb33a944989ada7f600c1e802da P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters:
I20250625 03:31:12.582247 3073 raft_consensus.cc:2802] T 85e02bb33a944989ada7f600c1e802da P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:31:12.582708 3073 raft_consensus.cc:695] T 85e02bb33a944989ada7f600c1e802da P 3f2aa40978064c9e9983cf3745eed206 [term 2 LEADER]: Becoming Leader. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Running, Role: LEADER
I20250625 03:31:12.583503 3073 consensus_queue.cc:237] T 85e02bb33a944989ada7f600c1e802da P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:12.586090 1671 raft_consensus.cc:2953] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:12.590406 2342 raft_consensus.cc:2466] T 85e02bb33a944989ada7f600c1e802da P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 2.
I20250625 03:31:12.594733 1737 raft_consensus.cc:2953] T a5a18934cc3f490288432ee1cb30b278 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:12.620168 1493 catalog_manager.cc:5582] T 85e02bb33a944989ada7f600c1e802da P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: term changed from 1 to 2, leader changed from ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) to 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130). New cstate: current_term: 2 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:12.618738 1490 catalog_manager.cc:5582] T a5a18934cc3f490288432ee1cb30b278 P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: config changed from index -1 to 4, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New cstate: current_term: 3 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:12.629449 1671 consensus_queue.cc:237] T 40b74a261fdd495f84ceb0690f0b30ba P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:31:12.637168 1589 raft_consensus.cc:1273] T 40b74a261fdd495f84ceb0690f0b30ba P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20250625 03:31:12.637742 1634 consensus_peers.cc:487] T 40b74a261fdd495f84ceb0690f0b30ba P 3f2aa40978064c9e9983cf3745eed206 -> Peer df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493): Couldn't send request to peer df8b9755d156478aafca552f9e9c539e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 40b74a261fdd495f84ceb0690f0b30ba. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:12.640059 1737 raft_consensus.cc:1273] T 40b74a261fdd495f84ceb0690f0b30ba P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20250625 03:31:12.639760 3102 consensus_queue.cc:1035] T 40b74a261fdd495f84ceb0690f0b30ba P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20250625 03:31:12.643716 3138 consensus_queue.cc:1035] T 40b74a261fdd495f84ceb0690f0b30ba P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:31:12.699731 3102 raft_consensus.cc:2953] T 40b74a261fdd495f84ceb0690f0b30ba P 3f2aa40978064c9e9983cf3745eed206 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:12.705525 1589 raft_consensus.cc:2953] T 40b74a261fdd495f84ceb0690f0b30ba P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:12.708262 1741 raft_consensus.cc:2953] T 40b74a261fdd495f84ceb0690f0b30ba P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:12.714632 1590 consensus_queue.cc:237] T c04f7c2d00994557b1cb83234b36fceb P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:31:12.718984 1490 catalog_manager.cc:5582] T 40b74a261fdd495f84ceb0690f0b30ba P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: config changed from index -1 to 3, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New cstate: current_term: 2 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20250625 03:31:12.730064 1559 consensus_peers.cc:487] T c04f7c2d00994557b1cb83234b36fceb P 7e9c4f2e01164f33b2e9034ed148398e -> Peer df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493): Couldn't send request to peer df8b9755d156478aafca552f9e9c539e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c04f7c2d00994557b1cb83234b36fceb. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:12.732199 3027 raft_consensus.cc:991] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1: : Instructing follower 7e9c4f2e01164f33b2e9034ed148398e to start an election
I20250625 03:31:12.732692 3027 raft_consensus.cc:1079] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Signalling peer 7e9c4f2e01164f33b2e9034ed148398e to start an election
I20250625 03:31:12.739217 1589 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "dea2dcc26f144802a16f0884fdd99063"
dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
from {username='slave'} at 127.0.0.1:52726
I20250625 03:31:12.741006 1671 raft_consensus.cc:1273] T c04f7c2d00994557b1cb83234b36fceb P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20250625 03:31:12.741371 1741 raft_consensus.cc:1273] T c04f7c2d00994557b1cb83234b36fceb P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20250625 03:31:12.739825 1589 raft_consensus.cc:491] T dea2dcc26f144802a16f0884fdd99063 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:31:12.744683 1589 raft_consensus.cc:3058] T dea2dcc26f144802a16f0884fdd99063 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:12.744071 3094 consensus_queue.cc:1035] T c04f7c2d00994557b1cb83234b36fceb P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:31:12.749320 3137 consensus_queue.cc:1035] T c04f7c2d00994557b1cb83234b36fceb P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:31:12.751312 1589 raft_consensus.cc:513] T dea2dcc26f144802a16f0884fdd99063 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:12.754130 1739 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dea2dcc26f144802a16f0884fdd99063" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:31:12.754724 1739 raft_consensus.cc:3053] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:31:12.754812 1589 leader_election.cc:290] T dea2dcc26f144802a16f0884fdd99063 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 2 election: Requested vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:31:12.755069 1739 raft_consensus.cc:738] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Running, Role: LEADER
I20250625 03:31:12.755818 1739 consensus_queue.cc:260] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:12.756870 1739 raft_consensus.cc:3058] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:12.760788 1666 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dea2dcc26f144802a16f0884fdd99063" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:31:12.761605 1666 raft_consensus.cc:3058] T dea2dcc26f144802a16f0884fdd99063 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:12.764158 3083 raft_consensus.cc:2953] T c04f7c2d00994557b1cb83234b36fceb P 7e9c4f2e01164f33b2e9034ed148398e [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:12.766917 1737 raft_consensus.cc:2953] T c04f7c2d00994557b1cb83234b36fceb P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:12.769282 1666 raft_consensus.cc:2466] T dea2dcc26f144802a16f0884fdd99063 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 2.
I20250625 03:31:12.772192 1739 raft_consensus.cc:2466] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 2.
I20250625 03:31:12.772691 1559 leader_election.cc:304] T dea2dcc26f144802a16f0884fdd99063 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e; no voters:
I20250625 03:31:12.773940 3139 raft_consensus.cc:2802] T dea2dcc26f144802a16f0884fdd99063 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:31:12.774521 3139 raft_consensus.cc:695] T dea2dcc26f144802a16f0884fdd99063 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 LEADER]: Becoming Leader. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Running, Role: LEADER
I20250625 03:31:12.775410 3139 consensus_queue.cc:237] T dea2dcc26f144802a16f0884fdd99063 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:12.781910 1739 consensus_queue.cc:237] T 465c15a46933411a985f29059fdb1c9f P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:31:12.782191 1671 raft_consensus.cc:2953] T c04f7c2d00994557b1cb83234b36fceb P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:12.789012 1491 catalog_manager.cc:5582] T c04f7c2d00994557b1cb83234b36fceb P 7e9c4f2e01164f33b2e9034ed148398e reported cstate change: config changed from index -1 to 3, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New cstate: current_term: 2 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:12.807868 1671 raft_consensus.cc:1273] T 465c15a46933411a985f29059fdb1c9f P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 03:31:12.810508 3033 consensus_queue.cc:1035] T 465c15a46933411a985f29059fdb1c9f P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20250625 03:31:12.815861 1708 consensus_peers.cc:487] T 465c15a46933411a985f29059fdb1c9f P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493): Couldn't send request to peer df8b9755d156478aafca552f9e9c539e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 465c15a46933411a985f29059fdb1c9f. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:12.816548 1590 raft_consensus.cc:1273] T 465c15a46933411a985f29059fdb1c9f P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 03:31:12.818115 3027 consensus_queue.cc:1035] T 465c15a46933411a985f29059fdb1c9f P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:12.822114 3033 raft_consensus.cc:2953] T 465c15a46933411a985f29059fdb1c9f P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:12.820631 1490 catalog_manager.cc:5582] T dea2dcc26f144802a16f0884fdd99063 P 7e9c4f2e01164f33b2e9034ed148398e reported cstate change: term changed from 1 to 2, leader changed from ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) to 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129). New cstate: current_term: 2 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:12.824790 1671 raft_consensus.cc:2953] T 465c15a46933411a985f29059fdb1c9f P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:12.830296 1590 raft_consensus.cc:2953] T 465c15a46933411a985f29059fdb1c9f P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:12.848809 1493 catalog_manager.cc:5582] T 465c15a46933411a985f29059fdb1c9f P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New cstate: current_term: 1 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:13.145366 1739 raft_consensus.cc:1273] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250625 03:31:13.146569 3102 consensus_queue.cc:1035] T 85e02bb33a944989ada7f600c1e802da P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250625 03:31:13.157583 2343 raft_consensus.cc:1273] T 85e02bb33a944989ada7f600c1e802da P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250625 03:31:13.160362 3138 consensus_queue.cc:1035] T 85e02bb33a944989ada7f600c1e802da P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250625 03:31:13.181324 3160 ts_tablet_manager.cc:927] T a5a18934cc3f490288432ee1cb30b278 P df8b9755d156478aafca552f9e9c539e: Initiating tablet copy from peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903)
I20250625 03:31:13.189913 1737 raft_consensus.cc:1273] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:13.191239 3139 consensus_queue.cc:1035] T dea2dcc26f144802a16f0884fdd99063 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:13.220381 3160 tablet_copy_client.cc:323] T a5a18934cc3f490288432ee1cb30b278 P df8b9755d156478aafca552f9e9c539e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.106.129:39903
I20250625 03:31:13.222257 1606 tablet_copy_service.cc:140] P 7e9c4f2e01164f33b2e9034ed148398e: Received BeginTabletCopySession request for tablet a5a18934cc3f490288432ee1cb30b278 from peer df8b9755d156478aafca552f9e9c539e ({username='slave'} at 127.0.0.1:44210)
I20250625 03:31:13.222826 1606 tablet_copy_service.cc:161] P 7e9c4f2e01164f33b2e9034ed148398e: Beginning new tablet copy session on tablet a5a18934cc3f490288432ee1cb30b278 from peer df8b9755d156478aafca552f9e9c539e at {username='slave'} at 127.0.0.1:44210: session id = df8b9755d156478aafca552f9e9c539e-a5a18934cc3f490288432ee1cb30b278
I20250625 03:31:13.230862 1606 tablet_copy_source_session.cc:215] T a5a18934cc3f490288432ee1cb30b278 P 7e9c4f2e01164f33b2e9034ed148398e: Tablet Copy: opened 0 blocks and 1 log segments
I20250625 03:31:13.238780 3160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5a18934cc3f490288432ee1cb30b278. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:13.239657 3165 ts_tablet_manager.cc:927] T 40b74a261fdd495f84ceb0690f0b30ba P df8b9755d156478aafca552f9e9c539e: Initiating tablet copy from peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:31:13.271976 3160 tablet_copy_client.cc:806] T a5a18934cc3f490288432ee1cb30b278 P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 0 data blocks...
I20250625 03:31:13.272852 3160 tablet_copy_client.cc:670] T a5a18934cc3f490288432ee1cb30b278 P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 1 WAL segments...
I20250625 03:31:13.283736 3160 tablet_copy_client.cc:538] T a5a18934cc3f490288432ee1cb30b278 P df8b9755d156478aafca552f9e9c539e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250625 03:31:13.284811 3164 ts_tablet_manager.cc:927] T c04f7c2d00994557b1cb83234b36fceb P df8b9755d156478aafca552f9e9c539e: Initiating tablet copy from peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903)
I20250625 03:31:13.295773 3165 tablet_copy_client.cc:323] T 40b74a261fdd495f84ceb0690f0b30ba P df8b9755d156478aafca552f9e9c539e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.106.130:34293
I20250625 03:31:13.297518 1671 raft_consensus.cc:1273] T dea2dcc26f144802a16f0884fdd99063 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:13.299557 3164 tablet_copy_client.cc:323] T c04f7c2d00994557b1cb83234b36fceb P df8b9755d156478aafca552f9e9c539e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.106.129:39903
I20250625 03:31:13.300647 3083 consensus_queue.cc:1035] T dea2dcc26f144802a16f0884fdd99063 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:13.301690 1680 tablet_copy_service.cc:140] P 3f2aa40978064c9e9983cf3745eed206: Received BeginTabletCopySession request for tablet 40b74a261fdd495f84ceb0690f0b30ba from peer df8b9755d156478aafca552f9e9c539e ({username='slave'} at 127.0.0.1:55766)
I20250625 03:31:13.301700 1606 tablet_copy_service.cc:140] P 7e9c4f2e01164f33b2e9034ed148398e: Received BeginTabletCopySession request for tablet c04f7c2d00994557b1cb83234b36fceb from peer df8b9755d156478aafca552f9e9c539e ({username='slave'} at 127.0.0.1:44210)
I20250625 03:31:13.302455 1606 tablet_copy_service.cc:161] P 7e9c4f2e01164f33b2e9034ed148398e: Beginning new tablet copy session on tablet c04f7c2d00994557b1cb83234b36fceb from peer df8b9755d156478aafca552f9e9c539e at {username='slave'} at 127.0.0.1:44210: session id = df8b9755d156478aafca552f9e9c539e-c04f7c2d00994557b1cb83234b36fceb
I20250625 03:31:13.304555 3160 tablet_bootstrap.cc:492] T a5a18934cc3f490288432ee1cb30b278 P df8b9755d156478aafca552f9e9c539e: Bootstrap starting.
I20250625 03:31:13.302379 1680 tablet_copy_service.cc:161] P 3f2aa40978064c9e9983cf3745eed206: Beginning new tablet copy session on tablet 40b74a261fdd495f84ceb0690f0b30ba from peer df8b9755d156478aafca552f9e9c539e at {username='slave'} at 127.0.0.1:55766: session id = df8b9755d156478aafca552f9e9c539e-40b74a261fdd495f84ceb0690f0b30ba
I20250625 03:31:13.315521 1606 tablet_copy_source_session.cc:215] T c04f7c2d00994557b1cb83234b36fceb P 7e9c4f2e01164f33b2e9034ed148398e: Tablet Copy: opened 0 blocks and 1 log segments
I20250625 03:31:13.319502 3164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c04f7c2d00994557b1cb83234b36fceb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:13.333432 1680 tablet_copy_source_session.cc:215] T 40b74a261fdd495f84ceb0690f0b30ba P 3f2aa40978064c9e9983cf3745eed206: Tablet Copy: opened 0 blocks and 1 log segments
I20250625 03:31:13.341477 3165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40b74a261fdd495f84ceb0690f0b30ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:13.352105 3164 tablet_copy_client.cc:806] T c04f7c2d00994557b1cb83234b36fceb P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 0 data blocks...
I20250625 03:31:13.352730 3164 tablet_copy_client.cc:670] T c04f7c2d00994557b1cb83234b36fceb P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 1 WAL segments...
I20250625 03:31:13.361253 3160 tablet_bootstrap.cc:492] T a5a18934cc3f490288432ee1cb30b278 P df8b9755d156478aafca552f9e9c539e: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:31:13.362408 3160 tablet_bootstrap.cc:492] T a5a18934cc3f490288432ee1cb30b278 P df8b9755d156478aafca552f9e9c539e: Bootstrap complete.
I20250625 03:31:13.362408 3165 tablet_copy_client.cc:806] T 40b74a261fdd495f84ceb0690f0b30ba P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 0 data blocks...
I20250625 03:31:13.363112 3165 tablet_copy_client.cc:670] T 40b74a261fdd495f84ceb0690f0b30ba P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 1 WAL segments...
I20250625 03:31:13.363332 3160 ts_tablet_manager.cc:1397] T a5a18934cc3f490288432ee1cb30b278 P df8b9755d156478aafca552f9e9c539e: Time spent bootstrapping tablet: real 0.059s user 0.026s sys 0.011s
I20250625 03:31:13.366256 3164 tablet_copy_client.cc:538] T c04f7c2d00994557b1cb83234b36fceb P df8b9755d156478aafca552f9e9c539e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250625 03:31:13.366407 3160 raft_consensus.cc:357] T a5a18934cc3f490288432ee1cb30b278 P df8b9755d156478aafca552f9e9c539e [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:31:13.367336 3160 raft_consensus.cc:738] T a5a18934cc3f490288432ee1cb30b278 P df8b9755d156478aafca552f9e9c539e [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: df8b9755d156478aafca552f9e9c539e, State: Initialized, Role: LEARNER
I20250625 03:31:13.368127 3160 consensus_queue.cc:260] T a5a18934cc3f490288432ee1cb30b278 P df8b9755d156478aafca552f9e9c539e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:31:13.375113 3160 ts_tablet_manager.cc:1428] T a5a18934cc3f490288432ee1cb30b278 P df8b9755d156478aafca552f9e9c539e: Time spent starting tablet: real 0.011s user 0.008s sys 0.000s
I20250625 03:31:13.379547 3170 ts_tablet_manager.cc:927] T 465c15a46933411a985f29059fdb1c9f P df8b9755d156478aafca552f9e9c539e: Initiating tablet copy from peer ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:31:13.380312 1606 tablet_copy_service.cc:342] P 7e9c4f2e01164f33b2e9034ed148398e: Request end of tablet copy session df8b9755d156478aafca552f9e9c539e-a5a18934cc3f490288432ee1cb30b278 received from {username='slave'} at 127.0.0.1:44210
I20250625 03:31:13.380887 1606 tablet_copy_service.cc:434] P 7e9c4f2e01164f33b2e9034ed148398e: ending tablet copy session df8b9755d156478aafca552f9e9c539e-a5a18934cc3f490288432ee1cb30b278 on tablet a5a18934cc3f490288432ee1cb30b278 with peer df8b9755d156478aafca552f9e9c539e
I20250625 03:31:13.386147 3164 tablet_bootstrap.cc:492] T c04f7c2d00994557b1cb83234b36fceb P df8b9755d156478aafca552f9e9c539e: Bootstrap starting.
I20250625 03:31:13.386610 3165 tablet_copy_client.cc:538] T 40b74a261fdd495f84ceb0690f0b30ba P df8b9755d156478aafca552f9e9c539e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250625 03:31:13.400182 3165 tablet_bootstrap.cc:492] T 40b74a261fdd495f84ceb0690f0b30ba P df8b9755d156478aafca552f9e9c539e: Bootstrap starting.
I20250625 03:31:13.400354 3170 tablet_copy_client.cc:323] T 465c15a46933411a985f29059fdb1c9f P df8b9755d156478aafca552f9e9c539e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.106.131:39359
I20250625 03:31:13.402922 1755 tablet_copy_service.cc:140] P ba464e89e0f044a0a0ea3e6125cbf2a1: Received BeginTabletCopySession request for tablet 465c15a46933411a985f29059fdb1c9f from peer df8b9755d156478aafca552f9e9c539e ({username='slave'} at 127.0.0.1:39774)
I20250625 03:31:13.403569 1755 tablet_copy_service.cc:161] P ba464e89e0f044a0a0ea3e6125cbf2a1: Beginning new tablet copy session on tablet 465c15a46933411a985f29059fdb1c9f from peer df8b9755d156478aafca552f9e9c539e at {username='slave'} at 127.0.0.1:39774: session id = df8b9755d156478aafca552f9e9c539e-465c15a46933411a985f29059fdb1c9f
I20250625 03:31:13.429486 3164 tablet_bootstrap.cc:492] T c04f7c2d00994557b1cb83234b36fceb P df8b9755d156478aafca552f9e9c539e: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:31:13.430579 3164 tablet_bootstrap.cc:492] T c04f7c2d00994557b1cb83234b36fceb P df8b9755d156478aafca552f9e9c539e: Bootstrap complete.
I20250625 03:31:13.431319 3164 ts_tablet_manager.cc:1397] T c04f7c2d00994557b1cb83234b36fceb P df8b9755d156478aafca552f9e9c539e: Time spent bootstrapping tablet: real 0.045s user 0.018s sys 0.022s
I20250625 03:31:13.434345 3164 raft_consensus.cc:357] T c04f7c2d00994557b1cb83234b36fceb P df8b9755d156478aafca552f9e9c539e [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:31:13.435259 3164 raft_consensus.cc:738] T c04f7c2d00994557b1cb83234b36fceb P df8b9755d156478aafca552f9e9c539e [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: df8b9755d156478aafca552f9e9c539e, State: Initialized, Role: LEARNER
I20250625 03:31:13.435933 3164 consensus_queue.cc:260] T c04f7c2d00994557b1cb83234b36fceb P df8b9755d156478aafca552f9e9c539e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:31:13.438848 3164 ts_tablet_manager.cc:1428] T c04f7c2d00994557b1cb83234b36fceb P df8b9755d156478aafca552f9e9c539e: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20250625 03:31:13.448352 1606 tablet_copy_service.cc:342] P 7e9c4f2e01164f33b2e9034ed148398e: Request end of tablet copy session df8b9755d156478aafca552f9e9c539e-c04f7c2d00994557b1cb83234b36fceb received from {username='slave'} at 127.0.0.1:44210
I20250625 03:31:13.448810 1606 tablet_copy_service.cc:434] P 7e9c4f2e01164f33b2e9034ed148398e: ending tablet copy session df8b9755d156478aafca552f9e9c539e-c04f7c2d00994557b1cb83234b36fceb on tablet c04f7c2d00994557b1cb83234b36fceb with peer df8b9755d156478aafca552f9e9c539e
I20250625 03:31:13.454483 1755 tablet_copy_source_session.cc:215] T 465c15a46933411a985f29059fdb1c9f P ba464e89e0f044a0a0ea3e6125cbf2a1: Tablet Copy: opened 0 blocks and 1 log segments
I20250625 03:31:13.458662 3170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 465c15a46933411a985f29059fdb1c9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:13.469099 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:31:13.484771 3165 tablet_bootstrap.cc:492] T 40b74a261fdd495f84ceb0690f0b30ba P df8b9755d156478aafca552f9e9c539e: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:31:13.486029 3165 tablet_bootstrap.cc:492] T 40b74a261fdd495f84ceb0690f0b30ba P df8b9755d156478aafca552f9e9c539e: Bootstrap complete.
I20250625 03:31:13.492681 3165 ts_tablet_manager.cc:1397] T 40b74a261fdd495f84ceb0690f0b30ba P df8b9755d156478aafca552f9e9c539e: Time spent bootstrapping tablet: real 0.093s user 0.042s sys 0.013s
I20250625 03:31:13.486220 3170 tablet_copy_client.cc:806] T 465c15a46933411a985f29059fdb1c9f P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 0 data blocks...
I20250625 03:31:13.493796 3170 tablet_copy_client.cc:670] T 465c15a46933411a985f29059fdb1c9f P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 1 WAL segments...
I20250625 03:31:13.496098 3165 raft_consensus.cc:357] T 40b74a261fdd495f84ceb0690f0b30ba P df8b9755d156478aafca552f9e9c539e [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:31:13.497205 3165 raft_consensus.cc:738] T 40b74a261fdd495f84ceb0690f0b30ba P df8b9755d156478aafca552f9e9c539e [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: df8b9755d156478aafca552f9e9c539e, State: Initialized, Role: LEARNER
I20250625 03:31:13.497769 3170 tablet_copy_client.cc:538] T 465c15a46933411a985f29059fdb1c9f P df8b9755d156478aafca552f9e9c539e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250625 03:31:13.498061 3165 consensus_queue.cc:260] T 40b74a261fdd495f84ceb0690f0b30ba P df8b9755d156478aafca552f9e9c539e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:31:13.506731 3165 ts_tablet_manager.cc:1428] T 40b74a261fdd495f84ceb0690f0b30ba P df8b9755d156478aafca552f9e9c539e: Time spent starting tablet: real 0.014s user 0.007s sys 0.000s
I20250625 03:31:13.509136 1680 tablet_copy_service.cc:342] P 3f2aa40978064c9e9983cf3745eed206: Request end of tablet copy session df8b9755d156478aafca552f9e9c539e-40b74a261fdd495f84ceb0690f0b30ba received from {username='slave'} at 127.0.0.1:55766
I20250625 03:31:13.509629 1680 tablet_copy_service.cc:434] P 3f2aa40978064c9e9983cf3745eed206: ending tablet copy session df8b9755d156478aafca552f9e9c539e-40b74a261fdd495f84ceb0690f0b30ba on tablet 40b74a261fdd495f84ceb0690f0b30ba with peer df8b9755d156478aafca552f9e9c539e
I20250625 03:31:13.524307 3170 tablet_bootstrap.cc:492] T 465c15a46933411a985f29059fdb1c9f P df8b9755d156478aafca552f9e9c539e: Bootstrap starting.
I20250625 03:31:13.543107 1666 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "6d7a37b3448d468baa1b9422a6167c9a"
dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
mode: GRACEFUL
new_leader_uuid: "df8b9755d156478aafca552f9e9c539e"
from {username='slave'} at 127.0.0.1:35370
I20250625 03:31:13.544344 1666 raft_consensus.cc:604] T 6d7a37b3448d468baa1b9422a6167c9a P 3f2aa40978064c9e9983cf3745eed206 [term 2 LEADER]: Received request to transfer leadership to TS df8b9755d156478aafca552f9e9c539e
I20250625 03:31:13.550252 1587 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "96030b80e1f340afa81659faaaf68755"
dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
mode: GRACEFUL
new_leader_uuid: "3f2aa40978064c9e9983cf3745eed206"
from {username='slave'} at 127.0.0.1:47018
I20250625 03:31:13.550837 1587 raft_consensus.cc:604] T 96030b80e1f340afa81659faaaf68755 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 LEADER]: Received request to transfer leadership to TS 3f2aa40978064c9e9983cf3745eed206
I20250625 03:31:13.556854 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20250625 03:31:13.558610 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:31:13.559315 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:31:13.561158 3170 tablet_bootstrap.cc:492] T 465c15a46933411a985f29059fdb1c9f P df8b9755d156478aafca552f9e9c539e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:31:13.564978 3170 tablet_bootstrap.cc:492] T 465c15a46933411a985f29059fdb1c9f P df8b9755d156478aafca552f9e9c539e: Bootstrap complete.
I20250625 03:31:13.565749 3170 ts_tablet_manager.cc:1397] T 465c15a46933411a985f29059fdb1c9f P df8b9755d156478aafca552f9e9c539e: Time spent bootstrapping tablet: real 0.042s user 0.014s sys 0.011s
I20250625 03:31:13.575241 3170 raft_consensus.cc:357] T 465c15a46933411a985f29059fdb1c9f P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:31:13.576287 3170 raft_consensus.cc:738] T 465c15a46933411a985f29059fdb1c9f P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: df8b9755d156478aafca552f9e9c539e, State: Initialized, Role: LEARNER
I20250625 03:31:13.577168 3170 consensus_queue.cc:260] T 465c15a46933411a985f29059fdb1c9f P df8b9755d156478aafca552f9e9c539e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:31:13.579922 3170 ts_tablet_manager.cc:1428] T 465c15a46933411a985f29059fdb1c9f P df8b9755d156478aafca552f9e9c539e: Time spent starting tablet: real 0.014s user 0.004s sys 0.002s
I20250625 03:31:13.581740 1755 tablet_copy_service.cc:342] P ba464e89e0f044a0a0ea3e6125cbf2a1: Request end of tablet copy session df8b9755d156478aafca552f9e9c539e-465c15a46933411a985f29059fdb1c9f received from {username='slave'} at 127.0.0.1:39774
I20250625 03:31:13.582196 1755 tablet_copy_service.cc:434] P ba464e89e0f044a0a0ea3e6125cbf2a1: ending tablet copy session df8b9755d156478aafca552f9e9c539e-465c15a46933411a985f29059fdb1c9f on tablet 465c15a46933411a985f29059fdb1c9f with peer df8b9755d156478aafca552f9e9c539e
I20250625 03:31:13.776059 2342 raft_consensus.cc:1215] T 40b74a261fdd495f84ceb0690f0b30ba P df8b9755d156478aafca552f9e9c539e [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3] Dedup: 2.3->[]
I20250625 03:31:13.901851 2345 raft_consensus.cc:1215] T 465c15a46933411a985f29059fdb1c9f P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20250625 03:31:13.978075 2343 raft_consensus.cc:1215] T a5a18934cc3f490288432ee1cb30b278 P df8b9755d156478aafca552f9e9c539e [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4] Dedup: 3.4->[]
I20250625 03:31:13.982537 2344 raft_consensus.cc:1215] T c04f7c2d00994557b1cb83234b36fceb P df8b9755d156478aafca552f9e9c539e [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3] Dedup: 2.3->[]
I20250625 03:31:13.996803 3083 raft_consensus.cc:991] T 96030b80e1f340afa81659faaaf68755 P 7e9c4f2e01164f33b2e9034ed148398e: : Instructing follower 3f2aa40978064c9e9983cf3745eed206 to start an election
I20250625 03:31:13.997298 3177 raft_consensus.cc:1079] T 96030b80e1f340afa81659faaaf68755 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 LEADER]: Signalling peer 3f2aa40978064c9e9983cf3745eed206 to start an election
I20250625 03:31:14.017354 1667 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "96030b80e1f340afa81659faaaf68755"
dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
from {username='slave'} at 127.0.0.1:53758
I20250625 03:31:14.017897 1667 raft_consensus.cc:491] T 96030b80e1f340afa81659faaaf68755 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:31:14.018225 1667 raft_consensus.cc:3058] T 96030b80e1f340afa81659faaaf68755 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:14.025992 1667 raft_consensus.cc:513] T 96030b80e1f340afa81659faaaf68755 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:14.026582 3138 raft_consensus.cc:991] T 6d7a37b3448d468baa1b9422a6167c9a P 3f2aa40978064c9e9983cf3745eed206: : Instructing follower df8b9755d156478aafca552f9e9c539e to start an election
I20250625 03:31:14.027024 3102 raft_consensus.cc:1079] T 6d7a37b3448d468baa1b9422a6167c9a P 3f2aa40978064c9e9983cf3745eed206 [term 2 LEADER]: Signalling peer df8b9755d156478aafca552f9e9c539e to start an election
I20250625 03:31:14.027741 1667 leader_election.cc:290] T 96030b80e1f340afa81659faaaf68755 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 3 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:31:14.028347 2344 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "6d7a37b3448d468baa1b9422a6167c9a"
dest_uuid: "df8b9755d156478aafca552f9e9c539e"
from {username='slave'} at 127.0.0.1:33226
I20250625 03:31:14.028793 2344 raft_consensus.cc:491] T 6d7a37b3448d468baa1b9422a6167c9a P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:31:14.028883 1587 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "96030b80e1f340afa81659faaaf68755" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
I20250625 03:31:14.029165 2344 raft_consensus.cc:3058] T 6d7a37b3448d468baa1b9422a6167c9a P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:14.028883 1745 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "96030b80e1f340afa81659faaaf68755" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:31:14.029623 1587 raft_consensus.cc:3053] T 96030b80e1f340afa81659faaaf68755 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 LEADER]: Stepping down as leader of term 2
I20250625 03:31:14.029745 1745 raft_consensus.cc:3058] T 96030b80e1f340afa81659faaaf68755 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:14.030004 1587 raft_consensus.cc:738] T 96030b80e1f340afa81659faaaf68755 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Running, Role: LEADER
I20250625 03:31:14.030828 1587 consensus_queue.cc:260] T 96030b80e1f340afa81659faaaf68755 P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:14.031860 1587 raft_consensus.cc:3058] T 96030b80e1f340afa81659faaaf68755 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:14.038419 1587 raft_consensus.cc:2466] T 96030b80e1f340afa81659faaaf68755 P 7e9c4f2e01164f33b2e9034ed148398e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 3.
I20250625 03:31:14.039717 2344 raft_consensus.cc:513] T 6d7a37b3448d468baa1b9422a6167c9a P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:14.042358 1590 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6d7a37b3448d468baa1b9422a6167c9a" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
I20250625 03:31:14.042871 1745 raft_consensus.cc:2466] T 96030b80e1f340afa81659faaaf68755 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 3.
I20250625 03:31:14.042946 1590 raft_consensus.cc:3058] T 6d7a37b3448d468baa1b9422a6167c9a P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:14.041301 1635 leader_election.cc:304] T 96030b80e1f340afa81659faaaf68755 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e; no voters:
I20250625 03:31:14.044268 3138 raft_consensus.cc:2802] T 96030b80e1f340afa81659faaaf68755 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Leader election won for term 3
I20250625 03:31:14.044519 1667 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6d7a37b3448d468baa1b9422a6167c9a" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:31:14.045301 1667 raft_consensus.cc:3053] T 6d7a37b3448d468baa1b9422a6167c9a P 3f2aa40978064c9e9983cf3745eed206 [term 2 LEADER]: Stepping down as leader of term 2
I20250625 03:31:14.044761 3138 raft_consensus.cc:695] T 96030b80e1f340afa81659faaaf68755 P 3f2aa40978064c9e9983cf3745eed206 [term 3 LEADER]: Becoming Leader. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Running, Role: LEADER
I20250625 03:31:14.046363 3138 consensus_queue.cc:237] T 96030b80e1f340afa81659faaaf68755 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:14.045612 1667 raft_consensus.cc:738] T 6d7a37b3448d468baa1b9422a6167c9a P 3f2aa40978064c9e9983cf3745eed206 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Running, Role: LEADER
I20250625 03:31:14.048419 1590 raft_consensus.cc:2466] T 6d7a37b3448d468baa1b9422a6167c9a P 7e9c4f2e01164f33b2e9034ed148398e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df8b9755d156478aafca552f9e9c539e in term 3.
I20250625 03:31:14.041862 2344 leader_election.cc:290] T 6d7a37b3448d468baa1b9422a6167c9a P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 3 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:31:14.049263 1667 consensus_queue.cc:260] T 6d7a37b3448d468baa1b9422a6167c9a P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:14.050750 1667 raft_consensus.cc:3058] T 6d7a37b3448d468baa1b9422a6167c9a P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:14.052439 2307 leader_election.cc:304] T 6d7a37b3448d468baa1b9422a6167c9a P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e, df8b9755d156478aafca552f9e9c539e; no voters:
I20250625 03:31:14.053681 3188 raft_consensus.cc:2802] T 6d7a37b3448d468baa1b9422a6167c9a P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Leader election won for term 3
I20250625 03:31:14.054152 3188 raft_consensus.cc:695] T 6d7a37b3448d468baa1b9422a6167c9a P df8b9755d156478aafca552f9e9c539e [term 3 LEADER]: Becoming Leader. State: Replica: df8b9755d156478aafca552f9e9c539e, State: Running, Role: LEADER
I20250625 03:31:14.057780 1667 raft_consensus.cc:2466] T 6d7a37b3448d468baa1b9422a6167c9a P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df8b9755d156478aafca552f9e9c539e in term 3.
I20250625 03:31:14.059484 3188 consensus_queue.cc:237] T 6d7a37b3448d468baa1b9422a6167c9a P df8b9755d156478aafca552f9e9c539e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:14.074985 1490 catalog_manager.cc:5582] T 96030b80e1f340afa81659faaaf68755 P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: term changed from 2 to 3, leader changed from 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) to 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130). New cstate: current_term: 3 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:14.085412 1493 catalog_manager.cc:5582] T 6d7a37b3448d468baa1b9422a6167c9a P df8b9755d156478aafca552f9e9c539e reported cstate change: term changed from 2 to 3, leader changed from 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) to df8b9755d156478aafca552f9e9c539e (127.0.106.132). New cstate: current_term: 3 leader_uuid: "df8b9755d156478aafca552f9e9c539e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250625 03:31:14.256352 3106 raft_consensus.cc:1062] T 465c15a46933411a985f29059fdb1c9f P ba464e89e0f044a0a0ea3e6125cbf2a1: attempting to promote NON_VOTER df8b9755d156478aafca552f9e9c539e to VOTER
I20250625 03:31:14.258981 3106 consensus_queue.cc:237] T 465c15a46933411a985f29059fdb1c9f P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:14.265935 2344 raft_consensus.cc:1273] T 465c15a46933411a985f29059fdb1c9f P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:31:14.267344 3180 consensus_queue.cc:1035] T 465c15a46933411a985f29059fdb1c9f P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:31:14.268397 1589 raft_consensus.cc:1273] T 465c15a46933411a985f29059fdb1c9f P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:31:14.268499 1665 raft_consensus.cc:1273] T 465c15a46933411a985f29059fdb1c9f P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:31:14.269933 3180 consensus_queue.cc:1035] T 465c15a46933411a985f29059fdb1c9f P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:31:14.272814 3180 consensus_queue.cc:1035] T 465c15a46933411a985f29059fdb1c9f P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:31:14.285534 3180 raft_consensus.cc:2953] T 465c15a46933411a985f29059fdb1c9f P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:14.287773 1590 raft_consensus.cc:2953] T 465c15a46933411a985f29059fdb1c9f P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:14.288867 1665 raft_consensus.cc:2953] T 465c15a46933411a985f29059fdb1c9f P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:14.307035 2344 raft_consensus.cc:2953] T 465c15a46933411a985f29059fdb1c9f P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:14.311935 1493 catalog_manager.cc:5582] T 465c15a46933411a985f29059fdb1c9f P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250625 03:31:14.316188 3139 raft_consensus.cc:1062] T c04f7c2d00994557b1cb83234b36fceb P 7e9c4f2e01164f33b2e9034ed148398e: attempting to promote NON_VOTER df8b9755d156478aafca552f9e9c539e to VOTER
I20250625 03:31:14.318801 3139 consensus_queue.cc:237] T c04f7c2d00994557b1cb83234b36fceb P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:14.328610 3102 raft_consensus.cc:1062] T 40b74a261fdd495f84ceb0690f0b30ba P 3f2aa40978064c9e9983cf3745eed206: attempting to promote NON_VOTER df8b9755d156478aafca552f9e9c539e to VOTER
I20250625 03:31:14.331079 3102 consensus_queue.cc:237] T 40b74a261fdd495f84ceb0690f0b30ba P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:14.336084 1744 consensus_queue.cc:237] T 465c15a46933411a985f29059fdb1c9f P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:14.337743 3178 raft_consensus.cc:1062] T a5a18934cc3f490288432ee1cb30b278 P 7e9c4f2e01164f33b2e9034ed148398e: attempting to promote NON_VOTER df8b9755d156478aafca552f9e9c539e to VOTER
I20250625 03:31:14.341594 2344 raft_consensus.cc:1273] T 465c15a46933411a985f29059fdb1c9f P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250625 03:31:14.342036 1589 raft_consensus.cc:1273] T 465c15a46933411a985f29059fdb1c9f P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250625 03:31:14.343602 3180 consensus_queue.cc:1035] T 465c15a46933411a985f29059fdb1c9f P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:31:14.345098 3106 consensus_queue.cc:1035] T 465c15a46933411a985f29059fdb1c9f P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:31:14.348170 1745 raft_consensus.cc:1273] T c04f7c2d00994557b1cb83234b36fceb P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20250625 03:31:14.351189 3083 consensus_queue.cc:1035] T c04f7c2d00994557b1cb83234b36fceb P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20250625 03:31:14.351006 3033 raft_consensus.cc:2953] T 465c15a46933411a985f29059fdb1c9f P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:14.352841 1589 raft_consensus.cc:2953] T 465c15a46933411a985f29059fdb1c9f P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:14.339994 3178 consensus_queue.cc:237] T a5a18934cc3f490288432ee1cb30b278 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:14.363611 2345 raft_consensus.cc:1273] T c04f7c2d00994557b1cb83234b36fceb P df8b9755d156478aafca552f9e9c539e [term 2 LEARNER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20250625 03:31:14.365149 1667 raft_consensus.cc:1273] T c04f7c2d00994557b1cb83234b36fceb P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20250625 03:31:14.365424 3083 consensus_queue.cc:1035] T c04f7c2d00994557b1cb83234b36fceb P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20250625 03:31:14.367604 3094 consensus_queue.cc:1035] T c04f7c2d00994557b1cb83234b36fceb P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20250625 03:31:14.372617 2345 raft_consensus.cc:2953] T 465c15a46933411a985f29059fdb1c9f P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:14.395045 1480 catalog_manager.cc:5095] ChangeConfig:REMOVE_PEER RPC for tablet 465c15a46933411a985f29059fdb1c9f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250625 03:31:14.410454 2341 raft_consensus.cc:1273] T a5a18934cc3f490288432ee1cb30b278 P df8b9755d156478aafca552f9e9c539e [term 3 LEARNER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20250625 03:31:14.410441 2343 raft_consensus.cc:1273] T 40b74a261fdd495f84ceb0690f0b30ba P df8b9755d156478aafca552f9e9c539e [term 2 LEARNER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20250625 03:31:14.411298 1745 raft_consensus.cc:1273] T 40b74a261fdd495f84ceb0690f0b30ba P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20250625 03:31:14.412736 3177 consensus_queue.cc:1035] T a5a18934cc3f490288432ee1cb30b278 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250625 03:31:14.413246 3185 consensus_queue.cc:1035] T 40b74a261fdd495f84ceb0690f0b30ba P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:31:14.414101 1490 catalog_manager.cc:5582] T 465c15a46933411a985f29059fdb1c9f P 7e9c4f2e01164f33b2e9034ed148398e reported cstate change: config changed from index 3 to 4, VOTER 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) evicted. New cstate: current_term: 1 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:14.415086 3185 consensus_queue.cc:1035] T 40b74a261fdd495f84ceb0690f0b30ba P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:31:14.435945 1589 raft_consensus.cc:1273] T 40b74a261fdd495f84ceb0690f0b30ba P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20250625 03:31:14.438349 1665 raft_consensus.cc:1273] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20250625 03:31:14.440547 1737 raft_consensus.cc:1273] T a5a18934cc3f490288432ee1cb30b278 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20250625 03:31:14.439709 3094 raft_consensus.cc:2953] T c04f7c2d00994557b1cb83234b36fceb P 7e9c4f2e01164f33b2e9034ed148398e [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:14.446445 3139 consensus_queue.cc:1035] T a5a18934cc3f490288432ee1cb30b278 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250625 03:31:14.446790 1669 raft_consensus.cc:2953] T c04f7c2d00994557b1cb83234b36fceb P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:14.453805 1658 tablet_service.cc:1515] Processing DeleteTablet for tablet 465c15a46933411a985f29059fdb1c9f with delete_type TABLET_DATA_TOMBSTONED (TS 3f2aa40978064c9e9983cf3745eed206 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53744
I20250625 03:31:14.463488 3139 consensus_queue.cc:1035] T a5a18934cc3f490288432ee1cb30b278 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20250625 03:31:14.484512 1491 catalog_manager.cc:5582] T c04f7c2d00994557b1cb83234b36fceb P 7e9c4f2e01164f33b2e9034ed148398e reported cstate change: config changed from index 3 to 4, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:14.524827 3083 raft_consensus.cc:2953] T a5a18934cc3f490288432ee1cb30b278 P 7e9c4f2e01164f33b2e9034ed148398e [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:14.524927 2344 raft_consensus.cc:2953] T c04f7c2d00994557b1cb83234b36fceb P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:14.535967 1587 consensus_queue.cc:237] T c04f7c2d00994557b1cb83234b36fceb P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:14.536240 2345 raft_consensus.cc:2953] T a5a18934cc3f490288432ee1cb30b278 P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:14.540743 1665 raft_consensus.cc:2953] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:14.564579 1490 catalog_manager.cc:5582] T a5a18934cc3f490288432ee1cb30b278 P df8b9755d156478aafca552f9e9c539e reported cstate change: config changed from index 4 to 5, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:14.586258 3209 tablet_replica.cc:331] T 465c15a46933411a985f29059fdb1c9f P 3f2aa40978064c9e9983cf3745eed206: stopping tablet replica
I20250625 03:31:14.592700 1589 raft_consensus.cc:1273] T 6d7a37b3448d468baa1b9422a6167c9a P 7e9c4f2e01164f33b2e9034ed148398e [term 3 FOLLOWER]: Refusing update from remote peer df8b9755d156478aafca552f9e9c539e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20250625 03:31:14.596132 1669 raft_consensus.cc:1273] T 6d7a37b3448d468baa1b9422a6167c9a P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Refusing update from remote peer df8b9755d156478aafca552f9e9c539e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20250625 03:31:14.596973 1590 consensus_queue.cc:237] T a5a18934cc3f490288432ee1cb30b278 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
W20250625 03:31:14.598021 1561 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.131:39359, user_credentials={real_user=slave}} blocked reactor thread for 136668us
I20250625 03:31:14.620473 3088 consensus_queue.cc:1035] T 6d7a37b3448d468baa1b9422a6167c9a P df8b9755d156478aafca552f9e9c539e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20250625 03:31:14.626195 1741 raft_consensus.cc:2953] T c04f7c2d00994557b1cb83234b36fceb P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } attrs { replace: true } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:14.609501 3102 raft_consensus.cc:2953] T 40b74a261fdd495f84ceb0690f0b30ba P 3f2aa40978064c9e9983cf3745eed206 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:14.611739 1745 raft_consensus.cc:2953] T 40b74a261fdd495f84ceb0690f0b30ba P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:14.616309 2342 raft_consensus.cc:1273] T c04f7c2d00994557b1cb83234b36fceb P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250625 03:31:14.632588 1669 raft_consensus.cc:1273] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20250625 03:31:14.587560 3209 raft_consensus.cc:2241] T 465c15a46933411a985f29059fdb1c9f P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:14.639008 1596 raft_consensus.cc:1273] T 96030b80e1f340afa81659faaaf68755 P 7e9c4f2e01164f33b2e9034ed148398e [term 3 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250625 03:31:14.639199 3209 raft_consensus.cc:2270] T 465c15a46933411a985f29059fdb1c9f P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:14.640265 3083 consensus_queue.cc:1035] T a5a18934cc3f490288432ee1cb30b278 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20250625 03:31:14.641698 3083 consensus_queue.cc:1035] T c04f7c2d00994557b1cb83234b36fceb P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250625 03:31:14.642490 3138 consensus_queue.cc:1035] T 40b74a261fdd495f84ceb0690f0b30ba P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:31:14.654359 3083 raft_consensus.cc:2953] T a5a18934cc3f490288432ee1cb30b278 P 7e9c4f2e01164f33b2e9034ed148398e [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:14.655685 1739 raft_consensus.cc:1273] T 96030b80e1f340afa81659faaaf68755 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250625 03:31:14.657403 1665 raft_consensus.cc:2953] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:14.659996 3188 consensus_queue.cc:1035] T 6d7a37b3448d468baa1b9422a6167c9a P df8b9755d156478aafca552f9e9c539e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20250625 03:31:14.660457 3139 raft_consensus.cc:2953] T c04f7c2d00994557b1cb83234b36fceb P 7e9c4f2e01164f33b2e9034ed148398e [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:14.649471 2343 raft_consensus.cc:1273] T a5a18934cc3f490288432ee1cb30b278 P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20250625 03:31:14.660084 2342 raft_consensus.cc:2953] T 40b74a261fdd495f84ceb0690f0b30ba P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:14.666432 2345 raft_consensus.cc:2953] T c04f7c2d00994557b1cb83234b36fceb P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:14.669183 3209 ts_tablet_manager.cc:1905] T 465c15a46933411a985f29059fdb1c9f P 3f2aa40978064c9e9983cf3745eed206: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250625 03:31:14.669425 3177 consensus_queue.cc:1035] T a5a18934cc3f490288432ee1cb30b278 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20250625 03:31:14.690985 2343 raft_consensus.cc:2953] T a5a18934cc3f490288432ee1cb30b278 P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:14.659132 3102 consensus_queue.cc:1035] T 96030b80e1f340afa81659faaaf68755 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20250625 03:31:14.707309 1740 raft_consensus.cc:1273] T c04f7c2d00994557b1cb83234b36fceb P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250625 03:31:14.712441 3177 consensus_queue.cc:1035] T c04f7c2d00994557b1cb83234b36fceb P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20250625 03:31:14.748651 1635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:39903, user_credentials={real_user=slave}} blocked reactor thread for 105941us
I20250625 03:31:14.747391 1491 catalog_manager.cc:5582] T 40b74a261fdd495f84ceb0690f0b30ba P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: config changed from index 3 to 4, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250625 03:31:14.783754 1491 catalog_manager.cc:5582] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: config changed from index 5 to 6, VOTER ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) evicted. New cstate: current_term: 3 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:14.783267 3213 consensus_queue.cc:1035] T 96030b80e1f340afa81659faaaf68755 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20250625 03:31:14.763025 1737 raft_consensus.cc:2953] T a5a18934cc3f490288432ee1cb30b278 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
W20250625 03:31:14.801723 1766 debug-util.cc:398] Leaking SignalData structure 0x7b0800060200 after lost signal to thread 429
I20250625 03:31:14.839838 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:31:14.847949 1479 catalog_manager.cc:5095] ChangeConfig:REMOVE_PEER RPC for tablet a5a18934cc3f490288432ee1cb30b278 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20250625 03:31:14.866153 1559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.130:34293, user_credentials={real_user=slave}} blocked reactor thread for 143163us
I20250625 03:31:14.870668 1745 raft_consensus.cc:2953] T c04f7c2d00994557b1cb83234b36fceb P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
W20250625 03:31:14.882277 2307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:39903, user_credentials={real_user=slave}} blocked reactor thread for 46140.4us
W20250625 03:31:14.878422 1766 debug-util.cc:398] Leaking SignalData structure 0x7b080016e060 after lost signal to thread 1528
W20250625 03:31:14.953817 2306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.130:34293, user_credentials={real_user=slave}} blocked reactor thread for 184274us
W20250625 03:31:14.956123 1766 debug-util.cc:398] Leaking SignalData structure 0x7b080036a4a0 after lost signal to thread 1620
W20250625 03:31:14.957686 1766 debug-util.cc:398] Leaking SignalData structure 0x7b0800363c80 after lost signal to thread 1695
W20250625 03:31:14.959129 1766 debug-util.cc:398] Leaking SignalData structure 0x7b08003552a0 after lost signal to thread 1769
W20250625 03:31:14.973951 1766 debug-util.cc:398] Leaking SignalData structure 0x7b0800287480 after lost signal to thread 2369
I20250625 03:31:14.983731 3209 ts_tablet_manager.cc:1918] T 465c15a46933411a985f29059fdb1c9f P 3f2aa40978064c9e9983cf3745eed206: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20250625 03:31:14.996228 3209 log.cc:1199] T 465c15a46933411a985f29059fdb1c9f P 3f2aa40978064c9e9983cf3745eed206: Deleting WAL directory at /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/ts-1-root/wals/465c15a46933411a985f29059fdb1c9f
I20250625 03:31:14.986610 1479 catalog_manager.cc:5095] ChangeConfig:REMOVE_PEER RPC for tablet c04f7c2d00994557b1cb83234b36fceb with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20250625 03:31:15.013770 1559 consensus_peers.cc:159] SignalRequest failed: Illegal state: peer closed
I20250625 03:31:15.028592 1493 catalog_manager.cc:5582] T c04f7c2d00994557b1cb83234b36fceb P df8b9755d156478aafca552f9e9c539e reported cstate change: config changed from index 4 to 5, VOTER 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) evicted. New cstate: current_term: 2 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:15.033378 1587 raft_consensus.cc:2953] T 40b74a261fdd495f84ceb0690f0b30ba P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:15.057125 1732 tablet_service.cc:1515] Processing DeleteTablet for tablet a5a18934cc3f490288432ee1cb30b278 with delete_type TABLET_DATA_TOMBSTONED (TS ba464e89e0f044a0a0ea3e6125cbf2a1 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:43672
W20250625 03:31:15.127274 1634 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.132:34493, user_credentials={real_user=slave}} blocked reactor thread for 181937us
I20250625 03:31:15.130009 1478 catalog_manager.cc:4928] TS 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): tablet 465c15a46933411a985f29059fdb1c9f (table test-workload [id=7f663eabec024fd1911b406c660fa838]) successfully deleted
W20250625 03:31:15.251816 1636 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.131:39359, user_credentials={real_user=slave}} blocked reactor thread for 79707.2us
W20250625 03:31:15.256027 1709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:39903, user_credentials={real_user=slave}} blocked reactor thread for 72967.6us
I20250625 03:31:15.272892 1669 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "c4354f7ffc0e4eabbc92a141d46b7984"
dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
mode: GRACEFUL
new_leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
from {username='slave'} at 127.0.0.1:35370
I20250625 03:31:15.273579 1669 raft_consensus.cc:604] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206 [term 3 LEADER]: Received request to transfer leadership to TS 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:31:15.294894 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 1
I20250625 03:31:15.296739 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:31:15.297506 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20250625 03:31:15.277213 3215 log.cc:927] Time spent T 6d7a37b3448d468baa1b9422a6167c9a P 3f2aa40978064c9e9983cf3745eed206: Append to log took a long time: real 0.065s user 0.000s sys 0.000s
W20250625 03:31:15.330348 1708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.130:34293, user_credentials={real_user=slave}} blocked reactor thread for 161747us
I20250625 03:31:15.331175 3244 tablet_replica.cc:331] T a5a18934cc3f490288432ee1cb30b278 P ba464e89e0f044a0a0ea3e6125cbf2a1: stopping tablet replica
I20250625 03:31:15.332824 3244 raft_consensus.cc:2241] T a5a18934cc3f490288432ee1cb30b278 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:15.333648 3244 raft_consensus.cc:2270] T a5a18934cc3f490288432ee1cb30b278 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Raft consensus is shut down!
W20250625 03:31:15.367020 3228 log.cc:927] Time spent T 96030b80e1f340afa81659faaaf68755 P 7e9c4f2e01164f33b2e9034ed148398e: Append to log took a long time: real 0.066s user 0.000s sys 0.001s
I20250625 03:31:15.378078 1671 consensus_queue.cc:237] T 40b74a261fdd495f84ceb0690f0b30ba P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
W20250625 03:31:15.383479 1709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:39903, user_credentials={real_user=slave}} blocked reactor thread for 125182us
W20250625 03:31:15.396561 3231 log.cc:927] Time spent T 96030b80e1f340afa81659faaaf68755 P ba464e89e0f044a0a0ea3e6125cbf2a1: Append to log took a long time: real 0.069s user 0.001s sys 0.000s
I20250625 03:31:15.444698 2343 raft_consensus.cc:1273] T 40b74a261fdd495f84ceb0690f0b30ba P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250625 03:31:15.448205 3237 consensus_queue.cc:1035] T 40b74a261fdd495f84ceb0690f0b30ba P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20250625 03:31:15.496114 1741 raft_consensus.cc:1273] T 40b74a261fdd495f84ceb0690f0b30ba P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250625 03:31:15.498606 1658 tablet_service.cc:1515] Processing DeleteTablet for tablet c04f7c2d00994557b1cb83234b36fceb with delete_type TABLET_DATA_TOMBSTONED (TS 3f2aa40978064c9e9983cf3745eed206 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:53744
I20250625 03:31:15.500023 3073 consensus_queue.cc:1035] T 40b74a261fdd495f84ceb0690f0b30ba P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250625 03:31:15.520371 3244 ts_tablet_manager.cc:1905] T a5a18934cc3f490288432ee1cb30b278 P ba464e89e0f044a0a0ea3e6125cbf2a1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20250625 03:31:15.530177 1559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.132:34493, user_credentials={real_user=slave}} blocked reactor thread for 77148.1us
I20250625 03:31:15.547551 3209 tablet_replica.cc:331] T c04f7c2d00994557b1cb83234b36fceb P 3f2aa40978064c9e9983cf3745eed206: stopping tablet replica
I20250625 03:31:15.550971 3237 raft_consensus.cc:991] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206: : Instructing follower 7e9c4f2e01164f33b2e9034ed148398e to start an election
I20250625 03:31:15.551590 3138 raft_consensus.cc:1079] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206 [term 3 LEADER]: Signalling peer 7e9c4f2e01164f33b2e9034ed148398e to start an election
I20250625 03:31:15.550928 3185 raft_consensus.cc:2953] T 40b74a261fdd495f84ceb0690f0b30ba P 3f2aa40978064c9e9983cf3745eed206 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:15.555341 1591 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "c4354f7ffc0e4eabbc92a141d46b7984"
dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
from {username='slave'} at 127.0.0.1:52738
I20250625 03:31:15.555990 1591 raft_consensus.cc:491] T c4354f7ffc0e4eabbc92a141d46b7984 P 7e9c4f2e01164f33b2e9034ed148398e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:31:15.556679 1591 raft_consensus.cc:3058] T c4354f7ffc0e4eabbc92a141d46b7984 P 7e9c4f2e01164f33b2e9034ed148398e [term 3 FOLLOWER]: Advancing to term 4
I20250625 03:31:15.558063 1741 raft_consensus.cc:2953] T 40b74a261fdd495f84ceb0690f0b30ba P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:15.652518 3209 raft_consensus.cc:2241] T c04f7c2d00994557b1cb83234b36fceb P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:15.655036 1591 raft_consensus.cc:513] T c4354f7ffc0e4eabbc92a141d46b7984 P 7e9c4f2e01164f33b2e9034ed148398e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:15.578977 2341 raft_consensus.cc:2953] T 40b74a261fdd495f84ceb0690f0b30ba P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:15.671716 1591 leader_election.cc:290] T c4354f7ffc0e4eabbc92a141d46b7984 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 4 election: Requested vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:31:15.700592 3209 raft_consensus.cc:2270] T c04f7c2d00994557b1cb83234b36fceb P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:15.703159 1737 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c4354f7ffc0e4eabbc92a141d46b7984" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:31:15.705034 1737 raft_consensus.cc:3058] T c4354f7ffc0e4eabbc92a141d46b7984 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Advancing to term 4
W20250625 03:31:15.696135 3231 log.cc:927] Time spent T 96030b80e1f340afa81659faaaf68755 P ba464e89e0f044a0a0ea3e6125cbf2a1: Append to log took a long time: real 0.087s user 0.000s sys 0.000s
I20250625 03:31:15.716282 3209 ts_tablet_manager.cc:1905] T c04f7c2d00994557b1cb83234b36fceb P 3f2aa40978064c9e9983cf3745eed206: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250625 03:31:15.729027 1737 raft_consensus.cc:2466] T c4354f7ffc0e4eabbc92a141d46b7984 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 4.
I20250625 03:31:15.733609 1561 leader_election.cc:304] T c4354f7ffc0e4eabbc92a141d46b7984 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters:
I20250625 03:31:15.734915 3242 raft_consensus.cc:2802] T c4354f7ffc0e4eabbc92a141d46b7984 P 7e9c4f2e01164f33b2e9034ed148398e [term 4 FOLLOWER]: Leader election won for term 4
I20250625 03:31:15.735462 3242 raft_consensus.cc:695] T c4354f7ffc0e4eabbc92a141d46b7984 P 7e9c4f2e01164f33b2e9034ed148398e [term 4 LEADER]: Becoming Leader. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Running, Role: LEADER
I20250625 03:31:15.736382 3242 consensus_queue.cc:237] T c4354f7ffc0e4eabbc92a141d46b7984 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:15.755112 1667 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c4354f7ffc0e4eabbc92a141d46b7984" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:31:15.755797 1667 raft_consensus.cc:3053] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206 [term 3 LEADER]: Stepping down as leader of term 3
I20250625 03:31:15.756079 1667 raft_consensus.cc:738] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Running, Role: LEADER
I20250625 03:31:15.756973 1478 catalog_manager.cc:5095] ChangeConfig:REMOVE_PEER RPC for tablet 40b74a261fdd495f84ceb0690f0b30ba with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250625 03:31:15.757270 1667 consensus_queue.cc:260] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:15.758534 1667 raft_consensus.cc:3058] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Advancing to term 4
I20250625 03:31:15.765142 1667 raft_consensus.cc:2466] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 4.
I20250625 03:31:15.757030 3244 ts_tablet_manager.cc:1918] T a5a18934cc3f490288432ee1cb30b278 P ba464e89e0f044a0a0ea3e6125cbf2a1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20250625 03:31:15.771489 3244 log.cc:1199] T a5a18934cc3f490288432ee1cb30b278 P ba464e89e0f044a0a0ea3e6125cbf2a1: Deleting WAL directory at /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/ts-2-root/wals/a5a18934cc3f490288432ee1cb30b278
I20250625 03:31:15.773479 1480 catalog_manager.cc:4928] TS ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): tablet a5a18934cc3f490288432ee1cb30b278 (table test-workload [id=7f663eabec024fd1911b406c660fa838]) successfully deleted
I20250625 03:31:15.774009 1493 catalog_manager.cc:5582] T 40b74a261fdd495f84ceb0690f0b30ba P df8b9755d156478aafca552f9e9c539e reported cstate change: config changed from index 4 to 5, VOTER 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) evicted. New cstate: current_term: 2 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:15.787618 3209 ts_tablet_manager.cc:1918] T c04f7c2d00994557b1cb83234b36fceb P 3f2aa40978064c9e9983cf3745eed206: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20250625 03:31:15.788133 3209 log.cc:1199] T c04f7c2d00994557b1cb83234b36fceb P 3f2aa40978064c9e9983cf3745eed206: Deleting WAL directory at /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/ts-1-root/wals/c04f7c2d00994557b1cb83234b36fceb
I20250625 03:31:15.789916 1478 catalog_manager.cc:4928] TS 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): tablet c04f7c2d00994557b1cb83234b36fceb (table test-workload [id=7f663eabec024fd1911b406c660fa838]) successfully deleted
I20250625 03:31:15.794683 1582 tablet_service.cc:1515] Processing DeleteTablet for tablet 40b74a261fdd495f84ceb0690f0b30ba with delete_type TABLET_DATA_TOMBSTONED (TS 7e9c4f2e01164f33b2e9034ed148398e not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:52712
I20250625 03:31:15.816731 3256 tablet_replica.cc:331] T 40b74a261fdd495f84ceb0690f0b30ba P 7e9c4f2e01164f33b2e9034ed148398e: stopping tablet replica
I20250625 03:31:15.826475 3256 raft_consensus.cc:2241] T 40b74a261fdd495f84ceb0690f0b30ba P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:15.827337 3256 raft_consensus.cc:2270] T 40b74a261fdd495f84ceb0690f0b30ba P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:15.830847 3256 ts_tablet_manager.cc:1905] T 40b74a261fdd495f84ceb0690f0b30ba P 7e9c4f2e01164f33b2e9034ed148398e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20250625 03:31:15.831856 1561 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.131:39359, user_credentials={real_user=slave}} blocked reactor thread for 60590.4us
I20250625 03:31:15.848655 1493 catalog_manager.cc:5582] T c4354f7ffc0e4eabbc92a141d46b7984 P 7e9c4f2e01164f33b2e9034ed148398e reported cstate change: term changed from 3 to 4, leader changed from 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) to 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129). New cstate: current_term: 4 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } }
W20250625 03:31:15.852588 1559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.132:34493, user_credentials={real_user=slave}} blocked reactor thread for 54937.4us
I20250625 03:31:15.853184 3256 ts_tablet_manager.cc:1918] T 40b74a261fdd495f84ceb0690f0b30ba P 7e9c4f2e01164f33b2e9034ed148398e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20250625 03:31:15.867611 3256 log.cc:1199] T 40b74a261fdd495f84ceb0690f0b30ba P 7e9c4f2e01164f33b2e9034ed148398e: Deleting WAL directory at /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/ts-0-root/wals/40b74a261fdd495f84ceb0690f0b30ba
I20250625 03:31:15.870771 1479 catalog_manager.cc:4928] TS 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): tablet 40b74a261fdd495f84ceb0690f0b30ba (table test-workload [id=7f663eabec024fd1911b406c660fa838]) successfully deleted
I20250625 03:31:16.166635 1671 raft_consensus.cc:1273] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206 [term 4 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20250625 03:31:16.168072 3242 consensus_queue.cc:1035] T c4354f7ffc0e4eabbc92a141d46b7984 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:31:16.202217 1744 raft_consensus.cc:1273] T c4354f7ffc0e4eabbc92a141d46b7984 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 4 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20250625 03:31:16.204172 3242 consensus_queue.cc:1035] T c4354f7ffc0e4eabbc92a141d46b7984 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:31:16.727931 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:31:16.782392 1596 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "dea2dcc26f144802a16f0884fdd99063"
dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
mode: GRACEFUL
new_leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
from {username='slave'} at 127.0.0.1:47018
I20250625 03:31:16.783116 1596 raft_consensus.cc:604] T dea2dcc26f144802a16f0884fdd99063 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 LEADER]: Received request to transfer leadership to TS ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:31:16.785022 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 1
I20250625 03:31:16.786861 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:31:16.787691 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:31:16.904700 1596 consensus_queue.cc:237] T f957bf9749c54be48094092cb80e9055 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
W20250625 03:31:16.910849 1559 consensus_peers.cc:487] T f957bf9749c54be48094092cb80e9055 P 7e9c4f2e01164f33b2e9034ed148398e -> Peer df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493): Couldn't send request to peer df8b9755d156478aafca552f9e9c539e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f957bf9749c54be48094092cb80e9055. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:16.912470 1741 raft_consensus.cc:1273] T f957bf9749c54be48094092cb80e9055 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:16.912474 1671 raft_consensus.cc:1273] T f957bf9749c54be48094092cb80e9055 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:16.916656 3218 consensus_queue.cc:1035] T f957bf9749c54be48094092cb80e9055 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:16.917454 3242 consensus_queue.cc:1035] T f957bf9749c54be48094092cb80e9055 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20250625 03:31:16.936861 3218 raft_consensus.cc:2953] T f957bf9749c54be48094092cb80e9055 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:16.937999 1741 raft_consensus.cc:2953] T f957bf9749c54be48094092cb80e9055 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:16.961180 1493 catalog_manager.cc:5582] T f957bf9749c54be48094092cb80e9055 P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New cstate: current_term: 2 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:16.993479 1671 raft_consensus.cc:2953] T f957bf9749c54be48094092cb80e9055 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:17.006667 1741 consensus_queue.cc:237] T fd279ddcf72a40e1bf2ec42a4f35e639 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:31:17.026161 1667 raft_consensus.cc:1273] T fd279ddcf72a40e1bf2ec42a4f35e639 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20250625 03:31:17.027004 1708 consensus_peers.cc:487] T fd279ddcf72a40e1bf2ec42a4f35e639 P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493): Couldn't send request to peer df8b9755d156478aafca552f9e9c539e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fd279ddcf72a40e1bf2ec42a4f35e639. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:17.028067 3243 consensus_queue.cc:1035] T fd279ddcf72a40e1bf2ec42a4f35e639 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20250625 03:31:17.033627 1587 raft_consensus.cc:1273] T fd279ddcf72a40e1bf2ec42a4f35e639 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 03:31:17.035077 3106 consensus_queue.cc:1035] T fd279ddcf72a40e1bf2ec42a4f35e639 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:17.043936 3243 raft_consensus.cc:2953] T fd279ddcf72a40e1bf2ec42a4f35e639 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:17.052166 1587 raft_consensus.cc:2953] T fd279ddcf72a40e1bf2ec42a4f35e639 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
W20250625 03:31:17.061501 1635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:39903, user_credentials={real_user=slave}} blocked reactor thread for 59819.6us
I20250625 03:31:17.080664 1587 consensus_queue.cc:237] T e88f79ed06514e01a9bc48261a5acfbb P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:31:17.100893 1490 catalog_manager.cc:5582] T fd279ddcf72a40e1bf2ec42a4f35e639 P 7e9c4f2e01164f33b2e9034ed148398e reported cstate change: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New cstate: current_term: 1 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:17.109076 1667 raft_consensus.cc:2953] T fd279ddcf72a40e1bf2ec42a4f35e639 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
W20250625 03:31:17.127097 1559 consensus_peers.cc:487] T e88f79ed06514e01a9bc48261a5acfbb P 7e9c4f2e01164f33b2e9034ed148398e -> Peer df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493): Couldn't send request to peer df8b9755d156478aafca552f9e9c539e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e88f79ed06514e01a9bc48261a5acfbb. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:17.130007 1741 raft_consensus.cc:1273] T e88f79ed06514e01a9bc48261a5acfbb P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20250625 03:31:17.132215 3254 consensus_queue.cc:1035] T e88f79ed06514e01a9bc48261a5acfbb P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:31:17.147140 1667 raft_consensus.cc:1273] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20250625 03:31:17.147759 3242 raft_consensus.cc:2953] T e88f79ed06514e01a9bc48261a5acfbb P 7e9c4f2e01164f33b2e9034ed148398e [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:17.150125 1741 raft_consensus.cc:2953] T e88f79ed06514e01a9bc48261a5acfbb P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:17.160933 3254 consensus_queue.cc:1035] T e88f79ed06514e01a9bc48261a5acfbb P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:31:17.179788 1667 raft_consensus.cc:2953] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:17.178686 1493 catalog_manager.cc:5582] T e88f79ed06514e01a9bc48261a5acfbb P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: config changed from index -1 to 3, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New cstate: current_term: 2 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:17.189127 1669 consensus_queue.cc:237] T a1d83fca2b484feeaff6f350fe749b24 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
W20250625 03:31:17.204825 1634 consensus_peers.cc:487] T a1d83fca2b484feeaff6f350fe749b24 P 3f2aa40978064c9e9983cf3745eed206 -> Peer df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493): Couldn't send request to peer df8b9755d156478aafca552f9e9c539e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a1d83fca2b484feeaff6f350fe749b24. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:17.209530 1741 raft_consensus.cc:1273] T a1d83fca2b484feeaff6f350fe749b24 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20250625 03:31:17.209856 1587 raft_consensus.cc:1273] T a1d83fca2b484feeaff6f350fe749b24 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20250625 03:31:17.211364 3278 consensus_queue.cc:1035] T a1d83fca2b484feeaff6f350fe749b24 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:31:17.215260 3185 consensus_queue.cc:1035] T a1d83fca2b484feeaff6f350fe749b24 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:31:17.236603 3279 raft_consensus.cc:2953] T a1d83fca2b484feeaff6f350fe749b24 P 3f2aa40978064c9e9983cf3745eed206 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:17.241442 1587 raft_consensus.cc:2953] T a1d83fca2b484feeaff6f350fe749b24 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:17.257460 1741 raft_consensus.cc:2953] T a1d83fca2b484feeaff6f350fe749b24 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:17.274631 1493 catalog_manager.cc:5582] T a1d83fca2b484feeaff6f350fe749b24 P 7e9c4f2e01164f33b2e9034ed148398e reported cstate change: config changed from index -1 to 3, NON_VOTER df8b9755d156478aafca552f9e9c539e (127.0.106.132) added. New cstate: current_term: 2 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } } }
I20250625 03:31:17.345119 3287 ts_tablet_manager.cc:927] T f957bf9749c54be48094092cb80e9055 P df8b9755d156478aafca552f9e9c539e: Initiating tablet copy from peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903)
I20250625 03:31:17.347048 3287 tablet_copy_client.cc:323] T f957bf9749c54be48094092cb80e9055 P df8b9755d156478aafca552f9e9c539e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.106.129:39903
I20250625 03:31:17.348759 1606 tablet_copy_service.cc:140] P 7e9c4f2e01164f33b2e9034ed148398e: Received BeginTabletCopySession request for tablet f957bf9749c54be48094092cb80e9055 from peer df8b9755d156478aafca552f9e9c539e ({username='slave'} at 127.0.0.1:44210)
I20250625 03:31:17.349352 1606 tablet_copy_service.cc:161] P 7e9c4f2e01164f33b2e9034ed148398e: Beginning new tablet copy session on tablet f957bf9749c54be48094092cb80e9055 from peer df8b9755d156478aafca552f9e9c539e at {username='slave'} at 127.0.0.1:44210: session id = df8b9755d156478aafca552f9e9c539e-f957bf9749c54be48094092cb80e9055
I20250625 03:31:17.357471 3254 raft_consensus.cc:991] T dea2dcc26f144802a16f0884fdd99063 P 7e9c4f2e01164f33b2e9034ed148398e: : Instructing follower ba464e89e0f044a0a0ea3e6125cbf2a1 to start an election
I20250625 03:31:17.358055 3242 raft_consensus.cc:1079] T dea2dcc26f144802a16f0884fdd99063 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 LEADER]: Signalling peer ba464e89e0f044a0a0ea3e6125cbf2a1 to start an election
I20250625 03:31:17.359624 1741 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "dea2dcc26f144802a16f0884fdd99063"
dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
from {username='slave'} at 127.0.0.1:43674
I20250625 03:31:17.360194 1741 raft_consensus.cc:491] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:31:17.360540 1741 raft_consensus.cc:3058] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:17.360992 1606 tablet_copy_source_session.cc:215] T f957bf9749c54be48094092cb80e9055 P 7e9c4f2e01164f33b2e9034ed148398e: Tablet Copy: opened 0 blocks and 1 log segments
I20250625 03:31:17.375726 3287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f957bf9749c54be48094092cb80e9055. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:17.379890 1741 raft_consensus.cc:513] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:17.383651 1741 leader_election.cc:290] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 3 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:31:17.384243 1596 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dea2dcc26f144802a16f0884fdd99063" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
I20250625 03:31:17.384858 1596 raft_consensus.cc:3053] T dea2dcc26f144802a16f0884fdd99063 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 LEADER]: Stepping down as leader of term 2
I20250625 03:31:17.385154 1596 raft_consensus.cc:738] T dea2dcc26f144802a16f0884fdd99063 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Running, Role: LEADER
I20250625 03:31:17.385911 1596 consensus_queue.cc:260] T dea2dcc26f144802a16f0884fdd99063 P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:17.388913 1671 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dea2dcc26f144802a16f0884fdd99063" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:31:17.389644 1671 raft_consensus.cc:3058] T dea2dcc26f144802a16f0884fdd99063 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:17.387907 1596 raft_consensus.cc:3058] T dea2dcc26f144802a16f0884fdd99063 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:17.407826 1671 raft_consensus.cc:2466] T dea2dcc26f144802a16f0884fdd99063 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 3.
I20250625 03:31:17.409291 1708 leader_election.cc:304] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters:
I20250625 03:31:17.402549 1596 raft_consensus.cc:2466] T dea2dcc26f144802a16f0884fdd99063 P 7e9c4f2e01164f33b2e9034ed148398e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 3.
I20250625 03:31:17.411049 3280 raft_consensus.cc:2802] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Leader election won for term 3
I20250625 03:31:17.411604 3280 raft_consensus.cc:695] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 LEADER]: Becoming Leader. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Running, Role: LEADER
I20250625 03:31:17.412549 3280 consensus_queue.cc:237] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:17.426324 3287 tablet_copy_client.cc:806] T f957bf9749c54be48094092cb80e9055 P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 0 data blocks...
I20250625 03:31:17.427066 3287 tablet_copy_client.cc:670] T f957bf9749c54be48094092cb80e9055 P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 1 WAL segments...
I20250625 03:31:17.434041 3287 tablet_copy_client.cc:538] T f957bf9749c54be48094092cb80e9055 P df8b9755d156478aafca552f9e9c539e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250625 03:31:17.436605 1491 catalog_manager.cc:5582] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: term changed from 2 to 3, leader changed from 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) to ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131). New cstate: current_term: 3 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: HEALTHY } } }
I20250625 03:31:17.448457 3287 tablet_bootstrap.cc:492] T f957bf9749c54be48094092cb80e9055 P df8b9755d156478aafca552f9e9c539e: Bootstrap starting.
I20250625 03:31:17.478420 3287 tablet_bootstrap.cc:492] T f957bf9749c54be48094092cb80e9055 P df8b9755d156478aafca552f9e9c539e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:31:17.480326 3287 tablet_bootstrap.cc:492] T f957bf9749c54be48094092cb80e9055 P df8b9755d156478aafca552f9e9c539e: Bootstrap complete.
I20250625 03:31:17.481061 3287 ts_tablet_manager.cc:1397] T f957bf9749c54be48094092cb80e9055 P df8b9755d156478aafca552f9e9c539e: Time spent bootstrapping tablet: real 0.033s user 0.012s sys 0.016s
I20250625 03:31:17.484127 3287 raft_consensus.cc:357] T f957bf9749c54be48094092cb80e9055 P df8b9755d156478aafca552f9e9c539e [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:31:17.485180 3287 raft_consensus.cc:738] T f957bf9749c54be48094092cb80e9055 P df8b9755d156478aafca552f9e9c539e [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: df8b9755d156478aafca552f9e9c539e, State: Initialized, Role: LEARNER
I20250625 03:31:17.485934 3287 consensus_queue.cc:260] T f957bf9749c54be48094092cb80e9055 P df8b9755d156478aafca552f9e9c539e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:31:17.488421 3287 ts_tablet_manager.cc:1428] T f957bf9749c54be48094092cb80e9055 P df8b9755d156478aafca552f9e9c539e: Time spent starting tablet: real 0.007s user 0.007s sys 0.001s
I20250625 03:31:17.494400 1606 tablet_copy_service.cc:342] P 7e9c4f2e01164f33b2e9034ed148398e: Request end of tablet copy session df8b9755d156478aafca552f9e9c539e-f957bf9749c54be48094092cb80e9055 received from {username='slave'} at 127.0.0.1:44210
I20250625 03:31:17.494895 1606 tablet_copy_service.cc:434] P 7e9c4f2e01164f33b2e9034ed148398e: ending tablet copy session df8b9755d156478aafca552f9e9c539e-f957bf9749c54be48094092cb80e9055 on tablet f957bf9749c54be48094092cb80e9055 with peer df8b9755d156478aafca552f9e9c539e
I20250625 03:31:17.609236 3287 ts_tablet_manager.cc:927] T a1d83fca2b484feeaff6f350fe749b24 P df8b9755d156478aafca552f9e9c539e: Initiating tablet copy from peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:31:17.611832 3287 tablet_copy_client.cc:323] T a1d83fca2b484feeaff6f350fe749b24 P df8b9755d156478aafca552f9e9c539e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.106.130:34293
I20250625 03:31:17.614382 1680 tablet_copy_service.cc:140] P 3f2aa40978064c9e9983cf3745eed206: Received BeginTabletCopySession request for tablet a1d83fca2b484feeaff6f350fe749b24 from peer df8b9755d156478aafca552f9e9c539e ({username='slave'} at 127.0.0.1:55766)
I20250625 03:31:17.615010 1680 tablet_copy_service.cc:161] P 3f2aa40978064c9e9983cf3745eed206: Beginning new tablet copy session on tablet a1d83fca2b484feeaff6f350fe749b24 from peer df8b9755d156478aafca552f9e9c539e at {username='slave'} at 127.0.0.1:55766: session id = df8b9755d156478aafca552f9e9c539e-a1d83fca2b484feeaff6f350fe749b24
I20250625 03:31:17.624300 1680 tablet_copy_source_session.cc:215] T a1d83fca2b484feeaff6f350fe749b24 P 3f2aa40978064c9e9983cf3745eed206: Tablet Copy: opened 0 blocks and 1 log segments
I20250625 03:31:17.626725 3292 ts_tablet_manager.cc:927] T fd279ddcf72a40e1bf2ec42a4f35e639 P df8b9755d156478aafca552f9e9c539e: Initiating tablet copy from peer ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:31:17.627825 3287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1d83fca2b484feeaff6f350fe749b24. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:17.644939 3292 tablet_copy_client.cc:323] T fd279ddcf72a40e1bf2ec42a4f35e639 P df8b9755d156478aafca552f9e9c539e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.106.131:39359
I20250625 03:31:17.648342 1755 tablet_copy_service.cc:140] P ba464e89e0f044a0a0ea3e6125cbf2a1: Received BeginTabletCopySession request for tablet fd279ddcf72a40e1bf2ec42a4f35e639 from peer df8b9755d156478aafca552f9e9c539e ({username='slave'} at 127.0.0.1:39774)
I20250625 03:31:17.648901 1755 tablet_copy_service.cc:161] P ba464e89e0f044a0a0ea3e6125cbf2a1: Beginning new tablet copy session on tablet fd279ddcf72a40e1bf2ec42a4f35e639 from peer df8b9755d156478aafca552f9e9c539e at {username='slave'} at 127.0.0.1:39774: session id = df8b9755d156478aafca552f9e9c539e-fd279ddcf72a40e1bf2ec42a4f35e639
I20250625 03:31:17.656710 1755 tablet_copy_source_session.cc:215] T fd279ddcf72a40e1bf2ec42a4f35e639 P ba464e89e0f044a0a0ea3e6125cbf2a1: Tablet Copy: opened 0 blocks and 1 log segments
I20250625 03:31:17.663053 3292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd279ddcf72a40e1bf2ec42a4f35e639. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:17.673524 3287 tablet_copy_client.cc:806] T a1d83fca2b484feeaff6f350fe749b24 P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 0 data blocks...
I20250625 03:31:17.674157 3287 tablet_copy_client.cc:670] T a1d83fca2b484feeaff6f350fe749b24 P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 1 WAL segments...
I20250625 03:31:17.684139 3287 tablet_copy_client.cc:538] T a1d83fca2b484feeaff6f350fe749b24 P df8b9755d156478aafca552f9e9c539e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250625 03:31:17.690084 3292 tablet_copy_client.cc:806] T fd279ddcf72a40e1bf2ec42a4f35e639 P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 0 data blocks...
I20250625 03:31:17.690786 3292 tablet_copy_client.cc:670] T fd279ddcf72a40e1bf2ec42a4f35e639 P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 1 WAL segments...
I20250625 03:31:17.696228 3292 tablet_copy_client.cc:538] T fd279ddcf72a40e1bf2ec42a4f35e639 P df8b9755d156478aafca552f9e9c539e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250625 03:31:17.703550 3287 tablet_bootstrap.cc:492] T a1d83fca2b484feeaff6f350fe749b24 P df8b9755d156478aafca552f9e9c539e: Bootstrap starting.
I20250625 03:31:17.705976 3292 tablet_bootstrap.cc:492] T fd279ddcf72a40e1bf2ec42a4f35e639 P df8b9755d156478aafca552f9e9c539e: Bootstrap starting.
I20250625 03:31:17.749897 3287 tablet_bootstrap.cc:492] T a1d83fca2b484feeaff6f350fe749b24 P df8b9755d156478aafca552f9e9c539e: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:31:17.755261 3292 tablet_bootstrap.cc:492] T fd279ddcf72a40e1bf2ec42a4f35e639 P df8b9755d156478aafca552f9e9c539e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:31:17.756536 3292 tablet_bootstrap.cc:492] T fd279ddcf72a40e1bf2ec42a4f35e639 P df8b9755d156478aafca552f9e9c539e: Bootstrap complete.
I20250625 03:31:17.757344 3292 ts_tablet_manager.cc:1397] T fd279ddcf72a40e1bf2ec42a4f35e639 P df8b9755d156478aafca552f9e9c539e: Time spent bootstrapping tablet: real 0.052s user 0.019s sys 0.015s
I20250625 03:31:17.760429 3292 raft_consensus.cc:357] T fd279ddcf72a40e1bf2ec42a4f35e639 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:31:17.761258 3292 raft_consensus.cc:738] T fd279ddcf72a40e1bf2ec42a4f35e639 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: df8b9755d156478aafca552f9e9c539e, State: Initialized, Role: LEARNER
I20250625 03:31:17.761462 3296 ts_tablet_manager.cc:927] T e88f79ed06514e01a9bc48261a5acfbb P df8b9755d156478aafca552f9e9c539e: Initiating tablet copy from peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903)
I20250625 03:31:17.761971 3292 consensus_queue.cc:260] T fd279ddcf72a40e1bf2ec42a4f35e639 P df8b9755d156478aafca552f9e9c539e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:31:17.765183 3287 tablet_bootstrap.cc:492] T a1d83fca2b484feeaff6f350fe749b24 P df8b9755d156478aafca552f9e9c539e: Bootstrap complete.
I20250625 03:31:17.765993 3287 ts_tablet_manager.cc:1397] T a1d83fca2b484feeaff6f350fe749b24 P df8b9755d156478aafca552f9e9c539e: Time spent bootstrapping tablet: real 0.063s user 0.028s sys 0.008s
I20250625 03:31:17.769760 3287 raft_consensus.cc:357] T a1d83fca2b484feeaff6f350fe749b24 P df8b9755d156478aafca552f9e9c539e [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:31:17.770601 3287 raft_consensus.cc:738] T a1d83fca2b484feeaff6f350fe749b24 P df8b9755d156478aafca552f9e9c539e [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: df8b9755d156478aafca552f9e9c539e, State: Initialized, Role: LEARNER
I20250625 03:31:17.771237 3287 consensus_queue.cc:260] T a1d83fca2b484feeaff6f350fe749b24 P df8b9755d156478aafca552f9e9c539e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:31:17.764750 3292 ts_tablet_manager.cc:1428] T fd279ddcf72a40e1bf2ec42a4f35e639 P df8b9755d156478aafca552f9e9c539e: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20250625 03:31:17.787922 1755 tablet_copy_service.cc:342] P ba464e89e0f044a0a0ea3e6125cbf2a1: Request end of tablet copy session df8b9755d156478aafca552f9e9c539e-fd279ddcf72a40e1bf2ec42a4f35e639 received from {username='slave'} at 127.0.0.1:39774
I20250625 03:31:17.788398 1755 tablet_copy_service.cc:434] P ba464e89e0f044a0a0ea3e6125cbf2a1: ending tablet copy session df8b9755d156478aafca552f9e9c539e-fd279ddcf72a40e1bf2ec42a4f35e639 on tablet fd279ddcf72a40e1bf2ec42a4f35e639 with peer df8b9755d156478aafca552f9e9c539e
I20250625 03:31:17.791867 3287 ts_tablet_manager.cc:1428] T a1d83fca2b484feeaff6f350fe749b24 P df8b9755d156478aafca552f9e9c539e: Time spent starting tablet: real 0.026s user 0.007s sys 0.001s
I20250625 03:31:17.795992 1680 tablet_copy_service.cc:342] P 3f2aa40978064c9e9983cf3745eed206: Request end of tablet copy session df8b9755d156478aafca552f9e9c539e-a1d83fca2b484feeaff6f350fe749b24 received from {username='slave'} at 127.0.0.1:55766
I20250625 03:31:17.796468 1680 tablet_copy_service.cc:434] P 3f2aa40978064c9e9983cf3745eed206: ending tablet copy session df8b9755d156478aafca552f9e9c539e-a1d83fca2b484feeaff6f350fe749b24 on tablet a1d83fca2b484feeaff6f350fe749b24 with peer df8b9755d156478aafca552f9e9c539e
I20250625 03:31:17.852103 3296 tablet_copy_client.cc:323] T e88f79ed06514e01a9bc48261a5acfbb P df8b9755d156478aafca552f9e9c539e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.106.129:39903
I20250625 03:31:17.856433 1606 tablet_copy_service.cc:140] P 7e9c4f2e01164f33b2e9034ed148398e: Received BeginTabletCopySession request for tablet e88f79ed06514e01a9bc48261a5acfbb from peer df8b9755d156478aafca552f9e9c539e ({username='slave'} at 127.0.0.1:44210)
I20250625 03:31:17.857075 1606 tablet_copy_service.cc:161] P 7e9c4f2e01164f33b2e9034ed148398e: Beginning new tablet copy session on tablet e88f79ed06514e01a9bc48261a5acfbb from peer df8b9755d156478aafca552f9e9c539e at {username='slave'} at 127.0.0.1:44210: session id = df8b9755d156478aafca552f9e9c539e-e88f79ed06514e01a9bc48261a5acfbb
I20250625 03:31:17.895277 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:31:17.994387 1587 raft_consensus.cc:1273] T dea2dcc26f144802a16f0884fdd99063 P 7e9c4f2e01164f33b2e9034ed148398e [term 3 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250625 03:31:18.011022 3299 consensus_queue.cc:1035] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20250625 03:31:18.026026 1606 tablet_copy_source_session.cc:215] T e88f79ed06514e01a9bc48261a5acfbb P 7e9c4f2e01164f33b2e9034ed148398e: Tablet Copy: opened 0 blocks and 1 log segments
I20250625 03:31:18.029702 1669 raft_consensus.cc:1273] T dea2dcc26f144802a16f0884fdd99063 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250625 03:31:18.033196 3299 consensus_queue.cc:1035] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:31:18.054695 3296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e88f79ed06514e01a9bc48261a5acfbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:18.073119 2345 raft_consensus.cc:1215] T a1d83fca2b484feeaff6f350fe749b24 P df8b9755d156478aafca552f9e9c539e [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3] Dedup: 2.3->[]
W20250625 03:31:18.077097 2308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.131:39359, user_credentials={real_user=slave}} blocked reactor thread for 79403.1us
I20250625 03:31:18.228340 2341 raft_consensus.cc:1215] T f957bf9749c54be48094092cb80e9055 P df8b9755d156478aafca552f9e9c539e [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2] Dedup: 2.2->[]
W20250625 03:31:18.259783 1636 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.131:39359, user_credentials={real_user=slave}} blocked reactor thread for 155908us
I20250625 03:31:18.261123 2341 raft_consensus.cc:1215] T fd279ddcf72a40e1bf2ec42a4f35e639 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
W20250625 03:31:18.350297 1708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.130:34293, user_credentials={real_user=slave}} blocked reactor thread for 50284.1us
I20250625 03:31:18.359165 3296 tablet_copy_client.cc:806] T e88f79ed06514e01a9bc48261a5acfbb P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 0 data blocks...
W20250625 03:31:18.359491 1709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:39903, user_credentials={real_user=slave}} blocked reactor thread for 77325.2us
I20250625 03:31:18.360168 3296 tablet_copy_client.cc:670] T e88f79ed06514e01a9bc48261a5acfbb P df8b9755d156478aafca552f9e9c539e: tablet copy: Starting download of 1 WAL segments...
I20250625 03:31:18.381705 3296 tablet_copy_client.cc:538] T e88f79ed06514e01a9bc48261a5acfbb P df8b9755d156478aafca552f9e9c539e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250625 03:31:18.409970 3296 tablet_bootstrap.cc:492] T e88f79ed06514e01a9bc48261a5acfbb P df8b9755d156478aafca552f9e9c539e: Bootstrap starting.
I20250625 03:31:18.435060 1741 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "dea2dcc26f144802a16f0884fdd99063"
dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
mode: GRACEFUL
new_leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
from {username='slave'} at 127.0.0.1:47496
I20250625 03:31:18.435974 1741 raft_consensus.cc:604] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 LEADER]: Received request to transfer leadership to TS 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:31:18.437263 3296 tablet_bootstrap.cc:492] T e88f79ed06514e01a9bc48261a5acfbb P df8b9755d156478aafca552f9e9c539e: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:31:18.437888 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 1
I20250625 03:31:18.438346 3296 tablet_bootstrap.cc:492] T e88f79ed06514e01a9bc48261a5acfbb P df8b9755d156478aafca552f9e9c539e: Bootstrap complete.
I20250625 03:31:18.439159 3296 ts_tablet_manager.cc:1397] T e88f79ed06514e01a9bc48261a5acfbb P df8b9755d156478aafca552f9e9c539e: Time spent bootstrapping tablet: real 0.029s user 0.020s sys 0.006s
I20250625 03:31:18.439702 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:31:18.440894 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:31:18.442529 3296 raft_consensus.cc:357] T e88f79ed06514e01a9bc48261a5acfbb P df8b9755d156478aafca552f9e9c539e [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:31:18.443280 3296 raft_consensus.cc:738] T e88f79ed06514e01a9bc48261a5acfbb P df8b9755d156478aafca552f9e9c539e [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: df8b9755d156478aafca552f9e9c539e, State: Initialized, Role: LEARNER
I20250625 03:31:18.443935 3296 consensus_queue.cc:260] T e88f79ed06514e01a9bc48261a5acfbb P df8b9755d156478aafca552f9e9c539e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: NON_VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: true } }
I20250625 03:31:18.448669 3296 ts_tablet_manager.cc:1428] T e88f79ed06514e01a9bc48261a5acfbb P df8b9755d156478aafca552f9e9c539e: Time spent starting tablet: real 0.009s user 0.006s sys 0.001s
I20250625 03:31:18.457368 1606 tablet_copy_service.cc:342] P 7e9c4f2e01164f33b2e9034ed148398e: Request end of tablet copy session df8b9755d156478aafca552f9e9c539e-e88f79ed06514e01a9bc48261a5acfbb received from {username='slave'} at 127.0.0.1:44210
I20250625 03:31:18.457825 1606 tablet_copy_service.cc:434] P 7e9c4f2e01164f33b2e9034ed148398e: ending tablet copy session df8b9755d156478aafca552f9e9c539e-e88f79ed06514e01a9bc48261a5acfbb on tablet e88f79ed06514e01a9bc48261a5acfbb with peer df8b9755d156478aafca552f9e9c539e
I20250625 03:31:18.473205 3279 raft_consensus.cc:1062] T a1d83fca2b484feeaff6f350fe749b24 P 3f2aa40978064c9e9983cf3745eed206: attempting to promote NON_VOTER df8b9755d156478aafca552f9e9c539e to VOTER
I20250625 03:31:18.481089 3279 consensus_queue.cc:237] T a1d83fca2b484feeaff6f350fe749b24 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:18.492159 2341 raft_consensus.cc:1273] T a1d83fca2b484feeaff6f350fe749b24 P df8b9755d156478aafca552f9e9c539e [term 2 LEARNER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20250625 03:31:18.495465 3305 consensus_queue.cc:1035] T a1d83fca2b484feeaff6f350fe749b24 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20250625 03:31:18.506672 1596 raft_consensus.cc:1273] T a1d83fca2b484feeaff6f350fe749b24 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20250625 03:31:18.506942 1744 raft_consensus.cc:1273] T a1d83fca2b484feeaff6f350fe749b24 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20250625 03:31:18.510583 3305 consensus_queue.cc:1035] T a1d83fca2b484feeaff6f350fe749b24 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:31:18.513974 3305 consensus_queue.cc:1035] T a1d83fca2b484feeaff6f350fe749b24 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20250625 03:31:18.547755 1741 raft_consensus.cc:2953] T a1d83fca2b484feeaff6f350fe749b24 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:18.538404 3279 raft_consensus.cc:2953] T a1d83fca2b484feeaff6f350fe749b24 P 3f2aa40978064c9e9983cf3745eed206 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:18.591005 2341 raft_consensus.cc:2953] T a1d83fca2b484feeaff6f350fe749b24 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:18.604916 1491 catalog_manager.cc:5582] T a1d83fca2b484feeaff6f350fe749b24 P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: config changed from index 3 to 4, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:18.630122 1596 raft_consensus.cc:2953] T a1d83fca2b484feeaff6f350fe749b24 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:18.635238 3304 raft_consensus.cc:1062] T f957bf9749c54be48094092cb80e9055 P 7e9c4f2e01164f33b2e9034ed148398e: attempting to promote NON_VOTER df8b9755d156478aafca552f9e9c539e to VOTER
I20250625 03:31:18.646786 3304 consensus_queue.cc:237] T f957bf9749c54be48094092cb80e9055 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:18.685060 2343 raft_consensus.cc:1273] T f957bf9749c54be48094092cb80e9055 P df8b9755d156478aafca552f9e9c539e [term 2 LEARNER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20250625 03:31:18.683928 1741 raft_consensus.cc:1273] T f957bf9749c54be48094092cb80e9055 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20250625 03:31:18.686731 3242 consensus_queue.cc:1035] T f957bf9749c54be48094092cb80e9055 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20250625 03:31:18.688845 3242 consensus_queue.cc:1035] T f957bf9749c54be48094092cb80e9055 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:31:18.705622 1671 raft_consensus.cc:1273] T f957bf9749c54be48094092cb80e9055 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20250625 03:31:18.710480 3304 consensus_queue.cc:1035] T f957bf9749c54be48094092cb80e9055 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:31:18.714203 3299 raft_consensus.cc:991] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1: : Instructing follower 7e9c4f2e01164f33b2e9034ed148398e to start an election
I20250625 03:31:18.714707 3299 raft_consensus.cc:1079] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 LEADER]: Signalling peer 7e9c4f2e01164f33b2e9034ed148398e to start an election
I20250625 03:31:18.714362 1667 consensus_queue.cc:237] T a1d83fca2b484feeaff6f350fe749b24 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:18.716708 1591 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "dea2dcc26f144802a16f0884fdd99063"
dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
from {username='slave'} at 127.0.0.1:52726
I20250625 03:31:18.717258 1591 raft_consensus.cc:491] T dea2dcc26f144802a16f0884fdd99063 P 7e9c4f2e01164f33b2e9034ed148398e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:31:18.717612 1591 raft_consensus.cc:3058] T dea2dcc26f144802a16f0884fdd99063 P 7e9c4f2e01164f33b2e9034ed148398e [term 3 FOLLOWER]: Advancing to term 4
I20250625 03:31:18.723402 2345 raft_consensus.cc:1273] T a1d83fca2b484feeaff6f350fe749b24 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250625 03:31:18.725471 1737 raft_consensus.cc:1273] T a1d83fca2b484feeaff6f350fe749b24 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250625 03:31:18.725250 3279 consensus_queue.cc:1035] T a1d83fca2b484feeaff6f350fe749b24 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250625 03:31:18.726991 3305 consensus_queue.cc:1035] T a1d83fca2b484feeaff6f350fe749b24 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250625 03:31:18.730388 1591 raft_consensus.cc:513] T dea2dcc26f144802a16f0884fdd99063 P 7e9c4f2e01164f33b2e9034ed148398e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:18.743742 1671 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dea2dcc26f144802a16f0884fdd99063" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:31:18.744436 1671 raft_consensus.cc:3058] T dea2dcc26f144802a16f0884fdd99063 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Advancing to term 4
I20250625 03:31:18.745102 3308 raft_consensus.cc:2953] T a1d83fca2b484feeaff6f350fe749b24 P 3f2aa40978064c9e9983cf3745eed206 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:18.751287 2341 raft_consensus.cc:2953] T a1d83fca2b484feeaff6f350fe749b24 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:18.757743 1741 raft_consensus.cc:2953] T a1d83fca2b484feeaff6f350fe749b24 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:18.758744 1671 raft_consensus.cc:2466] T dea2dcc26f144802a16f0884fdd99063 P 3f2aa40978064c9e9983cf3745eed206 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 4.
I20250625 03:31:18.768573 1667 raft_consensus.cc:1238] T dea2dcc26f144802a16f0884fdd99063 P 3f2aa40978064c9e9983cf3745eed206 [term 4 FOLLOWER]: Rejecting Update request from peer ba464e89e0f044a0a0ea3e6125cbf2a1 for earlier term 3. Current term is 4. Ops: []
I20250625 03:31:18.771252 3311 consensus_queue.cc:1046] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20250625 03:31:18.759500 1591 leader_election.cc:290] T dea2dcc26f144802a16f0884fdd99063 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 4 election: Requested vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:31:18.772529 3313 raft_consensus.cc:3053] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 LEADER]: Stepping down as leader of term 3
I20250625 03:31:18.760613 1744 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dea2dcc26f144802a16f0884fdd99063" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:31:18.772959 3313 raft_consensus.cc:738] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Running, Role: LEADER
W20250625 03:31:18.760821 3322 log.cc:927] Time spent T f957bf9749c54be48094092cb80e9055 P 7e9c4f2e01164f33b2e9034ed148398e: Append to log took a long time: real 0.081s user 0.001s sys 0.000s
I20250625 03:31:18.773792 3313 consensus_queue.cc:260] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:18.775009 3313 raft_consensus.cc:3058] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Advancing to term 4
I20250625 03:31:18.774367 3242 raft_consensus.cc:2953] T f957bf9749c54be48094092cb80e9055 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:18.781229 1559 leader_election.cc:304] T dea2dcc26f144802a16f0884fdd99063 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e; no voters:
I20250625 03:31:18.782733 3300 raft_consensus.cc:2802] T dea2dcc26f144802a16f0884fdd99063 P 7e9c4f2e01164f33b2e9034ed148398e [term 4 FOLLOWER]: Leader election won for term 4
I20250625 03:31:18.783212 3300 raft_consensus.cc:695] T dea2dcc26f144802a16f0884fdd99063 P 7e9c4f2e01164f33b2e9034ed148398e [term 4 LEADER]: Becoming Leader. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Running, Role: LEADER
I20250625 03:31:18.784094 3300 consensus_queue.cc:237] T dea2dcc26f144802a16f0884fdd99063 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:18.793135 1490 catalog_manager.cc:5582] T a1d83fca2b484feeaff6f350fe749b24 P df8b9755d156478aafca552f9e9c539e reported cstate change: config changed from index 4 to 5, VOTER 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) evicted. New cstate: current_term: 2 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:18.793728 2341 raft_consensus.cc:2953] T f957bf9749c54be48094092cb80e9055 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:18.805035 1671 raft_consensus.cc:2953] T f957bf9749c54be48094092cb80e9055 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:18.810469 1478 catalog_manager.cc:5095] ChangeConfig:REMOVE_PEER RPC for tablet a1d83fca2b484feeaff6f350fe749b24 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250625 03:31:18.812095 1491 catalog_manager.cc:5582] T dea2dcc26f144802a16f0884fdd99063 P 7e9c4f2e01164f33b2e9034ed148398e reported cstate change: term changed from 3 to 4, leader changed from ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) to 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129). New cstate: current_term: 4 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:18.813757 1491 catalog_manager.cc:5582] T f957bf9749c54be48094092cb80e9055 P 7e9c4f2e01164f33b2e9034ed148398e reported cstate change: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250625 03:31:18.823638 3312 raft_consensus.cc:1062] T fd279ddcf72a40e1bf2ec42a4f35e639 P ba464e89e0f044a0a0ea3e6125cbf2a1: attempting to promote NON_VOTER df8b9755d156478aafca552f9e9c539e to VOTER
I20250625 03:31:18.838258 1744 raft_consensus.cc:2466] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 4.
I20250625 03:31:18.842505 3312 consensus_queue.cc:237] T fd279ddcf72a40e1bf2ec42a4f35e639 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:18.847242 1741 raft_consensus.cc:2953] T f957bf9749c54be48094092cb80e9055 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:18.862221 1582 tablet_service.cc:1515] Processing DeleteTablet for tablet a1d83fca2b484feeaff6f350fe749b24 with delete_type TABLET_DATA_TOMBSTONED (TS 7e9c4f2e01164f33b2e9034ed148398e not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:52712
I20250625 03:31:18.865258 3330 tablet_replica.cc:331] T a1d83fca2b484feeaff6f350fe749b24 P 7e9c4f2e01164f33b2e9034ed148398e: stopping tablet replica
I20250625 03:31:18.866938 3330 raft_consensus.cc:2241] T a1d83fca2b484feeaff6f350fe749b24 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:18.909444 3330 raft_consensus.cc:2270] T a1d83fca2b484feeaff6f350fe749b24 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:18.916106 1671 raft_consensus.cc:1273] T fd279ddcf72a40e1bf2ec42a4f35e639 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:31:18.927029 1596 raft_consensus.cc:1273] T fd279ddcf72a40e1bf2ec42a4f35e639 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:31:18.930887 2341 raft_consensus.cc:1215] T e88f79ed06514e01a9bc48261a5acfbb P df8b9755d156478aafca552f9e9c539e [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3] Dedup: 2.3->[]
I20250625 03:31:18.932772 3313 consensus_queue.cc:1035] T fd279ddcf72a40e1bf2ec42a4f35e639 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20250625 03:31:18.944778 1591 consensus_queue.cc:237] T f957bf9749c54be48094092cb80e9055 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:18.945828 3330 ts_tablet_manager.cc:1905] T a1d83fca2b484feeaff6f350fe749b24 P 7e9c4f2e01164f33b2e9034ed148398e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250625 03:31:18.947222 3311 consensus_queue.cc:1035] T fd279ddcf72a40e1bf2ec42a4f35e639 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:31:18.970170 2341 raft_consensus.cc:1273] T f957bf9749c54be48094092cb80e9055 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20250625 03:31:18.971408 1671 raft_consensus.cc:1273] T f957bf9749c54be48094092cb80e9055 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20250625 03:31:18.971674 3304 consensus_queue.cc:1035] T f957bf9749c54be48094092cb80e9055 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20250625 03:31:18.972918 3328 consensus_queue.cc:1035] T f957bf9749c54be48094092cb80e9055 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:31:18.975123 3330 ts_tablet_manager.cc:1918] T a1d83fca2b484feeaff6f350fe749b24 P 7e9c4f2e01164f33b2e9034ed148398e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20250625 03:31:18.975649 3330 log.cc:1199] T a1d83fca2b484feeaff6f350fe749b24 P 7e9c4f2e01164f33b2e9034ed148398e: Deleting WAL directory at /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/ts-0-root/wals/a1d83fca2b484feeaff6f350fe749b24
I20250625 03:31:18.997076 2345 raft_consensus.cc:1273] T fd279ddcf72a40e1bf2ec42a4f35e639 P df8b9755d156478aafca552f9e9c539e [term 1 LEARNER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250625 03:31:19.000803 1479 catalog_manager.cc:4928] TS 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): tablet a1d83fca2b484feeaff6f350fe749b24 (table test-workload [id=7f663eabec024fd1911b406c660fa838]) successfully deleted
I20250625 03:31:19.007316 3299 consensus_queue.cc:1035] T fd279ddcf72a40e1bf2ec42a4f35e639 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20250625 03:31:19.014784 3242 raft_consensus.cc:2953] T f957bf9749c54be48094092cb80e9055 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:19.022063 1669 raft_consensus.cc:2953] T fd279ddcf72a40e1bf2ec42a4f35e639 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:19.021760 2345 raft_consensus.cc:2953] T fd279ddcf72a40e1bf2ec42a4f35e639 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:19.019484 3332 raft_consensus.cc:2953] T fd279ddcf72a40e1bf2ec42a4f35e639 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:19.027172 1479 catalog_manager.cc:5095] ChangeConfig:REMOVE_PEER RPC for tablet f957bf9749c54be48094092cb80e9055 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250625 03:31:19.034435 1490 catalog_manager.cc:5582] T f957bf9749c54be48094092cb80e9055 P 7e9c4f2e01164f33b2e9034ed148398e reported cstate change: config changed from index 3 to 4, VOTER ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) evicted. New cstate: current_term: 2 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250625 03:31:19.026098 2341 raft_consensus.cc:2953] T f957bf9749c54be48094092cb80e9055 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:19.027359 1671 raft_consensus.cc:2953] T f957bf9749c54be48094092cb80e9055 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:19.047510 1732 tablet_service.cc:1515] Processing DeleteTablet for tablet f957bf9749c54be48094092cb80e9055 with delete_type TABLET_DATA_TOMBSTONED (TS ba464e89e0f044a0a0ea3e6125cbf2a1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43672
I20250625 03:31:19.066097 1492 catalog_manager.cc:5582] T fd279ddcf72a40e1bf2ec42a4f35e639 P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:19.076406 1587 raft_consensus.cc:2953] T fd279ddcf72a40e1bf2ec42a4f35e639 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } attrs { replace: true } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:19.075613 3337 tablet_replica.cc:331] T f957bf9749c54be48094092cb80e9055 P ba464e89e0f044a0a0ea3e6125cbf2a1: stopping tablet replica
I20250625 03:31:19.083189 3337 raft_consensus.cc:2241] T f957bf9749c54be48094092cb80e9055 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:19.083937 3337 raft_consensus.cc:2270] T f957bf9749c54be48094092cb80e9055 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:19.101909 3337 ts_tablet_manager.cc:1905] T f957bf9749c54be48094092cb80e9055 P ba464e89e0f044a0a0ea3e6125cbf2a1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250625 03:31:19.109469 1737 consensus_queue.cc:237] T fd279ddcf72a40e1bf2ec42a4f35e639 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:19.120790 3337 ts_tablet_manager.cc:1918] T f957bf9749c54be48094092cb80e9055 P ba464e89e0f044a0a0ea3e6125cbf2a1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20250625 03:31:19.121421 3337 log.cc:1199] T f957bf9749c54be48094092cb80e9055 P ba464e89e0f044a0a0ea3e6125cbf2a1: Deleting WAL directory at /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/ts-2-root/wals/f957bf9749c54be48094092cb80e9055
I20250625 03:31:19.124890 1480 catalog_manager.cc:4928] TS ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): tablet f957bf9749c54be48094092cb80e9055 (table test-workload [id=7f663eabec024fd1911b406c660fa838]) successfully deleted
I20250625 03:31:19.133391 2341 raft_consensus.cc:1273] T fd279ddcf72a40e1bf2ec42a4f35e639 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250625 03:31:19.134945 3332 consensus_queue.cc:1035] T fd279ddcf72a40e1bf2ec42a4f35e639 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:31:19.142292 3299 raft_consensus.cc:2953] T fd279ddcf72a40e1bf2ec42a4f35e639 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:19.149065 1669 raft_consensus.cc:1273] T fd279ddcf72a40e1bf2ec42a4f35e639 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250625 03:31:19.149032 2345 raft_consensus.cc:2953] T fd279ddcf72a40e1bf2ec42a4f35e639 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:19.150624 3332 consensus_queue.cc:1035] T fd279ddcf72a40e1bf2ec42a4f35e639 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:31:19.154553 1669 raft_consensus.cc:2953] T fd279ddcf72a40e1bf2ec42a4f35e639 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:19.156126 1480 catalog_manager.cc:5095] ChangeConfig:REMOVE_PEER RPC for tablet fd279ddcf72a40e1bf2ec42a4f35e639 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250625 03:31:19.167755 1491 catalog_manager.cc:5582] T fd279ddcf72a40e1bf2ec42a4f35e639 P df8b9755d156478aafca552f9e9c539e reported cstate change: config changed from index 3 to 4, VOTER 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) evicted. New cstate: current_term: 1 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:19.198642 1582 tablet_service.cc:1515] Processing DeleteTablet for tablet fd279ddcf72a40e1bf2ec42a4f35e639 with delete_type TABLET_DATA_TOMBSTONED (TS 7e9c4f2e01164f33b2e9034ed148398e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52712
I20250625 03:31:19.199632 3330 tablet_replica.cc:331] T fd279ddcf72a40e1bf2ec42a4f35e639 P 7e9c4f2e01164f33b2e9034ed148398e: stopping tablet replica
I20250625 03:31:19.214941 3330 raft_consensus.cc:2241] T fd279ddcf72a40e1bf2ec42a4f35e639 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:19.215641 3330 raft_consensus.cc:2270] T fd279ddcf72a40e1bf2ec42a4f35e639 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:19.219293 3330 ts_tablet_manager.cc:1905] T fd279ddcf72a40e1bf2ec42a4f35e639 P 7e9c4f2e01164f33b2e9034ed148398e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250625 03:31:19.241698 3330 ts_tablet_manager.cc:1918] T fd279ddcf72a40e1bf2ec42a4f35e639 P 7e9c4f2e01164f33b2e9034ed148398e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20250625 03:31:19.242116 3330 log.cc:1199] T fd279ddcf72a40e1bf2ec42a4f35e639 P 7e9c4f2e01164f33b2e9034ed148398e: Deleting WAL directory at /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/ts-0-root/wals/fd279ddcf72a40e1bf2ec42a4f35e639
I20250625 03:31:19.243798 1479 catalog_manager.cc:4928] TS 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): tablet fd279ddcf72a40e1bf2ec42a4f35e639 (table test-workload [id=7f663eabec024fd1911b406c660fa838]) successfully deleted
I20250625 03:31:19.267199 1669 raft_consensus.cc:1273] T dea2dcc26f144802a16f0884fdd99063 P 3f2aa40978064c9e9983cf3745eed206 [term 4 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20250625 03:31:19.268772 3328 consensus_queue.cc:1035] T dea2dcc26f144802a16f0884fdd99063 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:31:19.296608 1737 raft_consensus.cc:1273] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 4 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20250625 03:31:19.298261 3242 consensus_queue.cc:1035] T dea2dcc26f144802a16f0884fdd99063 P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:31:19.445307 3328 raft_consensus.cc:1062] T e88f79ed06514e01a9bc48261a5acfbb P 7e9c4f2e01164f33b2e9034ed148398e: attempting to promote NON_VOTER df8b9755d156478aafca552f9e9c539e to VOTER
I20250625 03:31:19.447428 3328 consensus_queue.cc:237] T e88f79ed06514e01a9bc48261a5acfbb P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:19.453451 2341 raft_consensus.cc:1273] T e88f79ed06514e01a9bc48261a5acfbb P df8b9755d156478aafca552f9e9c539e [term 2 LEARNER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20250625 03:31:19.454790 3304 consensus_queue.cc:1035] T e88f79ed06514e01a9bc48261a5acfbb P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:31:19.458024 1739 raft_consensus.cc:1273] T e88f79ed06514e01a9bc48261a5acfbb P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20250625 03:31:19.461200 1669 raft_consensus.cc:1273] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20250625 03:31:19.462536 3304 consensus_queue.cc:1035] T e88f79ed06514e01a9bc48261a5acfbb P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:31:19.464393 3304 consensus_queue.cc:1035] T e88f79ed06514e01a9bc48261a5acfbb P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:31:19.533035 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:31:19.533430 3328 raft_consensus.cc:2953] T e88f79ed06514e01a9bc48261a5acfbb P 7e9c4f2e01164f33b2e9034ed148398e [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:19.540705 1669 raft_consensus.cc:2953] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:19.551826 2341 raft_consensus.cc:2953] T e88f79ed06514e01a9bc48261a5acfbb P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:19.554067 1739 raft_consensus.cc:2953] T e88f79ed06514e01a9bc48261a5acfbb P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:19.583148 1490 catalog_manager.cc:5582] T e88f79ed06514e01a9bc48261a5acfbb P 7e9c4f2e01164f33b2e9034ed148398e reported cstate change: config changed from index 3 to 4, df8b9755d156478aafca552f9e9c539e (127.0.106.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250625 03:31:19.623628 1587 consensus_queue.cc:237] T e88f79ed06514e01a9bc48261a5acfbb P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:19.633571 2345 raft_consensus.cc:1273] T e88f79ed06514e01a9bc48261a5acfbb P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250625 03:31:19.634302 1671 raft_consensus.cc:1273] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Refusing update from remote peer 7e9c4f2e01164f33b2e9034ed148398e: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250625 03:31:19.637434 3304 consensus_queue.cc:1035] T e88f79ed06514e01a9bc48261a5acfbb P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250625 03:31:19.638489 3242 consensus_queue.cc:1035] T e88f79ed06514e01a9bc48261a5acfbb P 7e9c4f2e01164f33b2e9034ed148398e [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250625 03:31:19.649855 3242 raft_consensus.cc:2953] T e88f79ed06514e01a9bc48261a5acfbb P 7e9c4f2e01164f33b2e9034ed148398e [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:19.653618 2345 raft_consensus.cc:2953] T e88f79ed06514e01a9bc48261a5acfbb P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:19.657040 1671 raft_consensus.cc:2953] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } } }
I20250625 03:31:19.664099 1479 catalog_manager.cc:5095] ChangeConfig:REMOVE_PEER RPC for tablet e88f79ed06514e01a9bc48261a5acfbb with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250625 03:31:19.673521 1490 catalog_manager.cc:5582] T e88f79ed06514e01a9bc48261a5acfbb P 7e9c4f2e01164f33b2e9034ed148398e reported cstate change: config changed from index 4 to 5, VOTER ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131) evicted. New cstate: current_term: 2 leader_uuid: "7e9c4f2e01164f33b2e9034ed148398e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250625 03:31:19.686682 1732 tablet_service.cc:1515] Processing DeleteTablet for tablet e88f79ed06514e01a9bc48261a5acfbb with delete_type TABLET_DATA_TOMBSTONED (TS ba464e89e0f044a0a0ea3e6125cbf2a1 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:43672
I20250625 03:31:19.715488 3347 tablet_replica.cc:331] T e88f79ed06514e01a9bc48261a5acfbb P ba464e89e0f044a0a0ea3e6125cbf2a1: stopping tablet replica
I20250625 03:31:19.716652 3347 raft_consensus.cc:2241] T e88f79ed06514e01a9bc48261a5acfbb P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:19.718142 3347 raft_consensus.cc:2270] T e88f79ed06514e01a9bc48261a5acfbb P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:19.722154 1591 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "3037be35f2054cbbabd8a47062f84244"
dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
mode: GRACEFUL
new_leader_uuid: "df8b9755d156478aafca552f9e9c539e"
from {username='slave'} at 127.0.0.1:47018
I20250625 03:31:19.722457 3347 ts_tablet_manager.cc:1905] T e88f79ed06514e01a9bc48261a5acfbb P ba464e89e0f044a0a0ea3e6125cbf2a1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250625 03:31:19.724546 1591 raft_consensus.cc:604] T 3037be35f2054cbbabd8a47062f84244 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 LEADER]: Received request to transfer leadership to TS df8b9755d156478aafca552f9e9c539e
I20250625 03:31:19.726037 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 1
I20250625 03:31:19.727723 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:31:19.728497 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:31:19.738790 3304 raft_consensus.cc:991] T 3037be35f2054cbbabd8a47062f84244 P 7e9c4f2e01164f33b2e9034ed148398e: : Instructing follower df8b9755d156478aafca552f9e9c539e to start an election
I20250625 03:31:19.739383 3304 raft_consensus.cc:1079] T 3037be35f2054cbbabd8a47062f84244 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 LEADER]: Signalling peer df8b9755d156478aafca552f9e9c539e to start an election
I20250625 03:31:19.741441 2345 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "3037be35f2054cbbabd8a47062f84244"
dest_uuid: "df8b9755d156478aafca552f9e9c539e"
from {username='slave'} at 127.0.0.1:54676
I20250625 03:31:19.742010 2345 raft_consensus.cc:491] T 3037be35f2054cbbabd8a47062f84244 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:31:19.742357 2345 raft_consensus.cc:3058] T 3037be35f2054cbbabd8a47062f84244 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:19.747431 3347 ts_tablet_manager.cc:1918] T e88f79ed06514e01a9bc48261a5acfbb P ba464e89e0f044a0a0ea3e6125cbf2a1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20250625 03:31:19.748160 3347 log.cc:1199] T e88f79ed06514e01a9bc48261a5acfbb P ba464e89e0f044a0a0ea3e6125cbf2a1: Deleting WAL directory at /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1750822166717217-426-0/minicluster-data/ts-2-root/wals/e88f79ed06514e01a9bc48261a5acfbb
I20250625 03:31:19.749190 2345 raft_consensus.cc:513] T 3037be35f2054cbbabd8a47062f84244 P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:19.750056 1480 catalog_manager.cc:4928] TS ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): tablet e88f79ed06514e01a9bc48261a5acfbb (table test-workload [id=7f663eabec024fd1911b406c660fa838]) successfully deleted
I20250625 03:31:19.752393 1591 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3037be35f2054cbbabd8a47062f84244" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
I20250625 03:31:19.752975 1591 raft_consensus.cc:3053] T 3037be35f2054cbbabd8a47062f84244 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 LEADER]: Stepping down as leader of term 2
I20250625 03:31:19.753299 1591 raft_consensus.cc:738] T 3037be35f2054cbbabd8a47062f84244 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7e9c4f2e01164f33b2e9034ed148398e, State: Running, Role: LEADER
I20250625 03:31:19.757359 1591 consensus_queue.cc:260] T 3037be35f2054cbbabd8a47062f84244 P 7e9c4f2e01164f33b2e9034ed148398e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:19.758445 1591 raft_consensus.cc:3058] T 3037be35f2054cbbabd8a47062f84244 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:19.774713 1665 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3037be35f2054cbbabd8a47062f84244" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:31:19.775244 1665 raft_consensus.cc:3058] T 3037be35f2054cbbabd8a47062f84244 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:19.782433 1665 raft_consensus.cc:2466] T 3037be35f2054cbbabd8a47062f84244 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df8b9755d156478aafca552f9e9c539e in term 3.
I20250625 03:31:19.783629 2306 leader_election.cc:304] T 3037be35f2054cbbabd8a47062f84244 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, df8b9755d156478aafca552f9e9c539e; no voters:
I20250625 03:31:19.784541 3262 raft_consensus.cc:2802] T 3037be35f2054cbbabd8a47062f84244 P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Leader election won for term 3
I20250625 03:31:19.785039 3262 raft_consensus.cc:695] T 3037be35f2054cbbabd8a47062f84244 P df8b9755d156478aafca552f9e9c539e [term 3 LEADER]: Becoming Leader. State: Replica: df8b9755d156478aafca552f9e9c539e, State: Running, Role: LEADER
I20250625 03:31:19.785881 3262 consensus_queue.cc:237] T 3037be35f2054cbbabd8a47062f84244 P df8b9755d156478aafca552f9e9c539e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:19.784283 2345 leader_election.cc:290] T 3037be35f2054cbbabd8a47062f84244 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 3 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:31:19.803901 1591 raft_consensus.cc:2466] T 3037be35f2054cbbabd8a47062f84244 P 7e9c4f2e01164f33b2e9034ed148398e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df8b9755d156478aafca552f9e9c539e in term 3.
I20250625 03:31:19.808483 1490 catalog_manager.cc:5582] T 3037be35f2054cbbabd8a47062f84244 P df8b9755d156478aafca552f9e9c539e reported cstate change: term changed from 2 to 3, leader changed from 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) to df8b9755d156478aafca552f9e9c539e (127.0.106.132). New cstate: current_term: 3 leader_uuid: "df8b9755d156478aafca552f9e9c539e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20250625 03:31:20.076332 2306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.130:34293, user_credentials={real_user=slave}} blocked reactor thread for 103457us
W20250625 03:31:20.124584 2308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.131:39359, user_credentials={real_user=slave}} blocked reactor thread for 160705us
I20250625 03:31:20.981509 3354 raft_consensus.cc:491] T fb6e83db706647e28e491a02f1641980 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader df8b9755d156478aafca552f9e9c539e)
I20250625 03:31:20.982230 3354 raft_consensus.cc:513] T fb6e83db706647e28e491a02f1641980 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:20.985455 3352 raft_consensus.cc:491] T 390aa72f98414be291f01e4e4fec77f1 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader df8b9755d156478aafca552f9e9c539e)
I20250625 03:31:20.986019 3354 leader_election.cc:290] T fb6e83db706647e28e491a02f1641980 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359), df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493)
I20250625 03:31:20.986096 3352 raft_consensus.cc:513] T 390aa72f98414be291f01e4e4fec77f1 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:21.012609 3356 raft_consensus.cc:491] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7e9c4f2e01164f33b2e9034ed148398e)
I20250625 03:31:21.013149 3311 raft_consensus.cc:491] T df29d87d804d44438345052a5902052f P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e9c4f2e01164f33b2e9034ed148398e)
I20250625 03:31:21.029404 3353 raft_consensus.cc:491] T 59ac1803c12d43448ef566f886cc22e6 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7e9c4f2e01164f33b2e9034ed148398e)
I20250625 03:31:21.029513 3311 raft_consensus.cc:513] T df29d87d804d44438345052a5902052f P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:21.030129 3353 raft_consensus.cc:513] T 59ac1803c12d43448ef566f886cc22e6 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:21.035305 3361 raft_consensus.cc:491] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader df8b9755d156478aafca552f9e9c539e)
I20250625 03:31:21.035825 3361 raft_consensus.cc:513] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:21.037817 3361 leader_election.cc:290] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359), df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493)
I20250625 03:31:21.041055 3311 leader_election.cc:290] T df29d87d804d44438345052a5902052f P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493)
I20250625 03:31:21.041683 3362 raft_consensus.cc:491] T d50c52b197294003b238a37da2fb55d8 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f2aa40978064c9e9983cf3745eed206)
I20250625 03:31:21.042248 3362 raft_consensus.cc:513] T d50c52b197294003b238a37da2fb55d8 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:21.030645 3359 raft_consensus.cc:491] T f8c715109ff0405997e1ca9952678c0d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3f2aa40978064c9e9983cf3745eed206)
I20250625 03:31:21.044569 3359 raft_consensus.cc:513] T f8c715109ff0405997e1ca9952678c0d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:21.046558 3359 leader_election.cc:290] T f8c715109ff0405997e1ca9952678c0d P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:31:21.048070 3353 leader_election.cc:290] T 59ac1803c12d43448ef566f886cc22e6 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:31:21.013221 3356 raft_consensus.cc:513] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:21.054220 3356 leader_election.cc:290] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:31:21.055060 3362 leader_election.cc:290] T d50c52b197294003b238a37da2fb55d8 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493)
I20250625 03:31:21.029657 3352 leader_election.cc:290] T 390aa72f98414be291f01e4e4fec77f1 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493)
W20250625 03:31:21.060099 2308 thread.cc:640] raft [worker] (thread pool) Time spent creating pthread: real 0.933s user 0.018s sys 0.009s
W20250625 03:31:21.060631 2308 thread.cc:606] raft [worker] (thread pool) Time spent starting thread: real 0.934s user 0.018s sys 0.009s
I20250625 03:31:21.060740 3352 raft_consensus.cc:491] T f8c715109ff0405997e1ca9952678c0d P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3f2aa40978064c9e9983cf3745eed206)
I20250625 03:31:21.061328 3352 raft_consensus.cc:513] T f8c715109ff0405997e1ca9952678c0d P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:21.063205 3352 leader_election.cc:290] T f8c715109ff0405997e1ca9952678c0d P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:31:21.065104 3356 raft_consensus.cc:491] T e58b1ae66ee14c6f8d6f2db8dda2b842 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader df8b9755d156478aafca552f9e9c539e)
I20250625 03:31:21.065963 3356 raft_consensus.cc:513] T e58b1ae66ee14c6f8d6f2db8dda2b842 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:21.067040 3364 raft_consensus.cc:491] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f2aa40978064c9e9983cf3745eed206)
I20250625 03:31:21.067618 3364 raft_consensus.cc:513] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:21.068351 3356 leader_election.cc:290] T e58b1ae66ee14c6f8d6f2db8dda2b842 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493)
I20250625 03:31:21.069692 3364 leader_election.cc:290] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493)
I20250625 03:31:21.074285 3363 raft_consensus.cc:491] T 9943bb8023444f49a11df01d93738f1e P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f2aa40978064c9e9983cf3745eed206)
I20250625 03:31:21.074810 3363 raft_consensus.cc:513] T 9943bb8023444f49a11df01d93738f1e P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:21.075974 3353 raft_consensus.cc:491] T e38dc50880914156805b07aa82e30863 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ba464e89e0f044a0a0ea3e6125cbf2a1)
I20250625 03:31:21.076452 3363 leader_election.cc:290] T 9943bb8023444f49a11df01d93738f1e P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:31:21.076575 3353 raft_consensus.cc:513] T e38dc50880914156805b07aa82e30863 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:21.078570 3353 leader_election.cc:290] T e38dc50880914156805b07aa82e30863 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359), df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493)
I20250625 03:31:21.082151 2339 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "390aa72f98414be291f01e4e4fec77f1" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "df8b9755d156478aafca552f9e9c539e" is_pre_election: true
I20250625 03:31:21.084278 3332 raft_consensus.cc:491] T 9643cfd400804eb8b9037c5e9efddfba P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader df8b9755d156478aafca552f9e9c539e)
I20250625 03:31:21.084498 2340 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3c2c045dee4b4b4faa93fa9d0ccdaa1c" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "df8b9755d156478aafca552f9e9c539e" is_pre_election: true
I20250625 03:31:21.084903 3332 raft_consensus.cc:513] T 9643cfd400804eb8b9037c5e9efddfba P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:21.086834 3332 leader_election.cc:290] T 9643cfd400804eb8b9037c5e9efddfba P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493)
I20250625 03:31:21.088331 2341 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e58b1ae66ee14c6f8d6f2db8dda2b842" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "df8b9755d156478aafca552f9e9c539e" is_pre_election: true
I20250625 03:31:21.089246 2342 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fb6e83db706647e28e491a02f1641980" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "df8b9755d156478aafca552f9e9c539e" is_pre_election: true
I20250625 03:31:21.087689 2338 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d50c52b197294003b238a37da2fb55d8" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "df8b9755d156478aafca552f9e9c539e" is_pre_election: true
I20250625 03:31:21.089869 1744 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fb6e83db706647e28e491a02f1641980" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:31:21.090131 1737 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "59ac1803c12d43448ef566f886cc22e6" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:31:21.092941 1741 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e38dc50880914156805b07aa82e30863" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:31:21.094753 1741 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e58b1ae66ee14c6f8d6f2db8dda2b842" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:31:21.095325 1741 raft_consensus.cc:2466] T e58b1ae66ee14c6f8d6f2db8dda2b842 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 2.
I20250625 03:31:21.099934 3333 raft_consensus.cc:491] T f957bf9749c54be48094092cb80e9055 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7e9c4f2e01164f33b2e9034ed148398e)
I20250625 03:31:21.100555 1739 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f8c715109ff0405997e1ca9952678c0d" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:31:21.101174 1739 raft_consensus.cc:2466] T f8c715109ff0405997e1ca9952678c0d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e9c4f2e01164f33b2e9034ed148398e in term 2.
I20250625 03:31:21.100557 3333 raft_consensus.cc:513] T f957bf9749c54be48094092cb80e9055 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:21.104899 3333 leader_election.cc:290] T f957bf9749c54be48094092cb80e9055 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:31:21.110117 1744 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9943bb8023444f49a11df01d93738f1e" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:31:21.111145 1561 leader_election.cc:304] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters:
I20250625 03:31:21.111670 3352 raft_consensus.cc:491] T 1fff19a38e8d4880a14da6b4c8284cc2 P 7e9c4f2e01164f33b2e9034ed148398e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ba464e89e0f044a0a0ea3e6125cbf2a1)
I20250625 03:31:21.111864 3300 raft_consensus.cc:2802] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20250625 03:31:21.108266 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:31:21.112277 3300 raft_consensus.cc:491] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Starting leader election (detected failure of leader df8b9755d156478aafca552f9e9c539e)
I20250625 03:31:21.112236 3352 raft_consensus.cc:513] T 1fff19a38e8d4880a14da6b4c8284cc2 P 7e9c4f2e01164f33b2e9034ed148398e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } }
I20250625 03:31:21.112890 3300 raft_consensus.cc:3058] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:21.116173 3352 leader_election.cc:290] T 1fff19a38e8d4880a14da6b4c8284cc2 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:31:21.121189 1561 leader_election.cc:304] T f8c715109ff0405997e1ca9952678c0d P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters:
I20250625 03:31:21.130868 1587 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "df29d87d804d44438345052a5902052f" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:31:21.132216 1596 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f8c715109ff0405997e1ca9952678c0d" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:31:21.132833 1596 raft_consensus.cc:2466] T f8c715109ff0405997e1ca9952678c0d P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 2.
I20250625 03:31:21.133773 1592 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dea2dcc26f144802a16f0884fdd99063" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:31:21.134645 3300 raft_consensus.cc:513] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:21.135061 1590 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e58b1ae66ee14c6f8d6f2db8dda2b842" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:31:21.135847 1590 raft_consensus.cc:2391] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in current term 3: Already voted for candidate 7e9c4f2e01164f33b2e9034ed148398e in this term.
I20250625 03:31:21.137856 3300 leader_election.cc:290] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 3 election: Requested vote from peers ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359), df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493)
I20250625 03:31:21.134686 3305 raft_consensus.cc:491] T cc3b100d6d574a68b79e6a8f23d77201 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7e9c4f2e01164f33b2e9034ed148398e)
W20250625 03:31:21.145166 1617 debug-util.cc:398] Leaking SignalData structure 0x7b08000d1640 after lost signal to thread 429
I20250625 03:31:21.145640 3305 raft_consensus.cc:513] T cc3b100d6d574a68b79e6a8f23d77201 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:21.148214 3305 leader_election.cc:290] T cc3b100d6d574a68b79e6a8f23d77201 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493)
I20250625 03:31:21.164855 3303 raft_consensus.cc:491] T a1d83fca2b484feeaff6f350fe749b24 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3f2aa40978064c9e9983cf3745eed206)
W20250625 03:31:21.165505 1617 debug-util.cc:398] Leaking SignalData structure 0x7b0800179820 after lost signal to thread 1528
I20250625 03:31:21.165472 3303 raft_consensus.cc:513] T a1d83fca2b484feeaff6f350fe749b24 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:21.166340 1709 leader_election.cc:304] T f8c715109ff0405997e1ca9952678c0d P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters:
I20250625 03:31:21.167165 3311 raft_consensus.cc:2802] T f8c715109ff0405997e1ca9952678c0d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20250625 03:31:21.167878 3311 raft_consensus.cc:491] T f8c715109ff0405997e1ca9952678c0d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3f2aa40978064c9e9983cf3745eed206)
I20250625 03:31:21.168594 3303 leader_election.cc:290] T a1d83fca2b484feeaff6f350fe749b24 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:31:21.185786 1559 leader_election.cc:304] T fb6e83db706647e28e491a02f1641980 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e; no voters: ba464e89e0f044a0a0ea3e6125cbf2a1, df8b9755d156478aafca552f9e9c539e
I20250625 03:31:21.173519 1590 raft_consensus.cc:1238] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e [term 3 FOLLOWER]: Rejecting Update request from peer df8b9755d156478aafca552f9e9c539e for earlier term 2. Current term is 3. Ops: []
I20250625 03:31:21.185400 3308 raft_consensus.cc:491] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader df8b9755d156478aafca552f9e9c539e)
I20250625 03:31:21.186916 3242 raft_consensus.cc:2747] T fb6e83db706647e28e491a02f1641980 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20250625 03:31:21.178664 1592 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f957bf9749c54be48094092cb80e9055" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:31:21.181813 3304 raft_consensus.cc:491] T 0e7eb287e9514c838aeed599d2703682 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba464e89e0f044a0a0ea3e6125cbf2a1)
W20250625 03:31:21.184144 1617 debug-util.cc:398] Leaking SignalData structure 0x7b08002e6d80 after lost signal to thread 1620
I20250625 03:31:21.187669 3311 raft_consensus.cc:3058] T f8c715109ff0405997e1ca9952678c0d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:21.187767 3304 raft_consensus.cc:513] T 0e7eb287e9514c838aeed599d2703682 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:21.187206 3308 raft_consensus.cc:513] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
W20250625 03:31:21.188524 1617 debug-util.cc:398] Leaking SignalData structure 0x7b0800399e40 after lost signal to thread 1695
W20250625 03:31:21.189606 1617 debug-util.cc:398] Leaking SignalData structure 0x7b0800289200 after lost signal to thread 1769
I20250625 03:31:21.189865 3304 leader_election.cc:290] T 0e7eb287e9514c838aeed599d2703682 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
W20250625 03:31:21.190696 1617 debug-util.cc:398] Leaking SignalData structure 0x7b080035e080 after lost signal to thread 2369
I20250625 03:31:21.185389 3238 raft_consensus.cc:491] T add8a729ea684e7eab256135c01309df P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7e9c4f2e01164f33b2e9034ed148398e)
I20250625 03:31:21.192461 3238 raft_consensus.cc:513] T add8a729ea684e7eab256135c01309df P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:21.174945 1589 raft_consensus.cc:1273] T 3037be35f2054cbbabd8a47062f84244 P 7e9c4f2e01164f33b2e9034ed148398e [term 3 FOLLOWER]: Refusing update from remote peer df8b9755d156478aafca552f9e9c539e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20250625 03:31:21.194250 3303 raft_consensus.cc:491] T fd279ddcf72a40e1bf2ec42a4f35e639 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba464e89e0f044a0a0ea3e6125cbf2a1)
I20250625 03:31:21.194489 3238 leader_election.cc:290] T add8a729ea684e7eab256135c01309df P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:31:21.194813 3303 raft_consensus.cc:513] T fd279ddcf72a40e1bf2ec42a4f35e639 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:21.195397 3304 raft_consensus.cc:491] T 96030b80e1f340afa81659faaaf68755 P 7e9c4f2e01164f33b2e9034ed148398e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3f2aa40978064c9e9983cf3745eed206)
I20250625 03:31:21.195904 3304 raft_consensus.cc:513] T 96030b80e1f340afa81659faaaf68755 P 7e9c4f2e01164f33b2e9034ed148398e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:21.196880 3303 leader_election.cc:290] T fd279ddcf72a40e1bf2ec42a4f35e639 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:31:21.197876 3304 leader_election.cc:290] T 96030b80e1f340afa81659faaaf68755 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:31:21.189913 3308 leader_election.cc:290] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493)
I20250625 03:31:21.200522 3368 raft_consensus.cc:491] T 70328d972b5943009ef0c7d92cbae349 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader df8b9755d156478aafca552f9e9c539e)
I20250625 03:31:21.171674 3333 raft_consensus.cc:491] T 9b7de80fbd7d4625aac41dea0457fd3e P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba464e89e0f044a0a0ea3e6125cbf2a1)
I20250625 03:31:21.201121 3368 raft_consensus.cc:513] T 70328d972b5943009ef0c7d92cbae349 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:21.201964 3333 raft_consensus.cc:513] T 9b7de80fbd7d4625aac41dea0457fd3e P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:21.204437 3333 leader_election.cc:290] T 9b7de80fbd7d4625aac41dea0457fd3e P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:31:21.208644 3352 raft_consensus.cc:2802] T f8c715109ff0405997e1ca9952678c0d P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20250625 03:31:21.210855 3352 raft_consensus.cc:491] T f8c715109ff0405997e1ca9952678c0d P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3f2aa40978064c9e9983cf3745eed206)
I20250625 03:31:21.211313 3352 raft_consensus.cc:3058] T f8c715109ff0405997e1ca9952678c0d P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:21.224509 3368 leader_election.cc:290] T 70328d972b5943009ef0c7d92cbae349 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493)
I20250625 03:31:21.225234 3368 raft_consensus.cc:491] T 1fff19a38e8d4880a14da6b4c8284cc2 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ba464e89e0f044a0a0ea3e6125cbf2a1)
I20250625 03:31:21.225823 3368 raft_consensus.cc:513] T 1fff19a38e8d4880a14da6b4c8284cc2 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } }
I20250625 03:31:21.226938 3333 consensus_queue.cc:1035] T 3037be35f2054cbbabd8a47062f84244 P df8b9755d156478aafca552f9e9c539e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20250625 03:31:21.226225 3303 consensus_queue.cc:1046] T e58b1ae66ee14c6f8d6f2db8dda2b842 P df8b9755d156478aafca552f9e9c539e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20250625 03:31:21.209074 1561 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.131:39359, user_credentials={real_user=slave}} blocked reactor thread for 87951.7us
I20250625 03:31:21.230952 1741 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fd279ddcf72a40e1bf2ec42a4f35e639" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:31:21.227263 1744 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a1d83fca2b484feeaff6f350fe749b24" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:31:21.246963 1745 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9b7de80fbd7d4625aac41dea0457fd3e" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:31:21.250914 1589 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9b7de80fbd7d4625aac41dea0457fd3e" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:31:21.232314 2343 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e58b1ae66ee14c6f8d6f2db8dda2b842" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "df8b9755d156478aafca552f9e9c539e"
I20250625 03:31:21.227188 3352 raft_consensus.cc:513] T f8c715109ff0405997e1ca9952678c0d P 7e9c4f2e01164f33b2e9034ed148398e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:21.273186 2308 leader_election.cc:304] T 9b7de80fbd7d4625aac41dea0457fd3e P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8b9755d156478aafca552f9e9c539e; no voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:31:21.237672 3262 raft_consensus.cc:491] T 93ecdce2da094dc9a80ac04828771fbd P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba464e89e0f044a0a0ea3e6125cbf2a1)
I20250625 03:31:21.276118 1744 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e58b1ae66ee14c6f8d6f2db8dda2b842" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:31:21.278856 1741 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0e7eb287e9514c838aeed599d2703682" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:31:21.279738 1591 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "59ac1803c12d43448ef566f886cc22e6" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:31:21.280822 3357 raft_consensus.cc:2747] T 9b7de80fbd7d4625aac41dea0457fd3e P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250625 03:31:21.280823 1745 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1fff19a38e8d4880a14da6b4c8284cc2" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:31:21.282406 1665 raft_consensus.cc:1273] T 3037be35f2054cbbabd8a47062f84244 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Refusing update from remote peer df8b9755d156478aafca552f9e9c539e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20250625 03:31:21.282497 1737 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "96030b80e1f340afa81659faaaf68755" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:31:21.285972 3372 raft_consensus.cc:491] T 731095860aad436e9658ab3ff5010f9d P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba464e89e0f044a0a0ea3e6125cbf2a1)
I20250625 03:31:21.274206 3333 raft_consensus.cc:491] T 85e02bb33a944989ada7f600c1e802da P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3f2aa40978064c9e9983cf3745eed206)
W20250625 03:31:21.284576 1636 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.131:39359, user_credentials={real_user=slave}} blocked reactor thread for 146476us
I20250625 03:31:21.299630 1669 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f957bf9749c54be48094092cb80e9055" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:31:21.299630 2343 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e38dc50880914156805b07aa82e30863" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "df8b9755d156478aafca552f9e9c539e" is_pre_election: true
I20250625 03:31:21.277729 3308 raft_consensus.cc:491] T b3f18b9311894580bc336199d357df41 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader df8b9755d156478aafca552f9e9c539e)
I20250625 03:31:21.313603 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250625 03:31:21.315258 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:31:21.316226 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:31:21.316148 3299 raft_consensus.cc:491] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3f2aa40978064c9e9983cf3745eed206)
I20250625 03:31:21.319756 1591 raft_consensus.cc:1238] T f8c715109ff0405997e1ca9952678c0d P 7e9c4f2e01164f33b2e9034ed148398e [term 3 FOLLOWER]: Rejecting Update request from peer 3f2aa40978064c9e9983cf3745eed206 for earlier term 2. Current term is 3. Ops: []
I20250625 03:31:21.316901 3299 raft_consensus.cc:513] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:21.320636 3366 raft_consensus.cc:491] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7e9c4f2e01164f33b2e9034ed148398e)
I20250625 03:31:21.322039 1591 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cc3b100d6d574a68b79e6a8f23d77201" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:31:21.322854 1596 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "70328d972b5943009ef0c7d92cbae349" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:31:21.323747 1589 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "add8a729ea684e7eab256135c01309df" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:31:21.324647 1665 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a1d83fca2b484feeaff6f350fe749b24" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:31:21.326016 2345 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "df29d87d804d44438345052a5902052f" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "df8b9755d156478aafca552f9e9c539e" is_pre_election: true
I20250625 03:31:21.284962 3262 raft_consensus.cc:513] T 93ecdce2da094dc9a80ac04828771fbd P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:21.301651 3238 raft_consensus.cc:491] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7e9c4f2e01164f33b2e9034ed148398e)
I20250625 03:31:21.329098 1590 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0c2b6052daaa4c57aaa55361e8d6e01c" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:31:21.345113 3238 raft_consensus.cc:513] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:21.330632 3299 leader_election.cc:290] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493)
I20250625 03:31:21.331032 3350 raft_consensus.cc:3053] T e58b1ae66ee14c6f8d6f2db8dda2b842 P df8b9755d156478aafca552f9e9c539e [term 2 LEADER]: Stepping down as leader of term 2
I20250625 03:31:21.346256 3350 raft_consensus.cc:738] T e58b1ae66ee14c6f8d6f2db8dda2b842 P df8b9755d156478aafca552f9e9c539e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: df8b9755d156478aafca552f9e9c539e, State: Running, Role: LEADER
I20250625 03:31:21.332165 1670 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dea2dcc26f144802a16f0884fdd99063" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:31:21.333099 1666 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9643cfd400804eb8b9037c5e9efddfba" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:31:21.333302 3262 leader_election.cc:290] T 93ecdce2da094dc9a80ac04828771fbd P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:31:21.334580 1665 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f8c715109ff0405997e1ca9952678c0d" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:31:21.336786 3305 raft_consensus.cc:491] T 6e7283d035e1429f946d8ebb98978656 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7e9c4f2e01164f33b2e9034ed148398e)
I20250625 03:31:21.337707 3368 leader_election.cc:290] T 1fff19a38e8d4880a14da6b4c8284cc2 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359), 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903)
I20250625 03:31:21.305253 3333 raft_consensus.cc:513] T 85e02bb33a944989ada7f600c1e802da P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:21.338302 1668 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b31026f89f1e49949acec419db9649d3" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:31:21.321161 3366 raft_consensus.cc:513] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:21.326079 3308 raft_consensus.cc:513] T b3f18b9311894580bc336199d357df41 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:21.340711 2341 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0c2b6052daaa4c57aaa55361e8d6e01c" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "df8b9755d156478aafca552f9e9c539e" is_pre_election: true
I20250625 03:31:21.342365 2340 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "70328d972b5943009ef0c7d92cbae349" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "df8b9755d156478aafca552f9e9c539e" is_pre_election: true
I20250625 03:31:21.298929 3311 raft_consensus.cc:513] T f8c715109ff0405997e1ca9952678c0d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:21.344549 1589 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "93ecdce2da094dc9a80ac04828771fbd" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:31:21.349045 1744 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "93ecdce2da094dc9a80ac04828771fbd" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:31:21.349761 1667 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "390aa72f98414be291f01e4e4fec77f1" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:31:21.350883 1745 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "add8a729ea684e7eab256135c01309df" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:31:21.352490 1561 leader_election.cc:304] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e; no voters: ba464e89e0f044a0a0ea3e6125cbf2a1, df8b9755d156478aafca552f9e9c539e
I20250625 03:31:21.347121 3350 consensus_queue.cc:260] T e58b1ae66ee14c6f8d6f2db8dda2b842 P df8b9755d156478aafca552f9e9c539e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:21.353760 3352 leader_election.cc:290] T f8c715109ff0405997e1ca9952678c0d P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 3 election: Requested vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:31:21.315907 3371 raft_consensus.cc:491] T e4034c33d83e4a96a187eaed46416e3c P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba464e89e0f044a0a0ea3e6125cbf2a1)
I20250625 03:31:21.340087 2342 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cc3b100d6d574a68b79e6a8f23d77201" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "df8b9755d156478aafca552f9e9c539e" is_pre_election: true
I20250625 03:31:21.359155 1669 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d50c52b197294003b238a37da2fb55d8" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:31:21.359922 1741 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c4354f7ffc0e4eabbc92a141d46b7984" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:31:21.365106 2345 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9643cfd400804eb8b9037c5e9efddfba" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "df8b9755d156478aafca552f9e9c539e" is_pre_election: true
I20250625 03:31:21.366215 1665 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fd279ddcf72a40e1bf2ec42a4f35e639" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:31:21.347148 3238 leader_election.cc:290] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:31:21.368404 3360 raft_consensus.cc:491] T 64add559c121402aa1f7753538a50857 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba464e89e0f044a0a0ea3e6125cbf2a1)
I20250625 03:31:21.353775 2339 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e58b1ae66ee14c6f8d6f2db8dda2b842" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "df8b9755d156478aafca552f9e9c539e" is_pre_election: true
I20250625 03:31:21.376238 1671 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3c2c045dee4b4b4faa93fa9d0ccdaa1c" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:31:21.377287 2308 leader_election.cc:304] T 93ecdce2da094dc9a80ac04828771fbd P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8b9755d156478aafca552f9e9c539e; no voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:31:21.368920 1670 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f8c715109ff0405997e1ca9952678c0d" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:31:21.379434 1744 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f8c715109ff0405997e1ca9952678c0d" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:31:21.379688 1589 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1fff19a38e8d4880a14da6b4c8284cc2" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:31:21.382983 1737 raft_consensus.cc:1238] T f8c715109ff0405997e1ca9952678c0d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Rejecting Update request from peer 3f2aa40978064c9e9983cf3745eed206 for earlier term 2. Current term is 3. Ops: []
I20250625 03:31:21.383354 1589 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e88f79ed06514e01a9bc48261a5acfbb" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:31:21.383473 1740 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1fff19a38e8d4880a14da6b4c8284cc2" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:31:21.362272 3366 leader_election.cc:290] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493)
I20250625 03:31:21.384393 1590 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c4354f7ffc0e4eabbc92a141d46b7984" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:31:21.385249 3262 raft_consensus.cc:2747] T 93ecdce2da094dc9a80ac04828771fbd P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250625 03:31:21.386727 3370 raft_consensus.cc:491] T b31026f89f1e49949acec419db9649d3 P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3f2aa40978064c9e9983cf3745eed206)
I20250625 03:31:21.384438 3371 raft_consensus.cc:513] T e4034c33d83e4a96a187eaed46416e3c P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:21.381307 3304 raft_consensus.cc:2747] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20250625 03:31:21.328126 3372 raft_consensus.cc:513] T 731095860aad436e9658ab3ff5010f9d P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:21.355955 3305 raft_consensus.cc:513] T 6e7283d035e1429f946d8ebb98978656 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:21.393146 3371 leader_election.cc:290] T e4034c33d83e4a96a187eaed46416e3c P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:31:21.393297 3305 leader_election.cc:290] T 6e7283d035e1429f946d8ebb98978656 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493)
I20250625 03:31:21.394279 3308 leader_election.cc:290] T b3f18b9311894580bc336199d357df41 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493)
I20250625 03:31:21.389580 3350 raft_consensus.cc:3058] T e58b1ae66ee14c6f8d6f2db8dda2b842 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:21.388265 3360 raft_consensus.cc:513] T 64add559c121402aa1f7753538a50857 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:21.403023 3333 leader_election.cc:290] T 85e02bb33a944989ada7f600c1e802da P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:31:21.403432 3360 leader_election.cc:290] T 64add559c121402aa1f7753538a50857 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:31:21.404773 1663 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9943bb8023444f49a11df01d93738f1e" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:31:21.405300 1590 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "64add559c121402aa1f7753538a50857" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:31:21.405548 3311 leader_election.cc:290] T f8c715109ff0405997e1ca9952678c0d P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 3 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:31:21.405885 1671 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f8c715109ff0405997e1ca9952678c0d" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:31:21.406553 1670 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "96030b80e1f340afa81659faaaf68755" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:31:21.406896 1668 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0e7eb287e9514c838aeed599d2703682" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:31:21.406571 1662 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1fff19a38e8d4880a14da6b4c8284cc2" candidate_uuid: "7e9c4f2e01164f33b2e9034ed148398e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:31:21.409610 1744 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "64add559c121402aa1f7753538a50857" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:31:21.413475 2308 leader_election.cc:304] T 64add559c121402aa1f7753538a50857 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8b9755d156478aafca552f9e9c539e; no voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:31:21.414530 1559 leader_election.cc:304] T 390aa72f98414be291f01e4e4fec77f1 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e; no voters: 3f2aa40978064c9e9983cf3745eed206, df8b9755d156478aafca552f9e9c539e
I20250625 03:31:21.387796 3370 raft_consensus.cc:513] T b31026f89f1e49949acec419db9649d3 P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:21.415736 3304 raft_consensus.cc:2747] T 390aa72f98414be291f01e4e4fec77f1 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20250625 03:31:21.415810 1590 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f8c715109ff0405997e1ca9952678c0d" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e"
I20250625 03:31:21.416679 1559 leader_election.cc:304] T d50c52b197294003b238a37da2fb55d8 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e; no voters: 3f2aa40978064c9e9983cf3745eed206, df8b9755d156478aafca552f9e9c539e
I20250625 03:31:21.417775 3352 raft_consensus.cc:2747] T d50c52b197294003b238a37da2fb55d8 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250625 03:31:21.417837 3370 leader_election.cc:290] T b31026f89f1e49949acec419db9649d3 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:31:21.418395 3370 raft_consensus.cc:2747] T 64add559c121402aa1f7753538a50857 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250625 03:31:21.419286 1559 leader_election.cc:304] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e; no voters: 3f2aa40978064c9e9983cf3745eed206, df8b9755d156478aafca552f9e9c539e
I20250625 03:31:21.419910 1708 leader_election.cc:304] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:31:21.421190 1590 raft_consensus.cc:2391] T f8c715109ff0405997e1ca9952678c0d P 7e9c4f2e01164f33b2e9034ed148398e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in current term 3: Already voted for candidate 7e9c4f2e01164f33b2e9034ed148398e in this term.
I20250625 03:31:21.420253 1737 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "85e02bb33a944989ada7f600c1e802da" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:31:21.423046 3372 leader_election.cc:290] T 731095860aad436e9658ab3ff5010f9d P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359), df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493)
I20250625 03:31:21.423980 1744 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b31026f89f1e49949acec419db9649d3" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:31:21.424448 3299 raft_consensus.cc:2747] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20250625 03:31:21.423661 3304 raft_consensus.cc:2747] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20250625 03:31:21.428067 1636 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.131:39359, user_credentials={real_user=slave}} blocked reactor thread for 58460.8us
I20250625 03:31:21.431459 1737 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "731095860aad436e9658ab3ff5010f9d" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:31:21.431514 1744 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e4034c33d83e4a96a187eaed46416e3c" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:31:21.435099 3372 consensus_queue.cc:1046] T f8c715109ff0405997e1ca9952678c0d P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:21.437878 3366 raft_consensus.cc:3053] T f8c715109ff0405997e1ca9952678c0d P 3f2aa40978064c9e9983cf3745eed206 [term 2 LEADER]: Stepping down as leader of term 2
I20250625 03:31:21.438272 3366 raft_consensus.cc:738] T f8c715109ff0405997e1ca9952678c0d P 3f2aa40978064c9e9983cf3745eed206 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Running, Role: LEADER
I20250625 03:31:21.439043 3366 consensus_queue.cc:260] T f8c715109ff0405997e1ca9952678c0d P 3f2aa40978064c9e9983cf3745eed206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:21.439997 3366 raft_consensus.cc:3058] T f8c715109ff0405997e1ca9952678c0d P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:21.442929 1559 leader_election.cc:304] T 9943bb8023444f49a11df01d93738f1e P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e; no voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:31:21.446696 3304 raft_consensus.cc:2747] T 9943bb8023444f49a11df01d93738f1e P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250625 03:31:21.452612 1708 leader_election.cc:304] T df29d87d804d44438345052a5902052f P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 7e9c4f2e01164f33b2e9034ed148398e, df8b9755d156478aafca552f9e9c539e
I20250625 03:31:21.454010 1708 leader_election.cc:304] T 9643cfd400804eb8b9037c5e9efddfba P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 3f2aa40978064c9e9983cf3745eed206, df8b9755d156478aafca552f9e9c539e
I20250625 03:31:21.461514 1666 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f8c715109ff0405997e1ca9952678c0d" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
W20250625 03:31:21.461612 1635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:39903, user_credentials={real_user=slave}} blocked reactor thread for 94292.6us
I20250625 03:31:21.462430 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:31:21.463060 1635 leader_election.cc:304] T 59ac1803c12d43448ef566f886cc22e6 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206; no voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:31:21.464686 1559 leader_election.cc:304] T f8c715109ff0405997e1ca9952678c0d P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e; no voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:31:21.465847 1559 leader_election.cc:304] T 96030b80e1f340afa81659faaaf68755 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e; no voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:31:21.467070 1559 leader_election.cc:304] T 0e7eb287e9514c838aeed599d2703682 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e; no voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:31:21.468389 3328 raft_consensus.cc:2747] T f8c715109ff0405997e1ca9952678c0d P 7e9c4f2e01164f33b2e9034ed148398e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20250625 03:31:21.469051 3328 raft_consensus.cc:2747] T 96030b80e1f340afa81659faaaf68755 P 7e9c4f2e01164f33b2e9034ed148398e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20250625 03:31:21.470108 2344 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "731095860aad436e9658ab3ff5010f9d" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "df8b9755d156478aafca552f9e9c539e" is_pre_election: true
I20250625 03:31:21.473508 3242 raft_consensus.cc:2747] T 0e7eb287e9514c838aeed599d2703682 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250625 03:31:21.474045 1559 leader_election.cc:304] T 1fff19a38e8d4880a14da6b4c8284cc2 P 7e9c4f2e01164f33b2e9034ed148398e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9c4f2e01164f33b2e9034ed148398e; no voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:31:21.462777 3356 raft_consensus.cc:2747] T df29d87d804d44438345052a5902052f P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250625 03:31:21.481127 2338 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6e7283d035e1429f946d8ebb98978656" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "df8b9755d156478aafca552f9e9c539e" is_pre_election: true
I20250625 03:31:21.477403 3300 raft_consensus.cc:2747] T 1fff19a38e8d4880a14da6b4c8284cc2 P 7e9c4f2e01164f33b2e9034ed148398e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20250625 03:31:21.485466 2342 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e88f79ed06514e01a9bc48261a5acfbb" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "df8b9755d156478aafca552f9e9c539e" is_pre_election: true
I20250625 03:31:21.471910 2336 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b31026f89f1e49949acec419db9649d3" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "df8b9755d156478aafca552f9e9c539e" is_pre_election: true
I20250625 03:31:21.489718 2306 leader_election.cc:304] T f957bf9749c54be48094092cb80e9055 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8b9755d156478aafca552f9e9c539e; no voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:31:21.466421 3359 raft_consensus.cc:2747] T 9643cfd400804eb8b9037c5e9efddfba P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20250625 03:31:21.490792 1635 leader_election.cc:304] T add8a729ea684e7eab256135c01309df P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206; no voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:31:21.472915 3372 raft_consensus.cc:2747] T 59ac1803c12d43448ef566f886cc22e6 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20250625 03:31:21.524541 1635 leader_election.cc:304] T 1fff19a38e8d4880a14da6b4c8284cc2 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206; no voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:31:21.527529 1635 leader_election.cc:304] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206; no voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:31:21.530993 1589 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b3f18b9311894580bc336199d357df41" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:31:21.517796 3238 raft_consensus.cc:2747] T add8a729ea684e7eab256135c01309df P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20250625 03:31:21.532485 1590 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e4034c33d83e4a96a187eaed46416e3c" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:31:21.474380 3357 consensus_queue.cc:1035] T 3037be35f2054cbbabd8a47062f84244 P df8b9755d156478aafca552f9e9c539e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20250625 03:31:21.533020 3372 raft_consensus.cc:2747] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20250625 03:31:21.534821 1634 leader_election.cc:304] T e38dc50880914156805b07aa82e30863 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206; no voters: ba464e89e0f044a0a0ea3e6125cbf2a1, df8b9755d156478aafca552f9e9c539e
I20250625 03:31:21.535714 3372 raft_consensus.cc:2747] T e38dc50880914156805b07aa82e30863 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20250625 03:31:21.535777 1634 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.132:34493, user_credentials={real_user=slave}} blocked reactor thread for 56737us
I20250625 03:31:21.538774 3355 raft_consensus.cc:2747] T f957bf9749c54be48094092cb80e9055 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20250625 03:31:21.539585 1590 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6e7283d035e1429f946d8ebb98978656" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7e9c4f2e01164f33b2e9034ed148398e" is_pre_election: true
I20250625 03:31:21.542408 1664 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "85e02bb33a944989ada7f600c1e802da" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:31:21.545017 1668 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b31026f89f1e49949acec419db9649d3" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:31:21.546763 1635 leader_election.cc:304] T e4034c33d83e4a96a187eaed46416e3c P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206; no voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:31:21.537925 1634 leader_election.cc:304] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206; no voters: 7e9c4f2e01164f33b2e9034ed148398e, df8b9755d156478aafca552f9e9c539e
I20250625 03:31:21.521528 2340 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b3f18b9311894580bc336199d357df41" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "df8b9755d156478aafca552f9e9c539e" is_pre_election: true
I20250625 03:31:21.561058 3375 raft_consensus.cc:2747] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20250625 03:31:21.576589 1634 leader_election.cc:304] T 70328d972b5943009ef0c7d92cbae349 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206; no voters: 7e9c4f2e01164f33b2e9034ed148398e, df8b9755d156478aafca552f9e9c539e
I20250625 03:31:21.581382 1634 leader_election.cc:304] T cc3b100d6d574a68b79e6a8f23d77201 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206; no voters: 7e9c4f2e01164f33b2e9034ed148398e, df8b9755d156478aafca552f9e9c539e
I20250625 03:31:21.584175 1634 leader_election.cc:304] T 731095860aad436e9658ab3ff5010f9d P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206; no voters: ba464e89e0f044a0a0ea3e6125cbf2a1, df8b9755d156478aafca552f9e9c539e
I20250625 03:31:21.583724 1666 raft_consensus.cc:2466] T f8c715109ff0405997e1ca9952678c0d P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 3.
I20250625 03:31:21.586989 3374 raft_consensus.cc:2747] T 70328d972b5943009ef0c7d92cbae349 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20250625 03:31:21.587144 3305 raft_consensus.cc:2747] T cc3b100d6d574a68b79e6a8f23d77201 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20250625 03:31:21.587985 426 tablet_server.cc:178] TabletServer@127.0.106.129:0 shutting down...
I20250625 03:31:21.590230 2339 raft_consensus.cc:2466] T e58b1ae66ee14c6f8d6f2db8dda2b842 P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 3.
I20250625 03:31:21.598791 3350 raft_consensus.cc:491] T 615cebbffcfc44e19b8f7a1e842073a3 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ba464e89e0f044a0a0ea3e6125cbf2a1)
I20250625 03:31:21.599337 3350 raft_consensus.cc:513] T 615cebbffcfc44e19b8f7a1e842073a3 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:21.601328 3350 leader_election.cc:290] T 615cebbffcfc44e19b8f7a1e842073a3 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
W20250625 03:31:21.606249 2307 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20250625 03:31:21.610237 1634 leader_election.cc:304] T 6e7283d035e1429f946d8ebb98978656 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206; no voters: 7e9c4f2e01164f33b2e9034ed148398e, df8b9755d156478aafca552f9e9c539e
I20250625 03:31:21.553654 3366 raft_consensus.cc:2747] T e4034c33d83e4a96a187eaed46416e3c P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20250625 03:31:21.617347 1708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.132:34493, user_credentials={real_user=slave}} blocked reactor thread for 150063us
I20250625 03:31:21.612197 1634 leader_election.cc:304] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206; no voters: 7e9c4f2e01164f33b2e9034ed148398e, df8b9755d156478aafca552f9e9c539e
I20250625 03:31:21.619329 1634 leader_election.cc:304] T b3f18b9311894580bc336199d357df41 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206; no voters: 7e9c4f2e01164f33b2e9034ed148398e, df8b9755d156478aafca552f9e9c539e
W20250625 03:31:21.621170 2306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.130:34293, user_credentials={real_user=slave}} blocked reactor thread for 128272us
I20250625 03:31:21.623975 2306 leader_election.cc:304] T a1d83fca2b484feeaff6f350fe749b24 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8b9755d156478aafca552f9e9c539e; no voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:31:21.612746 3374 raft_consensus.cc:2747] T 731095860aad436e9658ab3ff5010f9d P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250625 03:31:21.612879 3305 raft_consensus.cc:2747] T 6e7283d035e1429f946d8ebb98978656 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20250625 03:31:21.621650 3371 raft_consensus.cc:2747] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20250625 03:31:21.629230 3238 raft_consensus.cc:2747] T b3f18b9311894580bc336199d357df41 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20250625 03:31:21.640762 2306 leader_election.cc:304] T fd279ddcf72a40e1bf2ec42a4f35e639 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8b9755d156478aafca552f9e9c539e; no voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:31:21.644378 2306 leader_election.cc:304] T 85e02bb33a944989ada7f600c1e802da P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8b9755d156478aafca552f9e9c539e; no voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:31:21.637058 3355 raft_consensus.cc:2747] T a1d83fca2b484feeaff6f350fe749b24 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20250625 03:31:21.646373 3376 raft_consensus.cc:2747] T 1fff19a38e8d4880a14da6b4c8284cc2 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20250625 03:31:21.654542 2307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:39903, user_credentials={real_user=slave}} blocked reactor thread for 48415.9us
I20250625 03:31:21.649263 2306 leader_election.cc:304] T b31026f89f1e49949acec419db9649d3 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8b9755d156478aafca552f9e9c539e; no voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:31:21.647246 3262 raft_consensus.cc:2747] T fd279ddcf72a40e1bf2ec42a4f35e639 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250625 03:31:21.660552 3379 raft_consensus.cc:2747] T 85e02bb33a944989ada7f600c1e802da P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20250625 03:31:21.662247 3355 raft_consensus.cc:2747] T b31026f89f1e49949acec419db9649d3 P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20250625 03:31:21.673897 1635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:39903, user_credentials={real_user=slave}} blocked reactor thread for 66077.9us
I20250625 03:31:21.687811 3371 raft_consensus.cc:491] T 3037be35f2054cbbabd8a47062f84244 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:21.688318 3371 raft_consensus.cc:513] T 3037be35f2054cbbabd8a47062f84244 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:21.690685 3371 leader_election.cc:290] T 3037be35f2054cbbabd8a47062f84244 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493)
I20250625 03:31:21.694380 2344 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3037be35f2054cbbabd8a47062f84244" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "df8b9755d156478aafca552f9e9c539e" is_pre_election: true
W20250625 03:31:21.707262 1635 consensus_peers.cc:487] T 96030b80e1f340afa81659faaaf68755 P 3f2aa40978064c9e9983cf3745eed206 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250625 03:31:21.713946 1635 consensus_peers.cc:487] T d50c52b197294003b238a37da2fb55d8 P 3f2aa40978064c9e9983cf3745eed206 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250625 03:31:21.723371 1635 consensus_peers.cc:487] T 9943bb8023444f49a11df01d93738f1e P 3f2aa40978064c9e9983cf3745eed206 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:21.729496 1744 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "615cebbffcfc44e19b8f7a1e842073a3" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:31:21.732921 1708 leader_election.cc:304] T f8c715109ff0405997e1ca9952678c0d P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 7e9c4f2e01164f33b2e9034ed148398e
W20250625 03:31:21.731603 1635 consensus_peers.cc:487] T 393f73bcf106475cbee7a645b0d9660c P 3f2aa40978064c9e9983cf3745eed206 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250625 03:31:21.734972 1635 leader_election.cc:336] T 3037be35f2054cbbabd8a47062f84244 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20250625 03:31:21.737910 1635 leader_election.cc:304] T 3037be35f2054cbbabd8a47062f84244 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206; no voters: 7e9c4f2e01164f33b2e9034ed148398e, df8b9755d156478aafca552f9e9c539e
I20250625 03:31:21.739517 1708 leader_election.cc:304] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 3f2aa40978064c9e9983cf3745eed206, df8b9755d156478aafca552f9e9c539e
I20250625 03:31:21.737507 3332 raft_consensus.cc:2802] T f8c715109ff0405997e1ca9952678c0d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Leader election won for term 3
I20250625 03:31:21.744988 1708 leader_election.cc:304] T e58b1ae66ee14c6f8d6f2db8dda2b842 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1, df8b9755d156478aafca552f9e9c539e; no voters: 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:31:21.747030 3367 raft_consensus.cc:2802] T e58b1ae66ee14c6f8d6f2db8dda2b842 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20250625 03:31:21.747248 3388 raft_consensus.cc:2747] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20250625 03:31:21.747583 3367 raft_consensus.cc:491] T e58b1ae66ee14c6f8d6f2db8dda2b842 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader df8b9755d156478aafca552f9e9c539e)
I20250625 03:31:21.749218 3367 raft_consensus.cc:3058] T e58b1ae66ee14c6f8d6f2db8dda2b842 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:21.746623 3332 raft_consensus.cc:695] T f8c715109ff0405997e1ca9952678c0d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 LEADER]: Becoming Leader. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Running, Role: LEADER
W20250625 03:31:21.785796 1635 consensus_peers.cc:487] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 3f2aa40978064c9e9983cf3745eed206 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:21.788614 3332 consensus_queue.cc:237] T f8c715109ff0405997e1ca9952678c0d P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
W20250625 03:31:21.791726 2307 consensus_peers.cc:487] T 390aa72f98414be291f01e4e4fec77f1 P df8b9755d156478aafca552f9e9c539e -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250625 03:31:21.792194 2307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:39903, user_credentials={real_user=slave}} blocked reactor thread for 69012us
W20250625 03:31:21.805518 2307 leader_election.cc:336] T 615cebbffcfc44e19b8f7a1e842073a3 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20250625 03:31:21.806519 2307 leader_election.cc:304] T 615cebbffcfc44e19b8f7a1e842073a3 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8b9755d156478aafca552f9e9c539e; no voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1
W20250625 03:31:21.819512 2307 consensus_peers.cc:487] T b15eb94b9d3d4f6987b5fa5e20193655 P df8b9755d156478aafca552f9e9c539e -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250625 03:31:21.820031 2307 consensus_peers.cc:487] T 0c2b6052daaa4c57aaa55361e8d6e01c P df8b9755d156478aafca552f9e9c539e -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250625 03:31:21.820431 2307 consensus_peers.cc:487] T fb6e83db706647e28e491a02f1641980 P df8b9755d156478aafca552f9e9c539e -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250625 03:31:21.821446 2307 consensus_peers.cc:487] T 188e56b819ae44f9b72baefcbc749400 P df8b9755d156478aafca552f9e9c539e -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:21.819309 3305 raft_consensus.cc:2747] T 3037be35f2054cbbabd8a47062f84244 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20250625 03:31:21.822813 3360 raft_consensus.cc:2747] T 615cebbffcfc44e19b8f7a1e842073a3 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20250625 03:31:21.894698 1635 consensus_peers.cc:487] T 7553473daeb342ceaf782ddee8e4fc4d P 3f2aa40978064c9e9983cf3745eed206 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:21.894480 1490 catalog_manager.cc:5582] T f8c715109ff0405997e1ca9952678c0d P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: term changed from 2 to 3, leader changed from 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) to ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131). New cstate: current_term: 3 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: HEALTHY } } }
W20250625 03:31:21.908298 1709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:39903, user_credentials={real_user=slave}} blocked reactor thread for 71231.3us
I20250625 03:31:21.835898 3367 raft_consensus.cc:513] T e58b1ae66ee14c6f8d6f2db8dda2b842 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
W20250625 03:31:21.923568 2307 consensus_peers.cc:487] T b3f18b9311894580bc336199d357df41 P df8b9755d156478aafca552f9e9c539e -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250625 03:31:21.938872 1709 consensus_peers.cc:487] T 93ecdce2da094dc9a80ac04828771fbd P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250625 03:31:21.939090 2307 consensus_peers.cc:487] T 70328d972b5943009ef0c7d92cbae349 P df8b9755d156478aafca552f9e9c539e -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250625 03:31:21.939550 1709 consensus_peers.cc:487] T ba2ab3296190416aa07624e6d69ba09b P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250625 03:31:21.941099 1709 consensus_peers.cc:487] T 0e7eb287e9514c838aeed599d2703682 P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250625 03:31:21.948040 1709 consensus_peers.cc:487] T 1fff19a38e8d4880a14da6b4c8284cc2 P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250625 03:31:21.949375 1709 consensus_peers.cc:487] T 615cebbffcfc44e19b8f7a1e842073a3 P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250625 03:31:21.950073 1709 consensus_peers.cc:487] T e4034c33d83e4a96a187eaed46416e3c P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250625 03:31:21.950670 1709 consensus_peers.cc:487] T 441042afd59544a4a04bf85fa69d7d55 P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250625 03:31:21.951304 1709 consensus_peers.cc:487] T 465c15a46933411a985f29059fdb1c9f P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250625 03:31:21.954743 1709 consensus_peers.cc:487] T 9f7fbf33df3d429ab16f0ae3a2684207 P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250625 03:31:21.955467 1709 consensus_peers.cc:487] T 9b7de80fbd7d4625aac41dea0457fd3e P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250625 03:31:21.956822 1709 consensus_peers.cc:487] T c977876716a0400a9482dd8e0ad33b86 P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:21.958146 2339 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e58b1ae66ee14c6f8d6f2db8dda2b842" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "df8b9755d156478aafca552f9e9c539e"
I20250625 03:31:21.956984 3367 leader_election.cc:290] T e58b1ae66ee14c6f8d6f2db8dda2b842 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 3 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493)
W20250625 03:31:21.961222 1709 leader_election.cc:336] T e58b1ae66ee14c6f8d6f2db8dda2b842 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20250625 03:31:21.968897 2339 raft_consensus.cc:2466] T e58b1ae66ee14c6f8d6f2db8dda2b842 P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 3.
I20250625 03:31:21.970474 1708 leader_election.cc:304] T e58b1ae66ee14c6f8d6f2db8dda2b842 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1, df8b9755d156478aafca552f9e9c539e; no voters: 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:31:21.971102 3367 raft_consensus.cc:2802] T e58b1ae66ee14c6f8d6f2db8dda2b842 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Leader election won for term 3
I20250625 03:31:21.983690 3367 raft_consensus.cc:695] T e58b1ae66ee14c6f8d6f2db8dda2b842 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 LEADER]: Becoming Leader. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Running, Role: LEADER
I20250625 03:31:21.985857 3367 consensus_queue.cc:237] T e58b1ae66ee14c6f8d6f2db8dda2b842 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
W20250625 03:31:21.989492 2307 consensus_peers.cc:487] T 3037be35f2054cbbabd8a47062f84244 P df8b9755d156478aafca552f9e9c539e -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:21.993840 426 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250625 03:31:21.995146 426 tablet_replica.cc:331] T 59ac1803c12d43448ef566f886cc22e6 P 7e9c4f2e01164f33b2e9034ed148398e: stopping tablet replica
I20250625 03:31:21.996167 426 raft_consensus.cc:2241] T 59ac1803c12d43448ef566f886cc22e6 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:31:21.997386 426 raft_consensus.cc:2270] T 59ac1803c12d43448ef566f886cc22e6 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:22.001138 426 tablet_replica.cc:331] T add8a729ea684e7eab256135c01309df P 7e9c4f2e01164f33b2e9034ed148398e: stopping tablet replica
I20250625 03:31:22.002331 426 raft_consensus.cc:2241] T add8a729ea684e7eab256135c01309df P 7e9c4f2e01164f33b2e9034ed148398e [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:31:22.003379 426 raft_consensus.cc:2270] T add8a729ea684e7eab256135c01309df P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:22.006156 426 tablet_replica.cc:331] T 70328d972b5943009ef0c7d92cbae349 P 7e9c4f2e01164f33b2e9034ed148398e: stopping tablet replica
I20250625 03:31:22.006942 426 raft_consensus.cc:2241] T 70328d972b5943009ef0c7d92cbae349 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:22.009562 426 raft_consensus.cc:2270] T 70328d972b5943009ef0c7d92cbae349 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:22.011451 426 tablet_replica.cc:331] T 188e56b819ae44f9b72baefcbc749400 P 7e9c4f2e01164f33b2e9034ed148398e: stopping tablet replica
I20250625 03:31:22.012056 426 raft_consensus.cc:2241] T 188e56b819ae44f9b72baefcbc749400 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:22.012650 426 raft_consensus.cc:2270] T 188e56b819ae44f9b72baefcbc749400 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:22.015336 426 tablet_replica.cc:331] T 64add559c121402aa1f7753538a50857 P 7e9c4f2e01164f33b2e9034ed148398e: stopping tablet replica
I20250625 03:31:22.016129 426 raft_consensus.cc:2241] T 64add559c121402aa1f7753538a50857 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:22.016708 426 raft_consensus.cc:2270] T 64add559c121402aa1f7753538a50857 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:22.017110 1490 catalog_manager.cc:5582] T e58b1ae66ee14c6f8d6f2db8dda2b842 P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: term changed from 2 to 3, leader changed from df8b9755d156478aafca552f9e9c539e (127.0.106.132) to ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131). New cstate: current_term: 3 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:22.019217 426 tablet_replica.cc:331] T 6d7a37b3448d468baa1b9422a6167c9a P 7e9c4f2e01164f33b2e9034ed148398e: stopping tablet replica
I20250625 03:31:22.020035 426 raft_consensus.cc:2241] T 6d7a37b3448d468baa1b9422a6167c9a P 7e9c4f2e01164f33b2e9034ed148398e [term 3 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:22.020581 426 raft_consensus.cc:2270] T 6d7a37b3448d468baa1b9422a6167c9a P 7e9c4f2e01164f33b2e9034ed148398e [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:22.023133 426 tablet_replica.cc:331] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e: stopping tablet replica
I20250625 03:31:22.023849 426 raft_consensus.cc:2241] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e [term 3 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:22.024428 426 raft_consensus.cc:2270] T e58b1ae66ee14c6f8d6f2db8dda2b842 P 7e9c4f2e01164f33b2e9034ed148398e [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:22.031188 426 tablet_replica.cc:331] T 390aa72f98414be291f01e4e4fec77f1 P 7e9c4f2e01164f33b2e9034ed148398e: stopping tablet replica
I20250625 03:31:22.032094 426 raft_consensus.cc:2241] T 390aa72f98414be291f01e4e4fec77f1 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:22.033453 426 raft_consensus.cc:2270] T 390aa72f98414be291f01e4e4fec77f1 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:22.043793 426 tablet_replica.cc:331] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 7e9c4f2e01164f33b2e9034ed148398e: stopping tablet replica
I20250625 03:31:22.044788 426 raft_consensus.cc:2241] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:22.045686 426 raft_consensus.cc:2270] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:22.048578 426 tablet_replica.cc:331] T c04f7c2d00994557b1cb83234b36fceb P 7e9c4f2e01164f33b2e9034ed148398e: stopping tablet replica
I20250625 03:31:22.049535 426 raft_consensus.cc:2241] T c04f7c2d00994557b1cb83234b36fceb P 7e9c4f2e01164f33b2e9034ed148398e [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:31:22.050598 426 raft_consensus.cc:2270] T c04f7c2d00994557b1cb83234b36fceb P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:22.053436 426 tablet_replica.cc:331] T ba2ab3296190416aa07624e6d69ba09b P 7e9c4f2e01164f33b2e9034ed148398e: stopping tablet replica
I20250625 03:31:22.054342 426 raft_consensus.cc:2241] T ba2ab3296190416aa07624e6d69ba09b P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:22.054958 426 raft_consensus.cc:2270] T ba2ab3296190416aa07624e6d69ba09b P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:22.057804 426 tablet_replica.cc:331] T 96030b80e1f340afa81659faaaf68755 P 7e9c4f2e01164f33b2e9034ed148398e: stopping tablet replica
I20250625 03:31:22.058720 426 raft_consensus.cc:2241] T 96030b80e1f340afa81659faaaf68755 P 7e9c4f2e01164f33b2e9034ed148398e [term 3 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:22.059309 426 raft_consensus.cc:2270] T 96030b80e1f340afa81659faaaf68755 P 7e9c4f2e01164f33b2e9034ed148398e [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:22.062026 426 tablet_replica.cc:331] T fa68c3b7143345958f883bde3591b622 P 7e9c4f2e01164f33b2e9034ed148398e: stopping tablet replica
I20250625 03:31:22.062801 426 raft_consensus.cc:2241] T fa68c3b7143345958f883bde3591b622 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:31:22.064970 426 raft_consensus.cc:2270] T fa68c3b7143345958f883bde3591b622 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:22.067647 426 tablet_replica.cc:331] T cc3b100d6d574a68b79e6a8f23d77201 P 7e9c4f2e01164f33b2e9034ed148398e: stopping tablet replica
I20250625 03:31:22.068617 426 raft_consensus.cc:2241] T cc3b100d6d574a68b79e6a8f23d77201 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:31:22.069664 426 raft_consensus.cc:2270] T cc3b100d6d574a68b79e6a8f23d77201 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:22.072306 426 tablet_replica.cc:331] T a5a18934cc3f490288432ee1cb30b278 P 7e9c4f2e01164f33b2e9034ed148398e: stopping tablet replica
I20250625 03:31:22.073161 426 raft_consensus.cc:2241] T a5a18934cc3f490288432ee1cb30b278 P 7e9c4f2e01164f33b2e9034ed148398e [term 3 LEADER]: Raft consensus shutting down.
I20250625 03:31:22.074254 426 raft_consensus.cc:2270] T a5a18934cc3f490288432ee1cb30b278 P 7e9c4f2e01164f33b2e9034ed148398e [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:22.077035 426 tablet_replica.cc:331] T 3037be35f2054cbbabd8a47062f84244 P 7e9c4f2e01164f33b2e9034ed148398e: stopping tablet replica
I20250625 03:31:22.077842 426 raft_consensus.cc:2241] T 3037be35f2054cbbabd8a47062f84244 P 7e9c4f2e01164f33b2e9034ed148398e [term 3 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:22.078397 426 raft_consensus.cc:2270] T 3037be35f2054cbbabd8a47062f84244 P 7e9c4f2e01164f33b2e9034ed148398e [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:22.081815 426 tablet_replica.cc:331] T 393f73bcf106475cbee7a645b0d9660c P 7e9c4f2e01164f33b2e9034ed148398e: stopping tablet replica
I20250625 03:31:22.082690 426 raft_consensus.cc:2241] T 393f73bcf106475cbee7a645b0d9660c P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:22.083269 426 raft_consensus.cc:2270] T 393f73bcf106475cbee7a645b0d9660c P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:22.085845 426 tablet_replica.cc:331] T 7553473daeb342ceaf782ddee8e4fc4d P 7e9c4f2e01164f33b2e9034ed148398e: stopping tablet replica
I20250625 03:31:22.086625 426 raft_consensus.cc:2241] T 7553473daeb342ceaf782ddee8e4fc4d P 7e9c4f2e01164f33b2e9034ed148398e [term 3 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:22.087203 426 raft_consensus.cc:2270] T 7553473daeb342ceaf782ddee8e4fc4d P 7e9c4f2e01164f33b2e9034ed148398e [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:22.089708 426 tablet_replica.cc:331] T e88f79ed06514e01a9bc48261a5acfbb P 7e9c4f2e01164f33b2e9034ed148398e: stopping tablet replica
I20250625 03:31:22.090502 426 raft_consensus.cc:2241] T e88f79ed06514e01a9bc48261a5acfbb P 7e9c4f2e01164f33b2e9034ed148398e [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:31:22.091502 426 raft_consensus.cc:2270] T e88f79ed06514e01a9bc48261a5acfbb P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:22.094213 426 tablet_replica.cc:331] T 0e7eb287e9514c838aeed599d2703682 P 7e9c4f2e01164f33b2e9034ed148398e: stopping tablet replica
I20250625 03:31:22.095073 426 raft_consensus.cc:2241] T 0e7eb287e9514c838aeed599d2703682 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:22.095625 426 raft_consensus.cc:2270] T 0e7eb287e9514c838aeed599d2703682 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:22.098556 426 tablet_replica.cc:331] T dea2dcc26f144802a16f0884fdd99063 P 7e9c4f2e01164f33b2e9034ed148398e: stopping tablet replica
I20250625 03:31:22.099422 426 raft_consensus.cc:2241] T dea2dcc26f144802a16f0884fdd99063 P 7e9c4f2e01164f33b2e9034ed148398e [term 4 LEADER]: Raft consensus shutting down.
I20250625 03:31:22.100509 426 raft_consensus.cc:2270] T dea2dcc26f144802a16f0884fdd99063 P 7e9c4f2e01164f33b2e9034ed148398e [term 4 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:22.103343 426 tablet_replica.cc:331] T af4573692c104d67994dbb1bc518b568 P 7e9c4f2e01164f33b2e9034ed148398e: stopping tablet replica
I20250625 03:31:22.104200 426 raft_consensus.cc:2241] T af4573692c104d67994dbb1bc518b568 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:31:22.105245 426 raft_consensus.cc:2270] T af4573692c104d67994dbb1bc518b568 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Raft consensus is shut down!
W20250625 03:31:22.111195 2307 consensus_peers.cc:487] T 6d7a37b3448d468baa1b9422a6167c9a P df8b9755d156478aafca552f9e9c539e -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:22.117254 426 tablet_replica.cc:331] T 0c2b6052daaa4c57aaa55361e8d6e01c P 7e9c4f2e01164f33b2e9034ed148398e: stopping tablet replica
I20250625 03:31:22.118189 426 raft_consensus.cc:2241] T 0c2b6052daaa4c57aaa55361e8d6e01c P 7e9c4f2e01164f33b2e9034ed148398e [term 3 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:22.118880 426 raft_consensus.cc:2270] T 0c2b6052daaa4c57aaa55361e8d6e01c P 7e9c4f2e01164f33b2e9034ed148398e [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:22.127827 426 tablet_replica.cc:331] T 9f7fbf33df3d429ab16f0ae3a2684207 P 7e9c4f2e01164f33b2e9034ed148398e: stopping tablet replica
I20250625 03:31:22.128727 426 raft_consensus.cc:2241] T 9f7fbf33df3d429ab16f0ae3a2684207 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:22.131925 426 raft_consensus.cc:2270] T 9f7fbf33df3d429ab16f0ae3a2684207 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:22.135200 426 tablet_replica.cc:331] T 615cebbffcfc44e19b8f7a1e842073a3 P 7e9c4f2e01164f33b2e9034ed148398e: stopping tablet replica
I20250625 03:31:22.136067 426 raft_consensus.cc:2241] T 615cebbffcfc44e19b8f7a1e842073a3 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:22.136668 426 raft_consensus.cc:2270] T 615cebbffcfc44e19b8f7a1e842073a3 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:22.139760 426 tablet_replica.cc:331] T f9458dec7953448d8550396d67fad249 P 7e9c4f2e01164f33b2e9034ed148398e: stopping tablet replica
I20250625 03:31:22.140686 426 raft_consensus.cc:2241] T f9458dec7953448d8550396d67fad249 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:31:22.141870 426 raft_consensus.cc:2270] T f9458dec7953448d8550396d67fad249 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:22.144930 426 tablet_replica.cc:331] T fb6e83db706647e28e491a02f1641980 P 7e9c4f2e01164f33b2e9034ed148398e: stopping tablet replica
I20250625 03:31:22.145814 426 raft_consensus.cc:2241] T fb6e83db706647e28e491a02f1641980 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:22.146422 426 raft_consensus.cc:2270] T fb6e83db706647e28e491a02f1641980 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:22.149432 426 tablet_replica.cc:331] T e4034c33d83e4a96a187eaed46416e3c P 7e9c4f2e01164f33b2e9034ed148398e: stopping tablet replica
I20250625 03:31:22.150349 426 raft_consensus.cc:2241] T e4034c33d83e4a96a187eaed46416e3c P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:22.150969 426 raft_consensus.cc:2270] T e4034c33d83e4a96a187eaed46416e3c P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:22.154279 426 tablet_replica.cc:331] T 1fff19a38e8d4880a14da6b4c8284cc2 P 7e9c4f2e01164f33b2e9034ed148398e: stopping tablet replica
I20250625 03:31:22.155157 426 raft_consensus.cc:2241] T 1fff19a38e8d4880a14da6b4c8284cc2 P 7e9c4f2e01164f33b2e9034ed148398e [term 3 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:22.155786 426 raft_consensus.cc:2270] T 1fff19a38e8d4880a14da6b4c8284cc2 P 7e9c4f2e01164f33b2e9034ed148398e [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:22.159031 426 tablet_replica.cc:331] T d50c52b197294003b238a37da2fb55d8 P 7e9c4f2e01164f33b2e9034ed148398e: stopping tablet replica
I20250625 03:31:22.159957 426 raft_consensus.cc:2241] T d50c52b197294003b238a37da2fb55d8 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:22.160730 426 raft_consensus.cc:2270] T d50c52b197294003b238a37da2fb55d8 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:22.163570 426 tablet_replica.cc:331] T 465c15a46933411a985f29059fdb1c9f P 7e9c4f2e01164f33b2e9034ed148398e: stopping tablet replica
I20250625 03:31:22.164474 426 raft_consensus.cc:2241] T 465c15a46933411a985f29059fdb1c9f P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:22.165438 426 raft_consensus.cc:2270] T 465c15a46933411a985f29059fdb1c9f P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:22.168495 426 tablet_replica.cc:331] T c4354f7ffc0e4eabbc92a141d46b7984 P 7e9c4f2e01164f33b2e9034ed148398e: stopping tablet replica
W20250625 03:31:22.173182 1709 consensus_peers.cc:487] T 64add559c121402aa1f7753538a50857 P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250625 03:31:22.180106 1709 consensus_peers.cc:487] T f8c715109ff0405997e1ca9952678c0d P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:22.180459 426 raft_consensus.cc:2241] T c4354f7ffc0e4eabbc92a141d46b7984 P 7e9c4f2e01164f33b2e9034ed148398e [term 4 LEADER]: Raft consensus shutting down.
I20250625 03:31:22.181746 426 raft_consensus.cc:2270] T c4354f7ffc0e4eabbc92a141d46b7984 P 7e9c4f2e01164f33b2e9034ed148398e [term 4 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:22.185005 426 tablet_replica.cc:331] T b3f18b9311894580bc336199d357df41 P 7e9c4f2e01164f33b2e9034ed148398e: stopping tablet replica
I20250625 03:31:22.185902 426 raft_consensus.cc:2241] T b3f18b9311894580bc336199d357df41 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:22.186553 426 raft_consensus.cc:2270] T b3f18b9311894580bc336199d357df41 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:22.189509 426 tablet_replica.cc:331] T c977876716a0400a9482dd8e0ad33b86 P 7e9c4f2e01164f33b2e9034ed148398e: stopping tablet replica
I20250625 03:31:22.190410 426 raft_consensus.cc:2241] T c977876716a0400a9482dd8e0ad33b86 P 7e9c4f2e01164f33b2e9034ed148398e [term 3 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:22.190982 426 raft_consensus.cc:2270] T c977876716a0400a9482dd8e0ad33b86 P 7e9c4f2e01164f33b2e9034ed148398e [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:22.199541 426 tablet_replica.cc:331] T f8c715109ff0405997e1ca9952678c0d P 7e9c4f2e01164f33b2e9034ed148398e: stopping tablet replica
I20250625 03:31:22.200533 426 raft_consensus.cc:2241] T f8c715109ff0405997e1ca9952678c0d P 7e9c4f2e01164f33b2e9034ed148398e [term 3 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:22.201210 426 raft_consensus.cc:2270] T f8c715109ff0405997e1ca9952678c0d P 7e9c4f2e01164f33b2e9034ed148398e [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:22.204366 426 tablet_replica.cc:331] T 9b7de80fbd7d4625aac41dea0457fd3e P 7e9c4f2e01164f33b2e9034ed148398e: stopping tablet replica
I20250625 03:31:22.205277 426 raft_consensus.cc:2241] T 9b7de80fbd7d4625aac41dea0457fd3e P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:22.205936 426 raft_consensus.cc:2270] T 9b7de80fbd7d4625aac41dea0457fd3e P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:22.208961 426 tablet_replica.cc:331] T f957bf9749c54be48094092cb80e9055 P 7e9c4f2e01164f33b2e9034ed148398e: stopping tablet replica
I20250625 03:31:22.209774 426 raft_consensus.cc:2241] T f957bf9749c54be48094092cb80e9055 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:31:22.211023 426 raft_consensus.cc:2270] T f957bf9749c54be48094092cb80e9055 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:22.213862 426 tablet_replica.cc:331] T d9038fc1ce0d4b528c02c68012e1277d P 7e9c4f2e01164f33b2e9034ed148398e: stopping tablet replica
I20250625 03:31:22.214677 426 raft_consensus.cc:2241] T d9038fc1ce0d4b528c02c68012e1277d P 7e9c4f2e01164f33b2e9034ed148398e [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:31:22.215842 426 raft_consensus.cc:2270] T d9038fc1ce0d4b528c02c68012e1277d P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:22.218863 426 tablet_replica.cc:331] T b15eb94b9d3d4f6987b5fa5e20193655 P 7e9c4f2e01164f33b2e9034ed148398e: stopping tablet replica
I20250625 03:31:22.219854 426 raft_consensus.cc:2241] T b15eb94b9d3d4f6987b5fa5e20193655 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:22.220888 426 raft_consensus.cc:2270] T b15eb94b9d3d4f6987b5fa5e20193655 P 7e9c4f2e01164f33b2e9034ed148398e [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:22.223901 426 tablet_replica.cc:331] T 9943bb8023444f49a11df01d93738f1e P 7e9c4f2e01164f33b2e9034ed148398e: stopping tablet replica
I20250625 03:31:22.224750 426 raft_consensus.cc:2241] T 9943bb8023444f49a11df01d93738f1e P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:22.225345 426 raft_consensus.cc:2270] T 9943bb8023444f49a11df01d93738f1e P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:22.228180 426 tablet_replica.cc:331] T 93ecdce2da094dc9a80ac04828771fbd P 7e9c4f2e01164f33b2e9034ed148398e: stopping tablet replica
I20250625 03:31:22.228986 426 raft_consensus.cc:2241] T 93ecdce2da094dc9a80ac04828771fbd P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:22.229879 426 raft_consensus.cc:2270] T 93ecdce2da094dc9a80ac04828771fbd P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:22.234359 426 tablet_replica.cc:331] T 441042afd59544a4a04bf85fa69d7d55 P 7e9c4f2e01164f33b2e9034ed148398e: stopping tablet replica
I20250625 03:31:22.235095 426 raft_consensus.cc:2241] T 441042afd59544a4a04bf85fa69d7d55 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:22.235666 426 raft_consensus.cc:2270] T 441042afd59544a4a04bf85fa69d7d55 P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:22.236694 1662 raft_consensus.cc:1273] T f8c715109ff0405997e1ca9952678c0d P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20250625 03:31:22.238343 426 tablet_replica.cc:331] T df29d87d804d44438345052a5902052f P 7e9c4f2e01164f33b2e9034ed148398e: stopping tablet replica
I20250625 03:31:22.239153 426 raft_consensus.cc:2241] T df29d87d804d44438345052a5902052f P 7e9c4f2e01164f33b2e9034ed148398e [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:31:22.240300 426 raft_consensus.cc:2270] T df29d87d804d44438345052a5902052f P 7e9c4f2e01164f33b2e9034ed148398e [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:22.243167 426 tablet_replica.cc:331] T 6e7283d035e1429f946d8ebb98978656 P 7e9c4f2e01164f33b2e9034ed148398e: stopping tablet replica
I20250625 03:31:22.243854 426 raft_consensus.cc:2241] T 6e7283d035e1429f946d8ebb98978656 P 7e9c4f2e01164f33b2e9034ed148398e [term 3 LEADER]: Raft consensus shutting down.
I20250625 03:31:22.244881 426 raft_consensus.cc:2270] T 6e7283d035e1429f946d8ebb98978656 P 7e9c4f2e01164f33b2e9034ed148398e [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:22.249295 3365 consensus_queue.cc:1035] T f8c715109ff0405997e1ca9952678c0d P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20250625 03:31:22.528524 1709 consensus_peers.cc:487] T e58b1ae66ee14c6f8d6f2db8dda2b842 P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:22.619923 2339 raft_consensus.cc:1273] T e58b1ae66ee14c6f8d6f2db8dda2b842 P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20250625 03:31:22.621639 3356 consensus_queue.cc:1035] T e58b1ae66ee14c6f8d6f2db8dda2b842 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20250625 03:31:23.045187 3376 raft_consensus.cc:491] T 59ac1803c12d43448ef566f886cc22e6 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7e9c4f2e01164f33b2e9034ed148398e)
I20250625 03:31:23.045748 3376 raft_consensus.cc:513] T 59ac1803c12d43448ef566f886cc22e6 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
W20250625 03:31:23.052826 1635 leader_election.cc:336] T 59ac1803c12d43448ef566f886cc22e6 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111)
I20250625 03:31:23.054068 1741 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "59ac1803c12d43448ef566f886cc22e6" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:31:23.058004 1636 leader_election.cc:304] T 59ac1803c12d43448ef566f886cc22e6 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206; no voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:31:23.058923 3238 raft_consensus.cc:2747] T 59ac1803c12d43448ef566f886cc22e6 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20250625 03:31:23.059401 3376 leader_election.cc:290] T 59ac1803c12d43448ef566f886cc22e6 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:31:23.089954 3381 raft_consensus.cc:491] T add8a729ea684e7eab256135c01309df P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7e9c4f2e01164f33b2e9034ed148398e)
I20250625 03:31:23.090615 3381 raft_consensus.cc:513] T add8a729ea684e7eab256135c01309df P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:23.093124 3381 leader_election.cc:290] T add8a729ea684e7eab256135c01309df P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:31:23.094080 1662 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "add8a729ea684e7eab256135c01309df" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
W20250625 03:31:23.099277 1709 leader_election.cc:336] T add8a729ea684e7eab256135c01309df P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111)
I20250625 03:31:23.099819 1709 leader_election.cc:304] T add8a729ea684e7eab256135c01309df P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:31:23.101336 3299 raft_consensus.cc:2747] T add8a729ea684e7eab256135c01309df P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20250625 03:31:23.101933 3381 raft_consensus.cc:491] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7e9c4f2e01164f33b2e9034ed148398e)
I20250625 03:31:23.102581 3381 raft_consensus.cc:513] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:23.104686 3381 leader_election.cc:290] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:31:23.105737 1662 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dea2dcc26f144802a16f0884fdd99063" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
W20250625 03:31:23.112843 1709 leader_election.cc:336] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111)
I20250625 03:31:23.113420 1709 leader_election.cc:304] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:31:23.114408 3299 raft_consensus.cc:2747] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20250625 03:31:23.122078 3379 raft_consensus.cc:491] T fa68c3b7143345958f883bde3591b622 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e9c4f2e01164f33b2e9034ed148398e)
I20250625 03:31:23.122876 3379 raft_consensus.cc:513] T fa68c3b7143345958f883bde3591b622 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:23.125988 3355 raft_consensus.cc:491] T a5a18934cc3f490288432ee1cb30b278 P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7e9c4f2e01164f33b2e9034ed148398e)
I20250625 03:31:23.126574 3355 raft_consensus.cc:513] T a5a18934cc3f490288432ee1cb30b278 P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:23.129896 3355 leader_election.cc:290] T a5a18934cc3f490288432ee1cb30b278 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:31:23.134332 3379 leader_election.cc:290] T fa68c3b7143345958f883bde3591b622 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:31:23.135154 1662 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a5a18934cc3f490288432ee1cb30b278" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:31:23.134517 1741 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fa68c3b7143345958f883bde3591b622" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:31:23.150746 3355 raft_consensus.cc:491] T af4573692c104d67994dbb1bc518b568 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e9c4f2e01164f33b2e9034ed148398e)
I20250625 03:31:23.151487 3355 raft_consensus.cc:513] T af4573692c104d67994dbb1bc518b568 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:23.155961 1741 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "af4573692c104d67994dbb1bc518b568" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:31:23.163193 3379 raft_consensus.cc:491] T d9038fc1ce0d4b528c02c68012e1277d P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e9c4f2e01164f33b2e9034ed148398e)
I20250625 03:31:23.164040 3379 raft_consensus.cc:513] T d9038fc1ce0d4b528c02c68012e1277d P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:23.166169 3355 leader_election.cc:290] T af4573692c104d67994dbb1bc518b568 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:31:23.168758 3379 leader_election.cc:290] T d9038fc1ce0d4b528c02c68012e1277d P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:31:23.170213 1741 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d9038fc1ce0d4b528c02c68012e1277d" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
W20250625 03:31:23.180100 2307 leader_election.cc:336] T a5a18934cc3f490288432ee1cb30b278 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111)
I20250625 03:31:23.180678 2307 leader_election.cc:304] T a5a18934cc3f490288432ee1cb30b278 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8b9755d156478aafca552f9e9c539e; no voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:31:23.181654 3408 raft_consensus.cc:2747] T a5a18934cc3f490288432ee1cb30b278 P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20250625 03:31:23.182721 2307 leader_election.cc:336] T fa68c3b7143345958f883bde3591b622 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111)
I20250625 03:31:23.183215 2307 leader_election.cc:304] T fa68c3b7143345958f883bde3591b622 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8b9755d156478aafca552f9e9c539e; no voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:31:23.183987 3408 raft_consensus.cc:2747] T fa68c3b7143345958f883bde3591b622 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20250625 03:31:23.184973 2307 leader_election.cc:336] T af4573692c104d67994dbb1bc518b568 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111)
I20250625 03:31:23.185495 2307 leader_election.cc:304] T af4573692c104d67994dbb1bc518b568 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8b9755d156478aafca552f9e9c539e; no voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:31:23.186245 3408 raft_consensus.cc:2747] T af4573692c104d67994dbb1bc518b568 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20250625 03:31:23.187194 2307 leader_election.cc:336] T d9038fc1ce0d4b528c02c68012e1277d P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111)
I20250625 03:31:23.187697 2307 leader_election.cc:304] T d9038fc1ce0d4b528c02c68012e1277d P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8b9755d156478aafca552f9e9c539e; no voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:31:23.188469 3408 raft_consensus.cc:2747] T d9038fc1ce0d4b528c02c68012e1277d P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250625 03:31:23.189757 3408 raft_consensus.cc:491] T cc3b100d6d574a68b79e6a8f23d77201 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7e9c4f2e01164f33b2e9034ed148398e)
I20250625 03:31:23.190193 3408 raft_consensus.cc:513] T cc3b100d6d574a68b79e6a8f23d77201 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:23.192140 3408 leader_election.cc:290] T cc3b100d6d574a68b79e6a8f23d77201 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:31:23.195621 1662 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cc3b100d6d574a68b79e6a8f23d77201" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
W20250625 03:31:23.199369 2307 leader_election.cc:336] T cc3b100d6d574a68b79e6a8f23d77201 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111)
I20250625 03:31:23.199787 2307 leader_election.cc:304] T cc3b100d6d574a68b79e6a8f23d77201 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8b9755d156478aafca552f9e9c539e; no voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:31:23.200448 3408 raft_consensus.cc:2747] T cc3b100d6d574a68b79e6a8f23d77201 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20250625 03:31:23.212090 3408 raft_consensus.cc:491] T c04f7c2d00994557b1cb83234b36fceb P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7e9c4f2e01164f33b2e9034ed148398e)
I20250625 03:31:23.212622 3408 raft_consensus.cc:513] T c04f7c2d00994557b1cb83234b36fceb P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:23.214205 3408 leader_election.cc:290] T c04f7c2d00994557b1cb83234b36fceb P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
W20250625 03:31:23.218394 2307 leader_election.cc:336] T c04f7c2d00994557b1cb83234b36fceb P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111)
I20250625 03:31:23.218917 1741 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c04f7c2d00994557b1cb83234b36fceb" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:31:23.220041 2308 leader_election.cc:304] T c04f7c2d00994557b1cb83234b36fceb P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8b9755d156478aafca552f9e9c539e; no voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:31:23.220618 3408 raft_consensus.cc:2747] T c04f7c2d00994557b1cb83234b36fceb P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20250625 03:31:23.292164 3407 raft_consensus.cc:491] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7e9c4f2e01164f33b2e9034ed148398e)
I20250625 03:31:23.292796 3407 raft_consensus.cc:513] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:23.295094 3407 leader_election.cc:290] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:31:23.295387 3376 raft_consensus.cc:491] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7e9c4f2e01164f33b2e9034ed148398e)
I20250625 03:31:23.295975 3376 raft_consensus.cc:513] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:23.296675 1741 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c4354f7ffc0e4eabbc92a141d46b7984" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
W20250625 03:31:23.305342 1635 leader_election.cc:336] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111)
I20250625 03:31:23.305801 1635 leader_election.cc:304] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206; no voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:31:23.306684 3407 raft_consensus.cc:2747] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20250625 03:31:23.309376 3376 leader_election.cc:290] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493)
I20250625 03:31:23.311053 2340 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a5a18934cc3f490288432ee1cb30b278" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "df8b9755d156478aafca552f9e9c539e" is_pre_election: true
I20250625 03:31:23.311829 2340 raft_consensus.cc:2466] T a5a18934cc3f490288432ee1cb30b278 P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 3.
I20250625 03:31:23.315016 1634 leader_election.cc:304] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, df8b9755d156478aafca552f9e9c539e; no voters:
I20250625 03:31:23.315805 3376 raft_consensus.cc:2802] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20250625 03:31:23.316181 3376 raft_consensus.cc:491] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7e9c4f2e01164f33b2e9034ed148398e)
I20250625 03:31:23.316447 3376 raft_consensus.cc:3058] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Advancing to term 4
I20250625 03:31:23.319036 3407 raft_consensus.cc:491] T 6e7283d035e1429f946d8ebb98978656 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7e9c4f2e01164f33b2e9034ed148398e)
I20250625 03:31:23.319677 3407 raft_consensus.cc:513] T 6e7283d035e1429f946d8ebb98978656 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:23.321856 3407 leader_election.cc:290] T 6e7283d035e1429f946d8ebb98978656 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493)
I20250625 03:31:23.321743 3376 raft_consensus.cc:513] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:23.323168 2340 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6e7283d035e1429f946d8ebb98978656" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "df8b9755d156478aafca552f9e9c539e" is_pre_election: true
W20250625 03:31:23.323312 1635 leader_election.cc:336] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111)
I20250625 03:31:23.324337 3376 leader_election.cc:290] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 4 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493)
I20250625 03:31:23.325661 2340 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a5a18934cc3f490288432ee1cb30b278" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "df8b9755d156478aafca552f9e9c539e"
I20250625 03:31:23.326267 2340 raft_consensus.cc:3058] T a5a18934cc3f490288432ee1cb30b278 P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Advancing to term 4
W20250625 03:31:23.329190 1635 leader_election.cc:336] T 6e7283d035e1429f946d8ebb98978656 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111)
I20250625 03:31:23.329707 1635 leader_election.cc:304] T 6e7283d035e1429f946d8ebb98978656 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206; no voters: 7e9c4f2e01164f33b2e9034ed148398e, df8b9755d156478aafca552f9e9c539e
W20250625 03:31:23.330756 1635 leader_election.cc:336] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111)
I20250625 03:31:23.334434 2340 raft_consensus.cc:2466] T a5a18934cc3f490288432ee1cb30b278 P df8b9755d156478aafca552f9e9c539e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 4.
I20250625 03:31:23.334975 3376 raft_consensus.cc:2747] T 6e7283d035e1429f946d8ebb98978656 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20250625 03:31:23.335521 1634 leader_election.cc:304] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, df8b9755d156478aafca552f9e9c539e; no voters: 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:31:23.336225 3376 raft_consensus.cc:2802] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206 [term 4 FOLLOWER]: Leader election won for term 4
I20250625 03:31:23.336687 3376 raft_consensus.cc:695] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206 [term 4 LEADER]: Becoming Leader. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Running, Role: LEADER
I20250625 03:31:23.337440 3376 consensus_queue.cc:237] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:23.348577 1493 catalog_manager.cc:5582] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: term changed from 3 to 4, leader changed from 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) to 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130). New cstate: current_term: 4 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:23.367426 3376 raft_consensus.cc:491] T add8a729ea684e7eab256135c01309df P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7e9c4f2e01164f33b2e9034ed148398e)
I20250625 03:31:23.367878 3376 raft_consensus.cc:513] T add8a729ea684e7eab256135c01309df P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:23.369534 3376 leader_election.cc:290] T add8a729ea684e7eab256135c01309df P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:31:23.370580 1741 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "add8a729ea684e7eab256135c01309df" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:31:23.371245 1741 raft_consensus.cc:2466] T add8a729ea684e7eab256135c01309df P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 2.
I20250625 03:31:23.372361 1636 leader_election.cc:304] T add8a729ea684e7eab256135c01309df P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters:
I20250625 03:31:23.373245 3376 raft_consensus.cc:2802] T add8a729ea684e7eab256135c01309df P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20250625 03:31:23.373375 1635 leader_election.cc:336] T add8a729ea684e7eab256135c01309df P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111)
I20250625 03:31:23.373697 3376 raft_consensus.cc:491] T add8a729ea684e7eab256135c01309df P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7e9c4f2e01164f33b2e9034ed148398e)
I20250625 03:31:23.374186 3376 raft_consensus.cc:3058] T add8a729ea684e7eab256135c01309df P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:23.379398 3376 raft_consensus.cc:513] T add8a729ea684e7eab256135c01309df P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
W20250625 03:31:23.380893 426 thread.cc:535] Waited for 1000ms trying to join with diag-logger (tid 1617)
I20250625 03:31:23.382869 1741 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "add8a729ea684e7eab256135c01309df" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:31:23.383642 1741 raft_consensus.cc:3058] T add8a729ea684e7eab256135c01309df P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:23.387337 3376 leader_election.cc:290] T add8a729ea684e7eab256135c01309df P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 3 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
W20250625 03:31:23.388747 1635 leader_election.cc:336] T add8a729ea684e7eab256135c01309df P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111)
I20250625 03:31:23.389083 3299 raft_consensus.cc:491] T 59ac1803c12d43448ef566f886cc22e6 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7e9c4f2e01164f33b2e9034ed148398e)
I20250625 03:31:23.389797 3299 raft_consensus.cc:513] T 59ac1803c12d43448ef566f886cc22e6 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:23.391847 3299 leader_election.cc:290] T 59ac1803c12d43448ef566f886cc22e6 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:31:23.394148 1741 raft_consensus.cc:2466] T add8a729ea684e7eab256135c01309df P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 3.
I20250625 03:31:23.395852 3299 raft_consensus.cc:491] T d9038fc1ce0d4b528c02c68012e1277d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e9c4f2e01164f33b2e9034ed148398e)
I20250625 03:31:23.396476 3299 raft_consensus.cc:513] T d9038fc1ce0d4b528c02c68012e1277d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:23.398029 1662 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "59ac1803c12d43448ef566f886cc22e6" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:31:23.398665 1662 raft_consensus.cc:2466] T 59ac1803c12d43448ef566f886cc22e6 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 2.
I20250625 03:31:23.398530 3299 leader_election.cc:290] T d9038fc1ce0d4b528c02c68012e1277d P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493)
I20250625 03:31:23.400225 2340 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d9038fc1ce0d4b528c02c68012e1277d" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "df8b9755d156478aafca552f9e9c539e" is_pre_election: true
I20250625 03:31:23.400570 1636 leader_election.cc:304] T add8a729ea684e7eab256135c01309df P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:31:23.400956 2340 raft_consensus.cc:2466] T d9038fc1ce0d4b528c02c68012e1277d P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 1.
I20250625 03:31:23.400295 1708 leader_election.cc:304] T 59ac1803c12d43448ef566f886cc22e6 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters:
I20250625 03:31:23.401975 3407 raft_consensus.cc:2802] T add8a729ea684e7eab256135c01309df P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Leader election won for term 3
I20250625 03:31:23.402110 1708 leader_election.cc:304] T d9038fc1ce0d4b528c02c68012e1277d P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1, df8b9755d156478aafca552f9e9c539e; no voters:
I20250625 03:31:23.403656 3381 raft_consensus.cc:2802] T d9038fc1ce0d4b528c02c68012e1277d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250625 03:31:23.402006 3299 raft_consensus.cc:2802] T 59ac1803c12d43448ef566f886cc22e6 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20250625 03:31:23.404042 3381 raft_consensus.cc:491] T d9038fc1ce0d4b528c02c68012e1277d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7e9c4f2e01164f33b2e9034ed148398e)
I20250625 03:31:23.404488 3381 raft_consensus.cc:3058] T d9038fc1ce0d4b528c02c68012e1277d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:23.402626 3407 raft_consensus.cc:695] T add8a729ea684e7eab256135c01309df P 3f2aa40978064c9e9983cf3745eed206 [term 3 LEADER]: Becoming Leader. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Running, Role: LEADER
I20250625 03:31:23.404458 3299 raft_consensus.cc:491] T 59ac1803c12d43448ef566f886cc22e6 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7e9c4f2e01164f33b2e9034ed148398e)
I20250625 03:31:23.411677 3299 raft_consensus.cc:3058] T 59ac1803c12d43448ef566f886cc22e6 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:23.414115 3385 raft_consensus.cc:491] T fa68c3b7143345958f883bde3591b622 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e9c4f2e01164f33b2e9034ed148398e)
I20250625 03:31:23.414896 3385 raft_consensus.cc:513] T fa68c3b7143345958f883bde3591b622 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:23.416455 3407 consensus_queue.cc:237] T add8a729ea684e7eab256135c01309df P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:23.416949 3385 leader_election.cc:290] T fa68c3b7143345958f883bde3591b622 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493)
I20250625 03:31:23.419317 2340 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fa68c3b7143345958f883bde3591b622" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "df8b9755d156478aafca552f9e9c539e" is_pre_election: true
I20250625 03:31:23.419905 2340 raft_consensus.cc:2466] T fa68c3b7143345958f883bde3591b622 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 1.
I20250625 03:31:23.421020 1708 leader_election.cc:304] T fa68c3b7143345958f883bde3591b622 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1, df8b9755d156478aafca552f9e9c539e; no voters:
I20250625 03:31:23.421741 3385 raft_consensus.cc:2802] T fa68c3b7143345958f883bde3591b622 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250625 03:31:23.422137 3385 raft_consensus.cc:491] T fa68c3b7143345958f883bde3591b622 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7e9c4f2e01164f33b2e9034ed148398e)
I20250625 03:31:23.422487 3385 raft_consensus.cc:3058] T fa68c3b7143345958f883bde3591b622 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:23.430608 3381 raft_consensus.cc:513] T d9038fc1ce0d4b528c02c68012e1277d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:23.434067 2340 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d9038fc1ce0d4b528c02c68012e1277d" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "df8b9755d156478aafca552f9e9c539e"
I20250625 03:31:23.434769 2340 raft_consensus.cc:3058] T d9038fc1ce0d4b528c02c68012e1277d P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:23.436399 3385 raft_consensus.cc:513] T fa68c3b7143345958f883bde3591b622 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:23.438411 3355 raft_consensus.cc:491] T f9458dec7953448d8550396d67fad249 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7e9c4f2e01164f33b2e9034ed148398e)
I20250625 03:31:23.438983 3355 raft_consensus.cc:513] T f9458dec7953448d8550396d67fad249 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:23.442409 2340 raft_consensus.cc:2466] T d9038fc1ce0d4b528c02c68012e1277d P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 2.
I20250625 03:31:23.443496 1708 leader_election.cc:304] T d9038fc1ce0d4b528c02c68012e1277d P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1, df8b9755d156478aafca552f9e9c539e; no voters:
I20250625 03:31:23.443509 3355 leader_election.cc:290] T f9458dec7953448d8550396d67fad249 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:31:23.445096 1662 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f9458dec7953448d8550396d67fad249" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
W20250625 03:31:23.445742 2307 leader_election.cc:336] T f9458dec7953448d8550396d67fad249 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111)
I20250625 03:31:23.446475 3381 leader_election.cc:290] T d9038fc1ce0d4b528c02c68012e1277d P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 2 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493)
I20250625 03:31:23.447067 3381 raft_consensus.cc:2802] T d9038fc1ce0d4b528c02c68012e1277d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:31:23.447506 3381 raft_consensus.cc:695] T d9038fc1ce0d4b528c02c68012e1277d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 LEADER]: Becoming Leader. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Running, Role: LEADER
I20250625 03:31:23.448323 3381 consensus_queue.cc:237] T d9038fc1ce0d4b528c02c68012e1277d P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:23.452131 2306 leader_election.cc:304] T f9458dec7953448d8550396d67fad249 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8b9755d156478aafca552f9e9c539e; no voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:31:23.453205 3355 raft_consensus.cc:2747] T f9458dec7953448d8550396d67fad249 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20250625 03:31:23.454542 1493 catalog_manager.cc:5582] T add8a729ea684e7eab256135c01309df P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: term changed from 2 to 3, leader changed from 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) to 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130). New cstate: current_term: 3 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:23.458904 3299 raft_consensus.cc:513] T 59ac1803c12d43448ef566f886cc22e6 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:23.462118 3385 leader_election.cc:290] T fa68c3b7143345958f883bde3591b622 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 2 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493)
I20250625 03:31:23.465056 2340 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fa68c3b7143345958f883bde3591b622" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "df8b9755d156478aafca552f9e9c539e"
I20250625 03:31:23.474799 3407 raft_consensus.cc:491] T cc3b100d6d574a68b79e6a8f23d77201 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7e9c4f2e01164f33b2e9034ed148398e)
I20250625 03:31:23.475231 2340 raft_consensus.cc:3058] T fa68c3b7143345958f883bde3591b622 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:23.475553 3407 raft_consensus.cc:513] T cc3b100d6d574a68b79e6a8f23d77201 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:23.477764 3407 leader_election.cc:290] T cc3b100d6d574a68b79e6a8f23d77201 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493)
I20250625 03:31:23.479568 2339 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cc3b100d6d574a68b79e6a8f23d77201" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "df8b9755d156478aafca552f9e9c539e" is_pre_election: true
I20250625 03:31:23.480234 2339 raft_consensus.cc:2466] T cc3b100d6d574a68b79e6a8f23d77201 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 2.
I20250625 03:31:23.481325 1634 leader_election.cc:304] T cc3b100d6d574a68b79e6a8f23d77201 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, df8b9755d156478aafca552f9e9c539e; no voters:
I20250625 03:31:23.482203 3407 raft_consensus.cc:2802] T cc3b100d6d574a68b79e6a8f23d77201 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20250625 03:31:23.484647 3407 raft_consensus.cc:491] T cc3b100d6d574a68b79e6a8f23d77201 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7e9c4f2e01164f33b2e9034ed148398e)
I20250625 03:31:23.485055 3407 raft_consensus.cc:3058] T cc3b100d6d574a68b79e6a8f23d77201 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Advancing to term 3
W20250625 03:31:23.491466 1635 leader_election.cc:336] T cc3b100d6d574a68b79e6a8f23d77201 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111)
I20250625 03:31:23.493325 2340 raft_consensus.cc:2466] T fa68c3b7143345958f883bde3591b622 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 2.
I20250625 03:31:23.493014 1493 catalog_manager.cc:5582] T d9038fc1ce0d4b528c02c68012e1277d P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: term changed from 1 to 2, leader changed from 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) to ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131). New cstate: current_term: 2 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20250625 03:31:23.494659 1709 leader_election.cc:336] T 59ac1803c12d43448ef566f886cc22e6 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111)
I20250625 03:31:23.495019 1708 leader_election.cc:304] T fa68c3b7143345958f883bde3591b622 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1, df8b9755d156478aafca552f9e9c539e; no voters:
I20250625 03:31:23.497496 3385 raft_consensus.cc:2802] T fa68c3b7143345958f883bde3591b622 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:31:23.499537 3299 leader_election.cc:290] T 59ac1803c12d43448ef566f886cc22e6 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 3 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:31:23.500687 1662 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "59ac1803c12d43448ef566f886cc22e6" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:31:23.501231 1662 raft_consensus.cc:3058] T 59ac1803c12d43448ef566f886cc22e6 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:23.506042 3416 raft_consensus.cc:491] T c04f7c2d00994557b1cb83234b36fceb P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7e9c4f2e01164f33b2e9034ed148398e)
I20250625 03:31:23.508452 3416 raft_consensus.cc:513] T c04f7c2d00994557b1cb83234b36fceb P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:23.512885 2339 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c04f7c2d00994557b1cb83234b36fceb" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "df8b9755d156478aafca552f9e9c539e" is_pre_election: true
I20250625 03:31:23.513562 2339 raft_consensus.cc:2466] T c04f7c2d00994557b1cb83234b36fceb P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 2.
I20250625 03:31:23.514760 1708 leader_election.cc:304] T c04f7c2d00994557b1cb83234b36fceb P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1, df8b9755d156478aafca552f9e9c539e; no voters:
I20250625 03:31:23.515241 3407 raft_consensus.cc:513] T cc3b100d6d574a68b79e6a8f23d77201 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:23.511257 1662 raft_consensus.cc:2466] T 59ac1803c12d43448ef566f886cc22e6 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 3.
I20250625 03:31:23.517267 1708 leader_election.cc:304] T 59ac1803c12d43448ef566f886cc22e6 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters:
I20250625 03:31:23.517987 3416 leader_election.cc:290] T c04f7c2d00994557b1cb83234b36fceb P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493)
I20250625 03:31:23.519371 3416 raft_consensus.cc:2802] T c04f7c2d00994557b1cb83234b36fceb P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20250625 03:31:23.519824 3416 raft_consensus.cc:491] T c04f7c2d00994557b1cb83234b36fceb P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7e9c4f2e01164f33b2e9034ed148398e)
I20250625 03:31:23.520303 3416 raft_consensus.cc:3058] T c04f7c2d00994557b1cb83234b36fceb P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:23.523109 3408 raft_consensus.cc:491] T e88f79ed06514e01a9bc48261a5acfbb P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7e9c4f2e01164f33b2e9034ed148398e)
W20250625 03:31:23.524376 1635 leader_election.cc:336] T cc3b100d6d574a68b79e6a8f23d77201 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111)
I20250625 03:31:23.523751 3408 raft_consensus.cc:513] T e88f79ed06514e01a9bc48261a5acfbb P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:23.526952 3421 raft_consensus.cc:2802] T 59ac1803c12d43448ef566f886cc22e6 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Leader election won for term 3
I20250625 03:31:23.527463 3421 raft_consensus.cc:695] T 59ac1803c12d43448ef566f886cc22e6 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 LEADER]: Becoming Leader. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Running, Role: LEADER
I20250625 03:31:23.528185 3408 leader_election.cc:290] T e88f79ed06514e01a9bc48261a5acfbb P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:31:23.528366 3421 consensus_queue.cc:237] T 59ac1803c12d43448ef566f886cc22e6 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:23.532058 3385 raft_consensus.cc:695] T fa68c3b7143345958f883bde3591b622 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 LEADER]: Becoming Leader. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Running, Role: LEADER
I20250625 03:31:23.532991 3385 consensus_queue.cc:237] T fa68c3b7143345958f883bde3591b622 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
W20250625 03:31:23.535782 2307 leader_election.cc:336] T e88f79ed06514e01a9bc48261a5acfbb P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111)
I20250625 03:31:23.537839 1662 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e88f79ed06514e01a9bc48261a5acfbb" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:31:23.538506 3422 raft_consensus.cc:491] T af4573692c104d67994dbb1bc518b568 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e9c4f2e01164f33b2e9034ed148398e)
I20250625 03:31:23.539032 3422 raft_consensus.cc:513] T af4573692c104d67994dbb1bc518b568 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
W20250625 03:31:23.539119 1709 leader_election.cc:336] T d9038fc1ce0d4b528c02c68012e1277d P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111)
I20250625 03:31:23.539710 2306 leader_election.cc:304] T e88f79ed06514e01a9bc48261a5acfbb P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8b9755d156478aafca552f9e9c539e; no voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:31:23.535424 3416 raft_consensus.cc:513] T c04f7c2d00994557b1cb83234b36fceb P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:23.541000 3422 leader_election.cc:290] T af4573692c104d67994dbb1bc518b568 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493)
I20250625 03:31:23.540527 3408 raft_consensus.cc:2747] T e88f79ed06514e01a9bc48261a5acfbb P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20250625 03:31:23.541975 2340 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "af4573692c104d67994dbb1bc518b568" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "df8b9755d156478aafca552f9e9c539e" is_pre_election: true
I20250625 03:31:23.542886 2340 raft_consensus.cc:2466] T af4573692c104d67994dbb1bc518b568 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 1.
I20250625 03:31:23.544059 1708 leader_election.cc:304] T af4573692c104d67994dbb1bc518b568 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1, df8b9755d156478aafca552f9e9c539e; no voters:
I20250625 03:31:23.545806 2340 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c04f7c2d00994557b1cb83234b36fceb" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "df8b9755d156478aafca552f9e9c539e"
I20250625 03:31:23.546294 3422 raft_consensus.cc:2802] T af4573692c104d67994dbb1bc518b568 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250625 03:31:23.546931 3422 raft_consensus.cc:491] T af4573692c104d67994dbb1bc518b568 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7e9c4f2e01164f33b2e9034ed148398e)
I20250625 03:31:23.547328 3422 raft_consensus.cc:3058] T af4573692c104d67994dbb1bc518b568 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Advancing to term 2
W20250625 03:31:23.549744 1709 leader_election.cc:336] T fa68c3b7143345958f883bde3591b622 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111)
I20250625 03:31:23.546475 2340 raft_consensus.cc:3058] T c04f7c2d00994557b1cb83234b36fceb P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:23.551718 2339 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cc3b100d6d574a68b79e6a8f23d77201" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "df8b9755d156478aafca552f9e9c539e"
I20250625 03:31:23.552368 2339 raft_consensus.cc:3058] T cc3b100d6d574a68b79e6a8f23d77201 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Advancing to term 3
W20250625 03:31:23.554214 1709 leader_election.cc:336] T d9038fc1ce0d4b528c02c68012e1277d P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111)
I20250625 03:31:23.544155 3416 leader_election.cc:290] T c04f7c2d00994557b1cb83234b36fceb P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 3 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493)
W20250625 03:31:23.556960 1709 leader_election.cc:336] T fa68c3b7143345958f883bde3591b622 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111)
I20250625 03:31:23.558583 3408 raft_consensus.cc:491] T 6e7283d035e1429f946d8ebb98978656 P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7e9c4f2e01164f33b2e9034ed148398e)
I20250625 03:31:23.559100 3408 raft_consensus.cc:513] T 6e7283d035e1429f946d8ebb98978656 P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:23.562919 3408 leader_election.cc:290] T 6e7283d035e1429f946d8ebb98978656 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:31:23.564723 3376 raft_consensus.cc:491] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7e9c4f2e01164f33b2e9034ed148398e)
I20250625 03:31:23.569190 3422 raft_consensus.cc:513] T af4573692c104d67994dbb1bc518b568 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:23.569826 3376 raft_consensus.cc:513] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:23.571159 3422 leader_election.cc:290] T af4573692c104d67994dbb1bc518b568 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 2 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493)
I20250625 03:31:23.560603 2340 raft_consensus.cc:2466] T c04f7c2d00994557b1cb83234b36fceb P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 3.
I20250625 03:31:23.572360 3376 leader_election.cc:290] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493)
I20250625 03:31:23.573402 1662 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6e7283d035e1429f946d8ebb98978656" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:31:23.573743 1708 leader_election.cc:304] T c04f7c2d00994557b1cb83234b36fceb P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1, df8b9755d156478aafca552f9e9c539e; no voters:
I20250625 03:31:23.573971 2340 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "af4573692c104d67994dbb1bc518b568" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "df8b9755d156478aafca552f9e9c539e"
I20250625 03:31:23.574636 2340 raft_consensus.cc:3058] T af4573692c104d67994dbb1bc518b568 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:23.575614 3416 raft_consensus.cc:2802] T c04f7c2d00994557b1cb83234b36fceb P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Leader election won for term 3
I20250625 03:31:23.576277 3416 raft_consensus.cc:695] T c04f7c2d00994557b1cb83234b36fceb P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 LEADER]: Becoming Leader. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Running, Role: LEADER
I20250625 03:31:23.563171 2339 raft_consensus.cc:2466] T cc3b100d6d574a68b79e6a8f23d77201 P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 3.
I20250625 03:31:23.568840 3238 raft_consensus.cc:491] T f9458dec7953448d8550396d67fad249 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7e9c4f2e01164f33b2e9034ed148398e)
W20250625 03:31:23.576917 1709 leader_election.cc:336] T 59ac1803c12d43448ef566f886cc22e6 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111)
I20250625 03:31:23.574088 1662 raft_consensus.cc:2466] T 6e7283d035e1429f946d8ebb98978656 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df8b9755d156478aafca552f9e9c539e in term 3.
I20250625 03:31:23.577306 3238 raft_consensus.cc:513] T f9458dec7953448d8550396d67fad249 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:23.577291 3416 consensus_queue.cc:237] T c04f7c2d00994557b1cb83234b36fceb P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:23.579289 3238 leader_election.cc:290] T f9458dec7953448d8550396d67fad249 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493)
I20250625 03:31:23.581475 2306 leader_election.cc:304] T 6e7283d035e1429f946d8ebb98978656 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, df8b9755d156478aafca552f9e9c539e; no voters:
I20250625 03:31:23.582293 3408 raft_consensus.cc:491] T df29d87d804d44438345052a5902052f P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e9c4f2e01164f33b2e9034ed148398e)
I20250625 03:31:23.582417 3355 raft_consensus.cc:2802] T 6e7283d035e1429f946d8ebb98978656 P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20250625 03:31:23.583820 3355 raft_consensus.cc:491] T 6e7283d035e1429f946d8ebb98978656 P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7e9c4f2e01164f33b2e9034ed148398e)
I20250625 03:31:23.584390 3355 raft_consensus.cc:3058] T 6e7283d035e1429f946d8ebb98978656 P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Advancing to term 4
I20250625 03:31:23.587332 3238 raft_consensus.cc:491] T dea2dcc26f144802a16f0884fdd99063 P 3f2aa40978064c9e9983cf3745eed206 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7e9c4f2e01164f33b2e9034ed148398e)
I20250625 03:31:23.587826 3238 raft_consensus.cc:513] T dea2dcc26f144802a16f0884fdd99063 P 3f2aa40978064c9e9983cf3745eed206 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
W20250625 03:31:23.589376 1635 leader_election.cc:336] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111)
I20250625 03:31:23.589555 3238 leader_election.cc:290] T dea2dcc26f144802a16f0884fdd99063 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
W20250625 03:31:23.589892 1635 leader_election.cc:336] T f9458dec7953448d8550396d67fad249 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111)
I20250625 03:31:23.590624 1741 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dea2dcc26f144802a16f0884fdd99063" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
W20250625 03:31:23.591259 2307 leader_election.cc:336] T 6e7283d035e1429f946d8ebb98978656 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111)
I20250625 03:31:23.591311 1741 raft_consensus.cc:2466] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 4.
I20250625 03:31:23.592561 1634 leader_election.cc:304] T cc3b100d6d574a68b79e6a8f23d77201 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, df8b9755d156478aafca552f9e9c539e; no voters: 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:31:23.592654 1636 leader_election.cc:304] T dea2dcc26f144802a16f0884fdd99063 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters:
I20250625 03:31:23.593336 3238 raft_consensus.cc:2802] T cc3b100d6d574a68b79e6a8f23d77201 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Leader election won for term 3
I20250625 03:31:23.593575 3376 raft_consensus.cc:2802] T dea2dcc26f144802a16f0884fdd99063 P 3f2aa40978064c9e9983cf3745eed206 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20250625 03:31:23.593925 3376 raft_consensus.cc:491] T dea2dcc26f144802a16f0884fdd99063 P 3f2aa40978064c9e9983cf3745eed206 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7e9c4f2e01164f33b2e9034ed148398e)
I20250625 03:31:23.594353 3376 raft_consensus.cc:3058] T dea2dcc26f144802a16f0884fdd99063 P 3f2aa40978064c9e9983cf3745eed206 [term 4 FOLLOWER]: Advancing to term 5
I20250625 03:31:23.583016 3408 raft_consensus.cc:513] T df29d87d804d44438345052a5902052f P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:23.566897 3407 leader_election.cc:290] T cc3b100d6d574a68b79e6a8f23d77201 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 3 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493)
I20250625 03:31:23.603670 1741 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "df29d87d804d44438345052a5902052f" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:31:23.605949 2339 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e88f79ed06514e01a9bc48261a5acfbb" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "df8b9755d156478aafca552f9e9c539e" is_pre_election: true
I20250625 03:31:23.606259 3408 leader_election.cc:290] T df29d87d804d44438345052a5902052f P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:31:23.606755 2339 raft_consensus.cc:2466] T e88f79ed06514e01a9bc48261a5acfbb P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 2.
W20250625 03:31:23.607432 1635 leader_election.cc:336] T dea2dcc26f144802a16f0884fdd99063 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111)
I20250625 03:31:23.609117 2338 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f9458dec7953448d8550396d67fad249" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "df8b9755d156478aafca552f9e9c539e" is_pre_election: true
I20250625 03:31:23.609843 2338 raft_consensus.cc:2466] T f9458dec7953448d8550396d67fad249 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 2.
I20250625 03:31:23.612941 1634 leader_election.cc:304] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, df8b9755d156478aafca552f9e9c539e; no voters: 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:31:23.614161 3407 raft_consensus.cc:2802] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20250625 03:31:23.614622 3407 raft_consensus.cc:491] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7e9c4f2e01164f33b2e9034ed148398e)
I20250625 03:31:23.615068 3407 raft_consensus.cc:3058] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:23.620572 2340 raft_consensus.cc:2466] T af4573692c104d67994dbb1bc518b568 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 2.
I20250625 03:31:23.621052 1634 leader_election.cc:304] T f9458dec7953448d8550396d67fad249 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, df8b9755d156478aafca552f9e9c539e; no voters: 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:31:23.621762 1708 leader_election.cc:304] T af4573692c104d67994dbb1bc518b568 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1, df8b9755d156478aafca552f9e9c539e; no voters:
I20250625 03:31:23.622785 3421 raft_consensus.cc:2802] T af4573692c104d67994dbb1bc518b568 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:31:23.617281 3355 raft_consensus.cc:513] T 6e7283d035e1429f946d8ebb98978656 P df8b9755d156478aafca552f9e9c539e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:23.623363 3421 raft_consensus.cc:695] T af4573692c104d67994dbb1bc518b568 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 LEADER]: Becoming Leader. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Running, Role: LEADER
I20250625 03:31:23.632725 3419 raft_consensus.cc:491] T c4354f7ffc0e4eabbc92a141d46b7984 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7e9c4f2e01164f33b2e9034ed148398e)
I20250625 03:31:23.633281 3419 raft_consensus.cc:513] T c4354f7ffc0e4eabbc92a141d46b7984 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:23.635316 3419 leader_election.cc:290] T c4354f7ffc0e4eabbc92a141d46b7984 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:31:23.636266 3419 raft_consensus.cc:491] T df29d87d804d44438345052a5902052f P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e9c4f2e01164f33b2e9034ed148398e)
I20250625 03:31:23.635509 1493 catalog_manager.cc:5582] T fa68c3b7143345958f883bde3591b622 P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: term changed from 1 to 2, leader changed from 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) to ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131). New cstate: current_term: 2 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:23.636296 1662 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6e7283d035e1429f946d8ebb98978656" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:31:23.637943 1662 raft_consensus.cc:3058] T 6e7283d035e1429f946d8ebb98978656 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Advancing to term 4
I20250625 03:31:23.636786 3419 raft_consensus.cc:513] T df29d87d804d44438345052a5902052f P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:23.641319 3427 raft_consensus.cc:2802] T f9458dec7953448d8550396d67fad249 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20250625 03:31:23.641773 3419 leader_election.cc:290] T df29d87d804d44438345052a5902052f P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493)
I20250625 03:31:23.641726 3427 raft_consensus.cc:491] T f9458dec7953448d8550396d67fad249 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7e9c4f2e01164f33b2e9034ed148398e)
I20250625 03:31:23.642781 3427 raft_consensus.cc:3058] T f9458dec7953448d8550396d67fad249 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:23.647365 1662 raft_consensus.cc:2466] T 6e7283d035e1429f946d8ebb98978656 P 3f2aa40978064c9e9983cf3745eed206 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df8b9755d156478aafca552f9e9c539e in term 4.
W20250625 03:31:23.650430 1709 leader_election.cc:336] T c04f7c2d00994557b1cb83234b36fceb P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111)
I20250625 03:31:23.653265 2338 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "df29d87d804d44438345052a5902052f" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "df8b9755d156478aafca552f9e9c539e" is_pre_election: true
I20250625 03:31:23.654064 2338 raft_consensus.cc:2466] T df29d87d804d44438345052a5902052f P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 1.
I20250625 03:31:23.655126 1708 leader_election.cc:304] T df29d87d804d44438345052a5902052f P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1, df8b9755d156478aafca552f9e9c539e; no voters:
I20250625 03:31:23.655460 3376 raft_consensus.cc:513] T dea2dcc26f144802a16f0884fdd99063 P 3f2aa40978064c9e9983cf3745eed206 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:23.657517 3238 raft_consensus.cc:695] T cc3b100d6d574a68b79e6a8f23d77201 P 3f2aa40978064c9e9983cf3745eed206 [term 3 LEADER]: Becoming Leader. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Running, Role: LEADER
I20250625 03:31:23.658198 3376 leader_election.cc:290] T dea2dcc26f144802a16f0884fdd99063 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 5 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:31:23.658350 3238 consensus_queue.cc:237] T cc3b100d6d574a68b79e6a8f23d77201 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:23.659677 3419 raft_consensus.cc:2802] T df29d87d804d44438345052a5902052f P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250625 03:31:23.660131 3419 raft_consensus.cc:491] T df29d87d804d44438345052a5902052f P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7e9c4f2e01164f33b2e9034ed148398e)
I20250625 03:31:23.660625 3419 raft_consensus.cc:3058] T df29d87d804d44438345052a5902052f P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Advancing to term 2
W20250625 03:31:23.641695 2307 leader_election.cc:336] T df29d87d804d44438345052a5902052f P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111)
I20250625 03:31:23.657209 3407 raft_consensus.cc:513] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:23.667228 3407 leader_election.cc:290] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 3 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493)
W20250625 03:31:23.664937 1635 leader_election.cc:336] T dea2dcc26f144802a16f0884fdd99063 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111)
W20250625 03:31:23.664748 1709 leader_election.cc:336] T af4573692c104d67994dbb1bc518b568 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111)
W20250625 03:31:23.668614 1709 leader_election.cc:336] T c04f7c2d00994557b1cb83234b36fceb P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111)
I20250625 03:31:23.665288 2307 leader_election.cc:304] T df29d87d804d44438345052a5902052f P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8b9755d156478aafca552f9e9c539e; no voters: 7e9c4f2e01164f33b2e9034ed148398e, ba464e89e0f044a0a0ea3e6125cbf2a1
W20250625 03:31:23.672621 1709 leader_election.cc:336] T af4573692c104d67994dbb1bc518b568 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111)
I20250625 03:31:23.672204 3409 raft_consensus.cc:2747] T df29d87d804d44438345052a5902052f P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250625 03:31:23.669303 3355 leader_election.cc:290] T 6e7283d035e1429f946d8ebb98978656 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 4 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:31:23.675184 1666 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c4354f7ffc0e4eabbc92a141d46b7984" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:31:23.630316 3421 consensus_queue.cc:237] T af4573692c104d67994dbb1bc518b568 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:23.688731 2306 leader_election.cc:304] T 6e7283d035e1429f946d8ebb98978656 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, df8b9755d156478aafca552f9e9c539e; no voters:
I20250625 03:31:23.658226 3427 raft_consensus.cc:513] T f9458dec7953448d8550396d67fad249 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:23.693778 1666 raft_consensus.cc:2466] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 4.
I20250625 03:31:23.704335 1708 leader_election.cc:304] T c4354f7ffc0e4eabbc92a141d46b7984 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters:
I20250625 03:31:23.703795 3355 raft_consensus.cc:491] T f957bf9749c54be48094092cb80e9055 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7e9c4f2e01164f33b2e9034ed148398e)
I20250625 03:31:23.705698 3355 raft_consensus.cc:513] T f957bf9749c54be48094092cb80e9055 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:23.705195 3381 raft_consensus.cc:2802] T c4354f7ffc0e4eabbc92a141d46b7984 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20250625 03:31:23.707679 3355 leader_election.cc:290] T f957bf9749c54be48094092cb80e9055 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:31:23.707883 3381 raft_consensus.cc:491] T c4354f7ffc0e4eabbc92a141d46b7984 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7e9c4f2e01164f33b2e9034ed148398e)
I20250625 03:31:23.715978 1493 catalog_manager.cc:5582] T cc3b100d6d574a68b79e6a8f23d77201 P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: term changed from 2 to 3, leader changed from 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) to 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130). New cstate: current_term: 3 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:23.702637 3428 raft_consensus.cc:491] T f957bf9749c54be48094092cb80e9055 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7e9c4f2e01164f33b2e9034ed148398e)
W20250625 03:31:23.709172 1635 leader_election.cc:336] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111)
I20250625 03:31:23.718096 3428 raft_consensus.cc:513] T f957bf9749c54be48094092cb80e9055 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:23.720417 3419 raft_consensus.cc:513] T df29d87d804d44438345052a5902052f P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:23.721415 1668 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f957bf9749c54be48094092cb80e9055" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206" is_pre_election: true
I20250625 03:31:23.722038 1668 raft_consensus.cc:2466] T f957bf9749c54be48094092cb80e9055 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df8b9755d156478aafca552f9e9c539e in term 2.
I20250625 03:31:23.722407 3419 leader_election.cc:290] T df29d87d804d44438345052a5902052f P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 2 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493)
I20250625 03:31:23.720767 3428 leader_election.cc:290] T f957bf9749c54be48094092cb80e9055 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493)
W20250625 03:31:23.727113 1709 leader_election.cc:336] T df29d87d804d44438345052a5902052f P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111)
I20250625 03:31:23.726907 2306 leader_election.cc:304] T f957bf9749c54be48094092cb80e9055 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, df8b9755d156478aafca552f9e9c539e; no voters:
I20250625 03:31:23.728165 3408 raft_consensus.cc:2802] T f957bf9749c54be48094092cb80e9055 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20250625 03:31:23.728541 3408 raft_consensus.cc:491] T f957bf9749c54be48094092cb80e9055 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7e9c4f2e01164f33b2e9034ed148398e)
I20250625 03:31:23.728899 3408 raft_consensus.cc:3058] T f957bf9749c54be48094092cb80e9055 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Advancing to term 3
W20250625 03:31:23.729144 2307 leader_election.cc:336] T 6e7283d035e1429f946d8ebb98978656 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111)
I20250625 03:31:23.703924 3409 raft_consensus.cc:2802] T 6e7283d035e1429f946d8ebb98978656 P df8b9755d156478aafca552f9e9c539e [term 4 FOLLOWER]: Leader election won for term 4
I20250625 03:31:23.712145 3427 leader_election.cc:290] T f9458dec7953448d8550396d67fad249 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 3 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493)
I20250625 03:31:23.713958 2340 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e88f79ed06514e01a9bc48261a5acfbb" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "df8b9755d156478aafca552f9e9c539e"
I20250625 03:31:23.733548 2340 raft_consensus.cc:3058] T e88f79ed06514e01a9bc48261a5acfbb P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:23.716833 3381 raft_consensus.cc:3058] T c4354f7ffc0e4eabbc92a141d46b7984 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 4 FOLLOWER]: Advancing to term 5
I20250625 03:31:23.739477 2339 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f9458dec7953448d8550396d67fad249" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "df8b9755d156478aafca552f9e9c539e"
I20250625 03:31:23.740243 2339 raft_consensus.cc:3058] T f9458dec7953448d8550396d67fad249 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:23.740871 3408 raft_consensus.cc:513] T f957bf9749c54be48094092cb80e9055 P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:23.742808 3408 leader_election.cc:290] T f957bf9749c54be48094092cb80e9055 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 3 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:31:23.708251 1741 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dea2dcc26f144802a16f0884fdd99063" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:31:23.739418 2342 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "df29d87d804d44438345052a5902052f" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "df8b9755d156478aafca552f9e9c539e"
I20250625 03:31:23.744240 1741 raft_consensus.cc:3058] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 4 FOLLOWER]: Advancing to term 5
I20250625 03:31:23.744441 2342 raft_consensus.cc:3058] T df29d87d804d44438345052a5902052f P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Advancing to term 2
W20250625 03:31:23.744522 1709 leader_election.cc:336] T c4354f7ffc0e4eabbc92a141d46b7984 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111)
I20250625 03:31:23.750792 2338 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f957bf9749c54be48094092cb80e9055" candidate_uuid: "3f2aa40978064c9e9983cf3745eed206" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "df8b9755d156478aafca552f9e9c539e" is_pre_election: true
I20250625 03:31:23.751650 2338 raft_consensus.cc:2391] T f957bf9749c54be48094092cb80e9055 P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f2aa40978064c9e9983cf3745eed206 in current term 3: Already voted for candidate df8b9755d156478aafca552f9e9c539e in this term.
W20250625 03:31:23.753523 1709 leader_election.cc:336] T df29d87d804d44438345052a5902052f P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111)
W20250625 03:31:23.755139 1635 leader_election.cc:336] T f9458dec7953448d8550396d67fad249 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111)
W20250625 03:31:23.755926 2307 leader_election.cc:336] T f957bf9749c54be48094092cb80e9055 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111)
I20250625 03:31:23.759223 1741 raft_consensus.cc:2466] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 5.
I20250625 03:31:23.759090 1490 catalog_manager.cc:5582] T 59ac1803c12d43448ef566f886cc22e6 P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: term changed from 2 to 3, leader changed from 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) to ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131). New cstate: current_term: 3 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: HEALTHY } } }
W20250625 03:31:23.763715 2307 leader_election.cc:336] T f957bf9749c54be48094092cb80e9055 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111)
W20250625 03:31:23.757676 1635 leader_election.cc:336] T f957bf9749c54be48094092cb80e9055 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111)
I20250625 03:31:23.766674 2340 raft_consensus.cc:2466] T e88f79ed06514e01a9bc48261a5acfbb P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 3.
I20250625 03:31:23.776199 1490 catalog_manager.cc:5582] T c04f7c2d00994557b1cb83234b36fceb P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: term changed from 2 to 3, leader changed from 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) to ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131). New cstate: current_term: 3 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:23.777525 1636 leader_election.cc:304] T dea2dcc26f144802a16f0884fdd99063 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:31:23.777864 1490 catalog_manager.cc:5582] T af4573692c104d67994dbb1bc518b568 P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: term changed from 1 to 2, leader changed from 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) to ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131). New cstate: current_term: 2 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:23.778798 3428 raft_consensus.cc:2802] T dea2dcc26f144802a16f0884fdd99063 P 3f2aa40978064c9e9983cf3745eed206 [term 5 FOLLOWER]: Leader election won for term 5
I20250625 03:31:23.779336 3428 raft_consensus.cc:695] T dea2dcc26f144802a16f0884fdd99063 P 3f2aa40978064c9e9983cf3745eed206 [term 5 LEADER]: Becoming Leader. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Running, Role: LEADER
I20250625 03:31:23.774125 2342 raft_consensus.cc:2466] T df29d87d804d44438345052a5902052f P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 2.
I20250625 03:31:23.780192 3428 consensus_queue.cc:237] T dea2dcc26f144802a16f0884fdd99063 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:23.783560 1708 leader_election.cc:304] T df29d87d804d44438345052a5902052f P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1, df8b9755d156478aafca552f9e9c539e; no voters: 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:31:23.772817 3381 raft_consensus.cc:513] T c4354f7ffc0e4eabbc92a141d46b7984 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:23.777607 1634 leader_election.cc:304] T f957bf9749c54be48094092cb80e9055 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206; no voters: 7e9c4f2e01164f33b2e9034ed148398e, df8b9755d156478aafca552f9e9c539e
I20250625 03:31:23.785496 3376 raft_consensus.cc:3058] T f957bf9749c54be48094092cb80e9055 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:23.785993 3381 leader_election.cc:290] T c4354f7ffc0e4eabbc92a141d46b7984 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 5 election: Requested vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:31:23.786659 3381 raft_consensus.cc:2802] T df29d87d804d44438345052a5902052f P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:31:23.789911 1634 leader_election.cc:304] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, df8b9755d156478aafca552f9e9c539e; no voters: 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:31:23.790854 3429 raft_consensus.cc:2802] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Leader election won for term 3
I20250625 03:31:23.791311 3429 raft_consensus.cc:695] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206 [term 3 LEADER]: Becoming Leader. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Running, Role: LEADER
I20250625 03:31:23.792133 3429 consensus_queue.cc:237] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:23.793031 3381 raft_consensus.cc:695] T df29d87d804d44438345052a5902052f P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 LEADER]: Becoming Leader. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Running, Role: LEADER
I20250625 03:31:23.793937 3381 consensus_queue.cc:237] T df29d87d804d44438345052a5902052f P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
W20250625 03:31:23.794672 1709 leader_election.cc:336] T c4354f7ffc0e4eabbc92a141d46b7984 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111)
I20250625 03:31:23.798931 3376 raft_consensus.cc:2747] T f957bf9749c54be48094092cb80e9055 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20250625 03:31:23.801641 1662 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f957bf9749c54be48094092cb80e9055" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:31:23.805946 1668 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c4354f7ffc0e4eabbc92a141d46b7984" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3f2aa40978064c9e9983cf3745eed206"
I20250625 03:31:23.806666 1668 raft_consensus.cc:3058] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206 [term 4 FOLLOWER]: Advancing to term 5
I20250625 03:31:23.772619 2339 raft_consensus.cc:2466] T f9458dec7953448d8550396d67fad249 P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f2aa40978064c9e9983cf3745eed206 in term 3.
I20250625 03:31:23.809373 1662 raft_consensus.cc:2466] T f957bf9749c54be48094092cb80e9055 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df8b9755d156478aafca552f9e9c539e in term 3.
I20250625 03:31:23.825188 1634 leader_election.cc:304] T f9458dec7953448d8550396d67fad249 P 3f2aa40978064c9e9983cf3745eed206 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, df8b9755d156478aafca552f9e9c539e; no voters: 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:31:23.826359 2306 leader_election.cc:304] T f957bf9749c54be48094092cb80e9055 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, df8b9755d156478aafca552f9e9c539e; no voters: 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:31:23.826574 3427 raft_consensus.cc:2802] T f9458dec7953448d8550396d67fad249 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Leader election won for term 3
I20250625 03:31:23.827095 3427 raft_consensus.cc:695] T f9458dec7953448d8550396d67fad249 P 3f2aa40978064c9e9983cf3745eed206 [term 3 LEADER]: Becoming Leader. State: Replica: 3f2aa40978064c9e9983cf3745eed206, State: Running, Role: LEADER
I20250625 03:31:23.829095 3427 consensus_queue.cc:237] T f9458dec7953448d8550396d67fad249 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:23.828027 3409 raft_consensus.cc:695] T 6e7283d035e1429f946d8ebb98978656 P df8b9755d156478aafca552f9e9c539e [term 4 LEADER]: Becoming Leader. State: Replica: df8b9755d156478aafca552f9e9c539e, State: Running, Role: LEADER
I20250625 03:31:23.832969 3409 consensus_queue.cc:237] T 6e7283d035e1429f946d8ebb98978656 P df8b9755d156478aafca552f9e9c539e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:23.827487 3355 raft_consensus.cc:2802] T f957bf9749c54be48094092cb80e9055 P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Leader election won for term 3
I20250625 03:31:23.840904 1668 raft_consensus.cc:2466] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 5.
I20250625 03:31:23.841548 1493 catalog_manager.cc:5582] T dea2dcc26f144802a16f0884fdd99063 P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: term changed from 4 to 5, leader changed from 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) to 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130). New cstate: current_term: 5 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:23.844462 3355 raft_consensus.cc:695] T f957bf9749c54be48094092cb80e9055 P df8b9755d156478aafca552f9e9c539e [term 3 LEADER]: Becoming Leader. State: Replica: df8b9755d156478aafca552f9e9c539e, State: Running, Role: LEADER
I20250625 03:31:23.843832 1708 leader_election.cc:304] T c4354f7ffc0e4eabbc92a141d46b7984 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:31:23.845409 3355 consensus_queue.cc:237] T f957bf9749c54be48094092cb80e9055 P df8b9755d156478aafca552f9e9c539e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:23.846096 3422 raft_consensus.cc:2802] T c4354f7ffc0e4eabbc92a141d46b7984 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 5 FOLLOWER]: Leader election won for term 5
I20250625 03:31:23.846592 3422 raft_consensus.cc:695] T c4354f7ffc0e4eabbc92a141d46b7984 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 5 LEADER]: Becoming Leader. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Running, Role: LEADER
I20250625 03:31:23.847386 3422 consensus_queue.cc:237] T c4354f7ffc0e4eabbc92a141d46b7984 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:23.842355 1490 catalog_manager.cc:5582] T df29d87d804d44438345052a5902052f P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: term changed from 1 to 2, leader changed from 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) to ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131). New cstate: current_term: 2 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20250625 03:31:23.855432 2308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.131:39359, user_credentials={real_user=slave}} blocked reactor thread for 123194us
I20250625 03:31:23.889277 1490 catalog_manager.cc:5582] T 6e7283d035e1429f946d8ebb98978656 P df8b9755d156478aafca552f9e9c539e reported cstate change: term changed from 3 to 4, leader changed from 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) to df8b9755d156478aafca552f9e9c539e (127.0.106.132). New cstate: current_term: 4 leader_uuid: "df8b9755d156478aafca552f9e9c539e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250625 03:31:23.890076 1491 catalog_manager.cc:5582] T c4354f7ffc0e4eabbc92a141d46b7984 P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: term changed from 4 to 5, leader changed from 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) to ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131). New cstate: current_term: 5 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: HEALTHY } } }
I20250625 03:31:23.890861 1490 catalog_manager.cc:5582] T f957bf9749c54be48094092cb80e9055 P df8b9755d156478aafca552f9e9c539e reported cstate change: term changed from 2 to 3, leader changed from 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) to df8b9755d156478aafca552f9e9c539e (127.0.106.132). New cstate: current_term: 3 leader_uuid: "df8b9755d156478aafca552f9e9c539e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250625 03:31:23.892765 1493 catalog_manager.cc:5582] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: term changed from 2 to 3, leader changed from 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) to 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130). New cstate: current_term: 3 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:23.894065 1493 catalog_manager.cc:5582] T f9458dec7953448d8550396d67fad249 P 3f2aa40978064c9e9983cf3745eed206 reported cstate change: term changed from 2 to 3, leader changed from 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129) to 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130). New cstate: current_term: 3 leader_uuid: "3f2aa40978064c9e9983cf3745eed206" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:23.898504 2339 raft_consensus.cc:1273] T a5a18934cc3f490288432ee1cb30b278 P df8b9755d156478aafca552f9e9c539e [term 4 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20250625 03:31:23.898538 1709 consensus_peers.cc:487] T d9038fc1ce0d4b528c02c68012e1277d P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:23.902400 3429 consensus_queue.cc:1035] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20250625 03:31:23.917851 1635 consensus_peers.cc:487] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:23.931397 2339 raft_consensus.cc:1273] T fa68c3b7143345958f883bde3591b622 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250625 03:31:23.933395 3381 consensus_queue.cc:1035] T fa68c3b7143345958f883bde3591b622 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20250625 03:31:23.939875 1741 raft_consensus.cc:1273] T add8a729ea684e7eab256135c01309df P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250625 03:31:23.941466 3429 consensus_queue.cc:1035] T add8a729ea684e7eab256135c01309df P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20250625 03:31:23.971874 1635 consensus_peers.cc:487] T add8a729ea684e7eab256135c01309df P 3f2aa40978064c9e9983cf3745eed206 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250625 03:31:23.975466 1635 consensus_peers.cc:487] T 393f73bcf106475cbee7a645b0d9660c P 3f2aa40978064c9e9983cf3745eed206 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20250625 03:31:23.989132 2307 consensus_peers.cc:487] T 390aa72f98414be291f01e4e4fec77f1 P df8b9755d156478aafca552f9e9c539e -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20250625 03:31:23.992964 2342 raft_consensus.cc:1273] T c04f7c2d00994557b1cb83234b36fceb P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20250625 03:31:23.993386 1709 consensus_peers.cc:487] T 59ac1803c12d43448ef566f886cc22e6 P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:23.997954 3381 consensus_queue.cc:1035] T c04f7c2d00994557b1cb83234b36fceb P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20250625 03:31:24.000564 1635 consensus_peers.cc:487] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 3f2aa40978064c9e9983cf3745eed206 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20250625 03:31:24.019878 1709 consensus_peers.cc:487] T fa68c3b7143345958f883bde3591b622 P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250625 03:31:24.020499 1709 consensus_peers.cc:487] T c04f7c2d00994557b1cb83234b36fceb P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250625 03:31:24.034152 1709 consensus_peers.cc:487] T e4034c33d83e4a96a187eaed46416e3c P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20250625 03:31:24.046414 1635 consensus_peers.cc:487] T 96030b80e1f340afa81659faaaf68755 P 3f2aa40978064c9e9983cf3745eed206 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20250625 03:31:24.071879 1668 raft_consensus.cc:1273] T 59ac1803c12d43448ef566f886cc22e6 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250625 03:31:24.073292 3381 consensus_queue.cc:1035] T 59ac1803c12d43448ef566f886cc22e6 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:31:24.076699 2342 raft_consensus.cc:1273] T cc3b100d6d574a68b79e6a8f23d77201 P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20250625 03:31:24.079490 3427 consensus_queue.cc:1035] T cc3b100d6d574a68b79e6a8f23d77201 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20250625 03:31:24.098685 1709 consensus_peers.cc:487] T 0e7eb287e9514c838aeed599d2703682 P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20250625 03:31:24.100132 2339 raft_consensus.cc:1273] T d9038fc1ce0d4b528c02c68012e1277d P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20250625 03:31:24.104643 2307 consensus_peers.cc:487] T 0c2b6052daaa4c57aaa55361e8d6e01c P df8b9755d156478aafca552f9e9c539e -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20250625 03:31:24.107424 2339 raft_consensus.cc:1273] T af4573692c104d67994dbb1bc518b568 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250625 03:31:24.108469 3419 consensus_queue.cc:1035] T d9038fc1ce0d4b528c02c68012e1277d P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20250625 03:31:24.117810 1635 consensus_peers.cc:487] T d50c52b197294003b238a37da2fb55d8 P 3f2aa40978064c9e9983cf3745eed206 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20250625 03:31:24.119195 3419 consensus_queue.cc:1035] T af4573692c104d67994dbb1bc518b568 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20250625 03:31:24.128173 1635 consensus_peers.cc:487] T cc3b100d6d574a68b79e6a8f23d77201 P 3f2aa40978064c9e9983cf3745eed206 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250625 03:31:24.130564 1709 consensus_peers.cc:487] T c977876716a0400a9482dd8e0ad33b86 P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20250625 03:31:24.151526 1709 consensus_peers.cc:487] T af4573692c104d67994dbb1bc518b568 P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250625 03:31:24.161867 1709 consensus_peers.cc:487] T 93ecdce2da094dc9a80ac04828771fbd P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20250625 03:31:24.174579 2307 consensus_peers.cc:487] T b3f18b9311894580bc336199d357df41 P df8b9755d156478aafca552f9e9c539e -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20250625 03:31:24.205031 1709 consensus_peers.cc:487] T 441042afd59544a4a04bf85fa69d7d55 P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20250625 03:31:24.216187 1635 consensus_peers.cc:487] T f9458dec7953448d8550396d67fad249 P 3f2aa40978064c9e9983cf3745eed206 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250625 03:31:24.237140 2307 consensus_peers.cc:487] T b15eb94b9d3d4f6987b5fa5e20193655 P df8b9755d156478aafca552f9e9c539e -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20250625 03:31:24.237465 1741 raft_consensus.cc:1273] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 5 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20250625 03:31:24.238888 3428 consensus_queue.cc:1035] T dea2dcc26f144802a16f0884fdd99063 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250625 03:31:24.240749 2342 raft_consensus.cc:1273] T e88f79ed06514e01a9bc48261a5acfbb P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20250625 03:31:24.242538 3428 consensus_queue.cc:1035] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20250625 03:31:24.254094 1635 consensus_peers.cc:487] T dea2dcc26f144802a16f0884fdd99063 P 3f2aa40978064c9e9983cf3745eed206 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:24.256457 1662 raft_consensus.cc:1273] T 6e7283d035e1429f946d8ebb98978656 P 3f2aa40978064c9e9983cf3745eed206 [term 4 FOLLOWER]: Refusing update from remote peer df8b9755d156478aafca552f9e9c539e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20250625 03:31:24.257788 3355 consensus_queue.cc:1035] T 6e7283d035e1429f946d8ebb98978656 P df8b9755d156478aafca552f9e9c539e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20250625 03:31:24.259301 2307 consensus_peers.cc:487] T 6e7283d035e1429f946d8ebb98978656 P df8b9755d156478aafca552f9e9c539e -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:24.270634 2339 raft_consensus.cc:1273] T f9458dec7953448d8550396d67fad249 P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Refusing update from remote peer 3f2aa40978064c9e9983cf3745eed206: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20250625 03:31:24.274861 1709 consensus_peers.cc:487] T df29d87d804d44438345052a5902052f P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:24.278895 3428 consensus_queue.cc:1035] T f9458dec7953448d8550396d67fad249 P 3f2aa40978064c9e9983cf3745eed206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20250625 03:31:24.304098 1709 consensus_peers.cc:487] T 1fff19a38e8d4880a14da6b4c8284cc2 P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20250625 03:31:24.313691 1635 consensus_peers.cc:487] T 9943bb8023444f49a11df01d93738f1e P 3f2aa40978064c9e9983cf3745eed206 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20250625 03:31:24.314196 1635 consensus_peers.cc:487] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250625 03:31:24.315419 2307 consensus_peers.cc:487] T f957bf9749c54be48094092cb80e9055 P df8b9755d156478aafca552f9e9c539e -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:24.323283 1664 raft_consensus.cc:1273] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206 [term 5 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20250625 03:31:24.326004 3419 consensus_queue.cc:1035] T c4354f7ffc0e4eabbc92a141d46b7984 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250625 03:31:24.333734 1668 raft_consensus.cc:1273] T f957bf9749c54be48094092cb80e9055 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Refusing update from remote peer df8b9755d156478aafca552f9e9c539e: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20250625 03:31:24.338182 1709 consensus_peers.cc:487] T 9f7fbf33df3d429ab16f0ae3a2684207 P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20250625 03:31:24.339371 3408 consensus_queue.cc:1035] T f957bf9749c54be48094092cb80e9055 P df8b9755d156478aafca552f9e9c539e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250625 03:31:24.346158 2344 raft_consensus.cc:1273] T df29d87d804d44438345052a5902052f P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Refusing update from remote peer ba464e89e0f044a0a0ea3e6125cbf2a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250625 03:31:24.348897 3419 consensus_queue.cc:1035] T df29d87d804d44438345052a5902052f P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20250625 03:31:24.366768 2307 consensus_peers.cc:487] T fb6e83db706647e28e491a02f1641980 P df8b9755d156478aafca552f9e9c539e -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20250625 03:31:24.381397 426 thread.cc:535] Waited for 2000ms trying to join with diag-logger (tid 1617)
W20250625 03:31:24.395741 2307 consensus_peers.cc:487] T 188e56b819ae44f9b72baefcbc749400 P df8b9755d156478aafca552f9e9c539e -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20250625 03:31:24.404243 2307 consensus_peers.cc:487] T 70328d972b5943009ef0c7d92cbae349 P df8b9755d156478aafca552f9e9c539e -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20250625 03:31:24.811051 2307 consensus_peers.cc:487] T 6d7a37b3448d468baa1b9422a6167c9a P df8b9755d156478aafca552f9e9c539e -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20250625 03:31:24.830025 2307 consensus_peers.cc:487] T 3037be35f2054cbbabd8a47062f84244 P df8b9755d156478aafca552f9e9c539e -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20250625 03:31:24.826814 1709 consensus_peers.cc:487] T 64add559c121402aa1f7753538a50857 P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20250625 03:31:24.832497 1709 consensus_peers.cc:487] T ba2ab3296190416aa07624e6d69ba09b P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20250625 03:31:24.851166 1709 consensus_peers.cc:487] T 465c15a46933411a985f29059fdb1c9f P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20250625 03:31:24.851635 1709 consensus_peers.cc:487] T c4354f7ffc0e4eabbc92a141d46b7984 P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250625 03:31:24.852169 1709 consensus_peers.cc:487] T 9b7de80fbd7d4625aac41dea0457fd3e P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20250625 03:31:24.852845 1709 consensus_peers.cc:487] T 615cebbffcfc44e19b8f7a1e842073a3 P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20250625 03:31:24.875756 1709 consensus_peers.cc:487] T f8c715109ff0405997e1ca9952678c0d P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20250625 03:31:24.932452 1635 consensus_peers.cc:487] T 7553473daeb342ceaf782ddee8e4fc4d P 3f2aa40978064c9e9983cf3745eed206 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20250625 03:31:25.319909 1709 consensus_peers.cc:487] T e58b1ae66ee14c6f8d6f2db8dda2b842 P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20250625 03:31:25.381917 426 thread.cc:535] Waited for 3000ms trying to join with diag-logger (tid 1617)
W20250625 03:31:25.471287 1525 debug-util.cc:398] Leaking SignalData structure 0x7b0800128300 after lost signal to thread 429
W20250625 03:31:25.472441 1525 debug-util.cc:398] Leaking SignalData structure 0x7b0800090340 after lost signal to thread 1528
W20250625 03:31:25.473628 1525 debug-util.cc:398] Leaking SignalData structure 0x7b080019bc00 after lost signal to thread 1695
W20250625 03:31:25.474720 1525 debug-util.cc:398] Leaking SignalData structure 0x7b0800250220 after lost signal to thread 1769
W20250625 03:31:25.475852 1525 debug-util.cc:398] Leaking SignalData structure 0x7b0800383320 after lost signal to thread 2369
W20250625 03:31:26.364243 1709 consensus_peers.cc:487] T e4034c33d83e4a96a187eaed46416e3c P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20250625 03:31:26.382534 426 thread.cc:535] Waited for 4000ms trying to join with diag-logger (tid 1617)
W20250625 03:31:26.441650 1709 consensus_peers.cc:487] T 59ac1803c12d43448ef566f886cc22e6 P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20250625 03:31:26.485685 1709 consensus_peers.cc:487] T 0e7eb287e9514c838aeed599d2703682 P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20250625 03:31:26.495716 1635 consensus_peers.cc:487] T 96030b80e1f340afa81659faaaf68755 P 3f2aa40978064c9e9983cf3745eed206 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20250625 03:31:26.555150 1709 consensus_peers.cc:487] T fa68c3b7143345958f883bde3591b622 P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20250625 03:31:26.558640 1709 consensus_peers.cc:487] T d9038fc1ce0d4b528c02c68012e1277d P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20250625 03:31:26.603175 1635 consensus_peers.cc:487] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20250625 03:31:26.621668 2307 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111) [suppressed 414 similar messages]
W20250625 03:31:26.627007 2307 consensus_peers.cc:487] T 0c2b6052daaa4c57aaa55361e8d6e01c P df8b9755d156478aafca552f9e9c539e -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20250625 03:31:26.632186 2307 consensus_peers.cc:487] T 390aa72f98414be291f01e4e4fec77f1 P df8b9755d156478aafca552f9e9c539e -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20250625 03:31:26.637017 1709 consensus_peers.cc:487] T df29d87d804d44438345052a5902052f P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20250625 03:31:26.650226 1635 consensus_peers.cc:487] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 3f2aa40978064c9e9983cf3745eed206 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20250625 03:31:26.659273 1635 consensus_peers.cc:487] T dea2dcc26f144802a16f0884fdd99063 P 3f2aa40978064c9e9983cf3745eed206 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20250625 03:31:26.705155 1635 consensus_peers.cc:487] T d50c52b197294003b238a37da2fb55d8 P 3f2aa40978064c9e9983cf3745eed206 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20250625 03:31:26.705155 2307 consensus_peers.cc:487] T f957bf9749c54be48094092cb80e9055 P df8b9755d156478aafca552f9e9c539e -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20250625 03:31:26.713778 1709 consensus_peers.cc:487] T 9f7fbf33df3d429ab16f0ae3a2684207 P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20250625 03:31:26.726207 1709 consensus_peers.cc:487] T 465c15a46933411a985f29059fdb1c9f P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20250625 03:31:26.737353 1709 consensus_peers.cc:487] T 441042afd59544a4a04bf85fa69d7d55 P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20250625 03:31:26.737946 1709 consensus_peers.cc:487] T af4573692c104d67994dbb1bc518b568 P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20250625 03:31:26.746472 2307 consensus_peers.cc:487] T 188e56b819ae44f9b72baefcbc749400 P df8b9755d156478aafca552f9e9c539e -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20250625 03:31:26.755736 1635 consensus_peers.cc:487] T 7553473daeb342ceaf782ddee8e4fc4d P 3f2aa40978064c9e9983cf3745eed206 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20250625 03:31:26.757586 1709 consensus_peers.cc:487] T 9b7de80fbd7d4625aac41dea0457fd3e P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20250625 03:31:26.758173 1709 consensus_peers.cc:487] T c4354f7ffc0e4eabbc92a141d46b7984 P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20250625 03:31:26.787595 1635 consensus_peers.cc:487] T 393f73bcf106475cbee7a645b0d9660c P 3f2aa40978064c9e9983cf3745eed206 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20250625 03:31:26.820716 1635 consensus_peers.cc:487] T 9943bb8023444f49a11df01d93738f1e P 3f2aa40978064c9e9983cf3745eed206 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20250625 03:31:26.885311 1709 consensus_peers.cc:487] T 1fff19a38e8d4880a14da6b4c8284cc2 P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20250625 03:31:26.897274 2307 consensus_peers.cc:487] T b3f18b9311894580bc336199d357df41 P df8b9755d156478aafca552f9e9c539e -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20250625 03:31:26.906138 1635 consensus_peers.cc:487] T add8a729ea684e7eab256135c01309df P 3f2aa40978064c9e9983cf3745eed206 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20250625 03:31:26.904539 1709 consensus_peers.cc:487] T 93ecdce2da094dc9a80ac04828771fbd P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20250625 03:31:26.907891 1709 consensus_peers.cc:487] T ba2ab3296190416aa07624e6d69ba09b P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20250625 03:31:26.915995 2307 consensus_peers.cc:487] T fb6e83db706647e28e491a02f1641980 P df8b9755d156478aafca552f9e9c539e -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20250625 03:31:26.938622 2307 consensus_peers.cc:487] T b15eb94b9d3d4f6987b5fa5e20193655 P df8b9755d156478aafca552f9e9c539e -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20250625 03:31:26.946015 1635 consensus_peers.cc:487] T f9458dec7953448d8550396d67fad249 P 3f2aa40978064c9e9983cf3745eed206 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20250625 03:31:26.946589 1635 consensus_peers.cc:487] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20250625 03:31:26.977231 1635 consensus_peers.cc:487] T cc3b100d6d574a68b79e6a8f23d77201 P 3f2aa40978064c9e9983cf3745eed206 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20250625 03:31:26.989949 1709 consensus_peers.cc:487] T 615cebbffcfc44e19b8f7a1e842073a3 P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20250625 03:31:26.992960 1709 consensus_peers.cc:487] T c977876716a0400a9482dd8e0ad33b86 P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20250625 03:31:27.017472 1709 consensus_peers.cc:487] T c04f7c2d00994557b1cb83234b36fceb P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20250625 03:31:27.067464 2307 consensus_peers.cc:487] T 70328d972b5943009ef0c7d92cbae349 P df8b9755d156478aafca552f9e9c539e -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20250625 03:31:27.105527 2307 consensus_peers.cc:487] T 6e7283d035e1429f946d8ebb98978656 P df8b9755d156478aafca552f9e9c539e -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20250625 03:31:27.146833 2307 consensus_peers.cc:487] T 3037be35f2054cbbabd8a47062f84244 P df8b9755d156478aafca552f9e9c539e -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20250625 03:31:27.310557 2307 consensus_peers.cc:487] T 6d7a37b3448d468baa1b9422a6167c9a P df8b9755d156478aafca552f9e9c539e -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20250625 03:31:27.326957 1709 consensus_peers.cc:487] T f8c715109ff0405997e1ca9952678c0d P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20250625 03:31:27.383011 426 thread.cc:535] Waited for 5000ms trying to join with diag-logger (tid 1617)
W20250625 03:31:27.423662 1709 consensus_peers.cc:487] T 64add559c121402aa1f7753538a50857 P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20250625 03:31:27.549630 1709 consensus_peers.cc:487] T e58b1ae66ee14c6f8d6f2db8dda2b842 P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20250625 03:31:27.963002 1708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.130:34293, user_credentials={real_user=slave}} blocked reactor thread for 78453.7us
W20250625 03:31:27.966523 2306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.130:34293, user_credentials={real_user=slave}} blocked reactor thread for 44277.1us
W20250625 03:31:28.067209 1708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.132:34493, user_credentials={real_user=slave}} blocked reactor thread for 45924us
W20250625 03:31:28.155496 1708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.132:34493, user_credentials={real_user=slave}} blocked reactor thread for 77760.2us
W20250625 03:31:28.384021 426 thread.cc:535] Waited for 6000ms trying to join with diag-logger (tid 1617)
I20250625 03:31:28.608134 426 tablet_server.cc:195] TabletServer@127.0.106.129:0 shutdown complete.
W20250625 03:31:28.732479 1709 consensus_peers.cc:487] T 59ac1803c12d43448ef566f886cc22e6 P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20250625 03:31:28.839440 2307 consensus_peers.cc:487] T 390aa72f98414be291f01e4e4fec77f1 P df8b9755d156478aafca552f9e9c539e -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20250625 03:31:28.841459 426 tablet_server.cc:178] TabletServer@127.0.106.130:0 shutting down...
W20250625 03:31:28.861156 2306 consensus_peers.cc:487] T 58c56cde04014b85b662a9b4cbaa726f P df8b9755d156478aafca552f9e9c539e -> Peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Couldn't send request to peer 3f2aa40978064c9e9983cf3745eed206. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250625 03:31:28.914561 2306 consensus_peers.cc:487] T f957bf9749c54be48094092cb80e9055 P df8b9755d156478aafca552f9e9c539e -> Peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Couldn't send request to peer 3f2aa40978064c9e9983cf3745eed206. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250625 03:31:28.916554 1708 consensus_peers.cc:487] T 441042afd59544a4a04bf85fa69d7d55 P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Couldn't send request to peer 3f2aa40978064c9e9983cf3745eed206. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250625 03:31:28.917244 2306 consensus_peers.cc:487] T 6e7283d035e1429f946d8ebb98978656 P df8b9755d156478aafca552f9e9c539e -> Peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Couldn't send request to peer 3f2aa40978064c9e9983cf3745eed206. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250625 03:31:28.934046 2307 consensus_peers.cc:487] T 0c2b6052daaa4c57aaa55361e8d6e01c P df8b9755d156478aafca552f9e9c539e -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20250625 03:31:28.934329 2306 consensus_peers.cc:487] T 9643cfd400804eb8b9037c5e9efddfba P df8b9755d156478aafca552f9e9c539e -> Peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Couldn't send request to peer 3f2aa40978064c9e9983cf3745eed206. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250625 03:31:28.945780 2306 consensus_peers.cc:487] T b3f18b9311894580bc336199d357df41 P df8b9755d156478aafca552f9e9c539e -> Peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Couldn't send request to peer 3f2aa40978064c9e9983cf3745eed206. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250625 03:31:28.954130 1708 consensus_peers.cc:487] T 0e7eb287e9514c838aeed599d2703682 P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Couldn't send request to peer 3f2aa40978064c9e9983cf3745eed206. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:28.968174 426 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250625 03:31:28.971410 426 tablet_replica.cc:331] T 188e56b819ae44f9b72baefcbc749400 P 3f2aa40978064c9e9983cf3745eed206: stopping tablet replica
I20250625 03:31:28.972440 426 raft_consensus.cc:2241] T 188e56b819ae44f9b72baefcbc749400 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:28.973316 426 raft_consensus.cc:2270] T 188e56b819ae44f9b72baefcbc749400 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Raft consensus is shut down!
W20250625 03:31:28.977496 1708 consensus_peers.cc:487] T c4354f7ffc0e4eabbc92a141d46b7984 P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Couldn't send request to peer 3f2aa40978064c9e9983cf3745eed206. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:28.976486 426 tablet_replica.cc:331] T 70328d972b5943009ef0c7d92cbae349 P 3f2aa40978064c9e9983cf3745eed206: stopping tablet replica
I20250625 03:31:28.983958 426 raft_consensus.cc:2241] T 70328d972b5943009ef0c7d92cbae349 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:28.984778 426 raft_consensus.cc:2270] T 70328d972b5943009ef0c7d92cbae349 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Raft consensus is shut down!
W20250625 03:31:28.985110 2306 consensus_peers.cc:487] T 31885ef6a0c64613ae6723c07f9400b0 P df8b9755d156478aafca552f9e9c539e -> Peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Couldn't send request to peer 3f2aa40978064c9e9983cf3745eed206. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:28.987861 426 tablet_replica.cc:331] T 58c56cde04014b85b662a9b4cbaa726f P 3f2aa40978064c9e9983cf3745eed206: stopping tablet replica
I20250625 03:31:28.988735 426 raft_consensus.cc:2241] T 58c56cde04014b85b662a9b4cbaa726f P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:28.989538 426 raft_consensus.cc:2270] T 58c56cde04014b85b662a9b4cbaa726f P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:28.999145 426 tablet_replica.cc:331] T 59ac1803c12d43448ef566f886cc22e6 P 3f2aa40978064c9e9983cf3745eed206: stopping tablet replica
I20250625 03:31:28.999975 426 raft_consensus.cc:2241] T 59ac1803c12d43448ef566f886cc22e6 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:29.000600 426 raft_consensus.cc:2270] T 59ac1803c12d43448ef566f886cc22e6 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:29.003438 426 tablet_replica.cc:331] T e38dc50880914156805b07aa82e30863 P 3f2aa40978064c9e9983cf3745eed206: stopping tablet replica
I20250625 03:31:29.004475 426 raft_consensus.cc:2241] T e38dc50880914156805b07aa82e30863 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Raft consensus shutting down.
W20250625 03:31:29.004843 1708 consensus_peers.cc:487] T e4034c33d83e4a96a187eaed46416e3c P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Couldn't send request to peer 3f2aa40978064c9e9983cf3745eed206. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:29.005021 426 raft_consensus.cc:2270] T e38dc50880914156805b07aa82e30863 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:29.008047 426 tablet_replica.cc:331] T 6d7a37b3448d468baa1b9422a6167c9a P 3f2aa40978064c9e9983cf3745eed206: stopping tablet replica
W20250625 03:31:29.008049 1709 consensus_peers.cc:487] T 0e7eb287e9514c838aeed599d2703682 P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20250625 03:31:29.009146 426 raft_consensus.cc:2241] T 6d7a37b3448d468baa1b9422a6167c9a P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:29.009768 426 raft_consensus.cc:2270] T 6d7a37b3448d468baa1b9422a6167c9a P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:29.016389 426 tablet_replica.cc:331] T a1d83fca2b484feeaff6f350fe749b24 P 3f2aa40978064c9e9983cf3745eed206: stopping tablet replica
I20250625 03:31:29.017403 426 raft_consensus.cc:2241] T a1d83fca2b484feeaff6f350fe749b24 P 3f2aa40978064c9e9983cf3745eed206 [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:31:29.018615 426 raft_consensus.cc:2270] T a1d83fca2b484feeaff6f350fe749b24 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:29.024243 426 tablet_replica.cc:331] T add8a729ea684e7eab256135c01309df P 3f2aa40978064c9e9983cf3745eed206: stopping tablet replica
W20250625 03:31:29.027808 1708 consensus_peers.cc:487] T fd279ddcf72a40e1bf2ec42a4f35e639 P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Couldn't send request to peer 3f2aa40978064c9e9983cf3745eed206. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:29.032241 426 raft_consensus.cc:2241] T add8a729ea684e7eab256135c01309df P 3f2aa40978064c9e9983cf3745eed206 [term 3 LEADER]: Raft consensus shutting down.
W20250625 03:31:29.033093 1635 consensus_peers.cc:487] T dea2dcc26f144802a16f0884fdd99063 P 3f2aa40978064c9e9983cf3745eed206 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20250625 03:31:29.033600 426 raft_consensus.cc:2270] T add8a729ea684e7eab256135c01309df P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:29.036693 426 tablet_replica.cc:331] T 390aa72f98414be291f01e4e4fec77f1 P 3f2aa40978064c9e9983cf3745eed206: stopping tablet replica
I20250625 03:31:29.037565 426 raft_consensus.cc:2241] T 390aa72f98414be291f01e4e4fec77f1 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:29.038223 426 raft_consensus.cc:2270] T 390aa72f98414be291f01e4e4fec77f1 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:29.040882 426 tablet_replica.cc:331] T 96030b80e1f340afa81659faaaf68755 P 3f2aa40978064c9e9983cf3745eed206: stopping tablet replica
I20250625 03:31:29.041714 426 raft_consensus.cc:2241] T 96030b80e1f340afa81659faaaf68755 P 3f2aa40978064c9e9983cf3745eed206 [term 3 LEADER]: Raft consensus shutting down.
I20250625 03:31:29.042917 426 raft_consensus.cc:2270] T 96030b80e1f340afa81659faaaf68755 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:29.046247 426 tablet_replica.cc:331] T 31885ef6a0c64613ae6723c07f9400b0 P 3f2aa40978064c9e9983cf3745eed206: stopping tablet replica
I20250625 03:31:29.051083 426 raft_consensus.cc:2241] T 31885ef6a0c64613ae6723c07f9400b0 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:29.051685 426 raft_consensus.cc:2270] T 31885ef6a0c64613ae6723c07f9400b0 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:29.054311 426 tablet_replica.cc:331] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 3f2aa40978064c9e9983cf3745eed206: stopping tablet replica
I20250625 03:31:29.055012 426 raft_consensus.cc:2241] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:31:29.056103 426 raft_consensus.cc:2270] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:29.061409 426 tablet_replica.cc:331] T cc3b100d6d574a68b79e6a8f23d77201 P 3f2aa40978064c9e9983cf3745eed206: stopping tablet replica
I20250625 03:31:29.062285 426 raft_consensus.cc:2241] T cc3b100d6d574a68b79e6a8f23d77201 P 3f2aa40978064c9e9983cf3745eed206 [term 3 LEADER]: Raft consensus shutting down.
I20250625 03:31:29.063498 426 raft_consensus.cc:2270] T cc3b100d6d574a68b79e6a8f23d77201 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:29.066184 426 tablet_replica.cc:331] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206: stopping tablet replica
I20250625 03:31:29.066985 426 raft_consensus.cc:2241] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206 [term 4 LEADER]: Raft consensus shutting down.
I20250625 03:31:29.068585 426 raft_consensus.cc:2270] T a5a18934cc3f490288432ee1cb30b278 P 3f2aa40978064c9e9983cf3745eed206 [term 4 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:29.071388 426 tablet_replica.cc:331] T 3037be35f2054cbbabd8a47062f84244 P 3f2aa40978064c9e9983cf3745eed206: stopping tablet replica
I20250625 03:31:29.072190 426 raft_consensus.cc:2241] T 3037be35f2054cbbabd8a47062f84244 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:29.073158 426 raft_consensus.cc:2270] T 3037be35f2054cbbabd8a47062f84244 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:29.075620 426 tablet_replica.cc:331] T b31026f89f1e49949acec419db9649d3 P 3f2aa40978064c9e9983cf3745eed206: stopping tablet replica
I20250625 03:31:29.076408 426 raft_consensus.cc:2241] T b31026f89f1e49949acec419db9649d3 P 3f2aa40978064c9e9983cf3745eed206 [term 3 LEADER]: Raft consensus shutting down.
I20250625 03:31:29.078135 426 raft_consensus.cc:2270] T b31026f89f1e49949acec419db9649d3 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Raft consensus is shut down!
W20250625 03:31:29.078506 1708 consensus_peers.cc:487] T e38dc50880914156805b07aa82e30863 P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Couldn't send request to peer 3f2aa40978064c9e9983cf3745eed206. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:29.081033 426 tablet_replica.cc:331] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206: stopping tablet replica
I20250625 03:31:29.081961 426 raft_consensus.cc:2241] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206 [term 3 LEADER]: Raft consensus shutting down.
I20250625 03:31:29.083488 426 raft_consensus.cc:2270] T e88f79ed06514e01a9bc48261a5acfbb P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:29.092692 426 tablet_replica.cc:331] T 393f73bcf106475cbee7a645b0d9660c P 3f2aa40978064c9e9983cf3745eed206: stopping tablet replica
I20250625 03:31:29.093544 426 raft_consensus.cc:2241] T 393f73bcf106475cbee7a645b0d9660c P 3f2aa40978064c9e9983cf3745eed206 [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:31:29.095144 426 raft_consensus.cc:2270] T 393f73bcf106475cbee7a645b0d9660c P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:29.099668 426 tablet_replica.cc:331] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 3f2aa40978064c9e9983cf3745eed206: stopping tablet replica
I20250625 03:31:29.100518 426 raft_consensus.cc:2241] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:31:29.101613 426 raft_consensus.cc:2270] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250625 03:31:29.102783 2306 consensus_peers.cc:487] T 390aa72f98414be291f01e4e4fec77f1 P df8b9755d156478aafca552f9e9c539e -> Peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Couldn't send request to peer 3f2aa40978064c9e9983cf3745eed206. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:29.104490 426 tablet_replica.cc:331] T 7553473daeb342ceaf782ddee8e4fc4d P 3f2aa40978064c9e9983cf3745eed206: stopping tablet replica
I20250625 03:31:29.105401 426 raft_consensus.cc:2241] T 7553473daeb342ceaf782ddee8e4fc4d P 3f2aa40978064c9e9983cf3745eed206 [term 3 LEADER]: Raft consensus shutting down.
I20250625 03:31:29.106556 426 raft_consensus.cc:2270] T 7553473daeb342ceaf782ddee8e4fc4d P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:29.109417 426 tablet_replica.cc:331] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206: stopping tablet replica
I20250625 03:31:29.110184 426 raft_consensus.cc:2241] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:29.110741 426 raft_consensus.cc:2270] T 0c2b6052daaa4c57aaa55361e8d6e01c P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:29.113477 426 tablet_replica.cc:331] T b3f18b9311894580bc336199d357df41 P 3f2aa40978064c9e9983cf3745eed206: stopping tablet replica
I20250625 03:31:29.114216 426 raft_consensus.cc:2241] T b3f18b9311894580bc336199d357df41 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:29.114729 426 raft_consensus.cc:2270] T b3f18b9311894580bc336199d357df41 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Raft consensus is shut down!
W20250625 03:31:29.117163 1708 consensus_peers.cc:487] T 59ac1803c12d43448ef566f886cc22e6 P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Couldn't send request to peer 3f2aa40978064c9e9983cf3745eed206. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:29.118230 426 tablet_replica.cc:331] T c977876716a0400a9482dd8e0ad33b86 P 3f2aa40978064c9e9983cf3745eed206: stopping tablet replica
I20250625 03:31:29.119067 426 raft_consensus.cc:2241] T c977876716a0400a9482dd8e0ad33b86 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:29.119618 426 raft_consensus.cc:2270] T c977876716a0400a9482dd8e0ad33b86 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:29.126371 426 tablet_replica.cc:331] T f8c715109ff0405997e1ca9952678c0d P 3f2aa40978064c9e9983cf3745eed206: stopping tablet replica
I20250625 03:31:29.127287 426 raft_consensus.cc:2241] T f8c715109ff0405997e1ca9952678c0d P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:29.127856 426 raft_consensus.cc:2270] T f8c715109ff0405997e1ca9952678c0d P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:29.131623 426 tablet_replica.cc:331] T afe48b30a4e64a4d8faf2a5b42d5c706 P 3f2aa40978064c9e9983cf3745eed206: stopping tablet replica
I20250625 03:31:29.133767 426 raft_consensus.cc:2241] T afe48b30a4e64a4d8faf2a5b42d5c706 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Raft consensus shutting down.
W20250625 03:31:29.137130 1635 consensus_peers.cc:487] T d50c52b197294003b238a37da2fb55d8 P 3f2aa40978064c9e9983cf3745eed206 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20250625 03:31:29.138089 426 raft_consensus.cc:2270] T afe48b30a4e64a4d8faf2a5b42d5c706 P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:29.142220 426 tablet_replica.cc:331] T dea2dcc26f144802a16f0884fdd99063 P 3f2aa40978064c9e9983cf3745eed206: stopping tablet replica
I20250625 03:31:29.143059 426 raft_consensus.cc:2241] T dea2dcc26f144802a16f0884fdd99063 P 3f2aa40978064c9e9983cf3745eed206 [term 5 LEADER]: Raft consensus shutting down.
W20250625 03:31:29.145186 1709 consensus_peers.cc:487] T 465c15a46933411a985f29059fdb1c9f P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20250625 03:31:29.148517 426 raft_consensus.cc:2270] T dea2dcc26f144802a16f0884fdd99063 P 3f2aa40978064c9e9983cf3745eed206 [term 5 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:29.153604 426 tablet_replica.cc:331] T e4034c33d83e4a96a187eaed46416e3c P 3f2aa40978064c9e9983cf3745eed206: stopping tablet replica
I20250625 03:31:29.154389 426 raft_consensus.cc:2241] T e4034c33d83e4a96a187eaed46416e3c P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Raft consensus shutting down.
W20250625 03:31:29.154542 1708 consensus_peers.cc:487] T c977876716a0400a9482dd8e0ad33b86 P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Couldn't send request to peer 3f2aa40978064c9e9983cf3745eed206. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:29.155036 426 raft_consensus.cc:2270] T e4034c33d83e4a96a187eaed46416e3c P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250625 03:31:29.157698 1708 consensus_peers.cc:487] T f8c715109ff0405997e1ca9952678c0d P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Couldn't send request to peer 3f2aa40978064c9e9983cf3745eed206. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:29.159662 426 tablet_replica.cc:331] T 542f85d76df8432593ee963669155a9d P 3f2aa40978064c9e9983cf3745eed206: stopping tablet replica
I20250625 03:31:29.160557 426 raft_consensus.cc:2241] T 542f85d76df8432593ee963669155a9d P 3f2aa40978064c9e9983cf3745eed206 [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:31:29.161607 426 raft_consensus.cc:2270] T 542f85d76df8432593ee963669155a9d P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Raft consensus is shut down!
W20250625 03:31:29.162433 1708 consensus_peers.cc:487] T 9f7fbf33df3d429ab16f0ae3a2684207 P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Couldn't send request to peer 3f2aa40978064c9e9983cf3745eed206. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:29.164263 426 tablet_replica.cc:331] T f9458dec7953448d8550396d67fad249 P 3f2aa40978064c9e9983cf3745eed206: stopping tablet replica
I20250625 03:31:29.165071 426 raft_consensus.cc:2241] T f9458dec7953448d8550396d67fad249 P 3f2aa40978064c9e9983cf3745eed206 [term 3 LEADER]: Raft consensus shutting down.
I20250625 03:31:29.166215 426 raft_consensus.cc:2270] T f9458dec7953448d8550396d67fad249 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:29.169070 426 tablet_replica.cc:331] T 1fff19a38e8d4880a14da6b4c8284cc2 P 3f2aa40978064c9e9983cf3745eed206: stopping tablet replica
I20250625 03:31:29.170125 426 raft_consensus.cc:2241] T 1fff19a38e8d4880a14da6b4c8284cc2 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:29.170680 426 raft_consensus.cc:2270] T 1fff19a38e8d4880a14da6b4c8284cc2 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Raft consensus is shut down!
W20250625 03:31:29.171139 2306 consensus_peers.cc:487] T afe48b30a4e64a4d8faf2a5b42d5c706 P df8b9755d156478aafca552f9e9c539e -> Peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Couldn't send request to peer 3f2aa40978064c9e9983cf3745eed206. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:29.173550 426 tablet_replica.cc:331] T d50c52b197294003b238a37da2fb55d8 P 3f2aa40978064c9e9983cf3745eed206: stopping tablet replica
I20250625 03:31:29.174436 426 raft_consensus.cc:2241] T d50c52b197294003b238a37da2fb55d8 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:31:29.175707 426 raft_consensus.cc:2270] T d50c52b197294003b238a37da2fb55d8 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:29.182111 426 tablet_replica.cc:331] T 9f7fbf33df3d429ab16f0ae3a2684207 P 3f2aa40978064c9e9983cf3745eed206: stopping tablet replica
W20250625 03:31:29.182902 2306 consensus_peers.cc:487] T 3037be35f2054cbbabd8a47062f84244 P df8b9755d156478aafca552f9e9c539e -> Peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Couldn't send request to peer 3f2aa40978064c9e9983cf3745eed206. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:29.184274 426 raft_consensus.cc:2241] T 9f7fbf33df3d429ab16f0ae3a2684207 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:29.184902 426 raft_consensus.cc:2270] T 9f7fbf33df3d429ab16f0ae3a2684207 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250625 03:31:29.184876 1709 consensus_peers.cc:487] T 9f7fbf33df3d429ab16f0ae3a2684207 P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20250625 03:31:29.187723 426 tablet_replica.cc:331] T 44f429469440455593143983452a9fe3 P 3f2aa40978064c9e9983cf3745eed206: stopping tablet replica
I20250625 03:31:29.188542 426 raft_consensus.cc:2241] T 44f429469440455593143983452a9fe3 P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Raft consensus shutting down.
W20250625 03:31:29.188598 2306 consensus_peers.cc:487] T 0c2b6052daaa4c57aaa55361e8d6e01c P df8b9755d156478aafca552f9e9c539e -> Peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Couldn't send request to peer 3f2aa40978064c9e9983cf3745eed206. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:29.189692 426 raft_consensus.cc:2270] T 44f429469440455593143983452a9fe3 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:29.192330 426 tablet_replica.cc:331] T 40b74a261fdd495f84ceb0690f0b30ba P 3f2aa40978064c9e9983cf3745eed206: stopping tablet replica
I20250625 03:31:29.193102 426 raft_consensus.cc:2241] T 40b74a261fdd495f84ceb0690f0b30ba P 3f2aa40978064c9e9983cf3745eed206 [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:31:29.194240 426 raft_consensus.cc:2270] T 40b74a261fdd495f84ceb0690f0b30ba P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:29.196878 426 tablet_replica.cc:331] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206: stopping tablet replica
I20250625 03:31:29.197738 426 raft_consensus.cc:2241] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206 [term 5 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:29.198413 426 raft_consensus.cc:2270] T c4354f7ffc0e4eabbc92a141d46b7984 P 3f2aa40978064c9e9983cf3745eed206 [term 5 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:29.201277 426 tablet_replica.cc:331] T 6cc384f27ff041c0be70bb661ae610dd P 3f2aa40978064c9e9983cf3745eed206: stopping tablet replica
I20250625 03:31:29.202003 426 raft_consensus.cc:2241] T 6cc384f27ff041c0be70bb661ae610dd P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Raft consensus shutting down.
W20250625 03:31:29.202834 1709 consensus_peers.cc:487] T 93ecdce2da094dc9a80ac04828771fbd P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20250625 03:31:29.203233 426 raft_consensus.cc:2270] T 6cc384f27ff041c0be70bb661ae610dd P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:29.210327 426 tablet_replica.cc:331] T fd279ddcf72a40e1bf2ec42a4f35e639 P 3f2aa40978064c9e9983cf3745eed206: stopping tablet replica
I20250625 03:31:29.211103 426 raft_consensus.cc:2241] T fd279ddcf72a40e1bf2ec42a4f35e639 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:29.212242 426 raft_consensus.cc:2270] T fd279ddcf72a40e1bf2ec42a4f35e639 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:29.215025 426 tablet_replica.cc:331] T 9943bb8023444f49a11df01d93738f1e P 3f2aa40978064c9e9983cf3745eed206: stopping tablet replica
W20250625 03:31:29.215684 1708 consensus_peers.cc:487] T 731095860aad436e9658ab3ff5010f9d P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Couldn't send request to peer 3f2aa40978064c9e9983cf3745eed206. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:29.215759 426 raft_consensus.cc:2241] T 9943bb8023444f49a11df01d93738f1e P 3f2aa40978064c9e9983cf3745eed206 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:31:29.217020 426 raft_consensus.cc:2270] T 9943bb8023444f49a11df01d93738f1e P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:29.220096 426 tablet_replica.cc:331] T 9643cfd400804eb8b9037c5e9efddfba P 3f2aa40978064c9e9983cf3745eed206: stopping tablet replica
I20250625 03:31:29.220854 426 raft_consensus.cc:2241] T 9643cfd400804eb8b9037c5e9efddfba P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:29.221478 426 raft_consensus.cc:2270] T 9643cfd400804eb8b9037c5e9efddfba P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Raft consensus is shut down!
W20250625 03:31:29.227829 2307 consensus_peers.cc:487] T b15eb94b9d3d4f6987b5fa5e20193655 P df8b9755d156478aafca552f9e9c539e -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20250625 03:31:29.228679 426 tablet_replica.cc:331] T 0e7eb287e9514c838aeed599d2703682 P 3f2aa40978064c9e9983cf3745eed206: stopping tablet replica
I20250625 03:31:29.229543 426 raft_consensus.cc:2241] T 0e7eb287e9514c838aeed599d2703682 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:29.230074 426 raft_consensus.cc:2270] T 0e7eb287e9514c838aeed599d2703682 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:29.232945 426 tablet_replica.cc:331] T 731095860aad436e9658ab3ff5010f9d P 3f2aa40978064c9e9983cf3745eed206: stopping tablet replica
I20250625 03:31:29.233662 426 raft_consensus.cc:2241] T 731095860aad436e9658ab3ff5010f9d P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:29.234462 426 raft_consensus.cc:2270] T 731095860aad436e9658ab3ff5010f9d P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250625 03:31:29.234632 2306 consensus_peers.cc:487] T 6d7a37b3448d468baa1b9422a6167c9a P df8b9755d156478aafca552f9e9c539e -> Peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Couldn't send request to peer 3f2aa40978064c9e9983cf3745eed206. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:29.237468 426 tablet_replica.cc:331] T 441042afd59544a4a04bf85fa69d7d55 P 3f2aa40978064c9e9983cf3745eed206: stopping tablet replica
W20250625 03:31:29.242002 2307 consensus_peers.cc:487] T f957bf9749c54be48094092cb80e9055 P df8b9755d156478aafca552f9e9c539e -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20250625 03:31:29.242801 426 raft_consensus.cc:2241] T 441042afd59544a4a04bf85fa69d7d55 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:29.243433 426 raft_consensus.cc:2270] T 441042afd59544a4a04bf85fa69d7d55 P 3f2aa40978064c9e9983cf3745eed206 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:29.246394 426 tablet_replica.cc:331] T 6e7283d035e1429f946d8ebb98978656 P 3f2aa40978064c9e9983cf3745eed206: stopping tablet replica
I20250625 03:31:29.247103 426 raft_consensus.cc:2241] T 6e7283d035e1429f946d8ebb98978656 P 3f2aa40978064c9e9983cf3745eed206 [term 4 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:29.247617 426 raft_consensus.cc:2270] T 6e7283d035e1429f946d8ebb98978656 P 3f2aa40978064c9e9983cf3745eed206 [term 4 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:29.250205 426 tablet_replica.cc:331] T 85e02bb33a944989ada7f600c1e802da P 3f2aa40978064c9e9983cf3745eed206: stopping tablet replica
I20250625 03:31:29.250869 426 raft_consensus.cc:2241] T 85e02bb33a944989ada7f600c1e802da P 3f2aa40978064c9e9983cf3745eed206 [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:31:29.252040 426 raft_consensus.cc:2270] T 85e02bb33a944989ada7f600c1e802da P 3f2aa40978064c9e9983cf3745eed206 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:29.254956 426 tablet_replica.cc:331] T f957bf9749c54be48094092cb80e9055 P 3f2aa40978064c9e9983cf3745eed206: stopping tablet replica
I20250625 03:31:29.255642 426 raft_consensus.cc:2241] T f957bf9749c54be48094092cb80e9055 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:29.256443 426 raft_consensus.cc:2270] T f957bf9749c54be48094092cb80e9055 P 3f2aa40978064c9e9983cf3745eed206 [term 3 FOLLOWER]: Raft consensus is shut down!
W20250625 03:31:29.258008 2307 consensus_peers.cc:487] T b3f18b9311894580bc336199d357df41 P df8b9755d156478aafca552f9e9c539e -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20250625 03:31:29.295107 2307 consensus_peers.cc:487] T 188e56b819ae44f9b72baefcbc749400 P df8b9755d156478aafca552f9e9c539e -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20250625 03:31:29.303793 1709 consensus_peers.cc:487] T af4573692c104d67994dbb1bc518b568 P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20250625 03:31:29.307868 1709 consensus_peers.cc:487] T fa68c3b7143345958f883bde3591b622 P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20250625 03:31:29.314527 1709 consensus_peers.cc:487] T c4354f7ffc0e4eabbc92a141d46b7984 P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20250625 03:31:29.328969 2306 consensus_peers.cc:487] T 188e56b819ae44f9b72baefcbc749400 P df8b9755d156478aafca552f9e9c539e -> Peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Couldn't send request to peer 3f2aa40978064c9e9983cf3745eed206. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250625 03:31:29.336480 2307 consensus_peers.cc:487] T 70328d972b5943009ef0c7d92cbae349 P df8b9755d156478aafca552f9e9c539e -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20250625 03:31:29.362795 1709 consensus_peers.cc:487] T df29d87d804d44438345052a5902052f P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20250625 03:31:29.363554 1709 consensus_peers.cc:487] T d9038fc1ce0d4b528c02c68012e1277d P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20250625 03:31:29.368983 1709 consensus_peers.cc:487] T 9b7de80fbd7d4625aac41dea0457fd3e P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20250625 03:31:29.378214 1709 consensus_peers.cc:487] T e4034c33d83e4a96a187eaed46416e3c P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20250625 03:31:29.401511 1708 consensus_peers.cc:487] T 1fff19a38e8d4880a14da6b4c8284cc2 P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Couldn't send request to peer 3f2aa40978064c9e9983cf3745eed206. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250625 03:31:29.406493 1635 connection.cc:441] server connection from 127.0.0.1:55766 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55766 (request call id 574) could send its response
W20250625 03:31:29.407668 1635 connection.cc:441] server connection from 127.0.0.1:55766 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55766 (request call id 575) could send its response
W20250625 03:31:29.408712 2306 consensus_peers.cc:487] T 70328d972b5943009ef0c7d92cbae349 P df8b9755d156478aafca552f9e9c539e -> Peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Couldn't send request to peer 3f2aa40978064c9e9983cf3745eed206. Status: Network error: recv got EOF from 127.0.106.130:34293 (error 108). This is attempt 1: this message will repeat every 5th retry.
W20250625 03:31:29.411386 1709 consensus_peers.cc:487] T 441042afd59544a4a04bf85fa69d7d55 P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20250625 03:31:29.412762 426 connection.cc:441] server connection from 127.0.0.1:55766 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55766 (request call id 573) could send its response
W20250625 03:31:29.470142 1709 consensus_peers.cc:487] T f8c715109ff0405997e1ca9952678c0d P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20250625 03:31:29.523614 1709 consensus_peers.cc:487] T ba2ab3296190416aa07624e6d69ba09b P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20250625 03:31:29.548194 2307 consensus_peers.cc:487] T 6e7283d035e1429f946d8ebb98978656 P df8b9755d156478aafca552f9e9c539e -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20250625 03:31:29.555611 2307 consensus_peers.cc:487] T fb6e83db706647e28e491a02f1641980 P df8b9755d156478aafca552f9e9c539e -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20250625 03:31:29.602381 2307 consensus_peers.cc:487] T 3037be35f2054cbbabd8a47062f84244 P df8b9755d156478aafca552f9e9c539e -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20250625 03:31:29.603672 1709 consensus_peers.cc:487] T 1fff19a38e8d4880a14da6b4c8284cc2 P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20250625 03:31:29.729949 2307 consensus_peers.cc:487] T 6d7a37b3448d468baa1b9422a6167c9a P df8b9755d156478aafca552f9e9c539e -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20250625 03:31:29.793249 1709 consensus_peers.cc:487] T c04f7c2d00994557b1cb83234b36fceb P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20250625 03:31:29.830912 1709 consensus_peers.cc:487] T 615cebbffcfc44e19b8f7a1e842073a3 P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20250625 03:31:29.877615 1709 consensus_peers.cc:487] T c977876716a0400a9482dd8e0ad33b86 P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20250625 03:31:29.931834 1709 consensus_peers.cc:487] T e58b1ae66ee14c6f8d6f2db8dda2b842 P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20250625 03:31:30.021279 1709 consensus_peers.cc:487] T 64add559c121402aa1f7753538a50857 P ba464e89e0f044a0a0ea3e6125cbf2a1 -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20250625 03:31:30.133497 3474 raft_consensus.cc:491] T d50c52b197294003b238a37da2fb55d8 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f2aa40978064c9e9983cf3745eed206)
I20250625 03:31:30.134204 3474 raft_consensus.cc:513] T d50c52b197294003b238a37da2fb55d8 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:30.136924 3474 leader_election.cc:290] T d50c52b197294003b238a37da2fb55d8 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
W20250625 03:31:30.141956 2307 leader_election.cc:336] T d50c52b197294003b238a37da2fb55d8 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111)
I20250625 03:31:30.144850 3486 raft_consensus.cc:491] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f2aa40978064c9e9983cf3745eed206)
I20250625 03:31:30.145440 3486 raft_consensus.cc:513] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:30.148470 3486 leader_election.cc:290] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
W20250625 03:31:30.152170 2306 leader_election.cc:336] T d50c52b197294003b238a37da2fb55d8 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Network error: Client connection negotiation failed: client connection to 127.0.106.130:34293: connect: Connection refused (error 111)
I20250625 03:31:30.152724 2306 leader_election.cc:304] T d50c52b197294003b238a37da2fb55d8 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8b9755d156478aafca552f9e9c539e; no voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:31:30.154321 3474 raft_consensus.cc:2747] T d50c52b197294003b238a37da2fb55d8 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20250625 03:31:30.161230 2306 leader_election.cc:336] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Network error: Client connection negotiation failed: client connection to 127.0.106.130:34293: connect: Connection refused (error 111)
I20250625 03:31:30.163704 1737 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a9ae17eec3fe4ce0841d3fb17c91a8b8" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:31:30.165783 2308 leader_election.cc:304] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8b9755d156478aafca552f9e9c539e; no voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:31:30.167079 3474 raft_consensus.cc:2747] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250625 03:31:30.281919 3474 raft_consensus.cc:491] T 85e02bb33a944989ada7f600c1e802da P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3f2aa40978064c9e9983cf3745eed206)
I20250625 03:31:30.282522 3474 raft_consensus.cc:513] T 85e02bb33a944989ada7f600c1e802da P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:30.288487 3477 raft_consensus.cc:491] T 9943bb8023444f49a11df01d93738f1e P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f2aa40978064c9e9983cf3745eed206)
I20250625 03:31:30.289119 3477 raft_consensus.cc:513] T 9943bb8023444f49a11df01d93738f1e P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:30.293622 3474 leader_election.cc:290] T 85e02bb33a944989ada7f600c1e802da P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:31:30.294852 3477 leader_election.cc:290] T 9943bb8023444f49a11df01d93738f1e P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:31:30.302277 3474 raft_consensus.cc:491] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f2aa40978064c9e9983cf3745eed206)
I20250625 03:31:30.302989 3474 raft_consensus.cc:513] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:30.324754 3474 leader_election.cc:290] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
W20250625 03:31:30.331113 2307 leader_election.cc:336] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111)
W20250625 03:31:30.322762 2306 leader_election.cc:336] T 85e02bb33a944989ada7f600c1e802da P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Network error: Client connection negotiation failed: client connection to 127.0.106.130:34293: connect: Connection refused (error 111)
I20250625 03:31:30.339288 3486 raft_consensus.cc:491] T 6cc384f27ff041c0be70bb661ae610dd P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f2aa40978064c9e9983cf3745eed206)
I20250625 03:31:30.341543 3486 raft_consensus.cc:513] T 6cc384f27ff041c0be70bb661ae610dd P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:30.345466 3486 leader_election.cc:290] T 6cc384f27ff041c0be70bb661ae610dd P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:31:30.349299 3474 raft_consensus.cc:491] T e88f79ed06514e01a9bc48261a5acfbb P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3f2aa40978064c9e9983cf3745eed206)
I20250625 03:31:30.358213 3477 raft_consensus.cc:491] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3f2aa40978064c9e9983cf3745eed206)
I20250625 03:31:30.356428 3474 raft_consensus.cc:513] T e88f79ed06514e01a9bc48261a5acfbb P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:30.390373 3474 leader_election.cc:290] T e88f79ed06514e01a9bc48261a5acfbb P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:31:30.359046 3477 raft_consensus.cc:513] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:30.416900 3477 leader_election.cc:290] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
W20250625 03:31:30.402324 1709 leader_election.cc:336] T 9943bb8023444f49a11df01d93738f1e P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111)
I20250625 03:31:30.408247 3493 raft_consensus.cc:491] T add8a729ea684e7eab256135c01309df P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3f2aa40978064c9e9983cf3745eed206)
I20250625 03:31:30.417764 3493 raft_consensus.cc:513] T add8a729ea684e7eab256135c01309df P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:30.419698 3493 leader_election.cc:290] T add8a729ea684e7eab256135c01309df P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:31:30.412254 3473 raft_consensus.cc:491] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f2aa40978064c9e9983cf3745eed206)
I20250625 03:31:30.414680 1741 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "85e02bb33a944989ada7f600c1e802da" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:31:30.421320 3473 raft_consensus.cc:513] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:30.423931 3473 leader_election.cc:290] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493)
W20250625 03:31:30.437045 2307 leader_election.cc:336] T e88f79ed06514e01a9bc48261a5acfbb P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111)
I20250625 03:31:30.450418 3473 raft_consensus.cc:491] T 96030b80e1f340afa81659faaaf68755 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3f2aa40978064c9e9983cf3745eed206)
I20250625 03:31:30.451090 3473 raft_consensus.cc:513] T 96030b80e1f340afa81659faaaf68755 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:30.453249 3473 leader_election.cc:290] T 96030b80e1f340afa81659faaaf68755 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
W20250625 03:31:30.439604 2306 leader_election.cc:336] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Network error: Client connection negotiation failed: client connection to 127.0.106.130:34293: connect: Connection refused (error 111)
I20250625 03:31:30.444360 3492 raft_consensus.cc:491] T a1d83fca2b484feeaff6f350fe749b24 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3f2aa40978064c9e9983cf3745eed206)
I20250625 03:31:30.456379 3492 raft_consensus.cc:513] T a1d83fca2b484feeaff6f350fe749b24 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:30.455804 2306 leader_election.cc:304] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8b9755d156478aafca552f9e9c539e; no voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e
W20250625 03:31:30.462262 2306 leader_election.cc:336] T 6cc384f27ff041c0be70bb661ae610dd P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Network error: Client connection negotiation failed: client connection to 127.0.106.130:34293: connect: Connection refused (error 111)
I20250625 03:31:30.466557 2308 leader_election.cc:304] T 85e02bb33a944989ada7f600c1e802da P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8b9755d156478aafca552f9e9c539e; no voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:31:30.467730 1741 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6cc384f27ff041c0be70bb661ae610dd" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
W20250625 03:31:30.469834 1708 leader_election.cc:336] T 9943bb8023444f49a11df01d93738f1e P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Network error: Client connection negotiation failed: client connection to 127.0.106.130:34293: connect: Connection refused (error 111)
I20250625 03:31:30.463749 3474 raft_consensus.cc:2747] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250625 03:31:30.470217 1745 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a1d83fca2b484feeaff6f350fe749b24" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:31:30.470362 1708 leader_election.cc:304] T 9943bb8023444f49a11df01d93738f1e P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:31:30.471282 3493 raft_consensus.cc:2747] T 9943bb8023444f49a11df01d93738f1e P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20250625 03:31:30.475826 1709 leader_election.cc:336] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111)
W20250625 03:31:30.476557 1709 leader_election.cc:336] T add8a729ea684e7eab256135c01309df P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111)
I20250625 03:31:30.476848 3474 raft_consensus.cc:2747] T 85e02bb33a944989ada7f600c1e802da P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20250625 03:31:30.479717 1709 leader_election.cc:336] T 96030b80e1f340afa81659faaaf68755 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111)
I20250625 03:31:30.480316 3474 raft_consensus.cc:491] T f9458dec7953448d8550396d67fad249 P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3f2aa40978064c9e9983cf3745eed206)
I20250625 03:31:30.478314 3473 raft_consensus.cc:491] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3f2aa40978064c9e9983cf3745eed206)
I20250625 03:31:30.484943 3493 raft_consensus.cc:491] T 44f429469440455593143983452a9fe3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f2aa40978064c9e9983cf3745eed206)
I20250625 03:31:30.487843 3493 raft_consensus.cc:513] T 44f429469440455593143983452a9fe3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:30.489606 3494 raft_consensus.cc:491] T b31026f89f1e49949acec419db9649d3 P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3f2aa40978064c9e9983cf3745eed206)
W20250625 03:31:30.489692 2306 leader_election.cc:336] T e88f79ed06514e01a9bc48261a5acfbb P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Network error: Client connection negotiation failed: client connection to 127.0.106.130:34293: connect: Connection refused (error 111)
I20250625 03:31:30.490195 3494 raft_consensus.cc:513] T b31026f89f1e49949acec419db9649d3 P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:30.490386 2306 leader_election.cc:304] T e88f79ed06514e01a9bc48261a5acfbb P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8b9755d156478aafca552f9e9c539e; no voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:31:30.490361 3473 raft_consensus.cc:513] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:30.489905 3493 leader_election.cc:290] T 44f429469440455593143983452a9fe3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493)
I20250625 03:31:30.492343 3494 leader_election.cc:290] T b31026f89f1e49949acec419db9649d3 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:31:30.485420 3492 leader_election.cc:290] T a1d83fca2b484feeaff6f350fe749b24 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:31:30.492810 3494 raft_consensus.cc:491] T a5a18934cc3f490288432ee1cb30b278 P df8b9755d156478aafca552f9e9c539e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3f2aa40978064c9e9983cf3745eed206)
I20250625 03:31:30.493235 3492 raft_consensus.cc:2747] T e88f79ed06514e01a9bc48261a5acfbb P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20250625 03:31:30.493289 3494 raft_consensus.cc:513] T a5a18934cc3f490288432ee1cb30b278 P df8b9755d156478aafca552f9e9c539e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:30.495833 3473 leader_election.cc:290] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493)
I20250625 03:31:30.486836 3474 raft_consensus.cc:513] T f9458dec7953448d8550396d67fad249 P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:30.495899 3494 leader_election.cc:290] T a5a18934cc3f490288432ee1cb30b278 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:31:30.504911 3474 leader_election.cc:290] T f9458dec7953448d8550396d67fad249 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:31:30.507606 3495 raft_consensus.cc:491] T cc3b100d6d574a68b79e6a8f23d77201 P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3f2aa40978064c9e9983cf3745eed206)
I20250625 03:31:30.509265 3495 raft_consensus.cc:513] T cc3b100d6d574a68b79e6a8f23d77201 P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:30.514165 3474 raft_consensus.cc:491] T 44f429469440455593143983452a9fe3 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f2aa40978064c9e9983cf3745eed206)
I20250625 03:31:30.514874 3474 raft_consensus.cc:513] T 44f429469440455593143983452a9fe3 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:30.521035 3495 leader_election.cc:290] T cc3b100d6d574a68b79e6a8f23d77201 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
W20250625 03:31:30.517462 2307 leader_election.cc:336] T a5a18934cc3f490288432ee1cb30b278 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111)
I20250625 03:31:30.525359 2342 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a9ae17eec3fe4ce0841d3fb17c91a8b8" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "df8b9755d156478aafca552f9e9c539e" is_pre_election: true
W20250625 03:31:30.525879 2306 leader_election.cc:336] T a1d83fca2b484feeaff6f350fe749b24 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Network error: Client connection negotiation failed: client connection to 127.0.106.130:34293: connect: Connection refused (error 111)
I20250625 03:31:30.527194 2342 raft_consensus.cc:2466] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 1.
I20250625 03:31:30.526436 2308 leader_election.cc:304] T 6cc384f27ff041c0be70bb661ae610dd P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8b9755d156478aafca552f9e9c539e; no voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1
W20250625 03:31:30.530092 2306 leader_election.cc:336] T b31026f89f1e49949acec419db9649d3 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Network error: Client connection negotiation failed: client connection to 127.0.106.130:34293: connect: Connection refused (error 111)
I20250625 03:31:30.537089 3493 raft_consensus.cc:491] T a1d83fca2b484feeaff6f350fe749b24 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3f2aa40978064c9e9983cf3745eed206)
I20250625 03:31:30.537859 3493 raft_consensus.cc:513] T a1d83fca2b484feeaff6f350fe749b24 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:30.539192 2340 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b31026f89f1e49949acec419db9649d3" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "df8b9755d156478aafca552f9e9c539e" is_pre_election: true
I20250625 03:31:30.540232 3493 leader_election.cc:290] T a1d83fca2b484feeaff6f350fe749b24 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493)
I20250625 03:31:30.541635 1745 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b31026f89f1e49949acec419db9649d3" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:31:30.539883 2340 raft_consensus.cc:2466] T b31026f89f1e49949acec419db9649d3 P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 3.
I20250625 03:31:30.542073 3493 raft_consensus.cc:491] T 393f73bcf106475cbee7a645b0d9660c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3f2aa40978064c9e9983cf3745eed206)
I20250625 03:31:30.542963 1740 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "44f429469440455593143983452a9fe3" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:31:30.542773 3493 raft_consensus.cc:513] T 393f73bcf106475cbee7a645b0d9660c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
I20250625 03:31:30.538498 2344 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "44f429469440455593143983452a9fe3" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "df8b9755d156478aafca552f9e9c539e" is_pre_election: true
I20250625 03:31:30.543596 1740 raft_consensus.cc:2466] T 44f429469440455593143983452a9fe3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df8b9755d156478aafca552f9e9c539e in term 1.
I20250625 03:31:30.544057 2344 raft_consensus.cc:2466] T 44f429469440455593143983452a9fe3 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 1.
I20250625 03:31:30.542204 1745 raft_consensus.cc:2466] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df8b9755d156478aafca552f9e9c539e in term 3.
I20250625 03:31:30.545182 2308 leader_election.cc:304] T a1d83fca2b484feeaff6f350fe749b24 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8b9755d156478aafca552f9e9c539e; no voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:31:30.545372 3494 raft_consensus.cc:2747] T 6cc384f27ff041c0be70bb661ae610dd P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20250625 03:31:30.545738 1708 leader_election.cc:336] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Network error: Client connection negotiation failed: client connection to 127.0.106.130:34293: connect: Connection refused (error 111)
I20250625 03:31:30.545192 3493 leader_election.cc:290] T 393f73bcf106475cbee7a645b0d9660c P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
I20250625 03:31:30.546943 1708 leader_election.cc:304] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:31:30.547062 3486 raft_consensus.cc:2747] T a1d83fca2b484feeaff6f350fe749b24 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20250625 03:31:30.548403 1708 leader_election.cc:336] T add8a729ea684e7eab256135c01309df P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Network error: Client connection negotiation failed: client connection to 127.0.106.130:34293: connect: Connection refused (error 111)
I20250625 03:31:30.550593 1708 leader_election.cc:304] T add8a729ea684e7eab256135c01309df P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:31:30.551369 3477 raft_consensus.cc:2747] T add8a729ea684e7eab256135c01309df P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20250625 03:31:30.551580 1708 leader_election.cc:336] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Network error: Client connection negotiation failed: client connection to 127.0.106.130:34293: connect: Connection refused (error 111)
I20250625 03:31:30.548923 3493 raft_consensus.cc:2747] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20250625 03:31:30.552170 3474 leader_election.cc:290] T 44f429469440455593143983452a9fe3 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
W20250625 03:31:30.552738 1708 leader_election.cc:336] T 96030b80e1f340afa81659faaaf68755 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Network error: Client connection negotiation failed: client connection to 127.0.106.130:34293: connect: Connection refused (error 111)
W20250625 03:31:30.552843 2306 leader_election.cc:336] T a5a18934cc3f490288432ee1cb30b278 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Network error: Client connection negotiation failed: client connection to 127.0.106.130:34293: connect: Connection refused (error 111)
I20250625 03:31:30.553207 1708 leader_election.cc:304] T 96030b80e1f340afa81659faaaf68755 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:31:30.554941 2306 leader_election.cc:304] T a5a18934cc3f490288432ee1cb30b278 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8b9755d156478aafca552f9e9c539e; no voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:31:30.555496 3497 raft_consensus.cc:2747] T 96030b80e1f340afa81659faaaf68755 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20250625 03:31:30.556073 2306 leader_election.cc:336] T f9458dec7953448d8550396d67fad249 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Network error: Client connection negotiation failed: client connection to 127.0.106.130:34293: connect: Connection refused (error 111)
W20250625 03:31:30.556553 2306 leader_election.cc:336] T cc3b100d6d574a68b79e6a8f23d77201 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Network error: Client connection negotiation failed: client connection to 127.0.106.130:34293: connect: Connection refused (error 111)
W20250625 03:31:30.556941 2306 leader_election.cc:336] T 44f429469440455593143983452a9fe3 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Network error: Client connection negotiation failed: client connection to 127.0.106.130:34293: connect: Connection refused (error 111)
W20250625 03:31:30.557897 2307 leader_election.cc:336] T f9458dec7953448d8550396d67fad249 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111)
I20250625 03:31:30.565955 2307 leader_election.cc:304] T f9458dec7953448d8550396d67fad249 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8b9755d156478aafca552f9e9c539e; no voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:31:30.566845 3498 raft_consensus.cc:2747] T f9458dec7953448d8550396d67fad249 P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20250625 03:31:30.559788 2339 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a1d83fca2b484feeaff6f350fe749b24" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "df8b9755d156478aafca552f9e9c539e" is_pre_election: true
I20250625 03:31:30.560503 1708 leader_election.cc:304] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1, df8b9755d156478aafca552f9e9c539e; no voters: 3f2aa40978064c9e9983cf3745eed206
I20250625 03:31:30.567835 2339 raft_consensus.cc:2466] T a1d83fca2b484feeaff6f350fe749b24 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 2.
I20250625 03:31:30.568055 3497 raft_consensus.cc:2802] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250625 03:31:30.568483 3497 raft_consensus.cc:491] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3f2aa40978064c9e9983cf3745eed206)
I20250625 03:31:30.565407 3496 raft_consensus.cc:491] T 542f85d76df8432593ee963669155a9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3f2aa40978064c9e9983cf3745eed206)
I20250625 03:31:30.569473 3496 raft_consensus.cc:513] T 542f85d76df8432593ee963669155a9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:30.568989 3497 raft_consensus.cc:3058] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:30.558040 3495 raft_consensus.cc:2747] T a5a18934cc3f490288432ee1cb30b278 P df8b9755d156478aafca552f9e9c539e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20250625 03:31:30.570046 1708 leader_election.cc:304] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1, df8b9755d156478aafca552f9e9c539e; no voters:
I20250625 03:31:30.571816 3493 raft_consensus.cc:2802] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20250625 03:31:30.572242 3493 raft_consensus.cc:491] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3f2aa40978064c9e9983cf3745eed206)
I20250625 03:31:30.572857 3493 raft_consensus.cc:3058] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Advancing to term 4
I20250625 03:31:30.574537 3496 leader_election.cc:290] T 542f85d76df8432593ee963669155a9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493)
W20250625 03:31:30.578795 1709 leader_election.cc:336] T 393f73bcf106475cbee7a645b0d9660c P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111)
I20250625 03:31:30.572248 1708 leader_election.cc:304] T 44f429469440455593143983452a9fe3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1, df8b9755d156478aafca552f9e9c539e; no voters:
I20250625 03:31:30.582459 3477 raft_consensus.cc:2802] T 44f429469440455593143983452a9fe3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250625 03:31:30.582850 3477 raft_consensus.cc:491] T 44f429469440455593143983452a9fe3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3f2aa40978064c9e9983cf3745eed206)
I20250625 03:31:30.583182 3477 raft_consensus.cc:3058] T 44f429469440455593143983452a9fe3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:30.591109 3477 raft_consensus.cc:513] T 44f429469440455593143983452a9fe3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:30.591879 3496 raft_consensus.cc:491] T 7553473daeb342ceaf782ddee8e4fc4d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3f2aa40978064c9e9983cf3745eed206)
I20250625 03:31:30.592662 3496 raft_consensus.cc:513] T 7553473daeb342ceaf782ddee8e4fc4d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9c4f2e01164f33b2e9034ed148398e" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 39903 } } peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } }
W20250625 03:31:30.591362 2307 leader_election.cc:336] T cc3b100d6d574a68b79e6a8f23d77201 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111)
I20250625 03:31:30.601871 2307 leader_election.cc:304] T cc3b100d6d574a68b79e6a8f23d77201 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8b9755d156478aafca552f9e9c539e; no voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:31:30.601892 1708 leader_election.cc:304] T a1d83fca2b484feeaff6f350fe749b24 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1, df8b9755d156478aafca552f9e9c539e; no voters:
I20250625 03:31:30.602883 3495 raft_consensus.cc:2747] T cc3b100d6d574a68b79e6a8f23d77201 P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20250625 03:31:30.602946 3473 raft_consensus.cc:2802] T a1d83fca2b484feeaff6f350fe749b24 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20250625 03:31:30.603579 3473 raft_consensus.cc:491] T a1d83fca2b484feeaff6f350fe749b24 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3f2aa40978064c9e9983cf3745eed206)
I20250625 03:31:30.604086 3473 raft_consensus.cc:3058] T a1d83fca2b484feeaff6f350fe749b24 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:30.608898 2308 leader_election.cc:304] T 44f429469440455593143983452a9fe3 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1, df8b9755d156478aafca552f9e9c539e; no voters: 3f2aa40978064c9e9983cf3745eed206
W20250625 03:31:30.609503 1708 leader_election.cc:336] T 44f429469440455593143983452a9fe3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Network error: Client connection negotiation failed: client connection to 127.0.106.130:34293: connect: Connection refused (error 111)
I20250625 03:31:30.610123 2308 leader_election.cc:304] T b31026f89f1e49949acec419db9649d3 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1, df8b9755d156478aafca552f9e9c539e; no voters: 3f2aa40978064c9e9983cf3745eed206
W20250625 03:31:30.610307 1708 leader_election.cc:336] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Network error: Client connection negotiation failed: client connection to 127.0.106.130:34293: connect: Connection refused (error 111)
I20250625 03:31:30.610929 3498 raft_consensus.cc:2802] T 44f429469440455593143983452a9fe3 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250625 03:31:30.611322 3498 raft_consensus.cc:491] T 44f429469440455593143983452a9fe3 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3f2aa40978064c9e9983cf3745eed206)
I20250625 03:31:30.611496 3495 raft_consensus.cc:2802] T b31026f89f1e49949acec419db9649d3 P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20250625 03:31:30.611809 3498 raft_consensus.cc:3058] T 44f429469440455593143983452a9fe3 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:30.611981 3495 raft_consensus.cc:491] T b31026f89f1e49949acec419db9649d3 P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3f2aa40978064c9e9983cf3745eed206)
I20250625 03:31:30.612766 3495 raft_consensus.cc:3058] T b31026f89f1e49949acec419db9649d3 P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Advancing to term 4
I20250625 03:31:30.591028 3493 raft_consensus.cc:513] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:30.583297 3497 raft_consensus.cc:513] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:30.593629 3477 leader_election.cc:290] T 44f429469440455593143983452a9fe3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 2 election: Requested vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493)
I20250625 03:31:30.630148 3473 raft_consensus.cc:513] T a1d83fca2b484feeaff6f350fe749b24 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:30.638999 3474 raft_consensus.cc:491] T 542f85d76df8432593ee963669155a9d P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3f2aa40978064c9e9983cf3745eed206)
I20250625 03:31:30.639559 3474 raft_consensus.cc:513] T 542f85d76df8432593ee963669155a9d P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:30.640638 3495 raft_consensus.cc:513] T b31026f89f1e49949acec419db9649d3 P df8b9755d156478aafca552f9e9c539e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:30.642149 3474 leader_election.cc:290] T 542f85d76df8432593ee963669155a9d P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:31:30.631563 3477 raft_consensus.cc:491] T 6cc384f27ff041c0be70bb661ae610dd P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f2aa40978064c9e9983cf3745eed206)
I20250625 03:31:30.644207 3477 raft_consensus.cc:513] T 6cc384f27ff041c0be70bb661ae610dd P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:30.636425 2339 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "542f85d76df8432593ee963669155a9d" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "df8b9755d156478aafca552f9e9c539e" is_pre_election: true
I20250625 03:31:30.637254 2342 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "44f429469440455593143983452a9fe3" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "df8b9755d156478aafca552f9e9c539e"
I20250625 03:31:30.646405 2339 raft_consensus.cc:2466] T 542f85d76df8432593ee963669155a9d P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 2.
I20250625 03:31:30.642023 3498 raft_consensus.cc:513] T 44f429469440455593143983452a9fe3 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:30.647895 2342 raft_consensus.cc:2391] T 44f429469440455593143983452a9fe3 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in current term 2: Already voted for candidate df8b9755d156478aafca552f9e9c539e in this term.
I20250625 03:31:30.648964 3498 leader_election.cc:290] T 44f429469440455593143983452a9fe3 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 2 election: Requested vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:31:30.642648 3495 leader_election.cc:290] T b31026f89f1e49949acec419db9649d3 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 4 election: Requested vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
W20250625 03:31:30.653553 2306 leader_election.cc:336] T 542f85d76df8432593ee963669155a9d P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Network error: Client connection negotiation failed: client connection to 127.0.106.130:34293: connect: Connection refused (error 111)
W20250625 03:31:30.654336 2306 leader_election.cc:336] T b31026f89f1e49949acec419db9649d3 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Network error: Client connection negotiation failed: client connection to 127.0.106.130:34293: connect: Connection refused (error 111)
I20250625 03:31:30.657651 3496 leader_election.cc:290] T 7553473daeb342ceaf782ddee8e4fc4d P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903), 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293)
W20250625 03:31:30.631471 1709 leader_election.cc:336] T 7553473daeb342ceaf782ddee8e4fc4d P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111)
I20250625 03:31:30.661370 1741 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b31026f89f1e49949acec419db9649d3" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:31:30.661767 1740 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "542f85d76df8432593ee963669155a9d" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:31:30.662190 1741 raft_consensus.cc:2391] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate df8b9755d156478aafca552f9e9c539e in current term 4: Already voted for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in this term.
I20250625 03:31:30.662473 1740 raft_consensus.cc:2466] T 542f85d76df8432593ee963669155a9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df8b9755d156478aafca552f9e9c539e in term 2.
I20250625 03:31:30.663353 1737 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "44f429469440455593143983452a9fe3" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:31:30.664141 1737 raft_consensus.cc:2391] T 44f429469440455593143983452a9fe3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate df8b9755d156478aafca552f9e9c539e in current term 2: Already voted for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in this term.
I20250625 03:31:30.664530 3499 raft_consensus.cc:491] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3f2aa40978064c9e9983cf3745eed206)
I20250625 03:31:30.665043 3499 raft_consensus.cc:513] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:30.665741 3477 leader_election.cc:290] T 6cc384f27ff041c0be70bb661ae610dd P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493)
I20250625 03:31:30.668045 3493 leader_election.cc:290] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 4 election: Requested vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493)
I20250625 03:31:30.670147 3497 leader_election.cc:290] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 2 election: Requested vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493)
I20250625 03:31:30.672484 3496 raft_consensus.cc:491] T 40b74a261fdd495f84ceb0690f0b30ba P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3f2aa40978064c9e9983cf3745eed206)
I20250625 03:31:30.673108 3496 raft_consensus.cc:513] T 40b74a261fdd495f84ceb0690f0b30ba P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:30.673899 3473 leader_election.cc:290] T a1d83fca2b484feeaff6f350fe749b24 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 3 election: Requested vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493)
W20250625 03:31:30.674829 2306 leader_election.cc:336] T 44f429469440455593143983452a9fe3 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Network error: Client connection negotiation failed: client connection to 127.0.106.130:34293: connect: Connection refused (error 111)
I20250625 03:31:30.675179 3496 leader_election.cc:290] T 40b74a261fdd495f84ceb0690f0b30ba P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493)
I20250625 03:31:30.667078 3499 leader_election.cc:290] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493)
I20250625 03:31:30.677788 1708 leader_election.cc:304] T 542f85d76df8432593ee963669155a9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1, df8b9755d156478aafca552f9e9c539e; no voters:
I20250625 03:31:30.679608 3501 raft_consensus.cc:2802] T 542f85d76df8432593ee963669155a9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20250625 03:31:30.679904 2308 leader_election.cc:304] T b31026f89f1e49949acec419db9649d3 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8b9755d156478aafca552f9e9c539e; no voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:31:30.680688 3501 raft_consensus.cc:491] T 542f85d76df8432593ee963669155a9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3f2aa40978064c9e9983cf3745eed206)
I20250625 03:31:30.680857 3495 raft_consensus.cc:2747] T b31026f89f1e49949acec419db9649d3 P df8b9755d156478aafca552f9e9c539e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20250625 03:31:30.681296 2308 leader_election.cc:304] T 542f85d76df8432593ee963669155a9d P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1, df8b9755d156478aafca552f9e9c539e; no voters: 3f2aa40978064c9e9983cf3745eed206
W20250625 03:31:30.681414 1708 leader_election.cc:336] T 393f73bcf106475cbee7a645b0d9660c P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Network error: Client connection negotiation failed: client connection to 127.0.106.130:34293: connect: Connection refused (error 111)
I20250625 03:31:30.681524 3501 raft_consensus.cc:3058] T 542f85d76df8432593ee963669155a9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:30.682024 3495 raft_consensus.cc:2802] T 542f85d76df8432593ee963669155a9d P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20250625 03:31:30.682080 1708 leader_election.cc:304] T 393f73bcf106475cbee7a645b0d9660c P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:31:30.686173 3495 raft_consensus.cc:491] T 542f85d76df8432593ee963669155a9d P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3f2aa40978064c9e9983cf3745eed206)
I20250625 03:31:30.682484 3498 raft_consensus.cc:491] T 40b74a261fdd495f84ceb0690f0b30ba P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3f2aa40978064c9e9983cf3745eed206)
I20250625 03:31:30.686805 3495 raft_consensus.cc:3058] T 542f85d76df8432593ee963669155a9d P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:30.687124 3498 raft_consensus.cc:513] T 40b74a261fdd495f84ceb0690f0b30ba P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:30.691098 3498 leader_election.cc:290] T 40b74a261fdd495f84ceb0690f0b30ba P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:31:30.692492 3477 raft_consensus.cc:2747] T 393f73bcf106475cbee7a645b0d9660c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20250625 03:31:30.693257 2306 leader_election.cc:336] T 40b74a261fdd495f84ceb0690f0b30ba P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Network error: Client connection negotiation failed: client connection to 127.0.106.130:34293: connect: Connection refused (error 111)
I20250625 03:31:30.695883 3501 raft_consensus.cc:513] T 542f85d76df8432593ee963669155a9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:30.697958 3501 leader_election.cc:290] T 542f85d76df8432593ee963669155a9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 3 election: Requested vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493)
I20250625 03:31:30.698360 3495 raft_consensus.cc:513] T 542f85d76df8432593ee963669155a9d P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:30.701448 3495 leader_election.cc:290] T 542f85d76df8432593ee963669155a9d P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 3 election: Requested vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359)
I20250625 03:31:30.707760 2339 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "85e02bb33a944989ada7f600c1e802da" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "df8b9755d156478aafca552f9e9c539e" is_pre_election: true
I20250625 03:31:30.708449 2339 raft_consensus.cc:2466] T 85e02bb33a944989ada7f600c1e802da P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 2.
I20250625 03:31:30.705183 2308 leader_election.cc:304] T 44f429469440455593143983452a9fe3 P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8b9755d156478aafca552f9e9c539e; no voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:31:30.710340 3495 raft_consensus.cc:2747] T 44f429469440455593143983452a9fe3 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20250625 03:31:30.710621 2342 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6cc384f27ff041c0be70bb661ae610dd" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "df8b9755d156478aafca552f9e9c539e" is_pre_election: true
I20250625 03:31:30.712895 2342 raft_consensus.cc:2466] T 6cc384f27ff041c0be70bb661ae610dd P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 1.
I20250625 03:31:30.711609 2339 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b31026f89f1e49949acec419db9649d3" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "df8b9755d156478aafca552f9e9c539e"
W20250625 03:31:30.712224 2306 leader_election.cc:336] T 542f85d76df8432593ee963669155a9d P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Network error: Client connection negotiation failed: client connection to 127.0.106.130:34293: connect: Connection refused (error 111)
I20250625 03:31:30.713932 2339 raft_consensus.cc:2391] T b31026f89f1e49949acec419db9649d3 P df8b9755d156478aafca552f9e9c539e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in current term 4: Already voted for candidate df8b9755d156478aafca552f9e9c539e in this term.
I20250625 03:31:30.715807 2339 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a9ae17eec3fe4ce0841d3fb17c91a8b8" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "df8b9755d156478aafca552f9e9c539e"
I20250625 03:31:30.716455 2339 raft_consensus.cc:3058] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Advancing to term 2
W20250625 03:31:30.717748 1708 leader_election.cc:336] T 542f85d76df8432593ee963669155a9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Network error: Client connection negotiation failed: client connection to 127.0.106.130:34293: connect: Connection refused (error 111)
I20250625 03:31:30.721029 2340 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "40b74a261fdd495f84ceb0690f0b30ba" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "df8b9755d156478aafca552f9e9c539e" is_pre_election: true
W20250625 03:31:30.721379 1708 leader_election.cc:336] T 44f429469440455593143983452a9fe3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Network error: Client connection negotiation failed: client connection to 127.0.106.130:34293: connect: Connection refused (error 111)
I20250625 03:31:30.721711 2340 raft_consensus.cc:2466] T 40b74a261fdd495f84ceb0690f0b30ba P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 2.
I20250625 03:31:30.721901 1708 leader_election.cc:304] T 44f429469440455593143983452a9fe3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 3f2aa40978064c9e9983cf3745eed206, df8b9755d156478aafca552f9e9c539e
I20250625 03:31:30.722802 2338 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "542f85d76df8432593ee963669155a9d" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "df8b9755d156478aafca552f9e9c539e"
I20250625 03:31:30.723140 3502 raft_consensus.cc:2747] T 44f429469440455593143983452a9fe3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20250625 03:31:30.723667 2338 raft_consensus.cc:2391] T 542f85d76df8432593ee963669155a9d P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in current term 3: Already voted for candidate df8b9755d156478aafca552f9e9c539e in this term.
W20250625 03:31:30.723266 1708 leader_election.cc:336] T 7553473daeb342ceaf782ddee8e4fc4d P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Network error: Client connection negotiation failed: client connection to 127.0.106.130:34293: connect: Connection refused (error 111)
I20250625 03:31:30.719483 2342 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a1d83fca2b484feeaff6f350fe749b24" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "df8b9755d156478aafca552f9e9c539e"
I20250625 03:31:30.725437 2342 raft_consensus.cc:3058] T a1d83fca2b484feeaff6f350fe749b24 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:30.724231 1708 leader_election.cc:304] T 7553473daeb342ceaf782ddee8e4fc4d P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 3f2aa40978064c9e9983cf3745eed206, 7e9c4f2e01164f33b2e9034ed148398e
I20250625 03:31:30.731681 3501 raft_consensus.cc:2747] T 7553473daeb342ceaf782ddee8e4fc4d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20250625 03:31:30.732887 1708 leader_election.cc:336] T 6cc384f27ff041c0be70bb661ae610dd P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Network error: Client connection negotiation failed: client connection to 127.0.106.130:34293: connect: Connection refused (error 111)
W20250625 03:31:30.733477 1708 leader_election.cc:336] T a1d83fca2b484feeaff6f350fe749b24 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Network error: Client connection negotiation failed: client connection to 127.0.106.130:34293: connect: Connection refused (error 111)
W20250625 03:31:30.734656 1708 leader_election.cc:336] T a1d83fca2b484feeaff6f350fe749b24 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Network error: Client connection negotiation failed: client connection to 127.0.106.130:34293: connect: Connection refused (error 111)
I20250625 03:31:30.737674 1708 leader_election.cc:304] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1, df8b9755d156478aafca552f9e9c539e; no voters:
I20250625 03:31:30.738554 3501 raft_consensus.cc:2802] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20250625 03:31:30.738940 3501 raft_consensus.cc:491] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3f2aa40978064c9e9983cf3745eed206)
I20250625 03:31:30.739297 3501 raft_consensus.cc:3058] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:30.748230 3501 raft_consensus.cc:513] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:30.751399 3501 leader_election.cc:290] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 3 election: Requested vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493)
I20250625 03:31:30.751480 2339 raft_consensus.cc:2466] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 2.
I20250625 03:31:30.749792 2342 raft_consensus.cc:2466] T a1d83fca2b484feeaff6f350fe749b24 P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 3.
I20250625 03:31:30.752581 426 tablet_server.cc:195] TabletServer@127.0.106.130:0 shutdown complete.
I20250625 03:31:30.749397 1708 leader_election.cc:304] T 6cc384f27ff041c0be70bb661ae610dd P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1, df8b9755d156478aafca552f9e9c539e; no voters: 3f2aa40978064c9e9983cf3745eed206
I20250625 03:31:30.754273 3502 raft_consensus.cc:2802] T 6cc384f27ff041c0be70bb661ae610dd P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250625 03:31:30.754354 1708 leader_election.cc:304] T 40b74a261fdd495f84ceb0690f0b30ba P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1, df8b9755d156478aafca552f9e9c539e; no voters:
I20250625 03:31:30.754791 3502 raft_consensus.cc:491] T 6cc384f27ff041c0be70bb661ae610dd P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3f2aa40978064c9e9983cf3745eed206)
I20250625 03:31:30.755182 3502 raft_consensus.cc:3058] T 6cc384f27ff041c0be70bb661ae610dd P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:30.755734 3477 raft_consensus.cc:2802] T 40b74a261fdd495f84ceb0690f0b30ba P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20250625 03:31:30.755640 1708 leader_election.cc:304] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1, df8b9755d156478aafca552f9e9c539e; no voters:
I20250625 03:31:30.756227 3477 raft_consensus.cc:491] T 40b74a261fdd495f84ceb0690f0b30ba P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3f2aa40978064c9e9983cf3745eed206)
I20250625 03:31:30.756608 3477 raft_consensus.cc:3058] T 40b74a261fdd495f84ceb0690f0b30ba P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:30.756891 3499 raft_consensus.cc:2802] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:31:30.757388 3499 raft_consensus.cc:695] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 LEADER]: Becoming Leader. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Running, Role: LEADER
I20250625 03:31:30.758275 3499 consensus_queue.cc:237] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:30.763933 3502 raft_consensus.cc:513] T 6cc384f27ff041c0be70bb661ae610dd P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:30.766279 3502 leader_election.cc:290] T 6cc384f27ff041c0be70bb661ae610dd P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 2 election: Requested vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493)
I20250625 03:31:30.766891 1708 leader_election.cc:304] T a1d83fca2b484feeaff6f350fe749b24 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1, df8b9755d156478aafca552f9e9c539e; no voters: 3f2aa40978064c9e9983cf3745eed206
I20250625 03:31:30.768760 3502 raft_consensus.cc:2802] T a1d83fca2b484feeaff6f350fe749b24 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Leader election won for term 3
I20250625 03:31:30.769260 1737 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "40b74a261fdd495f84ceb0690f0b30ba" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" is_pre_election: true
I20250625 03:31:30.769268 3502 raft_consensus.cc:695] T a1d83fca2b484feeaff6f350fe749b24 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 LEADER]: Becoming Leader. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Running, Role: LEADER
I20250625 03:31:30.772346 1740 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "542f85d76df8432593ee963669155a9d" candidate_uuid: "df8b9755d156478aafca552f9e9c539e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1"
I20250625 03:31:30.773176 1740 raft_consensus.cc:2391] T 542f85d76df8432593ee963669155a9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate df8b9755d156478aafca552f9e9c539e in current term 3: Already voted for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in this term.
I20250625 03:31:30.776301 2342 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "85e02bb33a944989ada7f600c1e802da" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "df8b9755d156478aafca552f9e9c539e"
I20250625 03:31:30.776675 2339 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6cc384f27ff041c0be70bb661ae610dd" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "df8b9755d156478aafca552f9e9c539e"
I20250625 03:31:30.776870 2342 raft_consensus.cc:3058] T 85e02bb33a944989ada7f600c1e802da P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:30.777290 2339 raft_consensus.cc:3058] T 6cc384f27ff041c0be70bb661ae610dd P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:30.777208 3477 raft_consensus.cc:513] T 40b74a261fdd495f84ceb0690f0b30ba P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:30.778514 1737 raft_consensus.cc:2391] T 40b74a261fdd495f84ceb0690f0b30ba P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate df8b9755d156478aafca552f9e9c539e in current term 3: Already voted for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in this term.
I20250625 03:31:30.779336 3477 leader_election.cc:290] T 40b74a261fdd495f84ceb0690f0b30ba P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 3 election: Requested vote from peers 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293), df8b9755d156478aafca552f9e9c539e (127.0.106.132:34493)
I20250625 03:31:30.783571 2308 leader_election.cc:304] T 542f85d76df8432593ee963669155a9d P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8b9755d156478aafca552f9e9c539e; no voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:31:30.784708 3495 raft_consensus.cc:2747] T 542f85d76df8432593ee963669155a9d P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20250625 03:31:30.788252 1708 leader_election.cc:336] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Network error: Client connection negotiation failed: client connection to 127.0.106.130:34293: connect: Connection refused (error 111)
I20250625 03:31:30.788776 1708 leader_election.cc:304] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 3f2aa40978064c9e9983cf3745eed206, df8b9755d156478aafca552f9e9c539e
W20250625 03:31:30.789642 1708 leader_election.cc:336] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Network error: Client connection negotiation failed: client connection to 127.0.106.130:34293: connect: Connection refused (error 111)
W20250625 03:31:30.790803 1708 leader_election.cc:336] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Network error: Client connection negotiation failed: client connection to 127.0.106.130:34293: connect: Connection refused (error 111)
W20250625 03:31:30.791788 1708 leader_election.cc:336] T 40b74a261fdd495f84ceb0690f0b30ba P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Network error: Client connection negotiation failed: client connection to 127.0.106.130:34293: connect: Connection refused (error 111)
W20250625 03:31:30.792502 1708 leader_election.cc:336] T 542f85d76df8432593ee963669155a9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Network error: Client connection negotiation failed: client connection to 127.0.106.130:34293: connect: Connection refused (error 111)
I20250625 03:31:30.792898 1708 leader_election.cc:304] T 542f85d76df8432593ee963669155a9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1; no voters: 3f2aa40978064c9e9983cf3745eed206, df8b9755d156478aafca552f9e9c539e
I20250625 03:31:30.793627 3499 raft_consensus.cc:2747] T 542f85d76df8432593ee963669155a9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20250625 03:31:30.794253 2339 raft_consensus.cc:2466] T 6cc384f27ff041c0be70bb661ae610dd P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 2.
I20250625 03:31:30.772491 3502 consensus_queue.cc:237] T a1d83fca2b484feeaff6f350fe749b24 P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:30.790835 2342 raft_consensus.cc:2466] T 85e02bb33a944989ada7f600c1e802da P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 3.
I20250625 03:31:30.796475 1493 catalog_manager.cc:5582] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: term changed from 1 to 2, leader changed from 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) to ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131). New cstate: current_term: 2 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:30.790094 3477 raft_consensus.cc:2747] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20250625 03:31:30.807760 2308 leader_election.cc:304] T 40b74a261fdd495f84ceb0690f0b30ba P df8b9755d156478aafca552f9e9c539e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8b9755d156478aafca552f9e9c539e; no voters: 3f2aa40978064c9e9983cf3745eed206, ba464e89e0f044a0a0ea3e6125cbf2a1
I20250625 03:31:30.809100 3495 raft_consensus.cc:3058] T 40b74a261fdd495f84ceb0690f0b30ba P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:30.809736 2342 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "40b74a261fdd495f84ceb0690f0b30ba" candidate_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "df8b9755d156478aafca552f9e9c539e"
W20250625 03:31:30.809130 1708 leader_election.cc:336] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Network error: Client connection negotiation failed: client connection to 127.0.106.130:34293: connect: Connection refused (error 111)
W20250625 03:31:30.813146 1708 leader_election.cc:336] T 6cc384f27ff041c0be70bb661ae610dd P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Network error: Client connection negotiation failed: client connection to 127.0.106.130:34293: connect: Connection refused (error 111)
I20250625 03:31:30.816679 1708 leader_election.cc:304] T 6cc384f27ff041c0be70bb661ae610dd P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1, df8b9755d156478aafca552f9e9c539e; no voters: 3f2aa40978064c9e9983cf3745eed206
I20250625 03:31:30.817507 3502 raft_consensus.cc:2802] T 6cc384f27ff041c0be70bb661ae610dd P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:31:30.817981 3502 raft_consensus.cc:695] T 6cc384f27ff041c0be70bb661ae610dd P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 LEADER]: Becoming Leader. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Running, Role: LEADER
I20250625 03:31:30.818810 3502 consensus_queue.cc:237] T 6cc384f27ff041c0be70bb661ae610dd P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:30.819273 1708 leader_election.cc:304] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1, df8b9755d156478aafca552f9e9c539e; no voters: 3f2aa40978064c9e9983cf3745eed206
I20250625 03:31:30.821157 3477 raft_consensus.cc:2802] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Leader election won for term 3
I20250625 03:31:30.821688 3477 raft_consensus.cc:695] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 LEADER]: Becoming Leader. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Running, Role: LEADER
I20250625 03:31:30.822569 3477 consensus_queue.cc:237] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:30.831269 3495 raft_consensus.cc:2747] T 40b74a261fdd495f84ceb0690f0b30ba P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20250625 03:31:30.841327 1708 leader_election.cc:336] T 40b74a261fdd495f84ceb0690f0b30ba P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Network error: Client connection negotiation failed: client connection to 127.0.106.130:34293: connect: Connection refused (error 111)
I20250625 03:31:30.852145 2342 raft_consensus.cc:2466] T 40b74a261fdd495f84ceb0690f0b30ba P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba464e89e0f044a0a0ea3e6125cbf2a1 in term 3.
I20250625 03:31:30.855594 1708 leader_election.cc:304] T 40b74a261fdd495f84ceb0690f0b30ba P ba464e89e0f044a0a0ea3e6125cbf2a1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ba464e89e0f044a0a0ea3e6125cbf2a1, df8b9755d156478aafca552f9e9c539e; no voters: 3f2aa40978064c9e9983cf3745eed206
I20250625 03:31:30.856551 3499 raft_consensus.cc:2802] T 40b74a261fdd495f84ceb0690f0b30ba P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Leader election won for term 3
I20250625 03:31:30.857087 3499 raft_consensus.cc:695] T 40b74a261fdd495f84ceb0690f0b30ba P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 LEADER]: Becoming Leader. State: Replica: ba464e89e0f044a0a0ea3e6125cbf2a1, State: Running, Role: LEADER
I20250625 03:31:30.856876 1493 catalog_manager.cc:5582] T a1d83fca2b484feeaff6f350fe749b24 P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: term changed from 2 to 3, leader changed from 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) to ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131). New cstate: current_term: 3 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:30.858093 3499 consensus_queue.cc:237] T 40b74a261fdd495f84ceb0690f0b30ba P ba464e89e0f044a0a0ea3e6125cbf2a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } }
I20250625 03:31:30.859511 1493 catalog_manager.cc:5582] T 6cc384f27ff041c0be70bb661ae610dd P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: term changed from 1 to 2, leader changed from 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) to ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131). New cstate: current_term: 2 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:30.862150 1493 catalog_manager.cc:5582] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: term changed from 2 to 3, leader changed from 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) to ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131). New cstate: current_term: 3 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:30.897568 1493 catalog_manager.cc:5582] T 40b74a261fdd495f84ceb0690f0b30ba P ba464e89e0f044a0a0ea3e6125cbf2a1 reported cstate change: term changed from 2 to 3, leader changed from 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130) to ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131). New cstate: current_term: 3 leader_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f2aa40978064c9e9983cf3745eed206" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 34293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba464e89e0f044a0a0ea3e6125cbf2a1" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39359 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8b9755d156478aafca552f9e9c539e" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 34493 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:30.944691 426 tablet_server.cc:178] TabletServer@127.0.106.131:0 shutting down...
I20250625 03:31:31.013657 426 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250625 03:31:31.014485 426 tablet_replica.cc:331] T e58b1ae66ee14c6f8d6f2db8dda2b842 P ba464e89e0f044a0a0ea3e6125cbf2a1: stopping tablet replica
I20250625 03:31:31.015091 426 raft_consensus.cc:2241] T e58b1ae66ee14c6f8d6f2db8dda2b842 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 LEADER]: Raft consensus shutting down.
I20250625 03:31:31.015938 426 raft_consensus.cc:2270] T e58b1ae66ee14c6f8d6f2db8dda2b842 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.017925 426 tablet_replica.cc:331] T 58c56cde04014b85b662a9b4cbaa726f P ba464e89e0f044a0a0ea3e6125cbf2a1: stopping tablet replica
I20250625 03:31:31.018496 426 raft_consensus.cc:2241] T 58c56cde04014b85b662a9b4cbaa726f P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:31.019115 426 raft_consensus.cc:2270] T 58c56cde04014b85b662a9b4cbaa726f P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.020933 426 tablet_replica.cc:331] T 59ac1803c12d43448ef566f886cc22e6 P ba464e89e0f044a0a0ea3e6125cbf2a1: stopping tablet replica
I20250625 03:31:31.021600 426 raft_consensus.cc:2241] T 59ac1803c12d43448ef566f886cc22e6 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 LEADER]: Raft consensus shutting down.
I20250625 03:31:31.022563 426 raft_consensus.cc:2270] T 59ac1803c12d43448ef566f886cc22e6 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.025025 426 tablet_replica.cc:331] T df29d87d804d44438345052a5902052f P ba464e89e0f044a0a0ea3e6125cbf2a1: stopping tablet replica
I20250625 03:31:31.025745 426 raft_consensus.cc:2241] T df29d87d804d44438345052a5902052f P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:31:31.027081 426 raft_consensus.cc:2270] T df29d87d804d44438345052a5902052f P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.030095 426 tablet_replica.cc:331] T add8a729ea684e7eab256135c01309df P ba464e89e0f044a0a0ea3e6125cbf2a1: stopping tablet replica
I20250625 03:31:31.030894 426 raft_consensus.cc:2241] T add8a729ea684e7eab256135c01309df P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:31.031477 426 raft_consensus.cc:2270] T add8a729ea684e7eab256135c01309df P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.034040 426 tablet_replica.cc:331] T e38dc50880914156805b07aa82e30863 P ba464e89e0f044a0a0ea3e6125cbf2a1: stopping tablet replica
I20250625 03:31:31.034843 426 raft_consensus.cc:2241] T e38dc50880914156805b07aa82e30863 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:31:31.035933 426 raft_consensus.cc:2270] T e38dc50880914156805b07aa82e30863 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.038480 426 tablet_replica.cc:331] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1: stopping tablet replica
I20250625 03:31:31.039108 426 raft_consensus.cc:2241] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 4 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:31.039667 426 raft_consensus.cc:2270] T b31026f89f1e49949acec419db9649d3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.041507 426 tablet_replica.cc:331] T 31885ef6a0c64613ae6723c07f9400b0 P ba464e89e0f044a0a0ea3e6125cbf2a1: stopping tablet replica
I20250625 03:31:31.042023 426 raft_consensus.cc:2241] T 31885ef6a0c64613ae6723c07f9400b0 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:31.042456 426 raft_consensus.cc:2270] T 31885ef6a0c64613ae6723c07f9400b0 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.044566 426 tablet_replica.cc:331] T c04f7c2d00994557b1cb83234b36fceb P ba464e89e0f044a0a0ea3e6125cbf2a1: stopping tablet replica
I20250625 03:31:31.045274 426 raft_consensus.cc:2241] T c04f7c2d00994557b1cb83234b36fceb P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 LEADER]: Raft consensus shutting down.
I20250625 03:31:31.046526 426 raft_consensus.cc:2270] T c04f7c2d00994557b1cb83234b36fceb P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.048923 426 tablet_replica.cc:331] T 96030b80e1f340afa81659faaaf68755 P ba464e89e0f044a0a0ea3e6125cbf2a1: stopping tablet replica
I20250625 03:31:31.049638 426 raft_consensus.cc:2241] T 96030b80e1f340afa81659faaaf68755 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:31.050240 426 raft_consensus.cc:2270] T 96030b80e1f340afa81659faaaf68755 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.052769 426 tablet_replica.cc:331] T fa68c3b7143345958f883bde3591b622 P ba464e89e0f044a0a0ea3e6125cbf2a1: stopping tablet replica
I20250625 03:31:31.053525 426 raft_consensus.cc:2241] T fa68c3b7143345958f883bde3591b622 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:31:31.054589 426 raft_consensus.cc:2270] T fa68c3b7143345958f883bde3591b622 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.056710 426 tablet_replica.cc:331] T 7553473daeb342ceaf782ddee8e4fc4d P ba464e89e0f044a0a0ea3e6125cbf2a1: stopping tablet replica
I20250625 03:31:31.057235 426 raft_consensus.cc:2241] T 7553473daeb342ceaf782ddee8e4fc4d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:31.057719 426 raft_consensus.cc:2270] T 7553473daeb342ceaf782ddee8e4fc4d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.059438 426 tablet_replica.cc:331] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P ba464e89e0f044a0a0ea3e6125cbf2a1: stopping tablet replica
I20250625 03:31:31.059932 426 raft_consensus.cc:2241] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:31:31.060554 426 pending_rounds.cc:70] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P ba464e89e0f044a0a0ea3e6125cbf2a1: Trying to abort 1 pending ops.
I20250625 03:31:31.060782 426 pending_rounds.cc:77] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P ba464e89e0f044a0a0ea3e6125cbf2a1: Aborting op as it isn't in flight: id { term: 2 index: 5 } timestamp: 7171368102967767040 op_type: NO_OP noop_request { }
I20250625 03:31:31.061124 426 raft_consensus.cc:2887] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 03:31:31.061374 426 raft_consensus.cc:2270] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.063913 426 tablet_replica.cc:331] T ba2ab3296190416aa07624e6d69ba09b P ba464e89e0f044a0a0ea3e6125cbf2a1: stopping tablet replica
I20250625 03:31:31.064478 426 raft_consensus.cc:2241] T ba2ab3296190416aa07624e6d69ba09b P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:31:31.065232 426 raft_consensus.cc:2270] T ba2ab3296190416aa07624e6d69ba09b P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.067083 426 tablet_replica.cc:331] T 393f73bcf106475cbee7a645b0d9660c P ba464e89e0f044a0a0ea3e6125cbf2a1: stopping tablet replica
I20250625 03:31:31.067595 426 raft_consensus.cc:2241] T 393f73bcf106475cbee7a645b0d9660c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:31.067997 426 raft_consensus.cc:2270] T 393f73bcf106475cbee7a645b0d9660c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.069836 426 tablet_replica.cc:331] T 1fff19a38e8d4880a14da6b4c8284cc2 P ba464e89e0f044a0a0ea3e6125cbf2a1: stopping tablet replica
I20250625 03:31:31.070377 426 raft_consensus.cc:2241] T 1fff19a38e8d4880a14da6b4c8284cc2 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 LEADER]: Raft consensus shutting down.
I20250625 03:31:31.071101 426 raft_consensus.cc:2270] T 1fff19a38e8d4880a14da6b4c8284cc2 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.073357 426 tablet_replica.cc:331] T 9f7fbf33df3d429ab16f0ae3a2684207 P ba464e89e0f044a0a0ea3e6125cbf2a1: stopping tablet replica
I20250625 03:31:31.074100 426 raft_consensus.cc:2241] T 9f7fbf33df3d429ab16f0ae3a2684207 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:31:31.074920 426 raft_consensus.cc:2270] T 9f7fbf33df3d429ab16f0ae3a2684207 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.076889 426 tablet_replica.cc:331] T 44f429469440455593143983452a9fe3 P ba464e89e0f044a0a0ea3e6125cbf2a1: stopping tablet replica
I20250625 03:31:31.077418 426 raft_consensus.cc:2241] T 44f429469440455593143983452a9fe3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:31.077883 426 raft_consensus.cc:2270] T 44f429469440455593143983452a9fe3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.079614 426 tablet_replica.cc:331] T 40b74a261fdd495f84ceb0690f0b30ba P ba464e89e0f044a0a0ea3e6125cbf2a1: stopping tablet replica
I20250625 03:31:31.080179 426 raft_consensus.cc:2241] T 40b74a261fdd495f84ceb0690f0b30ba P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 LEADER]: Raft consensus shutting down.
I20250625 03:31:31.080932 426 pending_rounds.cc:70] T 40b74a261fdd495f84ceb0690f0b30ba P ba464e89e0f044a0a0ea3e6125cbf2a1: Trying to abort 1 pending ops.
I20250625 03:31:31.081101 426 pending_rounds.cc:77] T 40b74a261fdd495f84ceb0690f0b30ba P ba464e89e0f044a0a0ea3e6125cbf2a1: Aborting op as it isn't in flight: id { term: 3 index: 6 } timestamp: 7171368103365074944 op_type: NO_OP noop_request { }
I20250625 03:31:31.081353 426 raft_consensus.cc:2887] T 40b74a261fdd495f84ceb0690f0b30ba P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 03:31:31.081598 426 raft_consensus.cc:2270] T 40b74a261fdd495f84ceb0690f0b30ba P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.083719 426 tablet_replica.cc:331] T 615cebbffcfc44e19b8f7a1e842073a3 P ba464e89e0f044a0a0ea3e6125cbf2a1: stopping tablet replica
I20250625 03:31:31.084282 426 raft_consensus.cc:2241] T 615cebbffcfc44e19b8f7a1e842073a3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:31:31.084998 426 raft_consensus.cc:2270] T 615cebbffcfc44e19b8f7a1e842073a3 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.087107 426 tablet_replica.cc:331] T c977876716a0400a9482dd8e0ad33b86 P ba464e89e0f044a0a0ea3e6125cbf2a1: stopping tablet replica
I20250625 03:31:31.087669 426 raft_consensus.cc:2241] T c977876716a0400a9482dd8e0ad33b86 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 LEADER]: Raft consensus shutting down.
I20250625 03:31:31.088574 426 raft_consensus.cc:2270] T c977876716a0400a9482dd8e0ad33b86 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.090739 426 tablet_replica.cc:331] T 9b7de80fbd7d4625aac41dea0457fd3e P ba464e89e0f044a0a0ea3e6125cbf2a1: stopping tablet replica
I20250625 03:31:31.091259 426 raft_consensus.cc:2241] T 9b7de80fbd7d4625aac41dea0457fd3e P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:31:31.091977 426 raft_consensus.cc:2270] T 9b7de80fbd7d4625aac41dea0457fd3e P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.093840 426 tablet_replica.cc:331] T f8c715109ff0405997e1ca9952678c0d P ba464e89e0f044a0a0ea3e6125cbf2a1: stopping tablet replica
I20250625 03:31:31.094374 426 raft_consensus.cc:2241] T f8c715109ff0405997e1ca9952678c0d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 LEADER]: Raft consensus shutting down.
I20250625 03:31:31.095049 426 raft_consensus.cc:2270] T f8c715109ff0405997e1ca9952678c0d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.096809 426 tablet_replica.cc:331] T e4034c33d83e4a96a187eaed46416e3c P ba464e89e0f044a0a0ea3e6125cbf2a1: stopping tablet replica
I20250625 03:31:31.097316 426 raft_consensus.cc:2241] T e4034c33d83e4a96a187eaed46416e3c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:31:31.097998 426 raft_consensus.cc:2270] T e4034c33d83e4a96a187eaed46416e3c P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.100435 426 tablet_replica.cc:331] T fb6e83db706647e28e491a02f1641980 P ba464e89e0f044a0a0ea3e6125cbf2a1: stopping tablet replica
I20250625 03:31:31.101207 426 raft_consensus.cc:2241] T fb6e83db706647e28e491a02f1641980 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:31.101790 426 raft_consensus.cc:2270] T fb6e83db706647e28e491a02f1641980 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.104159 426 tablet_replica.cc:331] T 542f85d76df8432593ee963669155a9d P ba464e89e0f044a0a0ea3e6125cbf2a1: stopping tablet replica
I20250625 03:31:31.104781 426 raft_consensus.cc:2241] T 542f85d76df8432593ee963669155a9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:31.105480 426 raft_consensus.cc:2270] T 542f85d76df8432593ee963669155a9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.107568 426 tablet_replica.cc:331] T a1d83fca2b484feeaff6f350fe749b24 P ba464e89e0f044a0a0ea3e6125cbf2a1: stopping tablet replica
I20250625 03:31:31.108372 426 raft_consensus.cc:2241] T a1d83fca2b484feeaff6f350fe749b24 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 LEADER]: Raft consensus shutting down.
I20250625 03:31:31.109151 426 pending_rounds.cc:70] T a1d83fca2b484feeaff6f350fe749b24 P ba464e89e0f044a0a0ea3e6125cbf2a1: Trying to abort 1 pending ops.
I20250625 03:31:31.109329 426 pending_rounds.cc:77] T a1d83fca2b484feeaff6f350fe749b24 P ba464e89e0f044a0a0ea3e6125cbf2a1: Aborting op as it isn't in flight: id { term: 3 index: 6 } timestamp: 7171368103104266240 op_type: NO_OP noop_request { }
I20250625 03:31:31.109575 426 raft_consensus.cc:2887] T a1d83fca2b484feeaff6f350fe749b24 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 03:31:31.109819 426 raft_consensus.cc:2270] T a1d83fca2b484feeaff6f350fe749b24 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.112094 426 tablet_replica.cc:331] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1: stopping tablet replica
I20250625 03:31:31.112625 426 raft_consensus.cc:2241] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 5 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:31.113044 426 raft_consensus.cc:2270] T dea2dcc26f144802a16f0884fdd99063 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 5 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.114773 426 tablet_replica.cc:331] T af4573692c104d67994dbb1bc518b568 P ba464e89e0f044a0a0ea3e6125cbf2a1: stopping tablet replica
I20250625 03:31:31.115262 426 raft_consensus.cc:2241] T af4573692c104d67994dbb1bc518b568 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:31:31.116071 426 raft_consensus.cc:2270] T af4573692c104d67994dbb1bc518b568 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.118145 426 tablet_replica.cc:331] T afe48b30a4e64a4d8faf2a5b42d5c706 P ba464e89e0f044a0a0ea3e6125cbf2a1: stopping tablet replica
I20250625 03:31:31.118721 426 raft_consensus.cc:2241] T afe48b30a4e64a4d8faf2a5b42d5c706 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:31.119284 426 raft_consensus.cc:2270] T afe48b30a4e64a4d8faf2a5b42d5c706 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.121591 426 tablet_replica.cc:331] T fd279ddcf72a40e1bf2ec42a4f35e639 P ba464e89e0f044a0a0ea3e6125cbf2a1: stopping tablet replica
I20250625 03:31:31.122131 426 raft_consensus.cc:2241] T fd279ddcf72a40e1bf2ec42a4f35e639 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:31:31.122852 426 raft_consensus.cc:2270] T fd279ddcf72a40e1bf2ec42a4f35e639 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.124536 426 tablet_replica.cc:331] T 6cc384f27ff041c0be70bb661ae610dd P ba464e89e0f044a0a0ea3e6125cbf2a1: stopping tablet replica
I20250625 03:31:31.124997 426 raft_consensus.cc:2241] T 6cc384f27ff041c0be70bb661ae610dd P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:31:31.125689 426 pending_rounds.cc:70] T 6cc384f27ff041c0be70bb661ae610dd P ba464e89e0f044a0a0ea3e6125cbf2a1: Trying to abort 1 pending ops.
I20250625 03:31:31.125854 426 pending_rounds.cc:77] T 6cc384f27ff041c0be70bb661ae610dd P ba464e89e0f044a0a0ea3e6125cbf2a1: Aborting op as it isn't in flight: id { term: 2 index: 5 } timestamp: 7171368103209603072 op_type: NO_OP noop_request { }
I20250625 03:31:31.126132 426 raft_consensus.cc:2887] T 6cc384f27ff041c0be70bb661ae610dd P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 03:31:31.126372 426 raft_consensus.cc:2270] T 6cc384f27ff041c0be70bb661ae610dd P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.128430 426 tablet_replica.cc:331] T c4354f7ffc0e4eabbc92a141d46b7984 P ba464e89e0f044a0a0ea3e6125cbf2a1: stopping tablet replica
I20250625 03:31:31.128924 426 raft_consensus.cc:2241] T c4354f7ffc0e4eabbc92a141d46b7984 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 5 LEADER]: Raft consensus shutting down.
I20250625 03:31:31.129649 426 raft_consensus.cc:2270] T c4354f7ffc0e4eabbc92a141d46b7984 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 5 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.131474 426 tablet_replica.cc:331] T 465c15a46933411a985f29059fdb1c9f P ba464e89e0f044a0a0ea3e6125cbf2a1: stopping tablet replica
I20250625 03:31:31.131929 426 raft_consensus.cc:2241] T 465c15a46933411a985f29059fdb1c9f P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:31:31.132699 426 raft_consensus.cc:2270] T 465c15a46933411a985f29059fdb1c9f P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.134358 426 tablet_replica.cc:331] T 9943bb8023444f49a11df01d93738f1e P ba464e89e0f044a0a0ea3e6125cbf2a1: stopping tablet replica
I20250625 03:31:31.134824 426 raft_consensus.cc:2241] T 9943bb8023444f49a11df01d93738f1e P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:31.135197 426 raft_consensus.cc:2270] T 9943bb8023444f49a11df01d93738f1e P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.136889 426 tablet_replica.cc:331] T b15eb94b9d3d4f6987b5fa5e20193655 P ba464e89e0f044a0a0ea3e6125cbf2a1: stopping tablet replica
I20250625 03:31:31.137372 426 raft_consensus.cc:2241] T b15eb94b9d3d4f6987b5fa5e20193655 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:31.137794 426 raft_consensus.cc:2270] T b15eb94b9d3d4f6987b5fa5e20193655 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.139685 426 tablet_replica.cc:331] T 9643cfd400804eb8b9037c5e9efddfba P ba464e89e0f044a0a0ea3e6125cbf2a1: stopping tablet replica
I20250625 03:31:31.140210 426 raft_consensus.cc:2241] T 9643cfd400804eb8b9037c5e9efddfba P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:31.140596 426 raft_consensus.cc:2270] T 9643cfd400804eb8b9037c5e9efddfba P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.142298 426 tablet_replica.cc:331] T 64add559c121402aa1f7753538a50857 P ba464e89e0f044a0a0ea3e6125cbf2a1: stopping tablet replica
I20250625 03:31:31.142781 426 raft_consensus.cc:2241] T 64add559c121402aa1f7753538a50857 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:31:31.143517 426 raft_consensus.cc:2270] T 64add559c121402aa1f7753538a50857 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.145305 426 tablet_replica.cc:331] T d9038fc1ce0d4b528c02c68012e1277d P ba464e89e0f044a0a0ea3e6125cbf2a1: stopping tablet replica
I20250625 03:31:31.145761 426 raft_consensus.cc:2241] T d9038fc1ce0d4b528c02c68012e1277d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:31:31.146631 426 raft_consensus.cc:2270] T d9038fc1ce0d4b528c02c68012e1277d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.148454 426 tablet_replica.cc:331] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1: stopping tablet replica
I20250625 03:31:31.148931 426 raft_consensus.cc:2241] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 LEADER]: Raft consensus shutting down.
I20250625 03:31:31.149507 426 pending_rounds.cc:70] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1: Trying to abort 1 pending ops.
I20250625 03:31:31.149675 426 pending_rounds.cc:77] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1: Aborting op as it isn't in flight: id { term: 3 index: 6 } timestamp: 7171368103241273344 op_type: NO_OP noop_request { }
I20250625 03:31:31.149936 426 raft_consensus.cc:2887] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 03:31:31.150193 426 raft_consensus.cc:2270] T 85e02bb33a944989ada7f600c1e802da P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.153002 426 tablet_replica.cc:331] T 441042afd59544a4a04bf85fa69d7d55 P ba464e89e0f044a0a0ea3e6125cbf2a1: stopping tablet replica
I20250625 03:31:31.153492 426 raft_consensus.cc:2241] T 441042afd59544a4a04bf85fa69d7d55 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:31:31.154174 426 raft_consensus.cc:2270] T 441042afd59544a4a04bf85fa69d7d55 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.155989 426 tablet_replica.cc:331] T 0e7eb287e9514c838aeed599d2703682 P ba464e89e0f044a0a0ea3e6125cbf2a1: stopping tablet replica
I20250625 03:31:31.156492 426 raft_consensus.cc:2241] T 0e7eb287e9514c838aeed599d2703682 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:31:31.157212 426 raft_consensus.cc:2270] T 0e7eb287e9514c838aeed599d2703682 P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.158941 426 tablet_replica.cc:331] T 93ecdce2da094dc9a80ac04828771fbd P ba464e89e0f044a0a0ea3e6125cbf2a1: stopping tablet replica
I20250625 03:31:31.159431 426 raft_consensus.cc:2241] T 93ecdce2da094dc9a80ac04828771fbd P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:31:31.160180 426 raft_consensus.cc:2270] T 93ecdce2da094dc9a80ac04828771fbd P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.161896 426 tablet_replica.cc:331] T 731095860aad436e9658ab3ff5010f9d P ba464e89e0f044a0a0ea3e6125cbf2a1: stopping tablet replica
I20250625 03:31:31.162334 426 raft_consensus.cc:2241] T 731095860aad436e9658ab3ff5010f9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:31:31.163066 426 raft_consensus.cc:2270] T 731095860aad436e9658ab3ff5010f9d P ba464e89e0f044a0a0ea3e6125cbf2a1 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250625 03:31:31.173102 2308 consensus_peers.cc:487] T 31885ef6a0c64613ae6723c07f9400b0 P df8b9755d156478aafca552f9e9c539e -> Peer ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): Couldn't send request to peer ba464e89e0f044a0a0ea3e6125cbf2a1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250625 03:31:31.207101 2306 consensus_peers.cc:487] T 31885ef6a0c64613ae6723c07f9400b0 P df8b9755d156478aafca552f9e9c539e -> Peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Couldn't send request to peer 3f2aa40978064c9e9983cf3745eed206. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.130:34293: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20250625 03:31:31.240340 2308 consensus_peers.cc:487] T afe48b30a4e64a4d8faf2a5b42d5c706 P df8b9755d156478aafca552f9e9c539e -> Peer ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): Couldn't send request to peer ba464e89e0f044a0a0ea3e6125cbf2a1. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.131:39359: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250625 03:31:31.269017 2308 consensus_peers.cc:487] T 58c56cde04014b85b662a9b4cbaa726f P df8b9755d156478aafca552f9e9c539e -> Peer ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): Couldn't send request to peer ba464e89e0f044a0a0ea3e6125cbf2a1. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.131:39359: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250625 03:31:31.318260 2308 consensus_peers.cc:487] T fb6e83db706647e28e491a02f1641980 P df8b9755d156478aafca552f9e9c539e -> Peer ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): Couldn't send request to peer ba464e89e0f044a0a0ea3e6125cbf2a1. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.131:39359: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250625 03:31:31.321024 2308 consensus_peers.cc:487] T b15eb94b9d3d4f6987b5fa5e20193655 P df8b9755d156478aafca552f9e9c539e -> Peer ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): Couldn't send request to peer ba464e89e0f044a0a0ea3e6125cbf2a1. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.131:39359: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250625 03:31:31.340564 2308 consensus_peers.cc:487] T 9643cfd400804eb8b9037c5e9efddfba P df8b9755d156478aafca552f9e9c539e -> Peer ba464e89e0f044a0a0ea3e6125cbf2a1 (127.0.106.131:39359): Couldn't send request to peer ba464e89e0f044a0a0ea3e6125cbf2a1. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.131:39359: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250625 03:31:31.415295 2306 consensus_peers.cc:487] T f957bf9749c54be48094092cb80e9055 P df8b9755d156478aafca552f9e9c539e -> Peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Couldn't send request to peer 3f2aa40978064c9e9983cf3745eed206. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.130:34293: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20250625 03:31:31.424768 2306 consensus_peers.cc:487] T b3f18b9311894580bc336199d357df41 P df8b9755d156478aafca552f9e9c539e -> Peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Couldn't send request to peer 3f2aa40978064c9e9983cf3745eed206. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.130:34293: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20250625 03:31:31.445479 2306 consensus_peers.cc:487] T 58c56cde04014b85b662a9b4cbaa726f P df8b9755d156478aafca552f9e9c539e -> Peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Couldn't send request to peer 3f2aa40978064c9e9983cf3745eed206. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.130:34293: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20250625 03:31:31.451215 2306 consensus_peers.cc:487] T 390aa72f98414be291f01e4e4fec77f1 P df8b9755d156478aafca552f9e9c539e -> Peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Couldn't send request to peer 3f2aa40978064c9e9983cf3745eed206. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.130:34293: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20250625 03:31:31.467644 2306 consensus_peers.cc:487] T 6e7283d035e1429f946d8ebb98978656 P df8b9755d156478aafca552f9e9c539e -> Peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Couldn't send request to peer 3f2aa40978064c9e9983cf3745eed206. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.130:34293: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20250625 03:31:31.529325 426 tablet_server.cc:195] TabletServer@127.0.106.131:0 shutdown complete.
W20250625 03:31:31.572033 2307 consensus_peers.cc:487] T 0c2b6052daaa4c57aaa55361e8d6e01c P df8b9755d156478aafca552f9e9c539e -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20250625 03:31:31.574755 2307 consensus_peers.cc:487] T 390aa72f98414be291f01e4e4fec77f1 P df8b9755d156478aafca552f9e9c539e -> Peer 7e9c4f2e01164f33b2e9034ed148398e (127.0.106.129:39903): Couldn't send request to peer 7e9c4f2e01164f33b2e9034ed148398e. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20250625 03:31:31.612052 2306 consensus_peers.cc:487] T 0c2b6052daaa4c57aaa55361e8d6e01c P df8b9755d156478aafca552f9e9c539e -> Peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Couldn't send request to peer 3f2aa40978064c9e9983cf3745eed206. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.130:34293: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20250625 03:31:31.612614 2306 consensus_peers.cc:487] T 9643cfd400804eb8b9037c5e9efddfba P df8b9755d156478aafca552f9e9c539e -> Peer 3f2aa40978064c9e9983cf3745eed206 (127.0.106.130:34293): Couldn't send request to peer 3f2aa40978064c9e9983cf3745eed206. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.130:34293: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20250625 03:31:31.623827 426 tablet_server.cc:178] TabletServer@127.0.106.132:0 shutting down...
I20250625 03:31:31.661842 426 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250625 03:31:31.662876 426 tablet_replica.cc:331] T e88f79ed06514e01a9bc48261a5acfbb P df8b9755d156478aafca552f9e9c539e: stopping tablet replica
I20250625 03:31:31.663976 426 raft_consensus.cc:2241] T e88f79ed06514e01a9bc48261a5acfbb P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:31.664757 426 raft_consensus.cc:2270] T e88f79ed06514e01a9bc48261a5acfbb P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Raft consensus is shut down!
W20250625 03:31:31.665598 2307 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.106.129:39903: connect: Connection refused (error 111) [suppressed 539 similar messages]
I20250625 03:31:31.668094 426 tablet_replica.cc:331] T 465c15a46933411a985f29059fdb1c9f P df8b9755d156478aafca552f9e9c539e: stopping tablet replica
I20250625 03:31:31.669209 426 raft_consensus.cc:2241] T 465c15a46933411a985f29059fdb1c9f P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:31.670012 426 raft_consensus.cc:2270] T 465c15a46933411a985f29059fdb1c9f P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.672768 426 tablet_replica.cc:331] T c04f7c2d00994557b1cb83234b36fceb P df8b9755d156478aafca552f9e9c539e: stopping tablet replica
I20250625 03:31:31.673341 426 raft_consensus.cc:2241] T c04f7c2d00994557b1cb83234b36fceb P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:31.673719 426 raft_consensus.cc:2270] T c04f7c2d00994557b1cb83234b36fceb P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.675663 426 tablet_replica.cc:331] T a5a18934cc3f490288432ee1cb30b278 P df8b9755d156478aafca552f9e9c539e: stopping tablet replica
I20250625 03:31:31.676292 426 raft_consensus.cc:2241] T a5a18934cc3f490288432ee1cb30b278 P df8b9755d156478aafca552f9e9c539e [term 4 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:31.676831 426 raft_consensus.cc:2270] T a5a18934cc3f490288432ee1cb30b278 P df8b9755d156478aafca552f9e9c539e [term 4 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.678874 426 tablet_replica.cc:331] T 3037be35f2054cbbabd8a47062f84244 P df8b9755d156478aafca552f9e9c539e: stopping tablet replica
I20250625 03:31:31.679385 426 raft_consensus.cc:2241] T 3037be35f2054cbbabd8a47062f84244 P df8b9755d156478aafca552f9e9c539e [term 3 LEADER]: Raft consensus shutting down.
I20250625 03:31:31.680120 426 raft_consensus.cc:2270] T 3037be35f2054cbbabd8a47062f84244 P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.682046 426 tablet_replica.cc:331] T b31026f89f1e49949acec419db9649d3 P df8b9755d156478aafca552f9e9c539e: stopping tablet replica
I20250625 03:31:31.682602 426 raft_consensus.cc:2241] T b31026f89f1e49949acec419db9649d3 P df8b9755d156478aafca552f9e9c539e [term 4 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:31.683081 426 raft_consensus.cc:2270] T b31026f89f1e49949acec419db9649d3 P df8b9755d156478aafca552f9e9c539e [term 4 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.684968 426 tablet_replica.cc:331] T df29d87d804d44438345052a5902052f P df8b9755d156478aafca552f9e9c539e: stopping tablet replica
I20250625 03:31:31.685499 426 raft_consensus.cc:2241] T df29d87d804d44438345052a5902052f P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:31.686021 426 raft_consensus.cc:2270] T df29d87d804d44438345052a5902052f P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.687785 426 tablet_replica.cc:331] T 6e7283d035e1429f946d8ebb98978656 P df8b9755d156478aafca552f9e9c539e: stopping tablet replica
I20250625 03:31:31.688360 426 raft_consensus.cc:2241] T 6e7283d035e1429f946d8ebb98978656 P df8b9755d156478aafca552f9e9c539e [term 4 LEADER]: Raft consensus shutting down.
I20250625 03:31:31.689165 426 raft_consensus.cc:2270] T 6e7283d035e1429f946d8ebb98978656 P df8b9755d156478aafca552f9e9c539e [term 4 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.690958 426 tablet_replica.cc:331] T cc3b100d6d574a68b79e6a8f23d77201 P df8b9755d156478aafca552f9e9c539e: stopping tablet replica
I20250625 03:31:31.691486 426 raft_consensus.cc:2241] T cc3b100d6d574a68b79e6a8f23d77201 P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:31.691856 426 raft_consensus.cc:2270] T cc3b100d6d574a68b79e6a8f23d77201 P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.698078 426 tablet_replica.cc:331] T e38dc50880914156805b07aa82e30863 P df8b9755d156478aafca552f9e9c539e: stopping tablet replica
I20250625 03:31:31.699023 426 raft_consensus.cc:2241] T e38dc50880914156805b07aa82e30863 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:31.699682 426 raft_consensus.cc:2270] T e38dc50880914156805b07aa82e30863 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.702620 426 tablet_replica.cc:331] T 40b74a261fdd495f84ceb0690f0b30ba P df8b9755d156478aafca552f9e9c539e: stopping tablet replica
I20250625 03:31:31.703472 426 raft_consensus.cc:2241] T 40b74a261fdd495f84ceb0690f0b30ba P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:31.704172 426 raft_consensus.cc:2270] T 40b74a261fdd495f84ceb0690f0b30ba P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.706753 426 tablet_replica.cc:331] T 93ecdce2da094dc9a80ac04828771fbd P df8b9755d156478aafca552f9e9c539e: stopping tablet replica
I20250625 03:31:31.707525 426 raft_consensus.cc:2241] T 93ecdce2da094dc9a80ac04828771fbd P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:31.708215 426 raft_consensus.cc:2270] T 93ecdce2da094dc9a80ac04828771fbd P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.710798 426 tablet_replica.cc:331] T 70328d972b5943009ef0c7d92cbae349 P df8b9755d156478aafca552f9e9c539e: stopping tablet replica
I20250625 03:31:31.711582 426 raft_consensus.cc:2241] T 70328d972b5943009ef0c7d92cbae349 P df8b9755d156478aafca552f9e9c539e [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:31:31.712548 426 raft_consensus.cc:2270] T 70328d972b5943009ef0c7d92cbae349 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.715498 426 tablet_replica.cc:331] T 6d7a37b3448d468baa1b9422a6167c9a P df8b9755d156478aafca552f9e9c539e: stopping tablet replica
I20250625 03:31:31.716391 426 raft_consensus.cc:2241] T 6d7a37b3448d468baa1b9422a6167c9a P df8b9755d156478aafca552f9e9c539e [term 3 LEADER]: Raft consensus shutting down.
I20250625 03:31:31.717465 426 raft_consensus.cc:2270] T 6d7a37b3448d468baa1b9422a6167c9a P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.720459 426 tablet_replica.cc:331] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P df8b9755d156478aafca552f9e9c539e: stopping tablet replica
I20250625 03:31:31.721283 426 raft_consensus.cc:2241] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:31.721987 426 raft_consensus.cc:2270] T 3c2c045dee4b4b4faa93fa9d0ccdaa1c P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.724898 426 tablet_replica.cc:331] T 615cebbffcfc44e19b8f7a1e842073a3 P df8b9755d156478aafca552f9e9c539e: stopping tablet replica
I20250625 03:31:31.725704 426 raft_consensus.cc:2241] T 615cebbffcfc44e19b8f7a1e842073a3 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:31.726274 426 raft_consensus.cc:2270] T 615cebbffcfc44e19b8f7a1e842073a3 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.728930 426 tablet_replica.cc:331] T 390aa72f98414be291f01e4e4fec77f1 P df8b9755d156478aafca552f9e9c539e: stopping tablet replica
I20250625 03:31:31.729746 426 raft_consensus.cc:2241] T 390aa72f98414be291f01e4e4fec77f1 P df8b9755d156478aafca552f9e9c539e [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:31:31.730722 426 raft_consensus.cc:2270] T 390aa72f98414be291f01e4e4fec77f1 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.733248 426 tablet_replica.cc:331] T 6cc384f27ff041c0be70bb661ae610dd P df8b9755d156478aafca552f9e9c539e: stopping tablet replica
I20250625 03:31:31.733996 426 raft_consensus.cc:2241] T 6cc384f27ff041c0be70bb661ae610dd P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:31.734671 426 raft_consensus.cc:2270] T 6cc384f27ff041c0be70bb661ae610dd P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.737599 426 tablet_replica.cc:331] T 85e02bb33a944989ada7f600c1e802da P df8b9755d156478aafca552f9e9c539e: stopping tablet replica
I20250625 03:31:31.738438 426 raft_consensus.cc:2241] T 85e02bb33a944989ada7f600c1e802da P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:31.739194 426 raft_consensus.cc:2270] T 85e02bb33a944989ada7f600c1e802da P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.742033 426 tablet_replica.cc:331] T 64add559c121402aa1f7753538a50857 P df8b9755d156478aafca552f9e9c539e: stopping tablet replica
I20250625 03:31:31.742830 426 raft_consensus.cc:2241] T 64add559c121402aa1f7753538a50857 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:31.743535 426 raft_consensus.cc:2270] T 64add559c121402aa1f7753538a50857 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.746148 426 tablet_replica.cc:331] T fd279ddcf72a40e1bf2ec42a4f35e639 P df8b9755d156478aafca552f9e9c539e: stopping tablet replica
I20250625 03:31:31.746954 426 raft_consensus.cc:2241] T fd279ddcf72a40e1bf2ec42a4f35e639 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:31.747664 426 raft_consensus.cc:2270] T fd279ddcf72a40e1bf2ec42a4f35e639 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.750389 426 tablet_replica.cc:331] T fb6e83db706647e28e491a02f1641980 P df8b9755d156478aafca552f9e9c539e: stopping tablet replica
I20250625 03:31:31.751173 426 raft_consensus.cc:2241] T fb6e83db706647e28e491a02f1641980 P df8b9755d156478aafca552f9e9c539e [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:31:31.752238 426 raft_consensus.cc:2270] T fb6e83db706647e28e491a02f1641980 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.754889 426 tablet_replica.cc:331] T 9b7de80fbd7d4625aac41dea0457fd3e P df8b9755d156478aafca552f9e9c539e: stopping tablet replica
I20250625 03:31:31.755672 426 raft_consensus.cc:2241] T 9b7de80fbd7d4625aac41dea0457fd3e P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:31.756397 426 raft_consensus.cc:2270] T 9b7de80fbd7d4625aac41dea0457fd3e P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.758879 426 tablet_replica.cc:331] T b3f18b9311894580bc336199d357df41 P df8b9755d156478aafca552f9e9c539e: stopping tablet replica
I20250625 03:31:31.759634 426 raft_consensus.cc:2241] T b3f18b9311894580bc336199d357df41 P df8b9755d156478aafca552f9e9c539e [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:31:31.760609 426 raft_consensus.cc:2270] T b3f18b9311894580bc336199d357df41 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.763078 426 tablet_replica.cc:331] T f957bf9749c54be48094092cb80e9055 P df8b9755d156478aafca552f9e9c539e: stopping tablet replica
I20250625 03:31:31.763849 426 raft_consensus.cc:2241] T f957bf9749c54be48094092cb80e9055 P df8b9755d156478aafca552f9e9c539e [term 3 LEADER]: Raft consensus shutting down.
I20250625 03:31:31.765015 426 raft_consensus.cc:2270] T f957bf9749c54be48094092cb80e9055 P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.767585 426 tablet_replica.cc:331] T d9038fc1ce0d4b528c02c68012e1277d P df8b9755d156478aafca552f9e9c539e: stopping tablet replica
I20250625 03:31:31.768385 426 raft_consensus.cc:2241] T d9038fc1ce0d4b528c02c68012e1277d P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:31.769032 426 raft_consensus.cc:2270] T d9038fc1ce0d4b528c02c68012e1277d P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.771579 426 tablet_replica.cc:331] T d50c52b197294003b238a37da2fb55d8 P df8b9755d156478aafca552f9e9c539e: stopping tablet replica
I20250625 03:31:31.772372 426 raft_consensus.cc:2241] T d50c52b197294003b238a37da2fb55d8 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:31.773114 426 raft_consensus.cc:2270] T d50c52b197294003b238a37da2fb55d8 P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.775650 426 tablet_replica.cc:331] T 31885ef6a0c64613ae6723c07f9400b0 P df8b9755d156478aafca552f9e9c539e: stopping tablet replica
I20250625 03:31:31.776451 426 raft_consensus.cc:2241] T 31885ef6a0c64613ae6723c07f9400b0 P df8b9755d156478aafca552f9e9c539e [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:31:31.777477 426 raft_consensus.cc:2270] T 31885ef6a0c64613ae6723c07f9400b0 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.780150 426 tablet_replica.cc:331] T b15eb94b9d3d4f6987b5fa5e20193655 P df8b9755d156478aafca552f9e9c539e: stopping tablet replica
I20250625 03:31:31.780890 426 raft_consensus.cc:2241] T b15eb94b9d3d4f6987b5fa5e20193655 P df8b9755d156478aafca552f9e9c539e [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:31:31.781860 426 raft_consensus.cc:2270] T b15eb94b9d3d4f6987b5fa5e20193655 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.784452 426 tablet_replica.cc:331] T 542f85d76df8432593ee963669155a9d P df8b9755d156478aafca552f9e9c539e: stopping tablet replica
I20250625 03:31:31.785238 426 raft_consensus.cc:2241] T 542f85d76df8432593ee963669155a9d P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:31.785915 426 raft_consensus.cc:2270] T 542f85d76df8432593ee963669155a9d P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.788529 426 tablet_replica.cc:331] T 58c56cde04014b85b662a9b4cbaa726f P df8b9755d156478aafca552f9e9c539e: stopping tablet replica
I20250625 03:31:31.789314 426 raft_consensus.cc:2241] T 58c56cde04014b85b662a9b4cbaa726f P df8b9755d156478aafca552f9e9c539e [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:31:31.790316 426 raft_consensus.cc:2270] T 58c56cde04014b85b662a9b4cbaa726f P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.793031 426 tablet_replica.cc:331] T 44f429469440455593143983452a9fe3 P df8b9755d156478aafca552f9e9c539e: stopping tablet replica
I20250625 03:31:31.793771 426 raft_consensus.cc:2241] T 44f429469440455593143983452a9fe3 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:31.794375 426 raft_consensus.cc:2270] T 44f429469440455593143983452a9fe3 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.796993 426 tablet_replica.cc:331] T 731095860aad436e9658ab3ff5010f9d P df8b9755d156478aafca552f9e9c539e: stopping tablet replica
I20250625 03:31:31.797755 426 raft_consensus.cc:2241] T 731095860aad436e9658ab3ff5010f9d P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:31.798458 426 raft_consensus.cc:2270] T 731095860aad436e9658ab3ff5010f9d P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.801240 426 tablet_replica.cc:331] T a1d83fca2b484feeaff6f350fe749b24 P df8b9755d156478aafca552f9e9c539e: stopping tablet replica
I20250625 03:31:31.802088 426 raft_consensus.cc:2241] T a1d83fca2b484feeaff6f350fe749b24 P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:31.802857 426 raft_consensus.cc:2270] T a1d83fca2b484feeaff6f350fe749b24 P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.805446 426 tablet_replica.cc:331] T 0c2b6052daaa4c57aaa55361e8d6e01c P df8b9755d156478aafca552f9e9c539e: stopping tablet replica
I20250625 03:31:31.806193 426 raft_consensus.cc:2241] T 0c2b6052daaa4c57aaa55361e8d6e01c P df8b9755d156478aafca552f9e9c539e [term 3 LEADER]: Raft consensus shutting down.
I20250625 03:31:31.807142 426 raft_consensus.cc:2270] T 0c2b6052daaa4c57aaa55361e8d6e01c P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.809755 426 tablet_replica.cc:331] T e58b1ae66ee14c6f8d6f2db8dda2b842 P df8b9755d156478aafca552f9e9c539e: stopping tablet replica
I20250625 03:31:31.810510 426 raft_consensus.cc:2241] T e58b1ae66ee14c6f8d6f2db8dda2b842 P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:31.811069 426 raft_consensus.cc:2270] T e58b1ae66ee14c6f8d6f2db8dda2b842 P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.813731 426 tablet_replica.cc:331] T 188e56b819ae44f9b72baefcbc749400 P df8b9755d156478aafca552f9e9c539e: stopping tablet replica
I20250625 03:31:31.814481 426 raft_consensus.cc:2241] T 188e56b819ae44f9b72baefcbc749400 P df8b9755d156478aafca552f9e9c539e [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:31:31.815488 426 raft_consensus.cc:2270] T 188e56b819ae44f9b72baefcbc749400 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.817963 426 tablet_replica.cc:331] T fa68c3b7143345958f883bde3591b622 P df8b9755d156478aafca552f9e9c539e: stopping tablet replica
I20250625 03:31:31.818696 426 raft_consensus.cc:2241] T fa68c3b7143345958f883bde3591b622 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:31.819193 426 raft_consensus.cc:2270] T fa68c3b7143345958f883bde3591b622 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.821800 426 tablet_replica.cc:331] T af4573692c104d67994dbb1bc518b568 P df8b9755d156478aafca552f9e9c539e: stopping tablet replica
I20250625 03:31:31.822556 426 raft_consensus.cc:2241] T af4573692c104d67994dbb1bc518b568 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:31.823203 426 raft_consensus.cc:2270] T af4573692c104d67994dbb1bc518b568 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.825727 426 tablet_replica.cc:331] T afe48b30a4e64a4d8faf2a5b42d5c706 P df8b9755d156478aafca552f9e9c539e: stopping tablet replica
I20250625 03:31:31.826457 426 raft_consensus.cc:2241] T afe48b30a4e64a4d8faf2a5b42d5c706 P df8b9755d156478aafca552f9e9c539e [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:31:31.827523 426 raft_consensus.cc:2270] T afe48b30a4e64a4d8faf2a5b42d5c706 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.831525 426 tablet_replica.cc:331] T 9643cfd400804eb8b9037c5e9efddfba P df8b9755d156478aafca552f9e9c539e: stopping tablet replica
I20250625 03:31:31.832041 426 raft_consensus.cc:2241] T 9643cfd400804eb8b9037c5e9efddfba P df8b9755d156478aafca552f9e9c539e [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:31:31.832752 426 raft_consensus.cc:2270] T 9643cfd400804eb8b9037c5e9efddfba P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.834656 426 tablet_replica.cc:331] T ba2ab3296190416aa07624e6d69ba09b P df8b9755d156478aafca552f9e9c539e: stopping tablet replica
I20250625 03:31:31.835109 426 raft_consensus.cc:2241] T ba2ab3296190416aa07624e6d69ba09b P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:31.835597 426 raft_consensus.cc:2270] T ba2ab3296190416aa07624e6d69ba09b P df8b9755d156478aafca552f9e9c539e [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.837421 426 tablet_replica.cc:331] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P df8b9755d156478aafca552f9e9c539e: stopping tablet replica
I20250625 03:31:31.837885 426 raft_consensus.cc:2241] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:31.838286 426 raft_consensus.cc:2270] T a9ae17eec3fe4ce0841d3fb17c91a8b8 P df8b9755d156478aafca552f9e9c539e [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.840216 426 tablet_replica.cc:331] T f9458dec7953448d8550396d67fad249 P df8b9755d156478aafca552f9e9c539e: stopping tablet replica
I20250625 03:31:31.840723 426 raft_consensus.cc:2241] T f9458dec7953448d8550396d67fad249 P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:31.841113 426 raft_consensus.cc:2270] T f9458dec7953448d8550396d67fad249 P df8b9755d156478aafca552f9e9c539e [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:31.898517 426 tablet_server.cc:195] TabletServer@127.0.106.132:0 shutdown complete.
I20250625 03:31:31.968233 426 master.cc:561] Master@127.0.106.190:39719 shutting down...
I20250625 03:31:32.003355 426 raft_consensus.cc:2241] T 00000000000000000000000000000000 P 681a0ea90ed74b9d816182c76d9421d9 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:31:32.003922 426 raft_consensus.cc:2270] T 00000000000000000000000000000000 P 681a0ea90ed74b9d816182c76d9421d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:32.004297 426 tablet_replica.cc:331] T 00000000000000000000000000000000 P 681a0ea90ed74b9d816182c76d9421d9: stopping tablet replica
I20250625 03:31:32.104954 426 master.cc:583] Master@127.0.106.190:39719 shutdown complete.
[ OK ] LeaderRebalancerTest.AddTserver (64951 ms)
[ RUN ] LeaderRebalancerTest.RestartTserver
I20250625 03:31:32.198338 426 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.106.190:40959
I20250625 03:31:32.199445 426 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250625 03:31:32.205451 3513 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250625 03:31:32.205976 3514 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250625 03:31:32.207126 3516 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250625 03:31:32.208220 426 server_base.cc:1048] running on GCE node
I20250625 03:31:32.209672 426 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250625 03:31:32.209859 426 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250625 03:31:32.210007 426 hybrid_clock.cc:648] HybridClock initialized: now 1750822292209992 us; error 0 us; skew 500 ppm
I20250625 03:31:32.210542 426 server_base.cc:848] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250625 03:31:32.217408 426 webserver.cc:469] Webserver started at http://127.0.106.190:39881/ using document root <none> and password file <none>
I20250625 03:31:32.217912 426 fs_manager.cc:362] Metadata directory not provided
I20250625 03:31:32.218092 426 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250625 03:31:32.218377 426 server_base.cc:896] This appears to be a new deployment of Kudu; creating new FS layout
I20250625 03:31:32.219496 426 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1750822166717217-426-0/minicluster-data/master-0-root/instance:
uuid: "9fa95fcbf1e74bd8826a5f32008a0ffe"
format_stamp: "Formatted at 2025-06-25 03:31:32 on dist-test-slave-lj23"
I20250625 03:31:32.223913 426 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20250625 03:31:32.227342 3521 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250625 03:31:32.228082 426 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20250625 03:31:32.228374 426 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1750822166717217-426-0/minicluster-data/master-0-root
uuid: "9fa95fcbf1e74bd8826a5f32008a0ffe"
format_stamp: "Formatted at 2025-06-25 03:31:32 on dist-test-slave-lj23"
I20250625 03:31:32.228662 426 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1750822166717217-426-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1750822166717217-426-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1750822166717217-426-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250625 03:31:32.238395 426 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250625 03:31:32.239625 426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250625 03:31:32.277487 426 rpc_server.cc:307] RPC server started. Bound to: 127.0.106.190:40959
I20250625 03:31:32.277585 3572 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.106.190:40959 every 8 connection(s)
I20250625 03:31:32.281534 3573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:32.291838 3573 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9fa95fcbf1e74bd8826a5f32008a0ffe: Bootstrap starting.
I20250625 03:31:32.296814 3573 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9fa95fcbf1e74bd8826a5f32008a0ffe: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:32.300998 3573 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9fa95fcbf1e74bd8826a5f32008a0ffe: No bootstrap required, opened a new log
I20250625 03:31:32.303035 3573 raft_consensus.cc:357] T 00000000000000000000000000000000 P 9fa95fcbf1e74bd8826a5f32008a0ffe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fa95fcbf1e74bd8826a5f32008a0ffe" member_type: VOTER }
I20250625 03:31:32.303539 3573 raft_consensus.cc:383] T 00000000000000000000000000000000 P 9fa95fcbf1e74bd8826a5f32008a0ffe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:32.303821 3573 raft_consensus.cc:738] T 00000000000000000000000000000000 P 9fa95fcbf1e74bd8826a5f32008a0ffe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa95fcbf1e74bd8826a5f32008a0ffe, State: Initialized, Role: FOLLOWER
I20250625 03:31:32.304450 3573 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9fa95fcbf1e74bd8826a5f32008a0ffe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fa95fcbf1e74bd8826a5f32008a0ffe" member_type: VOTER }
I20250625 03:31:32.304889 3573 raft_consensus.cc:397] T 00000000000000000000000000000000 P 9fa95fcbf1e74bd8826a5f32008a0ffe [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250625 03:31:32.305104 3573 raft_consensus.cc:491] T 00000000000000000000000000000000 P 9fa95fcbf1e74bd8826a5f32008a0ffe [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250625 03:31:32.305366 3573 raft_consensus.cc:3058] T 00000000000000000000000000000000 P 9fa95fcbf1e74bd8826a5f32008a0ffe [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:32.309841 3573 raft_consensus.cc:513] T 00000000000000000000000000000000 P 9fa95fcbf1e74bd8826a5f32008a0ffe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fa95fcbf1e74bd8826a5f32008a0ffe" member_type: VOTER }
I20250625 03:31:32.310396 3573 leader_election.cc:304] T 00000000000000000000000000000000 P 9fa95fcbf1e74bd8826a5f32008a0ffe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9fa95fcbf1e74bd8826a5f32008a0ffe; no voters:
I20250625 03:31:32.311499 3573 leader_election.cc:290] T 00000000000000000000000000000000 P 9fa95fcbf1e74bd8826a5f32008a0ffe [CANDIDATE]: Term 1 election: Requested vote from peers
I20250625 03:31:32.311923 3576 raft_consensus.cc:2802] T 00000000000000000000000000000000 P 9fa95fcbf1e74bd8826a5f32008a0ffe [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:31:32.313301 3576 raft_consensus.cc:695] T 00000000000000000000000000000000 P 9fa95fcbf1e74bd8826a5f32008a0ffe [term 1 LEADER]: Becoming Leader. State: Replica: 9fa95fcbf1e74bd8826a5f32008a0ffe, State: Running, Role: LEADER
I20250625 03:31:32.313975 3576 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9fa95fcbf1e74bd8826a5f32008a0ffe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fa95fcbf1e74bd8826a5f32008a0ffe" member_type: VOTER }
I20250625 03:31:32.314543 3573 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9fa95fcbf1e74bd8826a5f32008a0ffe [sys.catalog]: configured and running, proceeding with master startup.
I20250625 03:31:32.320606 3577 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9fa95fcbf1e74bd8826a5f32008a0ffe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9fa95fcbf1e74bd8826a5f32008a0ffe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fa95fcbf1e74bd8826a5f32008a0ffe" member_type: VOTER } }
I20250625 03:31:32.321445 3577 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9fa95fcbf1e74bd8826a5f32008a0ffe [sys.catalog]: This master's current role is: LEADER
I20250625 03:31:32.323488 3578 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9fa95fcbf1e74bd8826a5f32008a0ffe [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9fa95fcbf1e74bd8826a5f32008a0ffe. Latest consensus state: current_term: 1 leader_uuid: "9fa95fcbf1e74bd8826a5f32008a0ffe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fa95fcbf1e74bd8826a5f32008a0ffe" member_type: VOTER } }
I20250625 03:31:32.324499 3578 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9fa95fcbf1e74bd8826a5f32008a0ffe [sys.catalog]: This master's current role is: LEADER
I20250625 03:31:32.327836 3586 catalog_manager.cc:1477] Loading table and tablet metadata into memory...
I20250625 03:31:32.329035 426 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20250625 03:31:32.332743 3586 catalog_manager.cc:1486] Initializing Kudu cluster ID...
I20250625 03:31:32.340937 3586 catalog_manager.cc:1349] Generated new cluster ID: ce0b508ce4e445cdbe21b3b7429ce0d6
I20250625 03:31:32.341248 3586 catalog_manager.cc:1497] Initializing Kudu internal certificate authority...
I20250625 03:31:32.365449 3586 catalog_manager.cc:1372] Generated new certificate authority record
I20250625 03:31:32.366737 3586 catalog_manager.cc:1506] Loading token signing keys...
I20250625 03:31:32.378721 3586 catalog_manager.cc:5955] T 00000000000000000000000000000000 P 9fa95fcbf1e74bd8826a5f32008a0ffe: Generated new TSK 0
I20250625 03:31:32.379352 3586 catalog_manager.cc:1516] Initializing in-progress tserver states...
I20250625 03:31:32.396600 426 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250625 03:31:32.402346 3594 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250625 03:31:32.403695 3595 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250625 03:31:32.406070 3597 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250625 03:31:32.406519 426 server_base.cc:1048] running on GCE node
I20250625 03:31:32.408514 426 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250625 03:31:32.408718 426 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250625 03:31:32.408880 426 hybrid_clock.cc:648] HybridClock initialized: now 1750822292408850 us; error 0 us; skew 500 ppm
I20250625 03:31:32.409369 426 server_base.cc:848] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250625 03:31:32.411842 426 webserver.cc:469] Webserver started at http://127.0.106.129:34457/ using document root <none> and password file <none>
I20250625 03:31:32.412356 426 fs_manager.cc:362] Metadata directory not provided
I20250625 03:31:32.412539 426 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250625 03:31:32.412796 426 server_base.cc:896] This appears to be a new deployment of Kudu; creating new FS layout
I20250625 03:31:32.413939 426 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1750822166717217-426-0/minicluster-data/ts-0-root/instance:
uuid: "01873d289e0b4f9f9184b251369502a9"
format_stamp: "Formatted at 2025-06-25 03:31:32 on dist-test-slave-lj23"
I20250625 03:31:32.418480 426 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20250625 03:31:32.421929 3602 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250625 03:31:32.422704 426 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20250625 03:31:32.422992 426 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1750822166717217-426-0/minicluster-data/ts-0-root
uuid: "01873d289e0b4f9f9184b251369502a9"
format_stamp: "Formatted at 2025-06-25 03:31:32 on dist-test-slave-lj23"
I20250625 03:31:32.423275 426 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1750822166717217-426-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1750822166717217-426-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1750822166717217-426-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250625 03:31:32.445035 426 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250625 03:31:32.446209 426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250625 03:31:32.447649 426 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20250625 03:31:32.449899 426 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250625 03:31:32.450090 426 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250625 03:31:32.450318 426 ts_tablet_manager.cc:610] Registered 0 tablets
I20250625 03:31:32.450480 426 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250625 03:31:32.490676 426 rpc_server.cc:307] RPC server started. Bound to: 127.0.106.129:37771
I20250625 03:31:32.490777 3664 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.106.129:37771 every 8 connection(s)
I20250625 03:31:32.495563 426 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250625 03:31:32.502985 3669 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250625 03:31:32.505441 3670 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250625 03:31:32.508749 3672 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250625 03:31:32.509042 3665 heartbeater.cc:344] Connected to a master server at 127.0.106.190:40959
I20250625 03:31:32.509485 3665 heartbeater.cc:461] Registering TS with master...
I20250625 03:31:32.509502 426 server_base.cc:1048] running on GCE node
I20250625 03:31:32.510285 3665 heartbeater.cc:507] Master 127.0.106.190:40959 requested a full tablet report, sending...
I20250625 03:31:32.510928 426 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250625 03:31:32.511170 426 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250625 03:31:32.511333 426 hybrid_clock.cc:648] HybridClock initialized: now 1750822292511318 us; error 0 us; skew 500 ppm
I20250625 03:31:32.511987 426 server_base.cc:848] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250625 03:31:32.512367 3538 ts_manager.cc:194] Registered new tserver with Master: 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:31:32.514850 3538 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42868
I20250625 03:31:32.514926 426 webserver.cc:469] Webserver started at http://127.0.106.130:36293/ using document root <none> and password file <none>
I20250625 03:31:32.515683 426 fs_manager.cc:362] Metadata directory not provided
I20250625 03:31:32.515934 426 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250625 03:31:32.516317 426 server_base.cc:896] This appears to be a new deployment of Kudu; creating new FS layout
I20250625 03:31:32.517364 426 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1750822166717217-426-0/minicluster-data/ts-1-root/instance:
uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
format_stamp: "Formatted at 2025-06-25 03:31:32 on dist-test-slave-lj23"
I20250625 03:31:32.521764 426 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20250625 03:31:32.525142 3677 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250625 03:31:32.525872 426 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20250625 03:31:32.526153 426 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1750822166717217-426-0/minicluster-data/ts-1-root
uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
format_stamp: "Formatted at 2025-06-25 03:31:32 on dist-test-slave-lj23"
I20250625 03:31:32.526427 426 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1750822166717217-426-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1750822166717217-426-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1750822166717217-426-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250625 03:31:32.540552 426 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250625 03:31:32.541707 426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250625 03:31:32.543162 426 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20250625 03:31:32.545369 426 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250625 03:31:32.545571 426 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250625 03:31:32.545779 426 ts_tablet_manager.cc:610] Registered 0 tablets
I20250625 03:31:32.545926 426 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250625 03:31:32.587751 426 rpc_server.cc:307] RPC server started. Bound to: 127.0.106.130:42041
I20250625 03:31:32.587857 3739 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.106.130:42041 every 8 connection(s)
I20250625 03:31:32.592311 426 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250625 03:31:32.598865 3743 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250625 03:31:32.601070 3744 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250625 03:31:32.602509 3746 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250625 03:31:32.604260 3740 heartbeater.cc:344] Connected to a master server at 127.0.106.190:40959
I20250625 03:31:32.604696 3740 heartbeater.cc:461] Registering TS with master...
I20250625 03:31:32.605140 426 server_base.cc:1048] running on GCE node
I20250625 03:31:32.605650 3740 heartbeater.cc:507] Master 127.0.106.190:40959 requested a full tablet report, sending...
I20250625 03:31:32.605966 426 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250625 03:31:32.606212 426 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250625 03:31:32.606367 426 hybrid_clock.cc:648] HybridClock initialized: now 1750822292606348 us; error 0 us; skew 500 ppm
I20250625 03:31:32.607059 426 server_base.cc:848] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250625 03:31:32.607710 3538 ts_manager.cc:194] Registered new tserver with Master: 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:31:32.609288 3538 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42880
I20250625 03:31:32.609787 426 webserver.cc:469] Webserver started at http://127.0.106.131:44437/ using document root <none> and password file <none>
I20250625 03:31:32.610405 426 fs_manager.cc:362] Metadata directory not provided
I20250625 03:31:32.610615 426 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250625 03:31:32.610859 426 server_base.cc:896] This appears to be a new deployment of Kudu; creating new FS layout
I20250625 03:31:32.612028 426 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1750822166717217-426-0/minicluster-data/ts-2-root/instance:
uuid: "841018313ad649679de64e006582f4c5"
format_stamp: "Formatted at 2025-06-25 03:31:32 on dist-test-slave-lj23"
I20250625 03:31:32.616468 426 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20250625 03:31:32.619668 3751 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250625 03:31:32.620405 426 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20250625 03:31:32.620693 426 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1750822166717217-426-0/minicluster-data/ts-2-root
uuid: "841018313ad649679de64e006582f4c5"
format_stamp: "Formatted at 2025-06-25 03:31:32 on dist-test-slave-lj23"
I20250625 03:31:32.620980 426 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1750822166717217-426-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1750822166717217-426-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1750822166717217-426-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250625 03:31:32.643416 426 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250625 03:31:32.644683 426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250625 03:31:32.646136 426 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20250625 03:31:32.648429 426 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250625 03:31:32.648638 426 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250625 03:31:32.648864 426 ts_tablet_manager.cc:610] Registered 0 tablets
I20250625 03:31:32.649019 426 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250625 03:31:32.689097 426 rpc_server.cc:307] RPC server started. Bound to: 127.0.106.131:39467
I20250625 03:31:32.689193 3813 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.106.131:39467 every 8 connection(s)
I20250625 03:31:32.693693 426 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250625 03:31:32.700517 3817 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250625 03:31:32.701459 3818 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250625 03:31:32.704339 3820 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250625 03:31:32.706506 3814 heartbeater.cc:344] Connected to a master server at 127.0.106.190:40959
I20250625 03:31:32.706900 3814 heartbeater.cc:461] Registering TS with master...
I20250625 03:31:32.707226 426 server_base.cc:1048] running on GCE node
I20250625 03:31:32.707688 3814 heartbeater.cc:507] Master 127.0.106.190:40959 requested a full tablet report, sending...
I20250625 03:31:32.708200 426 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250625 03:31:32.708452 426 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250625 03:31:32.708627 426 hybrid_clock.cc:648] HybridClock initialized: now 1750822292708610 us; error 0 us; skew 500 ppm
I20250625 03:31:32.709255 426 server_base.cc:848] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250625 03:31:32.709745 3538 ts_manager.cc:194] Registered new tserver with Master: 841018313ad649679de64e006582f4c5 (127.0.106.131:39467)
I20250625 03:31:32.711606 3538 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42882
I20250625 03:31:32.712282 426 webserver.cc:469] Webserver started at http://127.0.106.132:35135/ using document root <none> and password file <none>
I20250625 03:31:32.713003 426 fs_manager.cc:362] Metadata directory not provided
I20250625 03:31:32.713186 426 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250625 03:31:32.713433 426 server_base.cc:896] This appears to be a new deployment of Kudu; creating new FS layout
I20250625 03:31:32.714545 426 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1750822166717217-426-0/minicluster-data/ts-3-root/instance:
uuid: "ddc0ad67020f45edb3ba9c83cab687a4"
format_stamp: "Formatted at 2025-06-25 03:31:32 on dist-test-slave-lj23"
I20250625 03:31:32.719147 426 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.001s
I20250625 03:31:32.722642 3825 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250625 03:31:32.723402 426 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20250625 03:31:32.723696 426 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1750822166717217-426-0/minicluster-data/ts-3-root
uuid: "ddc0ad67020f45edb3ba9c83cab687a4"
format_stamp: "Formatted at 2025-06-25 03:31:32 on dist-test-slave-lj23"
I20250625 03:31:32.723963 426 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1750822166717217-426-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1750822166717217-426-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1750822166717217-426-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250625 03:31:32.743441 426 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250625 03:31:32.744715 426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250625 03:31:32.746150 426 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20250625 03:31:32.748358 426 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250625 03:31:32.748564 426 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250625 03:31:32.748793 426 ts_tablet_manager.cc:610] Registered 0 tablets
I20250625 03:31:32.748955 426 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250625 03:31:32.788117 426 rpc_server.cc:307] RPC server started. Bound to: 127.0.106.132:37353
I20250625 03:31:32.788215 3887 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.106.132:37353 every 8 connection(s)
I20250625 03:31:32.801317 3888 heartbeater.cc:344] Connected to a master server at 127.0.106.190:40959
I20250625 03:31:32.801726 3888 heartbeater.cc:461] Registering TS with master...
I20250625 03:31:32.802408 3888 heartbeater.cc:507] Master 127.0.106.190:40959 requested a full tablet report, sending...
I20250625 03:31:32.804175 3538 ts_manager.cc:194] Registered new tserver with Master: ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353)
I20250625 03:31:32.804945 426 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.013728675s
I20250625 03:31:32.805811 3538 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42892
I20250625 03:31:32.807687 426 test_util.cc:276] Using random seed: 349429748
I20250625 03:31:32.832808 3538 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42908:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 03:31:33.085865 3779 tablet_service.cc:1468] Processing CreateTablet for tablet 7a8ecc65ca1140beb905dd6368bfaa2a (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20250625 03:31:33.087440 3779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a8ecc65ca1140beb905dd6368bfaa2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.089088 3778 tablet_service.cc:1468] Processing CreateTablet for tablet b74d9f11c2bc4a7bb6431d6222d45175 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20250625 03:31:33.089859 3848 tablet_service.cc:1468] Processing CreateTablet for tablet 2e956665b7e4411f86cf77259093c8aa (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20250625 03:31:33.090600 3778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b74d9f11c2bc4a7bb6431d6222d45175. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.091224 3848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e956665b7e4411f86cf77259093c8aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.093230 3630 tablet_service.cc:1468] Processing CreateTablet for tablet f3a33aa1d146468c986f0b1ba7d5fb84 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION VALUES < 36398027
I20250625 03:31:33.094313 3851 tablet_service.cc:1468] Processing CreateTablet for tablet bccba871bcd747fd80a890b25628ebe2 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20250625 03:31:33.094580 3625 tablet_service.cc:1468] Processing CreateTablet for tablet 485f3e9350e245a9939133866b354302 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20250625 03:31:33.095683 3851 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bccba871bcd747fd80a890b25628ebe2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.097115 3852 tablet_service.cc:1468] Processing CreateTablet for tablet b74d9f11c2bc4a7bb6431d6222d45175 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20250625 03:31:33.097564 3627 tablet_service.cc:1468] Processing CreateTablet for tablet 3ecdd525d6fd47deacf323decbc5c329 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20250625 03:31:33.097792 3847 tablet_service.cc:1468] Processing CreateTablet for tablet a07d77259251401d957af853b296750a (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20250625 03:31:33.099438 3853 tablet_service.cc:1468] Processing CreateTablet for tablet f3a33aa1d146468c986f0b1ba7d5fb84 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION VALUES < 36398027
I20250625 03:31:33.099754 3626 tablet_service.cc:1468] Processing CreateTablet for tablet 5dc5a179a27f462989b291e8133742da (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20250625 03:31:33.100050 3846 tablet_service.cc:1468] Processing CreateTablet for tablet 49d4fb2581ed4ef998f6a113ea67c323 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20250625 03:31:33.101784 3624 tablet_service.cc:1468] Processing CreateTablet for tablet 7e92fd94b9f24b1097e9a7373896cb26 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20250625 03:31:33.102844 3845 tablet_service.cc:1468] Processing CreateTablet for tablet 6fc84ca2087c4ded91412fb32117af48 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20250625 03:31:33.103607 3775 tablet_service.cc:1468] Processing CreateTablet for tablet 485f3e9350e245a9939133866b354302 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20250625 03:31:33.104099 3623 tablet_service.cc:1468] Processing CreateTablet for tablet a07d77259251401d957af853b296750a (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20250625 03:31:33.104990 3775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 485f3e9350e245a9939133866b354302. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.105859 3622 tablet_service.cc:1468] Processing CreateTablet for tablet 49d4fb2581ed4ef998f6a113ea67c323 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20250625 03:31:33.106222 3772 tablet_service.cc:1468] Processing CreateTablet for tablet 49d4fb2581ed4ef998f6a113ea67c323 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20250625 03:31:33.107563 3772 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49d4fb2581ed4ef998f6a113ea67c323. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.108997 3844 tablet_service.cc:1468] Processing CreateTablet for tablet c592f2c5305141c487b73e0867d0f36b (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20250625 03:31:33.109128 3770 tablet_service.cc:1468] Processing CreateTablet for tablet 06f309640df64f97a4065b1420fea692 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20250625 03:31:33.110487 3770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06f309640df64f97a4065b1420fea692. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.113348 3777 tablet_service.cc:1468] Processing CreateTablet for tablet bccba871bcd747fd80a890b25628ebe2 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20250625 03:31:33.117533 3771 tablet_service.cc:1468] Processing CreateTablet for tablet 6fc84ca2087c4ded91412fb32117af48 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20250625 03:31:33.101715 3774 tablet_service.cc:1468] Processing CreateTablet for tablet 2e956665b7e4411f86cf77259093c8aa (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20250625 03:31:33.130827 3705 tablet_service.cc:1468] Processing CreateTablet for tablet f3a33aa1d146468c986f0b1ba7d5fb84 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION VALUES < 36398027
I20250625 03:31:33.133291 3704 tablet_service.cc:1468] Processing CreateTablet for tablet 7a8ecc65ca1140beb905dd6368bfaa2a (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20250625 03:31:33.135263 3705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3a33aa1d146468c986f0b1ba7d5fb84. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.094658 3630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3a33aa1d146468c986f0b1ba7d5fb84. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.122010 3629 tablet_service.cc:1468] Processing CreateTablet for tablet 7a8ecc65ca1140beb905dd6368bfaa2a (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20250625 03:31:33.124825 3776 tablet_service.cc:1468] Processing CreateTablet for tablet 3ecdd525d6fd47deacf323decbc5c329 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20250625 03:31:33.125778 3773 tablet_service.cc:1468] Processing CreateTablet for tablet 7e92fd94b9f24b1097e9a7373896cb26 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20250625 03:31:33.093233 3849 tablet_service.cc:1468] Processing CreateTablet for tablet 485f3e9350e245a9939133866b354302 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20250625 03:31:33.127102 3850 tablet_service.cc:1468] Processing CreateTablet for tablet 5dc5a179a27f462989b291e8133742da (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20250625 03:31:33.096055 3628 tablet_service.cc:1468] Processing CreateTablet for tablet b74d9f11c2bc4a7bb6431d6222d45175 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20250625 03:31:33.139011 3703 tablet_service.cc:1468] Processing CreateTablet for tablet bccba871bcd747fd80a890b25628ebe2 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20250625 03:31:33.140668 3624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e92fd94b9f24b1097e9a7373896cb26. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.143818 3621 tablet_service.cc:1468] Processing CreateTablet for tablet 06f309640df64f97a4065b1420fea692 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20250625 03:31:33.144682 3704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a8ecc65ca1140beb905dd6368bfaa2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.146914 3703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bccba871bcd747fd80a890b25628ebe2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.115221 3777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bccba871bcd747fd80a890b25628ebe2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.148828 3774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e956665b7e4411f86cf77259093c8aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.143873 3629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a8ecc65ca1140beb905dd6368bfaa2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.150400 3627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ecdd525d6fd47deacf323decbc5c329. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.151829 3623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a07d77259251401d957af853b296750a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.153151 3626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dc5a179a27f462989b291e8133742da. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.154201 3622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49d4fb2581ed4ef998f6a113ea67c323. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.154984 3621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06f309640df64f97a4065b1420fea692. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.155717 3625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 485f3e9350e245a9939133866b354302. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.157248 3628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b74d9f11c2bc4a7bb6431d6222d45175. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.151966 3771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fc84ca2087c4ded91412fb32117af48. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.167143 3776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ecdd525d6fd47deacf323decbc5c329. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.168256 3773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e92fd94b9f24b1097e9a7373896cb26. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.170472 3702 tablet_service.cc:1468] Processing CreateTablet for tablet 3ecdd525d6fd47deacf323decbc5c329 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20250625 03:31:33.172816 3847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a07d77259251401d957af853b296750a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.173480 3701 tablet_service.cc:1468] Processing CreateTablet for tablet 5dc5a179a27f462989b291e8133742da (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20250625 03:31:33.174535 3849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 485f3e9350e245a9939133866b354302. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.175269 3701 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dc5a179a27f462989b291e8133742da. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.176116 3850 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dc5a179a27f462989b291e8133742da. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.176564 3702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ecdd525d6fd47deacf323decbc5c329. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.177685 3852 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b74d9f11c2bc4a7bb6431d6222d45175. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.179220 3853 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3a33aa1d146468c986f0b1ba7d5fb84. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.180282 3845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fc84ca2087c4ded91412fb32117af48. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.181178 3844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c592f2c5305141c487b73e0867d0f36b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.182081 3846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49d4fb2581ed4ef998f6a113ea67c323. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.263482 3700 tablet_service.cc:1468] Processing CreateTablet for tablet 2e956665b7e4411f86cf77259093c8aa (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20250625 03:31:33.264994 3700 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e956665b7e4411f86cf77259093c8aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.269634 3699 tablet_service.cc:1468] Processing CreateTablet for tablet 7e92fd94b9f24b1097e9a7373896cb26 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20250625 03:31:33.271063 3699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e92fd94b9f24b1097e9a7373896cb26. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.274420 3698 tablet_service.cc:1468] Processing CreateTablet for tablet a07d77259251401d957af853b296750a (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20250625 03:31:33.275833 3698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a07d77259251401d957af853b296750a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.311414 3905 tablet_bootstrap.cc:492] T 485f3e9350e245a9939133866b354302 P 841018313ad649679de64e006582f4c5: Bootstrap starting.
I20250625 03:31:33.311956 3697 tablet_service.cc:1468] Processing CreateTablet for tablet 6fc84ca2087c4ded91412fb32117af48 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20250625 03:31:33.313409 3697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fc84ca2087c4ded91412fb32117af48. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.329289 3905 tablet_bootstrap.cc:654] T 485f3e9350e245a9939133866b354302 P 841018313ad649679de64e006582f4c5: Neither blocks nor log segments found. Creating new log.
W20250625 03:31:33.334190 3585 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20250625 03:31:33.336751 3906 tablet_bootstrap.cc:492] T f3a33aa1d146468c986f0b1ba7d5fb84 P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:33.342875 3906 tablet_bootstrap.cc:654] T f3a33aa1d146468c986f0b1ba7d5fb84 P 01873d289e0b4f9f9184b251369502a9: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:33.344770 3775 tablet_service.cc:1468] Processing CreateTablet for tablet 1e9c146f8cd743f7ac35dc61d9226d1d (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20250625 03:31:33.346122 3775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e9c146f8cd743f7ac35dc61d9226d1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.360550 3770 tablet_service.cc:1468] Processing CreateTablet for tablet b1ece928b2e2452191ee263cf19ec4f8 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20250625 03:31:33.362041 3770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1ece928b2e2452191ee263cf19ec4f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.378739 3630 tablet_service.cc:1468] Processing CreateTablet for tablet c592f2c5305141c487b73e0867d0f36b (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20250625 03:31:33.381371 3696 tablet_service.cc:1468] Processing CreateTablet for tablet 06f309640df64f97a4065b1420fea692 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20250625 03:31:33.384871 3696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06f309640df64f97a4065b1420fea692. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.382349 3629 tablet_service.cc:1468] Processing CreateTablet for tablet c0c8dfded31e4566b07bc439f6e58ef6 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20250625 03:31:33.396636 3629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0c8dfded31e4566b07bc439f6e58ef6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.397095 3624 tablet_service.cc:1468] Processing CreateTablet for tablet 1e9c146f8cd743f7ac35dc61d9226d1d (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20250625 03:31:33.398519 3624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e9c146f8cd743f7ac35dc61d9226d1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.402757 3630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c592f2c5305141c487b73e0867d0f36b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.413868 3699 tablet_service.cc:1468] Processing CreateTablet for tablet b1ece928b2e2452191ee263cf19ec4f8 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20250625 03:31:33.415237 3699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1ece928b2e2452191ee263cf19ec4f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.419371 3778 tablet_service.cc:1468] Processing CreateTablet for tablet c0c8dfded31e4566b07bc439f6e58ef6 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20250625 03:31:33.420771 3778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0c8dfded31e4566b07bc439f6e58ef6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.422340 3704 tablet_service.cc:1468] Processing CreateTablet for tablet c592f2c5305141c487b73e0867d0f36b (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20250625 03:31:33.423693 3704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c592f2c5305141c487b73e0867d0f36b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.423806 3844 tablet_service.cc:1468] Processing CreateTablet for tablet 1e9c146f8cd743f7ac35dc61d9226d1d (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20250625 03:31:33.425133 3844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e9c146f8cd743f7ac35dc61d9226d1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.446259 3909 tablet_bootstrap.cc:492] T a07d77259251401d957af853b296750a P 3d5b9823dfcd41cb92bd195c811cbf39: Bootstrap starting.
I20250625 03:31:33.446821 3698 tablet_service.cc:1468] Processing CreateTablet for tablet c0c8dfded31e4566b07bc439f6e58ef6 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20250625 03:31:33.454171 3628 tablet_service.cc:1468] Processing CreateTablet for tablet d08de4c2326d46bab26f42d8d483ebd0 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20250625 03:31:33.455578 3628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d08de4c2326d46bab26f42d8d483ebd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.464346 3622 tablet_service.cc:1468] Processing CreateTablet for tablet 2c4bb2d21b5242d387f6bc6ada60b4d5 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20250625 03:31:33.465731 3622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c4bb2d21b5242d387f6bc6ada60b4d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.467100 3626 tablet_service.cc:1468] Processing CreateTablet for tablet 002d4371d5414440b756829fe3343d07 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20250625 03:31:33.469306 3906 tablet_bootstrap.cc:492] T f3a33aa1d146468c986f0b1ba7d5fb84 P 01873d289e0b4f9f9184b251369502a9: No bootstrap required, opened a new log
I20250625 03:31:33.469817 3906 ts_tablet_manager.cc:1397] T f3a33aa1d146468c986f0b1ba7d5fb84 P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.133s user 0.003s sys 0.013s
I20250625 03:31:33.481913 3848 tablet_service.cc:1468] Processing CreateTablet for tablet b1ece928b2e2452191ee263cf19ec4f8 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20250625 03:31:33.483388 3848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1ece928b2e2452191ee263cf19ec4f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.484758 3779 tablet_service.cc:1468] Processing CreateTablet for tablet 2c4bb2d21b5242d387f6bc6ada60b4d5 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20250625 03:31:33.492794 3906 raft_consensus.cc:357] T f3a33aa1d146468c986f0b1ba7d5fb84 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:33.493923 3626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 002d4371d5414440b756829fe3343d07. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.500838 3848 tablet_service.cc:1468] Processing CreateTablet for tablet d08de4c2326d46bab26f42d8d483ebd0 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20250625 03:31:33.502444 3905 tablet_bootstrap.cc:492] T 485f3e9350e245a9939133866b354302 P 841018313ad649679de64e006582f4c5: No bootstrap required, opened a new log
I20250625 03:31:33.503485 3698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0c8dfded31e4566b07bc439f6e58ef6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.503664 3697 tablet_service.cc:1468] Processing CreateTablet for tablet d08de4c2326d46bab26f42d8d483ebd0 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20250625 03:31:33.506207 3849 tablet_service.cc:1468] Processing CreateTablet for tablet 2c4bb2d21b5242d387f6bc6ada60b4d5 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20250625 03:31:33.517570 3665 heartbeater.cc:499] Master 127.0.106.190:40959 was elected leader, sending a full tablet report...
I20250625 03:31:33.518461 3627 tablet_service.cc:1468] Processing CreateTablet for tablet 526951ad467a4708926096ed1162a722 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20250625 03:31:33.518695 3847 tablet_service.cc:1468] Processing CreateTablet for tablet 5e59ae16ec1a4c69aac820531e504206 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20250625 03:31:33.527122 3705 tablet_service.cc:1468] Processing CreateTablet for tablet 5e59ae16ec1a4c69aac820531e504206 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20250625 03:31:33.537019 3906 raft_consensus.cc:383] T f3a33aa1d146468c986f0b1ba7d5fb84 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:33.543176 3905 ts_tablet_manager.cc:1397] T 485f3e9350e245a9939133866b354302 P 841018313ad649679de64e006582f4c5: Time spent bootstrapping tablet: real 0.232s user 0.015s sys 0.017s
I20250625 03:31:33.550120 3906 raft_consensus.cc:738] T f3a33aa1d146468c986f0b1ba7d5fb84 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:33.556550 3697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d08de4c2326d46bab26f42d8d483ebd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.533092 3774 tablet_service.cc:1468] Processing CreateTablet for tablet 5e59ae16ec1a4c69aac820531e504206 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20250625 03:31:33.556525 3906 consensus_queue.cc:260] T f3a33aa1d146468c986f0b1ba7d5fb84 P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:33.565486 3779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c4bb2d21b5242d387f6bc6ada60b4d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.563977 3848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d08de4c2326d46bab26f42d8d483ebd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.573665 3702 tablet_service.cc:1468] Processing CreateTablet for tablet 002d4371d5414440b756829fe3343d07 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20250625 03:31:33.595595 3776 tablet_service.cc:1468] Processing CreateTablet for tablet 002d4371d5414440b756829fe3343d07 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20250625 03:31:33.596426 3705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e59ae16ec1a4c69aac820531e504206. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.574766 3905 raft_consensus.cc:357] T 485f3e9350e245a9939133866b354302 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:33.597286 3910 tablet_bootstrap.cc:492] T 2e956665b7e4411f86cf77259093c8aa P ddc0ad67020f45edb3ba9c83cab687a4: Bootstrap starting.
I20250625 03:31:33.603960 3776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 002d4371d5414440b756829fe3343d07. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.571375 3853 tablet_service.cc:1468] Processing CreateTablet for tablet eeca5a85dddf4d1884917690e01ff81d (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20250625 03:31:33.575399 3703 tablet_service.cc:1468] Processing CreateTablet for tablet 526951ad467a4708926096ed1162a722 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20250625 03:31:33.612378 3909 tablet_bootstrap.cc:700] T a07d77259251401d957af853b296750a P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent opening tablet: real 0.100s user 0.003s sys 0.001s
I20250625 03:31:33.612578 3740 heartbeater.cc:499] Master 127.0.106.190:40959 was elected leader, sending a full tablet report...
I20250625 03:31:33.606223 3905 raft_consensus.cc:383] T 485f3e9350e245a9939133866b354302 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:33.613866 3847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e59ae16ec1a4c69aac820531e504206. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.626027 3696 tablet_service.cc:1468] Processing CreateTablet for tablet eeca5a85dddf4d1884917690e01ff81d (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20250625 03:31:33.626482 3778 tablet_service.cc:1468] Processing CreateTablet for tablet eeca5a85dddf4d1884917690e01ff81d (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20250625 03:31:33.627712 3778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eeca5a85dddf4d1884917690e01ff81d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.633123 3699 tablet_service.cc:1468] Processing CreateTablet for tablet d00ad2472fd74bfc9065d9dc4808e0c1 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20250625 03:31:33.607220 3852 tablet_service.cc:1468] Processing CreateTablet for tablet 526951ad467a4708926096ed1162a722 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20250625 03:31:33.617874 3905 raft_consensus.cc:738] T 485f3e9350e245a9939133866b354302 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841018313ad649679de64e006582f4c5, State: Initialized, Role: FOLLOWER
I20250625 03:31:33.620651 3702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 002d4371d5414440b756829fe3343d07. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.638545 3909 tablet_bootstrap.cc:654] T a07d77259251401d957af853b296750a P 3d5b9823dfcd41cb92bd195c811cbf39: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:33.660235 3852 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 526951ad467a4708926096ed1162a722. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.651780 3777 tablet_service.cc:1468] Processing CreateTablet for tablet e7d3871088394a3ba7a6d18baae1feba (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20250625 03:31:33.675508 3776 tablet_service.cc:1468] Processing CreateTablet for tablet d00ad2472fd74bfc9065d9dc4808e0c1 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20250625 03:31:33.660669 3905 consensus_queue.cc:260] T 485f3e9350e245a9939133866b354302 P 841018313ad649679de64e006582f4c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:33.651016 3621 tablet_service.cc:1468] Processing CreateTablet for tablet e7d3871088394a3ba7a6d18baae1feba (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20250625 03:31:33.605213 3850 tablet_service.cc:1468] Processing CreateTablet for tablet e7d3871088394a3ba7a6d18baae1feba (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20250625 03:31:33.659771 3628 tablet_service.cc:1468] Processing CreateTablet for tablet 007d68495d594a73a5e2748f51e7c44c (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20250625 03:31:33.657672 3623 tablet_service.cc:1468] Processing CreateTablet for tablet e638ce3a86d242fcadb10cdf57f5960d (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20250625 03:31:33.652056 3625 tablet_service.cc:1468] Processing CreateTablet for tablet 9d985eca3d6f497c86b94c53f16c8ae5 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20250625 03:31:33.650321 3627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 526951ad467a4708926096ed1162a722. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.714274 3814 heartbeater.cc:499] Master 127.0.106.190:40959 was elected leader, sending a full tablet report...
I20250625 03:31:33.673429 3703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 526951ad467a4708926096ed1162a722. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.716544 3696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eeca5a85dddf4d1884917690e01ff81d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.717415 3625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d985eca3d6f497c86b94c53f16c8ae5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.720395 3623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e638ce3a86d242fcadb10cdf57f5960d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.726253 3628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 007d68495d594a73a5e2748f51e7c44c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.739697 3909 tablet_bootstrap.cc:492] T a07d77259251401d957af853b296750a P 3d5b9823dfcd41cb92bd195c811cbf39: No bootstrap required, opened a new log
I20250625 03:31:33.740777 3909 ts_tablet_manager.cc:1397] T a07d77259251401d957af853b296750a P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent bootstrapping tablet: real 0.295s user 0.012s sys 0.002s
I20250625 03:31:33.743317 3905 ts_tablet_manager.cc:1428] T 485f3e9350e245a9939133866b354302 P 841018313ad649679de64e006582f4c5: Time spent starting tablet: real 0.187s user 0.005s sys 0.004s
I20250625 03:31:33.744436 3905 tablet_bootstrap.cc:492] T 06f309640df64f97a4065b1420fea692 P 841018313ad649679de64e006582f4c5: Bootstrap starting.
W20250625 03:31:33.745841 3666 tablet.cc:2378] T f3a33aa1d146468c986f0b1ba7d5fb84 P 01873d289e0b4f9f9184b251369502a9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20250625 03:31:33.751781 3850 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7d3871088394a3ba7a6d18baae1feba. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.753145 3696 tablet_service.cc:1468] Processing CreateTablet for tablet 3d5b503929b24663a1f868ffaec34157 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20250625 03:31:33.754535 3696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d5b503929b24663a1f868ffaec34157. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.753659 3844 tablet_service.cc:1468] Processing CreateTablet for tablet 007d68495d594a73a5e2748f51e7c44c (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20250625 03:31:33.756419 3848 tablet_service.cc:1468] Processing CreateTablet for tablet 3d5b503929b24663a1f868ffaec34157 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20250625 03:31:33.757614 3845 tablet_service.cc:1468] Processing CreateTablet for tablet 036dfe9e6b844fc6964b3b5e371f8c95 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20250625 03:31:33.760288 3624 tablet_service.cc:1468] Processing CreateTablet for tablet 39da7c80318f4c408f8cdaf2229b0c96 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20250625 03:31:33.761656 3624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39da7c80318f4c408f8cdaf2229b0c96. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.756359 3846 tablet_service.cc:1468] Processing CreateTablet for tablet 5ece5f5b2a904c9cbef3065e210e9a30 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20250625 03:31:33.769434 3844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 007d68495d594a73a5e2748f51e7c44c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.769229 3698 tablet_service.cc:1468] Processing CreateTablet for tablet a6b45bf21adf457d9a920f57d758ba15 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20250625 03:31:33.770531 3698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6b45bf21adf457d9a920f57d758ba15. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.770989 3697 tablet_service.cc:1468] Processing CreateTablet for tablet 39da7c80318f4c408f8cdaf2229b0c96 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20250625 03:31:33.772250 3697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39da7c80318f4c408f8cdaf2229b0c96. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.772629 3848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d5b503929b24663a1f868ffaec34157. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.772625 3909 raft_consensus.cc:357] T a07d77259251401d957af853b296750a P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:33.774444 3909 raft_consensus.cc:383] T a07d77259251401d957af853b296750a P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:33.774751 3909 raft_consensus.cc:738] T a07d77259251401d957af853b296750a P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Initialized, Role: FOLLOWER
I20250625 03:31:33.776029 3626 tablet_service.cc:1468] Processing CreateTablet for tablet 03c46dae805341fdb9ec29725fa182a2 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20250625 03:31:33.777333 3626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03c46dae805341fdb9ec29725fa182a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.777498 3847 tablet_service.cc:1468] Processing CreateTablet for tablet a6b45bf21adf457d9a920f57d758ba15 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20250625 03:31:33.778797 3847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6b45bf21adf457d9a920f57d758ba15. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.779496 3621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7d3871088394a3ba7a6d18baae1feba. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.780313 3909 consensus_queue.cc:260] T a07d77259251401d957af853b296750a P 3d5b9823dfcd41cb92bd195c811cbf39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:33.683983 3775 tablet_service.cc:1468] Processing CreateTablet for tablet a6b45bf21adf457d9a920f57d758ba15 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20250625 03:31:33.630800 3851 tablet_service.cc:1468] Processing CreateTablet for tablet e638ce3a86d242fcadb10cdf57f5960d (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20250625 03:31:33.784438 3851 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e638ce3a86d242fcadb10cdf57f5960d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.661927 3630 tablet_service.cc:1468] Processing CreateTablet for tablet d00ad2472fd74bfc9065d9dc4808e0c1 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20250625 03:31:33.785718 3846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ece5f5b2a904c9cbef3065e210e9a30. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.786412 3630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d00ad2472fd74bfc9065d9dc4808e0c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.688678 3772 tablet_service.cc:1468] Processing CreateTablet for tablet 9d985eca3d6f497c86b94c53f16c8ae5 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20250625 03:31:33.693006 3906 ts_tablet_manager.cc:1428] T f3a33aa1d146468c986f0b1ba7d5fb84 P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.223s user 0.027s sys 0.009s
I20250625 03:31:33.671780 3773 tablet_service.cc:1468] Processing CreateTablet for tablet 5ece5f5b2a904c9cbef3065e210e9a30 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20250625 03:31:33.693459 3701 tablet_service.cc:1468] Processing CreateTablet for tablet e638ce3a86d242fcadb10cdf57f5960d (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20250625 03:31:33.695456 3629 tablet_service.cc:1468] Processing CreateTablet for tablet 3d5b503929b24663a1f868ffaec34157 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20250625 03:31:33.792960 3906 tablet_bootstrap.cc:492] T 7e92fd94b9f24b1097e9a7373896cb26 P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:33.793605 3629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d5b503929b24663a1f868ffaec34157. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.698201 3622 tablet_service.cc:1468] Processing CreateTablet for tablet 036dfe9e6b844fc6964b3b5e371f8c95 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20250625 03:31:33.796774 3622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 036dfe9e6b844fc6964b3b5e371f8c95. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.669396 3771 tablet_service.cc:1468] Processing CreateTablet for tablet 007d68495d594a73a5e2748f51e7c44c (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20250625 03:31:33.666075 3774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e59ae16ec1a4c69aac820531e504206. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.668694 3700 tablet_service.cc:1468] Processing CreateTablet for tablet 9d985eca3d6f497c86b94c53f16c8ae5 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20250625 03:31:33.801769 3700 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d985eca3d6f497c86b94c53f16c8ae5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.802685 3906 tablet_bootstrap.cc:654] T 7e92fd94b9f24b1097e9a7373896cb26 P 01873d289e0b4f9f9184b251369502a9: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:33.704399 3770 tablet_service.cc:1468] Processing CreateTablet for tablet 036dfe9e6b844fc6964b3b5e371f8c95 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20250625 03:31:33.707049 3705 tablet_service.cc:1468] Processing CreateTablet for tablet 5ece5f5b2a904c9cbef3065e210e9a30 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20250625 03:31:33.805333 3705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ece5f5b2a904c9cbef3065e210e9a30. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.792659 3845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 036dfe9e6b844fc6964b3b5e371f8c95. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.812315 3888 heartbeater.cc:499] Master 127.0.106.190:40959 was elected leader, sending a full tablet report...
I20250625 03:31:33.816469 3772 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d985eca3d6f497c86b94c53f16c8ae5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.818261 3770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 036dfe9e6b844fc6964b3b5e371f8c95. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.820065 3773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ece5f5b2a904c9cbef3065e210e9a30. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.823743 3776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d00ad2472fd74bfc9065d9dc4808e0c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.828449 3771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 007d68495d594a73a5e2748f51e7c44c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.829094 3775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6b45bf21adf457d9a920f57d758ba15. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.830818 3699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d00ad2472fd74bfc9065d9dc4808e0c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.831607 3704 tablet_service.cc:1468] Processing CreateTablet for tablet 03c46dae805341fdb9ec29725fa182a2 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20250625 03:31:33.832984 3704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03c46dae805341fdb9ec29725fa182a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.834102 3849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c4bb2d21b5242d387f6bc6ada60b4d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.839754 3777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7d3871088394a3ba7a6d18baae1feba. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.850097 3848 tablet_service.cc:1468] Processing CreateTablet for tablet 03c46dae805341fdb9ec29725fa182a2 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20250625 03:31:33.851517 3848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03c46dae805341fdb9ec29725fa182a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.860747 3701 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e638ce3a86d242fcadb10cdf57f5960d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.859576 3847 tablet_service.cc:1468] Processing CreateTablet for tablet 559ad5ac1bd14e8c8da7a2e7419cfcc6 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20250625 03:31:33.881074 3847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 559ad5ac1bd14e8c8da7a2e7419cfcc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.882828 3779 tablet_service.cc:1468] Processing CreateTablet for tablet 39da7c80318f4c408f8cdaf2229b0c96 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20250625 03:31:33.855654 3696 tablet_service.cc:1468] Processing CreateTablet for tablet caea215a97a344e88348ecb21035902d (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20250625 03:31:33.884276 3779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39da7c80318f4c408f8cdaf2229b0c96. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.885046 3696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet caea215a97a344e88348ecb21035902d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.892357 3853 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eeca5a85dddf4d1884917690e01ff81d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.893640 3911 raft_consensus.cc:491] T f3a33aa1d146468c986f0b1ba7d5fb84 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:33.894150 3911 raft_consensus.cc:513] T f3a33aa1d146468c986f0b1ba7d5fb84 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:33.896638 3911 leader_election.cc:290] T f3a33aa1d146468c986f0b1ba7d5fb84 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041), ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353)
I20250625 03:31:33.916752 3913 raft_consensus.cc:491] T 485f3e9350e245a9939133866b354302 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:33.895699 3844 tablet_service.cc:1468] Processing CreateTablet for tablet caea215a97a344e88348ecb21035902d (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20250625 03:31:33.897065 3846 tablet_service.cc:1468] Processing CreateTablet for tablet 4b38a4199d1d44988233b6d8604d1a96 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20250625 03:31:33.919977 3905 tablet_bootstrap.cc:654] T 06f309640df64f97a4065b1420fea692 P 841018313ad649679de64e006582f4c5: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:33.934700 3913 raft_consensus.cc:513] T 485f3e9350e245a9939133866b354302 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:33.970953 3913 leader_election.cc:290] T 485f3e9350e245a9939133866b354302 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:31:33.893652 3778 tablet_service.cc:1468] Processing CreateTablet for tablet 559ad5ac1bd14e8c8da7a2e7419cfcc6 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20250625 03:31:33.991065 3909 ts_tablet_manager.cc:1428] T a07d77259251401d957af853b296750a P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent starting tablet: real 0.250s user 0.024s sys 0.020s
I20250625 03:31:33.992298 3909 tablet_bootstrap.cc:492] T 7e92fd94b9f24b1097e9a7373896cb26 P 3d5b9823dfcd41cb92bd195c811cbf39: Bootstrap starting.
I20250625 03:31:33.999068 3914 raft_consensus.cc:491] T a07d77259251401d957af853b296750a P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:33.999617 3914 raft_consensus.cc:513] T a07d77259251401d957af853b296750a P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:33.987510 3910 tablet_bootstrap.cc:700] T 2e956665b7e4411f86cf77259093c8aa P ddc0ad67020f45edb3ba9c83cab687a4: Time spent opening tablet: real 0.116s user 0.000s sys 0.005s
I20250625 03:31:34.012837 3628 tablet_service.cc:1468] Processing CreateTablet for tablet 0cf94f40d3434a11b3bfec277069c8c5 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20250625 03:31:34.014603 3628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cf94f40d3434a11b3bfec277069c8c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.015168 3909 tablet_bootstrap.cc:654] T 7e92fd94b9f24b1097e9a7373896cb26 P 3d5b9823dfcd41cb92bd195c811cbf39: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:34.018891 3697 tablet_service.cc:1468] Processing CreateTablet for tablet 4b38a4199d1d44988233b6d8604d1a96 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20250625 03:31:34.020890 3697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b38a4199d1d44988233b6d8604d1a96. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.024504 3702 tablet_service.cc:1468] Processing CreateTablet for tablet 0cf94f40d3434a11b3bfec277069c8c5 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20250625 03:31:34.025835 3702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cf94f40d3434a11b3bfec277069c8c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.026325 3776 tablet_service.cc:1468] Processing CreateTablet for tablet caea215a97a344e88348ecb21035902d (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20250625 03:31:34.028311 3778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 559ad5ac1bd14e8c8da7a2e7419cfcc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.005142 3846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b38a4199d1d44988233b6d8604d1a96. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:33.971920 3627 tablet_service.cc:1468] Processing CreateTablet for tablet 559ad5ac1bd14e8c8da7a2e7419cfcc6 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20250625 03:31:34.039649 3910 tablet_bootstrap.cc:654] T 2e956665b7e4411f86cf77259093c8aa P ddc0ad67020f45edb3ba9c83cab687a4: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:34.066042 3776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet caea215a97a344e88348ecb21035902d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.085507 3844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet caea215a97a344e88348ecb21035902d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.085322 3906 tablet_bootstrap.cc:492] T 7e92fd94b9f24b1097e9a7373896cb26 P 01873d289e0b4f9f9184b251369502a9: No bootstrap required, opened a new log
I20250625 03:31:34.091738 3914 leader_election.cc:290] T a07d77259251401d957af853b296750a P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:31:34.108290 3627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 559ad5ac1bd14e8c8da7a2e7419cfcc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.057462 3703 tablet_service.cc:1468] Processing CreateTablet for tablet 6de9e445ad834b008a2f513fac78dba1 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20250625 03:31:34.122434 3705 tablet_service.cc:1468] Processing CreateTablet for tablet 6a179f065ae046df819a9bd88194dae6 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20250625 03:31:34.123839 3705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a179f065ae046df819a9bd88194dae6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.141359 3625 tablet_service.cc:1468] Processing CreateTablet for tablet 8ee7d6306b5146ed90a1b8392e062172 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20250625 03:31:34.142745 3625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ee7d6306b5146ed90a1b8392e062172. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.148793 3845 tablet_service.cc:1468] Processing CreateTablet for tablet 8ee7d6306b5146ed90a1b8392e062172 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20250625 03:31:34.148874 3779 tablet_service.cc:1468] Processing CreateTablet for tablet 28cf5da85c864698894ed4e1ee38cd86 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20250625 03:31:34.150261 3845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ee7d6306b5146ed90a1b8392e062172. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.150612 3779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28cf5da85c864698894ed4e1ee38cd86. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.152428 3771 tablet_service.cc:1468] Processing CreateTablet for tablet 6de9e445ad834b008a2f513fac78dba1 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20250625 03:31:34.152667 3774 tablet_service.cc:1468] Processing CreateTablet for tablet 6a179f065ae046df819a9bd88194dae6 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20250625 03:31:34.154345 3772 tablet_service.cc:1468] Processing CreateTablet for tablet 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20250625 03:31:34.156603 3852 tablet_service.cc:1468] Processing CreateTablet for tablet 28cf5da85c864698894ed4e1ee38cd86 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20250625 03:31:34.160079 3630 tablet_service.cc:1468] Processing CreateTablet for tablet 28cf5da85c864698894ed4e1ee38cd86 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20250625 03:31:34.161118 3777 tablet_service.cc:1468] Processing CreateTablet for tablet e91e209dcfdb4fd0bebe666bbbe16b75 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20250625 03:31:34.115568 3906 ts_tablet_manager.cc:1397] T 7e92fd94b9f24b1097e9a7373896cb26 P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.323s user 0.017s sys 0.001s
I20250625 03:31:34.163395 3623 tablet_service.cc:1468] Processing CreateTablet for tablet 4b38a4199d1d44988233b6d8604d1a96 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20250625 03:31:34.155594 3629 tablet_service.cc:1468] Processing CreateTablet for tablet c5a9463f96314a83b7955d80444b1c29 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20250625 03:31:34.182806 3773 tablet_service.cc:1468] Processing CreateTablet for tablet 0cf94f40d3434a11b3bfec277069c8c5 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20250625 03:31:34.197059 3703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6de9e445ad834b008a2f513fac78dba1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.205462 3624 tablet_service.cc:1468] Processing CreateTablet for tablet 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20250625 03:31:34.205533 3623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b38a4199d1d44988233b6d8604d1a96. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.211689 3700 tablet_service.cc:1468] Processing CreateTablet for tablet c5a9463f96314a83b7955d80444b1c29 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20250625 03:31:34.208177 3622 tablet_service.cc:1468] Processing CreateTablet for tablet 5350a260b3364354b73176e6bdd77940 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20250625 03:31:34.273217 3848 tablet_service.cc:1468] Processing CreateTablet for tablet 5350a260b3364354b73176e6bdd77940 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20250625 03:31:34.274237 3622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5350a260b3364354b73176e6bdd77940. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.215188 3851 tablet_service.cc:1468] Processing CreateTablet for tablet 6de9e445ad834b008a2f513fac78dba1 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20250625 03:31:34.216325 3621 tablet_service.cc:1468] Processing CreateTablet for tablet 6a179f065ae046df819a9bd88194dae6 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20250625 03:31:34.278748 3621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a179f065ae046df819a9bd88194dae6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.217133 3852 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28cf5da85c864698894ed4e1ee38cd86. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.217223 3849 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49468 (request call id 13) took 1075 ms. Trace:
I20250625 03:31:34.220136 3771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6de9e445ad834b008a2f513fac78dba1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.281824 3849 rpcz_store.cc:276] 0625 03:31:33.141883 (+ 0us) service_pool.cc:168] Inserting onto call queue
0625 03:31:33.505304 (+363421us) service_pool.cc:225] Handling call
0625 03:31:33.643070 (+137766us) spinlock_profiling.cc:243] Waited 2.41 ms on lock 0x7b5800560498. stack: 00007f54a3b1a493 00007f54a3b1a390 00007f54a3473574 00007f54acf675a4 00007f54acf67539 00007f54a398f971 00007f54a3b0eec1 00007f54a3b0f4f2 00007f54ac8247e9 00007f54ab987968 00007f54aba482c0 00007f54ab9f8c99 00007f54a4fb5d34 00007f54a4fb5cc2 00007f54a4fb5bf1 00007f54a4fb5b6c
0625 03:31:33.643136 (+ 66us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0625 03:31:33.643247 (+ 111us) ts_tablet_manager.cc:676] Creating new metadata...
0625 03:31:34.000570 (+357323us) tablet_metadata.cc:641] Metadata flushed
0625 03:31:34.216667 (+216097us) tablet_replica.cc:206] Creating consensus instance
0625 03:31:34.217149 (+ 482us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5541632}
I20250625 03:31:34.224820 3696 tablet_service.cc:1468] Processing CreateTablet for tablet 8ee7d6306b5146ed90a1b8392e062172 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20250625 03:31:34.225142 3715 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f3a33aa1d146468c986f0b1ba7d5fb84" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" is_pre_election: true
I20250625 03:31:34.284417 3849 tablet_service.cc:1468] Processing CreateTablet for tablet ea706d649de940bf8652264ed57a901f (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20250625 03:31:34.285771 3849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea706d649de940bf8652264ed57a901f. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 03:31:34.285818 3605 leader_election.cc:343] T f3a33aa1d146468c986f0b1ba7d5fb84 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:34.225049 3640 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "485f3e9350e245a9939133866b354302" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
W20250625 03:31:34.287989 3754 leader_election.cc:343] T 485f3e9350e245a9939133866b354302 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:34.283839 3696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ee7d6306b5146ed90a1b8392e062172. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.226287 3906 raft_consensus.cc:357] T 7e92fd94b9f24b1097e9a7373896cb26 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:34.163347 3775 tablet_service.cc:1468] Processing CreateTablet for tablet c5a9463f96314a83b7955d80444b1c29 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20250625 03:31:34.236490 3779 tablet_service.cc:1468] Processing CreateTablet for tablet ea706d649de940bf8652264ed57a901f (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20250625 03:31:34.293929 3775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5a9463f96314a83b7955d80444b1c29. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.242213 3910 tablet_bootstrap.cc:492] T 2e956665b7e4411f86cf77259093c8aa P ddc0ad67020f45edb3ba9c83cab687a4: No bootstrap required, opened a new log
I20250625 03:31:34.254792 3770 tablet_service.cc:1468] Processing CreateTablet for tablet 41d33fbc861a40338ae6da1732fb696b (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20250625 03:31:34.254935 3698 tablet_service.cc:1468] Processing CreateTablet for tablet e91e209dcfdb4fd0bebe666bbbe16b75 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20250625 03:31:34.295905 3863 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a07d77259251401d957af853b296750a" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:34.296665 3698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e91e209dcfdb4fd0bebe666bbbe16b75. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.298992 3863 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f3a33aa1d146468c986f0b1ba7d5fb84" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:34.255836 3704 tablet_service.cc:1468] Processing CreateTablet for tablet 5350a260b3364354b73176e6bdd77940 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20250625 03:31:34.300088 3906 raft_consensus.cc:383] T 7e92fd94b9f24b1097e9a7373896cb26 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:34.300513 3906 raft_consensus.cc:738] T 7e92fd94b9f24b1097e9a7373896cb26 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
W20250625 03:31:34.300727 3679 leader_election.cc:343] T a07d77259251401d957af853b296750a P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:34.301402 3910 ts_tablet_manager.cc:1397] T 2e956665b7e4411f86cf77259093c8aa P ddc0ad67020f45edb3ba9c83cab687a4: Time spent bootstrapping tablet: real 0.739s user 0.017s sys 0.027s
I20250625 03:31:34.301220 3906 consensus_queue.cc:260] T 7e92fd94b9f24b1097e9a7373896cb26 P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:34.258525 3847 tablet_service.cc:1468] Processing CreateTablet for tablet e91e209dcfdb4fd0bebe666bbbe16b75 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20250625 03:31:34.302850 3847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e91e209dcfdb4fd0bebe666bbbe16b75. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.266647 3778 tablet_service.cc:1468] Processing CreateTablet for tablet db241b7e8b2a45f297e0bbd9ba86cdd8 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20250625 03:31:34.300961 3704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5350a260b3364354b73176e6bdd77940. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.258555 3701 tablet_service.cc:1468] Processing CreateTablet for tablet 41d33fbc861a40338ae6da1732fb696b (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20250625 03:31:34.305899 3701 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41d33fbc861a40338ae6da1732fb696b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.305706 3697 tablet_service.cc:1468] Processing CreateTablet for tablet db241b7e8b2a45f297e0bbd9ba86cdd8 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20250625 03:31:34.307086 3697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db241b7e8b2a45f297e0bbd9ba86cdd8. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 03:31:34.308360 3604 leader_election.cc:343] T f3a33aa1d146468c986f0b1ba7d5fb84 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:34.308871 3604 leader_election.cc:304] T f3a33aa1d146468c986f0b1ba7d5fb84 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9; no voters: 3d5b9823dfcd41cb92bd195c811cbf39, ddc0ad67020f45edb3ba9c83cab687a4
I20250625 03:31:34.310324 3911 raft_consensus.cc:2747] T f3a33aa1d146468c986f0b1ba7d5fb84 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:31:34.310257 3699 tablet_service.cc:1468] Processing CreateTablet for tablet 049948eeceeb43c98ccda9e839b521a8 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20250625 03:31:34.311837 3699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 049948eeceeb43c98ccda9e839b521a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.345438 3850 tablet_service.cc:1468] Processing CreateTablet for tablet 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20250625 03:31:34.346896 3850 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ae65ab4d0d2480cb3e4d2d0dd5f5c14. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.348448 3629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5a9463f96314a83b7955d80444b1c29. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.351433 3845 tablet_service.cc:1468] Processing CreateTablet for tablet 41d33fbc861a40338ae6da1732fb696b (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20250625 03:31:34.352535 3625 tablet_service.cc:1468] Processing CreateTablet for tablet db241b7e8b2a45f297e0bbd9ba86cdd8 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20250625 03:31:34.353215 3845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41d33fbc861a40338ae6da1732fb696b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.353840 3625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db241b7e8b2a45f297e0bbd9ba86cdd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.356334 3630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28cf5da85c864698894ed4e1ee38cd86. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.356531 3705 tablet_service.cc:1468] Processing CreateTablet for tablet 162ddcc09f594ed7bcb752f842b6c97c (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20250625 03:31:34.357811 3705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 162ddcc09f594ed7bcb752f842b6c97c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.358824 3846 tablet_service.cc:1468] Processing CreateTablet for tablet 39880aedaeca464f81d899dc222a35b9 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20250625 03:31:34.361119 3776 tablet_service.cc:1468] Processing CreateTablet for tablet 162ddcc09f594ed7bcb752f842b6c97c (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20250625 03:31:34.312077 3628 tablet_service.cc:1468] Processing CreateTablet for tablet ea706d649de940bf8652264ed57a901f (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20250625 03:31:34.312723 3910 raft_consensus.cc:357] T 2e956665b7e4411f86cf77259093c8aa P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:34.313630 3905 tablet_bootstrap.cc:492] T 06f309640df64f97a4065b1420fea692 P 841018313ad649679de64e006582f4c5: No bootstrap required, opened a new log
I20250625 03:31:34.372264 3910 raft_consensus.cc:383] T 2e956665b7e4411f86cf77259093c8aa P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:34.372556 3905 ts_tablet_manager.cc:1397] T 06f309640df64f97a4065b1420fea692 P 841018313ad649679de64e006582f4c5: Time spent bootstrapping tablet: real 0.628s user 0.023s sys 0.009s
I20250625 03:31:34.372797 3910 raft_consensus.cc:738] T 2e956665b7e4411f86cf77259093c8aa P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Initialized, Role: FOLLOWER
I20250625 03:31:34.373921 3910 consensus_queue.cc:260] T 2e956665b7e4411f86cf77259093c8aa P ddc0ad67020f45edb3ba9c83cab687a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:34.376509 3700 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5a9463f96314a83b7955d80444b1c29. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.375754 3905 raft_consensus.cc:357] T 06f309640df64f97a4065b1420fea692 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:34.377089 3905 raft_consensus.cc:383] T 06f309640df64f97a4065b1420fea692 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:34.377496 3905 raft_consensus.cc:738] T 06f309640df64f97a4065b1420fea692 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841018313ad649679de64e006582f4c5, State: Initialized, Role: FOLLOWER
I20250625 03:31:34.378453 3905 consensus_queue.cc:260] T 06f309640df64f97a4065b1420fea692 P 841018313ad649679de64e006582f4c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
W20250625 03:31:34.388520 3523 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.106.132:37353, user_credentials={real_user=slave}} blocked reactor thread for 162014us
I20250625 03:31:34.396212 3846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39880aedaeca464f81d899dc222a35b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.397106 3851 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6de9e445ad834b008a2f513fac78dba1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.398603 3913 raft_consensus.cc:491] T 06f309640df64f97a4065b1420fea692 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:34.399114 3913 raft_consensus.cc:513] T 06f309640df64f97a4065b1420fea692 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:34.400413 3848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5350a260b3364354b73176e6bdd77940. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.318349 3853 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49468 (request call id 17) took 1055 ms. Trace:
I20250625 03:31:34.318630 3906 ts_tablet_manager.cc:1428] T 7e92fd94b9f24b1097e9a7373896cb26 P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.133s user 0.007s sys 0.001s
I20250625 03:31:34.319934 3863 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "485f3e9350e245a9939133866b354302" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:34.335928 3640 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a07d77259251401d957af853b296750a" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
W20250625 03:31:34.336762 3585 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20250625 03:31:34.337724 3775 tablet_service.cc:1468] Processing CreateTablet for tablet 39880aedaeca464f81d899dc222a35b9 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20250625 03:31:34.364385 3779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea706d649de940bf8652264ed57a901f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.364970 3624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ae65ab4d0d2480cb3e4d2d0dd5f5c14. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.355561 3844 tablet_service.cc:1468] Processing CreateTablet for tablet 049948eeceeb43c98ccda9e839b521a8 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20250625 03:31:34.421772 3913 leader_election.cc:290] T 06f309640df64f97a4065b1420fea692 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
W20250625 03:31:34.421851 3680 leader_election.cc:343] T a07d77259251401d957af853b296750a P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:34.423038 3680 leader_election.cc:304] T a07d77259251401d957af853b296750a P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39; no voters: 01873d289e0b4f9f9184b251369502a9, ddc0ad67020f45edb3ba9c83cab687a4
I20250625 03:31:34.424341 3914 raft_consensus.cc:2747] T a07d77259251401d957af853b296750a P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:31:34.425598 3906 tablet_bootstrap.cc:492] T 7a8ecc65ca1140beb905dd6368bfaa2a P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:34.432744 3627 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:42640 (request call id 26) took 1063 ms. Trace:
I20250625 03:31:34.434458 3640 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "06f309640df64f97a4065b1420fea692" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:34.434396 3627 rpcz_store.cc:276] 0625 03:31:33.369644 (+ 0us) service_pool.cc:168] Inserting onto call queue
0625 03:31:33.970949 (+601305us) service_pool.cc:225] Handling call
0625 03:31:34.076575 (+105626us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0625 03:31:34.085549 (+ 8974us) ts_tablet_manager.cc:676] Creating new metadata...
0625 03:31:34.239388 (+153839us) tablet_metadata.cc:641] Metadata flushed
0625 03:31:34.432200 (+192812us) tablet_replica.cc:206] Creating consensus instance
0625 03:31:34.432681 (+ 481us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20250625 03:31:34.436614 3754 leader_election.cc:343] T 06f309640df64f97a4065b1420fea692 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
W20250625 03:31:34.436604 3753 leader_election.cc:343] T 485f3e9350e245a9939133866b354302 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:34.436940 3628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea706d649de940bf8652264ed57a901f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.437250 3753 leader_election.cc:304] T 485f3e9350e245a9939133866b354302 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841018313ad649679de64e006582f4c5; no voters: 01873d289e0b4f9f9184b251369502a9, ddc0ad67020f45edb3ba9c83cab687a4
I20250625 03:31:34.437784 3844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 049948eeceeb43c98ccda9e839b521a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.438272 3905 ts_tablet_manager.cc:1428] T 06f309640df64f97a4065b1420fea692 P 841018313ad649679de64e006582f4c5: Time spent starting tablet: real 0.065s user 0.007s sys 0.001s
I20250625 03:31:34.438417 3913 raft_consensus.cc:2747] T 485f3e9350e245a9939133866b354302 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:31:34.439361 3905 tablet_bootstrap.cc:492] T b74d9f11c2bc4a7bb6431d6222d45175 P 841018313ad649679de64e006582f4c5: Bootstrap starting.
I20250625 03:31:34.439862 3698 tablet_service.cc:1468] Processing CreateTablet for tablet d657bcfa8eea4e7db43d4d2715857516 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20250625 03:31:34.441213 3698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d657bcfa8eea4e7db43d4d2715857516. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.442572 3852 tablet_service.cc:1468] Processing CreateTablet for tablet 162ddcc09f594ed7bcb752f842b6c97c (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20250625 03:31:34.444857 3626 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:42640 (request call id 25) took 1082 ms. Trace:
I20250625 03:31:34.446120 3626 rpcz_store.cc:276] 0625 03:31:33.362875 (+ 0us) service_pool.cc:168] Inserting onto call queue
0625 03:31:33.772795 (+409920us) service_pool.cc:225] Handling call
0625 03:31:33.776883 (+ 4088us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0625 03:31:33.776983 (+ 100us) ts_tablet_manager.cc:676] Creating new metadata...
0625 03:31:34.233587 (+456604us) tablet_metadata.cc:641] Metadata flushed
0625 03:31:34.444310 (+210723us) tablet_replica.cc:206] Creating consensus instance
0625 03:31:34.444795 (+ 485us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250625 03:31:34.450069 3906 tablet_bootstrap.cc:654] T 7a8ecc65ca1140beb905dd6368bfaa2a P 01873d289e0b4f9f9184b251369502a9: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:34.465240 3626 tablet_service.cc:1468] Processing CreateTablet for tablet 39880aedaeca464f81d899dc222a35b9 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20250625 03:31:34.466799 3626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39880aedaeca464f81d899dc222a35b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.473125 3621 tablet_service.cc:1468] Processing CreateTablet for tablet d657bcfa8eea4e7db43d4d2715857516 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20250625 03:31:34.474602 3621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d657bcfa8eea4e7db43d4d2715857516. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.477190 3627 tablet_service.cc:1468] Processing CreateTablet for tablet d83c6c79a784452289ba414976adb9e0 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20250625 03:31:34.478631 3627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d83c6c79a784452289ba414976adb9e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.481767 3909 tablet_bootstrap.cc:492] T 7e92fd94b9f24b1097e9a7373896cb26 P 3d5b9823dfcd41cb92bd195c811cbf39: No bootstrap required, opened a new log
I20250625 03:31:34.482380 3909 ts_tablet_manager.cc:1397] T 7e92fd94b9f24b1097e9a7373896cb26 P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent bootstrapping tablet: real 0.490s user 0.024s sys 0.089s
I20250625 03:31:34.405625 3853 rpcz_store.cc:276] 0625 03:31:33.263382 (+ 0us) service_pool.cc:168] Inserting onto call queue
0625 03:31:33.570420 (+307038us) service_pool.cc:225] Handling call
0625 03:31:33.619682 (+ 49262us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0625 03:31:33.624065 (+ 4383us) ts_tablet_manager.cc:676] Creating new metadata...
0625 03:31:34.220957 (+596892us) tablet_metadata.cc:641] Metadata flushed
0625 03:31:34.317824 (+ 96867us) tablet_replica.cc:206] Creating consensus instance
0625 03:31:34.318283 (+ 459us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250625 03:31:34.485906 3853 tablet_service.cc:1468] Processing CreateTablet for tablet d83c6c79a784452289ba414976adb9e0 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20250625 03:31:34.450816 3622 tablet_service.cc:1468] Processing CreateTablet for tablet 049948eeceeb43c98ccda9e839b521a8 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20250625 03:31:34.443862 3852 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 162ddcc09f594ed7bcb752f842b6c97c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.422663 3773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cf94f40d3434a11b3bfec277069c8c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.454949 3715 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "06f309640df64f97a4065b1420fea692" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" is_pre_election: true
I20250625 03:31:34.497613 3772 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ae65ab4d0d2480cb3e4d2d0dd5f5c14. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.500329 3775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39880aedaeca464f81d899dc222a35b9. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 03:31:34.500973 3754 leader_election.cc:343] T 06f309640df64f97a4065b1420fea692 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:34.501529 3754 leader_election.cc:304] T 06f309640df64f97a4065b1420fea692 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841018313ad649679de64e006582f4c5; no voters: 01873d289e0b4f9f9184b251369502a9, 3d5b9823dfcd41cb92bd195c811cbf39
I20250625 03:31:34.502369 3913 raft_consensus.cc:2747] T 06f309640df64f97a4065b1420fea692 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:31:34.502980 3770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41d33fbc861a40338ae6da1732fb696b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.505127 3702 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:33754 (request call id 27) took 1079 ms. Trace:
I20250625 03:31:34.505561 3702 rpcz_store.cc:276] 0625 03:31:33.425885 (+ 0us) service_pool.cc:168] Inserting onto call queue
0625 03:31:33.908341 (+482456us) service_pool.cc:225] Handling call
0625 03:31:34.025364 (+117023us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0625 03:31:34.025466 (+ 102us) ts_tablet_manager.cc:676] Creating new metadata...
0625 03:31:34.253501 (+228035us) tablet_metadata.cc:641] Metadata flushed
0625 03:31:34.504587 (+251086us) tablet_replica.cc:206] Creating consensus instance
0625 03:31:34.505068 (+ 481us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250625 03:31:34.510095 3910 ts_tablet_manager.cc:1428] T 2e956665b7e4411f86cf77259093c8aa P ddc0ad67020f45edb3ba9c83cab687a4: Time spent starting tablet: real 0.208s user 0.015s sys 0.000s
I20250625 03:31:34.512358 3776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 162ddcc09f594ed7bcb752f842b6c97c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.515287 3623 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:42640 (request call id 28) took 1085 ms. Trace:
I20250625 03:31:34.516055 3777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e91e209dcfdb4fd0bebe666bbbe16b75. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.517053 3909 raft_consensus.cc:357] T 7e92fd94b9f24b1097e9a7373896cb26 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:34.517838 3909 raft_consensus.cc:383] T 7e92fd94b9f24b1097e9a7373896cb26 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:34.518141 3909 raft_consensus.cc:738] T 7e92fd94b9f24b1097e9a7373896cb26 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Initialized, Role: FOLLOWER
I20250625 03:31:34.518961 3909 consensus_queue.cc:260] T 7e92fd94b9f24b1097e9a7373896cb26 P 3d5b9823dfcd41cb92bd195c811cbf39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:34.520470 3622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 049948eeceeb43c98ccda9e839b521a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.507534 3771 tablet_service.cc:1468] Processing CreateTablet for tablet d657bcfa8eea4e7db43d4d2715857516 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20250625 03:31:34.525027 3778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db241b7e8b2a45f297e0bbd9ba86cdd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.525378 3853 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d83c6c79a784452289ba414976adb9e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.548346 3771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d657bcfa8eea4e7db43d4d2715857516. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.551002 3774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a179f065ae046df819a9bd88194dae6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.508306 3702 tablet_service.cc:1468] Processing CreateTablet for tablet d83c6c79a784452289ba414976adb9e0 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20250625 03:31:34.537117 3630 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:42640 (request call id 29) took 1056 ms. Trace:
I20250625 03:31:34.557439 3630 rpcz_store.cc:276] 0625 03:31:33.480702 (+ 0us) service_pool.cc:168] Inserting onto call queue
0625 03:31:34.091346 (+610644us) service_pool.cc:225] Handling call
0625 03:31:34.255983 (+164637us) spinlock_profiling.cc:243] Waited 885 us on lock 0x7b5800004298. stack: 00007f54a3b1a493 00007f54a3b1a390 00007f54a3473574 00007f54acf675a4 00007f54acf67539 00007f54a398f971 00007f54a3b0eec1 00007f54a3b0f4f2 00007f54ac8247e9 00007f54ab987968 00007f54aba482c0 00007f54ab9f8c99 00007f54a4fb5d34 00007f54a4fb5cc2 00007f54a4fb5bf1 00007f54a4fb5b6c
0625 03:31:34.256070 (+ 87us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0625 03:31:34.256164 (+ 94us) ts_tablet_manager.cc:676] Creating new metadata...
0625 03:31:34.440841 (+184677us) tablet_metadata.cc:641] Metadata flushed
0625 03:31:34.536449 (+ 95608us) tablet_replica.cc:206] Creating consensus instance
0625 03:31:34.537042 (+ 593us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2034560}
I20250625 03:31:34.559939 3630 tablet_service.cc:1468] Processing CreateTablet for tablet aa64717b3f7d4af893e9908260f4520e (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20250625 03:31:34.561381 3630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa64717b3f7d4af893e9908260f4520e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.568611 3905 tablet_bootstrap.cc:654] T b74d9f11c2bc4a7bb6431d6222d45175 P 841018313ad649679de64e006582f4c5: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:34.570492 3701 tablet_service.cc:1468] Processing CreateTablet for tablet 6afeedd3b768470f921526d58704c21d (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20250625 03:31:34.568647 3702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d83c6c79a784452289ba414976adb9e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.573632 3703 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:33754 (request call id 29) took 1068 ms. Trace:
I20250625 03:31:34.574072 3703 rpcz_store.cc:276] 0625 03:31:33.505395 (+ 0us) service_pool.cc:168] Inserting onto call queue
0625 03:31:34.056351 (+550956us) service_pool.cc:225] Handling call
0625 03:31:34.175920 (+119569us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0625 03:31:34.178995 (+ 3075us) ts_tablet_manager.cc:676] Creating new metadata...
0625 03:31:34.344604 (+165609us) tablet_metadata.cc:641] Metadata flushed
0625 03:31:34.573117 (+228513us) tablet_replica.cc:206] Creating consensus instance
0625 03:31:34.573571 (+ 454us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250625 03:31:34.536737 3910 tablet_bootstrap.cc:492] T c592f2c5305141c487b73e0867d0f36b P ddc0ad67020f45edb3ba9c83cab687a4: Bootstrap starting.
I20250625 03:31:34.539489 3705 tablet_service.cc:1468] Processing CreateTablet for tablet 7257f8e1d9b24e3a9650c5838fe1a8c5 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20250625 03:31:34.582693 3845 tablet_service.cc:1468] Processing CreateTablet for tablet b6311a11ae9e44bea3a7340b8134679b (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20250625 03:31:34.515705 3623 rpcz_store.cc:276] 0625 03:31:33.429458 (+ 0us) service_pool.cc:168] Inserting onto call queue
0625 03:31:34.162301 (+732843us) service_pool.cc:225] Handling call
0625 03:31:34.192959 (+ 30658us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0625 03:31:34.200241 (+ 7282us) ts_tablet_manager.cc:676] Creating new metadata...
0625 03:31:34.322801 (+122560us) tablet_metadata.cc:641] Metadata flushed
0625 03:31:34.514790 (+191989us) tablet_replica.cc:206] Creating consensus instance
0625 03:31:34.515228 (+ 438us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250625 03:31:34.585318 3623 tablet_service.cc:1468] Processing CreateTablet for tablet 6afeedd3b768470f921526d58704c21d (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20250625 03:31:34.586675 3623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6afeedd3b768470f921526d58704c21d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.544410 3697 tablet_service.cc:1468] Processing CreateTablet for tablet aa64717b3f7d4af893e9908260f4520e (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20250625 03:31:34.593163 3849 tablet_service.cc:1468] Processing CreateTablet for tablet 7257f8e1d9b24e3a9650c5838fe1a8c5 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20250625 03:31:34.601167 3852 tablet_service.cc:1468] Processing CreateTablet for tablet 6afeedd3b768470f921526d58704c21d (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20250625 03:31:34.609265 3909 ts_tablet_manager.cc:1428] T 7e92fd94b9f24b1097e9a7373896cb26 P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent starting tablet: real 0.127s user 0.004s sys 0.004s
I20250625 03:31:34.603809 3773 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36426 (request call id 27) took 1176 ms. Trace:
I20250625 03:31:34.609280 3701 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6afeedd3b768470f921526d58704c21d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.628429 3773 rpcz_store.cc:276] 0625 03:31:33.427669 (+ 0us) service_pool.cc:168] Inserting onto call queue
0625 03:31:34.090458 (+662789us) service_pool.cc:225] Handling call
0625 03:31:34.212108 (+121650us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0625 03:31:34.212225 (+ 117us) ts_tablet_manager.cc:676] Creating new metadata...
0625 03:31:34.539300 (+327075us) tablet_metadata.cc:641] Metadata flushed
0625 03:31:34.603288 (+ 63988us) tablet_replica.cc:206] Creating consensus instance
0625 03:31:34.603748 (+ 460us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250625 03:31:34.529258 3629 tablet_service.cc:1468] Processing CreateTablet for tablet b6311a11ae9e44bea3a7340b8134679b (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20250625 03:31:34.649654 3629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6311a11ae9e44bea3a7340b8134679b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.655351 3850 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49468 (request call id 31) took 1059 ms. Trace:
I20250625 03:31:34.616397 3845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6311a11ae9e44bea3a7340b8134679b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.634631 3697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa64717b3f7d4af893e9908260f4520e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.610612 3909 tablet_bootstrap.cc:492] T 7a8ecc65ca1140beb905dd6368bfaa2a P 3d5b9823dfcd41cb92bd195c811cbf39: Bootstrap starting.
I20250625 03:31:34.663880 3705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7257f8e1d9b24e3a9650c5838fe1a8c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.670423 3849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7257f8e1d9b24e3a9650c5838fe1a8c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.673496 3775 tablet_service.cc:1468] Processing CreateTablet for tablet b6311a11ae9e44bea3a7340b8134679b (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20250625 03:31:34.675307 3775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6311a11ae9e44bea3a7340b8134679b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.676823 3906 tablet_bootstrap.cc:492] T 7a8ecc65ca1140beb905dd6368bfaa2a P 01873d289e0b4f9f9184b251369502a9: No bootstrap required, opened a new log
I20250625 03:31:34.677356 3906 ts_tablet_manager.cc:1397] T 7a8ecc65ca1140beb905dd6368bfaa2a P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.252s user 0.012s sys 0.006s
I20250625 03:31:34.686030 3773 tablet_service.cc:1468] Processing CreateTablet for tablet aa64717b3f7d4af893e9908260f4520e (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20250625 03:31:34.703128 3910 tablet_bootstrap.cc:654] T c592f2c5305141c487b73e0867d0f36b P ddc0ad67020f45edb3ba9c83cab687a4: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:34.704118 3852 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6afeedd3b768470f921526d58704c21d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.708391 3773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa64717b3f7d4af893e9908260f4520e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.712424 3847 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49468 (request call id 32) took 1095 ms. Trace:
I20250625 03:31:34.655861 3850 rpcz_store.cc:276] 0625 03:31:33.597591 (+ 0us) service_pool.cc:168] Inserting onto call queue
0625 03:31:34.250099 (+652508us) service_pool.cc:225] Handling call
0625 03:31:34.346404 (+ 96305us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0625 03:31:34.346510 (+ 106us) ts_tablet_manager.cc:676] Creating new metadata...
0625 03:31:34.519035 (+172525us) tablet_metadata.cc:641] Metadata flushed
0625 03:31:34.654813 (+135778us) tablet_replica.cc:206] Creating consensus instance
0625 03:31:34.655282 (+ 469us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250625 03:31:34.730705 3911 raft_consensus.cc:491] T 7e92fd94b9f24b1097e9a7373896cb26 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:34.641085 3846 tablet_service.cc:1468] Processing CreateTablet for tablet 7c1dda599f144ecfab4c075ee4e28c16 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20250625 03:31:34.712919 3847 rpcz_store.cc:276] 0625 03:31:33.621725 (+ 0us) service_pool.cc:168] Inserting onto call queue
0625 03:31:34.257666 (+635941us) service_pool.cc:225] Handling call
0625 03:31:34.302383 (+ 44717us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0625 03:31:34.302478 (+ 95us) ts_tablet_manager.cc:676] Creating new metadata...
0625 03:31:34.489489 (+187011us) tablet_metadata.cc:641] Metadata flushed
0625 03:31:34.668879 (+179390us) tablet_replica.cc:206] Creating consensus instance
0625 03:31:34.712351 (+ 43472us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250625 03:31:34.737375 3909 tablet_bootstrap.cc:654] T 7a8ecc65ca1140beb905dd6368bfaa2a P 3d5b9823dfcd41cb92bd195c811cbf39: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:34.789361 3905 tablet_bootstrap.cc:492] T b74d9f11c2bc4a7bb6431d6222d45175 P 841018313ad649679de64e006582f4c5: No bootstrap required, opened a new log
I20250625 03:31:34.789996 3905 ts_tablet_manager.cc:1397] T b74d9f11c2bc4a7bb6431d6222d45175 P 841018313ad649679de64e006582f4c5: Time spent bootstrapping tablet: real 0.351s user 0.014s sys 0.018s
I20250625 03:31:34.792979 3905 raft_consensus.cc:357] T b74d9f11c2bc4a7bb6431d6222d45175 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:34.795929 3932 raft_consensus.cc:491] T 2e956665b7e4411f86cf77259093c8aa P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:34.798902 3905 raft_consensus.cc:383] T b74d9f11c2bc4a7bb6431d6222d45175 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:34.799338 3905 raft_consensus.cc:738] T b74d9f11c2bc4a7bb6431d6222d45175 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841018313ad649679de64e006582f4c5, State: Initialized, Role: FOLLOWER
I20250625 03:31:34.799041 3932 raft_consensus.cc:513] T 2e956665b7e4411f86cf77259093c8aa P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:34.791839 3778 tablet_service.cc:1468] Processing CreateTablet for tablet 7c1dda599f144ecfab4c075ee4e28c16 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20250625 03:31:34.803807 3905 consensus_queue.cc:260] T b74d9f11c2bc4a7bb6431d6222d45175 P 841018313ad649679de64e006582f4c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:34.805217 3778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c1dda599f144ecfab4c075ee4e28c16. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.801039 3774 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36426 (request call id 30) took 1228 ms. Trace:
I20250625 03:31:34.805660 3774 rpcz_store.cc:276] 0625 03:31:33.572597 (+ 0us) service_pool.cc:168] Inserting onto call queue
0625 03:31:34.151788 (+579191us) service_pool.cc:225] Handling call
0625 03:31:34.252805 (+101017us) spinlock_profiling.cc:243] Waited 4.44 ms on lock 0x7b5800105998. stack: 00007f54a3b1a493 00007f54a3b1a390 00007f54a3473574 00007f54acf675a4 00007f54acf67539 00007f54a398f971 00007f54a3b0eec1 00007f54a3b0ed72 00007f54ac7fc8f9 00007f54ab987ac0 00007f54aba6ae71 00007f54aba48203 00007f54ab9f8c99 00007f54a4fb5d34 00007f54a4fb5cc2 00007f54a4fb5bf1
0625 03:31:34.252964 (+ 159us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0625 03:31:34.253074 (+ 110us) ts_tablet_manager.cc:676] Creating new metadata...
0625 03:31:34.635434 (+382360us) tablet_metadata.cc:641] Metadata flushed
0625 03:31:34.800661 (+165227us) tablet_replica.cc:206] Creating consensus instance
0625 03:31:34.800995 (+ 334us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":10201472}
I20250625 03:31:34.805137 3932 leader_election.cc:290] T 2e956665b7e4411f86cf77259093c8aa P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041), 841018313ad649679de64e006582f4c5 (127.0.106.131:39467)
I20250625 03:31:34.798130 3772 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36426 (request call id 31) took 1196 ms. Trace:
I20250625 03:31:34.807168 3772 rpcz_store.cc:276] 0625 03:31:33.602284 (+ 0us) service_pool.cc:168] Inserting onto call queue
0625 03:31:34.153459 (+551175us) service_pool.cc:225] Handling call
0625 03:31:34.253670 (+100211us) spinlock_profiling.cc:243] Waited 3.72 ms on lock 0x7b5800105998. stack: 00007f54a3b1a493 00007f54a3b1a390 00007f54a3473574 00007f54acf675a4 00007f54acf67539 00007f54a398f971 00007f54a3b0eec1 00007f54a3b0ed72 00007f54ac7fc8f9 00007f54ab987ac0 00007f54aba6ae71 00007f54aba48203 00007f54ab9f8c99 00007f54a4fb5d34 00007f54a4fb5cc2 00007f54a4fb5bf1
0625 03:31:34.253787 (+ 117us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0625 03:31:34.253878 (+ 91us) ts_tablet_manager.cc:676] Creating new metadata...
0625 03:31:34.602690 (+348812us) tablet_metadata.cc:641] Metadata flushed
0625 03:31:34.797608 (+194918us) tablet_replica.cc:206] Creating consensus instance
0625 03:31:34.798072 (+ 464us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":8550656}
I20250625 03:31:34.809484 3846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c1dda599f144ecfab4c075ee4e28c16. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.817094 3779 tablet_service.cc:1468] Processing CreateTablet for tablet 7257f8e1d9b24e3a9650c5838fe1a8c5 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20250625 03:31:34.731287 3911 raft_consensus.cc:513] T 7e92fd94b9f24b1097e9a7373896cb26 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:34.818953 3779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7257f8e1d9b24e3a9650c5838fe1a8c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.780396 3624 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:42640 (request call id 32) took 1169 ms. Trace:
I20250625 03:31:34.731175 3851 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49468 (request call id 29) took 1194 ms. Trace:
I20250625 03:31:34.819730 3624 rpcz_store.cc:276] 0625 03:31:33.613048 (+ 0us) service_pool.cc:168] Inserting onto call queue
0625 03:31:34.147782 (+534734us) service_pool.cc:225] Handling call
0625 03:31:34.272430 (+124648us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0625 03:31:34.272546 (+ 116us) ts_tablet_manager.cc:676] Creating new metadata...
0625 03:31:34.488077 (+215531us) tablet_metadata.cc:641] Metadata flushed
0625 03:31:34.705947 (+217870us) tablet_replica.cc:206] Creating consensus instance
0625 03:31:34.779723 (+ 73776us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250625 03:31:34.832155 3628 tablet_service.cc:1468] Processing CreateTablet for tablet 7c1dda599f144ecfab4c075ee4e28c16 (DEFAULT_TABLE table=test-workload [id=2bbac7c5e18b43ceb43163507ce19e5e]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20250625 03:31:34.833938 3628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c1dda599f144ecfab4c075ee4e28c16. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:31:34.784925 3777 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36426 (request call id 32) took 1154 ms. Trace:
I20250625 03:31:34.852505 3715 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7e92fd94b9f24b1097e9a7373896cb26" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" is_pre_election: true
I20250625 03:31:34.853199 3715 raft_consensus.cc:2466] T 7e92fd94b9f24b1097e9a7373896cb26 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01873d289e0b4f9f9184b251369502a9 in term 0.
I20250625 03:31:34.854447 3605 leader_election.cc:304] T 7e92fd94b9f24b1097e9a7373896cb26 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9, 3d5b9823dfcd41cb92bd195c811cbf39; no voters:
I20250625 03:31:34.820187 3851 rpcz_store.cc:276] 0625 03:31:33.537901 (+ 0us) service_pool.cc:168] Inserting onto call queue
0625 03:31:34.194483 (+656582us) service_pool.cc:225] Handling call
0625 03:31:34.277732 (+ 83249us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0625 03:31:34.277828 (+ 96us) ts_tablet_manager.cc:676] Creating new metadata...
0625 03:31:34.550360 (+272532us) tablet_metadata.cc:641] Metadata flushed
0625 03:31:34.730618 (+180258us) tablet_replica.cc:206] Creating consensus instance
0625 03:31:34.731115 (+ 497us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250625 03:31:34.851820 3905 ts_tablet_manager.cc:1428] T b74d9f11c2bc4a7bb6431d6222d45175 P 841018313ad649679de64e006582f4c5: Time spent starting tablet: real 0.061s user 0.010s sys 0.005s
W20250625 03:31:34.844745 3523 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.106.132:37353, user_credentials={real_user=slave}} blocked reactor thread for 59671.5us
I20250625 03:31:34.875921 3910 tablet_bootstrap.cc:492] T c592f2c5305141c487b73e0867d0f36b P ddc0ad67020f45edb3ba9c83cab687a4: No bootstrap required, opened a new log
I20250625 03:31:34.876111 3911 leader_election.cc:290] T 7e92fd94b9f24b1097e9a7373896cb26 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041), 841018313ad649679de64e006582f4c5 (127.0.106.131:39467)
I20250625 03:31:34.876533 3910 ts_tablet_manager.cc:1397] T c592f2c5305141c487b73e0867d0f36b P ddc0ad67020f45edb3ba9c83cab687a4: Time spent bootstrapping tablet: real 0.340s user 0.003s sys 0.024s
I20250625 03:31:34.876843 3905 tablet_bootstrap.cc:492] T 7a8ecc65ca1140beb905dd6368bfaa2a P 841018313ad649679de64e006582f4c5: Bootstrap starting.
I20250625 03:31:34.879379 3910 raft_consensus.cc:357] T c592f2c5305141c487b73e0867d0f36b P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:34.880169 3910 raft_consensus.cc:383] T c592f2c5305141c487b73e0867d0f36b P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:34.880453 3910 raft_consensus.cc:738] T c592f2c5305141c487b73e0867d0f36b P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Initialized, Role: FOLLOWER
I20250625 03:31:34.881250 3910 consensus_queue.cc:260] T c592f2c5305141c487b73e0867d0f36b P ddc0ad67020f45edb3ba9c83cab687a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:34.894060 3910 ts_tablet_manager.cc:1428] T c592f2c5305141c487b73e0867d0f36b P ddc0ad67020f45edb3ba9c83cab687a4: Time spent starting tablet: real 0.017s user 0.004s sys 0.003s
I20250625 03:31:34.898739 3909 tablet_bootstrap.cc:492] T 7a8ecc65ca1140beb905dd6368bfaa2a P 3d5b9823dfcd41cb92bd195c811cbf39: No bootstrap required, opened a new log
I20250625 03:31:34.899355 3909 ts_tablet_manager.cc:1397] T 7a8ecc65ca1140beb905dd6368bfaa2a P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent bootstrapping tablet: real 0.289s user 0.022s sys 0.010s
I20250625 03:31:34.900689 3906 raft_consensus.cc:357] T 7a8ecc65ca1140beb905dd6368bfaa2a P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:34.902000 3906 raft_consensus.cc:383] T 7a8ecc65ca1140beb905dd6368bfaa2a P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:34.902330 3906 raft_consensus.cc:738] T 7a8ecc65ca1140beb905dd6368bfaa2a P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:34.902987 3905 tablet_bootstrap.cc:654] T 7a8ecc65ca1140beb905dd6368bfaa2a P 841018313ad649679de64e006582f4c5: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:34.844314 3777 rpcz_store.cc:276] 0625 03:31:33.625723 (+ 0us) service_pool.cc:168] Inserting onto call queue
0625 03:31:34.160216 (+534493us) service_pool.cc:225] Handling call
0625 03:31:34.193056 (+ 32840us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0625 03:31:34.200220 (+ 7164us) ts_tablet_manager.cc:676] Creating new metadata...
0625 03:31:34.576996 (+376776us) tablet_metadata.cc:641] Metadata flushed
0625 03:31:34.607967 (+ 30971us) tablet_replica.cc:206] Creating consensus instance
0625 03:31:34.779086 (+171119us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250625 03:31:34.910238 3910 tablet_bootstrap.cc:492] T b1ece928b2e2452191ee263cf19ec4f8 P ddc0ad67020f45edb3ba9c83cab687a4: Bootstrap starting.
I20250625 03:31:34.918980 3913 raft_consensus.cc:491] T b74d9f11c2bc4a7bb6431d6222d45175 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:34.919620 3913 raft_consensus.cc:513] T b74d9f11c2bc4a7bb6431d6222d45175 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:34.921686 3913 leader_election.cc:290] T b74d9f11c2bc4a7bb6431d6222d45175 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:31:34.922761 3938 raft_consensus.cc:2802] T 7e92fd94b9f24b1097e9a7373896cb26 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:31:34.923226 3938 raft_consensus.cc:491] T 7e92fd94b9f24b1097e9a7373896cb26 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:31:34.923666 3863 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b74d9f11c2bc4a7bb6431d6222d45175" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:34.923549 3938 raft_consensus.cc:3058] T 7e92fd94b9f24b1097e9a7373896cb26 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Advancing to term 1
W20250625 03:31:34.925350 3753 leader_election.cc:343] T b74d9f11c2bc4a7bb6431d6222d45175 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:34.903404 3909 raft_consensus.cc:357] T 7a8ecc65ca1140beb905dd6368bfaa2a P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:34.929700 3909 raft_consensus.cc:383] T 7a8ecc65ca1140beb905dd6368bfaa2a P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:34.928993 3640 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b74d9f11c2bc4a7bb6431d6222d45175" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:34.930023 3909 raft_consensus.cc:738] T 7a8ecc65ca1140beb905dd6368bfaa2a P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Initialized, Role: FOLLOWER
I20250625 03:31:34.903324 3906 consensus_queue.cc:260] T 7a8ecc65ca1140beb905dd6368bfaa2a P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
W20250625 03:31:34.939373 3754 leader_election.cc:343] T b74d9f11c2bc4a7bb6431d6222d45175 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:34.940174 3754 leader_election.cc:304] T b74d9f11c2bc4a7bb6431d6222d45175 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841018313ad649679de64e006582f4c5; no voters: 01873d289e0b4f9f9184b251369502a9, ddc0ad67020f45edb3ba9c83cab687a4
I20250625 03:31:34.945574 3715 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2e956665b7e4411f86cf77259093c8aa" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" is_pre_election: true
W20250625 03:31:34.947813 3828 leader_election.cc:343] T 2e956665b7e4411f86cf77259093c8aa P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:34.948642 3909 consensus_queue.cc:260] T 7a8ecc65ca1140beb905dd6368bfaa2a P 3d5b9823dfcd41cb92bd195c811cbf39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:34.951454 3909 ts_tablet_manager.cc:1428] T 7a8ecc65ca1140beb905dd6368bfaa2a P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent starting tablet: real 0.052s user 0.009s sys 0.000s
I20250625 03:31:34.953119 3913 raft_consensus.cc:2747] T b74d9f11c2bc4a7bb6431d6222d45175 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:31:34.955256 3909 tablet_bootstrap.cc:492] T 6fc84ca2087c4ded91412fb32117af48 P 3d5b9823dfcd41cb92bd195c811cbf39: Bootstrap starting.
I20250625 03:31:34.961246 3906 ts_tablet_manager.cc:1428] T 7a8ecc65ca1140beb905dd6368bfaa2a P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.284s user 0.028s sys 0.012s
I20250625 03:31:34.969302 3906 tablet_bootstrap.cc:492] T b74d9f11c2bc4a7bb6431d6222d45175 P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:34.962684 3789 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7e92fd94b9f24b1097e9a7373896cb26" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:31:34.967514 3788 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2e956665b7e4411f86cf77259093c8aa" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:31:34.962162 3910 tablet_bootstrap.cc:654] T b1ece928b2e2452191ee263cf19ec4f8 P ddc0ad67020f45edb3ba9c83cab687a4: Neither blocks nor log segments found. Creating new log.
W20250625 03:31:34.973193 3605 leader_election.cc:343] T 7e92fd94b9f24b1097e9a7373896cb26 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841018313ad649679de64e006582f4c5 (127.0.106.131:39467): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:34.973838 3905 tablet_bootstrap.cc:492] T 7a8ecc65ca1140beb905dd6368bfaa2a P 841018313ad649679de64e006582f4c5: No bootstrap required, opened a new log
W20250625 03:31:34.974241 3828 leader_election.cc:343] T 2e956665b7e4411f86cf77259093c8aa P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841018313ad649679de64e006582f4c5 (127.0.106.131:39467): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:34.974814 3828 leader_election.cc:304] T 2e956665b7e4411f86cf77259093c8aa P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddc0ad67020f45edb3ba9c83cab687a4; no voters: 3d5b9823dfcd41cb92bd195c811cbf39, 841018313ad649679de64e006582f4c5
I20250625 03:31:34.975004 3938 raft_consensus.cc:513] T 7e92fd94b9f24b1097e9a7373896cb26 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:34.975750 3932 raft_consensus.cc:2747] T 2e956665b7e4411f86cf77259093c8aa P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:31:34.974392 3905 ts_tablet_manager.cc:1397] T 7a8ecc65ca1140beb905dd6368bfaa2a P 841018313ad649679de64e006582f4c5: Time spent bootstrapping tablet: real 0.098s user 0.010s sys 0.008s
I20250625 03:31:34.976625 3911 raft_consensus.cc:491] T 7a8ecc65ca1140beb905dd6368bfaa2a P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:34.983480 3911 raft_consensus.cc:513] T 7a8ecc65ca1140beb905dd6368bfaa2a P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:34.986383 3905 raft_consensus.cc:357] T 7a8ecc65ca1140beb905dd6368bfaa2a P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:34.987100 3911 leader_election.cc:290] T 7a8ecc65ca1140beb905dd6368bfaa2a P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:31:34.987512 3905 raft_consensus.cc:383] T 7a8ecc65ca1140beb905dd6368bfaa2a P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:34.987495 3788 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7a8ecc65ca1140beb905dd6368bfaa2a" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:31:34.988230 3905 raft_consensus.cc:738] T 7a8ecc65ca1140beb905dd6368bfaa2a P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841018313ad649679de64e006582f4c5, State: Initialized, Role: FOLLOWER
I20250625 03:31:34.990365 3910 tablet_bootstrap.cc:492] T b1ece928b2e2452191ee263cf19ec4f8 P ddc0ad67020f45edb3ba9c83cab687a4: No bootstrap required, opened a new log
I20250625 03:31:34.990794 3909 tablet_bootstrap.cc:654] T 6fc84ca2087c4ded91412fb32117af48 P 3d5b9823dfcd41cb92bd195c811cbf39: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:34.990962 3910 ts_tablet_manager.cc:1397] T b1ece928b2e2452191ee263cf19ec4f8 P ddc0ad67020f45edb3ba9c83cab687a4: Time spent bootstrapping tablet: real 0.081s user 0.006s sys 0.006s
I20250625 03:31:34.990128 3715 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7a8ecc65ca1140beb905dd6368bfaa2a" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" is_pre_election: true
I20250625 03:31:34.991904 3715 raft_consensus.cc:2466] T 7a8ecc65ca1140beb905dd6368bfaa2a P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01873d289e0b4f9f9184b251369502a9 in term 0.
I20250625 03:31:34.993257 3605 leader_election.cc:304] T 7a8ecc65ca1140beb905dd6368bfaa2a P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9, 3d5b9823dfcd41cb92bd195c811cbf39; no voters:
I20250625 03:31:34.994239 3911 raft_consensus.cc:2802] T 7a8ecc65ca1140beb905dd6368bfaa2a P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:31:34.994689 3911 raft_consensus.cc:491] T 7a8ecc65ca1140beb905dd6368bfaa2a P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:31:34.995040 3911 raft_consensus.cc:3058] T 7a8ecc65ca1140beb905dd6368bfaa2a P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:34.996163 3909 tablet_bootstrap.cc:492] T 6fc84ca2087c4ded91412fb32117af48 P 3d5b9823dfcd41cb92bd195c811cbf39: No bootstrap required, opened a new log
I20250625 03:31:34.994441 3905 consensus_queue.cc:260] T 7a8ecc65ca1140beb905dd6368bfaa2a P 841018313ad649679de64e006582f4c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:34.996667 3909 ts_tablet_manager.cc:1397] T 6fc84ca2087c4ded91412fb32117af48 P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent bootstrapping tablet: real 0.044s user 0.006s sys 0.006s
I20250625 03:31:34.997272 3788 raft_consensus.cc:2466] T 7a8ecc65ca1140beb905dd6368bfaa2a P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01873d289e0b4f9f9184b251369502a9 in term 0.
I20250625 03:31:34.995736 3910 raft_consensus.cc:357] T b1ece928b2e2452191ee263cf19ec4f8 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:34.997901 3910 raft_consensus.cc:383] T b1ece928b2e2452191ee263cf19ec4f8 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:35.000763 3910 raft_consensus.cc:738] T b1ece928b2e2452191ee263cf19ec4f8 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Initialized, Role: FOLLOWER
I20250625 03:31:35.001667 3910 consensus_queue.cc:260] T b1ece928b2e2452191ee263cf19ec4f8 P ddc0ad67020f45edb3ba9c83cab687a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:34.999541 3905 ts_tablet_manager.cc:1428] T 7a8ecc65ca1140beb905dd6368bfaa2a P 841018313ad649679de64e006582f4c5: Time spent starting tablet: real 0.016s user 0.006s sys 0.001s
I20250625 03:31:35.002238 3909 raft_consensus.cc:357] T 6fc84ca2087c4ded91412fb32117af48 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:35.002615 3715 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7e92fd94b9f24b1097e9a7373896cb26" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
I20250625 03:31:35.003006 3909 raft_consensus.cc:383] T 6fc84ca2087c4ded91412fb32117af48 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:35.003274 3715 raft_consensus.cc:3058] T 7e92fd94b9f24b1097e9a7373896cb26 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:35.003338 3909 raft_consensus.cc:738] T 6fc84ca2087c4ded91412fb32117af48 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Initialized, Role: FOLLOWER
I20250625 03:31:35.004351 3909 consensus_queue.cc:260] T 6fc84ca2087c4ded91412fb32117af48 P 3d5b9823dfcd41cb92bd195c811cbf39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:35.006726 3909 ts_tablet_manager.cc:1428] T 6fc84ca2087c4ded91412fb32117af48 P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent starting tablet: real 0.010s user 0.003s sys 0.001s
I20250625 03:31:35.016340 3909 tablet_bootstrap.cc:492] T f3a33aa1d146468c986f0b1ba7d5fb84 P 3d5b9823dfcd41cb92bd195c811cbf39: Bootstrap starting.
I20250625 03:31:35.022950 3909 tablet_bootstrap.cc:654] T f3a33aa1d146468c986f0b1ba7d5fb84 P 3d5b9823dfcd41cb92bd195c811cbf39: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:35.028908 3938 leader_election.cc:290] T 7e92fd94b9f24b1097e9a7373896cb26 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 election: Requested vote from peers 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041), 841018313ad649679de64e006582f4c5 (127.0.106.131:39467)
I20250625 03:31:35.011924 3715 raft_consensus.cc:2466] T 7e92fd94b9f24b1097e9a7373896cb26 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01873d289e0b4f9f9184b251369502a9 in term 1.
I20250625 03:31:35.029637 3905 tablet_bootstrap.cc:492] T 2e956665b7e4411f86cf77259093c8aa P 841018313ad649679de64e006582f4c5: Bootstrap starting.
I20250625 03:31:35.030696 3605 leader_election.cc:304] T 7e92fd94b9f24b1097e9a7373896cb26 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9, 3d5b9823dfcd41cb92bd195c811cbf39; no voters:
I20250625 03:31:35.031306 3788 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7e92fd94b9f24b1097e9a7373896cb26" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5"
I20250625 03:31:35.031733 3938 raft_consensus.cc:2802] T 7e92fd94b9f24b1097e9a7373896cb26 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Leader election won for term 1
W20250625 03:31:35.032891 3605 leader_election.cc:343] T 7e92fd94b9f24b1097e9a7373896cb26 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 841018313ad649679de64e006582f4c5 (127.0.106.131:39467): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:35.033704 3910 ts_tablet_manager.cc:1428] T b1ece928b2e2452191ee263cf19ec4f8 P ddc0ad67020f45edb3ba9c83cab687a4: Time spent starting tablet: real 0.042s user 0.007s sys 0.000s
I20250625 03:31:35.036248 3910 tablet_bootstrap.cc:492] T 485f3e9350e245a9939133866b354302 P ddc0ad67020f45edb3ba9c83cab687a4: Bootstrap starting.
I20250625 03:31:35.019640 3911 raft_consensus.cc:513] T 7a8ecc65ca1140beb905dd6368bfaa2a P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:35.044871 3788 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7a8ecc65ca1140beb905dd6368bfaa2a" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5"
I20250625 03:31:35.045486 3788 raft_consensus.cc:3058] T 7a8ecc65ca1140beb905dd6368bfaa2a P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:35.053224 3910 tablet_bootstrap.cc:654] T 485f3e9350e245a9939133866b354302 P ddc0ad67020f45edb3ba9c83cab687a4: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:35.038002 3938 raft_consensus.cc:695] T 7e92fd94b9f24b1097e9a7373896cb26 P 01873d289e0b4f9f9184b251369502a9 [term 1 LEADER]: Becoming Leader. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Running, Role: LEADER
I20250625 03:31:35.042218 3905 tablet_bootstrap.cc:654] T 2e956665b7e4411f86cf77259093c8aa P 841018313ad649679de64e006582f4c5: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:35.053962 3909 tablet_bootstrap.cc:492] T f3a33aa1d146468c986f0b1ba7d5fb84 P 3d5b9823dfcd41cb92bd195c811cbf39: No bootstrap required, opened a new log
I20250625 03:31:35.055632 3715 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7a8ecc65ca1140beb905dd6368bfaa2a" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
I20250625 03:31:35.056614 3788 raft_consensus.cc:2466] T 7a8ecc65ca1140beb905dd6368bfaa2a P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01873d289e0b4f9f9184b251369502a9 in term 1.
I20250625 03:31:35.065261 3909 ts_tablet_manager.cc:1397] T f3a33aa1d146468c986f0b1ba7d5fb84 P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent bootstrapping tablet: real 0.049s user 0.003s sys 0.011s
I20250625 03:31:35.066156 3605 leader_election.cc:304] T 7a8ecc65ca1140beb905dd6368bfaa2a P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9, 841018313ad649679de64e006582f4c5; no voters:
I20250625 03:31:35.067124 3946 raft_consensus.cc:2802] T 7a8ecc65ca1140beb905dd6368bfaa2a P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:31:35.068517 3909 raft_consensus.cc:357] T f3a33aa1d146468c986f0b1ba7d5fb84 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:35.069322 3909 raft_consensus.cc:383] T f3a33aa1d146468c986f0b1ba7d5fb84 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:35.069644 3909 raft_consensus.cc:738] T f3a33aa1d146468c986f0b1ba7d5fb84 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Initialized, Role: FOLLOWER
I20250625 03:31:35.065286 3715 raft_consensus.cc:3058] T 7a8ecc65ca1140beb905dd6368bfaa2a P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:35.065286 3938 consensus_queue.cc:237] T 7e92fd94b9f24b1097e9a7373896cb26 P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:35.070709 3909 consensus_queue.cc:260] T f3a33aa1d146468c986f0b1ba7d5fb84 P 3d5b9823dfcd41cb92bd195c811cbf39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:35.071929 3905 tablet_bootstrap.cc:492] T 2e956665b7e4411f86cf77259093c8aa P 841018313ad649679de64e006582f4c5: No bootstrap required, opened a new log
I20250625 03:31:35.076205 3905 ts_tablet_manager.cc:1397] T 2e956665b7e4411f86cf77259093c8aa P 841018313ad649679de64e006582f4c5: Time spent bootstrapping tablet: real 0.064s user 0.014s sys 0.000s
I20250625 03:31:35.057022 3911 leader_election.cc:290] T 7a8ecc65ca1140beb905dd6368bfaa2a P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 election: Requested vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:31:35.072100 3914 raft_consensus.cc:491] T f3a33aa1d146468c986f0b1ba7d5fb84 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:34.982821 3906 tablet_bootstrap.cc:654] T b74d9f11c2bc4a7bb6431d6222d45175 P 01873d289e0b4f9f9184b251369502a9: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:35.077436 3946 raft_consensus.cc:695] T 7a8ecc65ca1140beb905dd6368bfaa2a P 01873d289e0b4f9f9184b251369502a9 [term 1 LEADER]: Becoming Leader. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Running, Role: LEADER
I20250625 03:31:35.078451 3946 consensus_queue.cc:237] T 7a8ecc65ca1140beb905dd6368bfaa2a P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:35.079473 3910 tablet_bootstrap.cc:492] T 485f3e9350e245a9939133866b354302 P ddc0ad67020f45edb3ba9c83cab687a4: No bootstrap required, opened a new log
I20250625 03:31:35.079758 3715 raft_consensus.cc:2466] T 7a8ecc65ca1140beb905dd6368bfaa2a P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01873d289e0b4f9f9184b251369502a9 in term 1.
I20250625 03:31:35.077559 3914 raft_consensus.cc:513] T f3a33aa1d146468c986f0b1ba7d5fb84 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:35.085070 3910 ts_tablet_manager.cc:1397] T 485f3e9350e245a9939133866b354302 P ddc0ad67020f45edb3ba9c83cab687a4: Time spent bootstrapping tablet: real 0.049s user 0.014s sys 0.000s
I20250625 03:31:35.084323 3905 raft_consensus.cc:357] T 2e956665b7e4411f86cf77259093c8aa P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:35.087100 3905 raft_consensus.cc:383] T 2e956665b7e4411f86cf77259093c8aa P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:35.087425 3905 raft_consensus.cc:738] T 2e956665b7e4411f86cf77259093c8aa P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841018313ad649679de64e006582f4c5, State: Initialized, Role: FOLLOWER
I20250625 03:31:35.087774 3914 leader_election.cc:290] T f3a33aa1d146468c986f0b1ba7d5fb84 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:31:35.088541 3863 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f3a33aa1d146468c986f0b1ba7d5fb84" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
W20250625 03:31:35.092370 3679 leader_election.cc:343] T f3a33aa1d146468c986f0b1ba7d5fb84 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:35.093485 3640 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f3a33aa1d146468c986f0b1ba7d5fb84" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:35.094365 3640 raft_consensus.cc:2466] T f3a33aa1d146468c986f0b1ba7d5fb84 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5b9823dfcd41cb92bd195c811cbf39 in term 0.
I20250625 03:31:35.096485 3680 leader_election.cc:304] T f3a33aa1d146468c986f0b1ba7d5fb84 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9, 3d5b9823dfcd41cb92bd195c811cbf39; no voters: ddc0ad67020f45edb3ba9c83cab687a4
I20250625 03:31:35.098136 3914 raft_consensus.cc:2802] T f3a33aa1d146468c986f0b1ba7d5fb84 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:31:35.098748 3914 raft_consensus.cc:491] T f3a33aa1d146468c986f0b1ba7d5fb84 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:31:35.098351 3538 catalog_manager.cc:5582] T 7e92fd94b9f24b1097e9a7373896cb26 P 01873d289e0b4f9f9184b251369502a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 01873d289e0b4f9f9184b251369502a9 (127.0.106.129). New cstate: current_term: 1 leader_uuid: "01873d289e0b4f9f9184b251369502a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:35.099304 3914 raft_consensus.cc:3058] T f3a33aa1d146468c986f0b1ba7d5fb84 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:35.088177 3905 consensus_queue.cc:260] T 2e956665b7e4411f86cf77259093c8aa P 841018313ad649679de64e006582f4c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:35.113770 3905 ts_tablet_manager.cc:1428] T 2e956665b7e4411f86cf77259093c8aa P 841018313ad649679de64e006582f4c5: Time spent starting tablet: real 0.037s user 0.007s sys 0.000s
I20250625 03:31:35.115240 3905 tablet_bootstrap.cc:492] T 3ecdd525d6fd47deacf323decbc5c329 P 841018313ad649679de64e006582f4c5: Bootstrap starting.
I20250625 03:31:35.130682 3914 raft_consensus.cc:513] T f3a33aa1d146468c986f0b1ba7d5fb84 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:35.136502 3905 tablet_bootstrap.cc:654] T 3ecdd525d6fd47deacf323decbc5c329 P 841018313ad649679de64e006582f4c5: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:35.138126 3906 tablet_bootstrap.cc:492] T b74d9f11c2bc4a7bb6431d6222d45175 P 01873d289e0b4f9f9184b251369502a9: No bootstrap required, opened a new log
I20250625 03:31:35.138716 3906 ts_tablet_manager.cc:1397] T b74d9f11c2bc4a7bb6431d6222d45175 P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.170s user 0.012s sys 0.000s
I20250625 03:31:35.138845 3863 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f3a33aa1d146468c986f0b1ba7d5fb84" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4"
W20250625 03:31:35.140391 3679 leader_election.cc:343] T f3a33aa1d146468c986f0b1ba7d5fb84 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:35.140643 3910 raft_consensus.cc:357] T 485f3e9350e245a9939133866b354302 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:35.141453 3910 raft_consensus.cc:383] T 485f3e9350e245a9939133866b354302 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:35.141767 3910 raft_consensus.cc:738] T 485f3e9350e245a9939133866b354302 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Initialized, Role: FOLLOWER
I20250625 03:31:35.142508 3640 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f3a33aa1d146468c986f0b1ba7d5fb84" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9"
I20250625 03:31:35.142695 3951 raft_consensus.cc:491] T 6fc84ca2087c4ded91412fb32117af48 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:35.143206 3640 raft_consensus.cc:3058] T f3a33aa1d146468c986f0b1ba7d5fb84 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:35.143246 3951 raft_consensus.cc:513] T 6fc84ca2087c4ded91412fb32117af48 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:35.144131 3909 ts_tablet_manager.cc:1428] T f3a33aa1d146468c986f0b1ba7d5fb84 P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent starting tablet: real 0.078s user 0.029s sys 0.031s
I20250625 03:31:35.145195 3909 tablet_bootstrap.cc:492] T 3ecdd525d6fd47deacf323decbc5c329 P 3d5b9823dfcd41cb92bd195c811cbf39: Bootstrap starting.
I20250625 03:31:35.152166 3640 raft_consensus.cc:2466] T f3a33aa1d146468c986f0b1ba7d5fb84 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5b9823dfcd41cb92bd195c811cbf39 in term 1.
I20250625 03:31:35.142009 3906 raft_consensus.cc:357] T b74d9f11c2bc4a7bb6431d6222d45175 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:35.153285 3909 tablet_bootstrap.cc:654] T 3ecdd525d6fd47deacf323decbc5c329 P 3d5b9823dfcd41cb92bd195c811cbf39: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:35.153393 3906 raft_consensus.cc:383] T b74d9f11c2bc4a7bb6431d6222d45175 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:35.153455 3914 leader_election.cc:290] T f3a33aa1d146468c986f0b1ba7d5fb84 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 election: Requested vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:31:35.153909 3906 raft_consensus.cc:738] T b74d9f11c2bc4a7bb6431d6222d45175 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:35.154806 3906 consensus_queue.cc:260] T b74d9f11c2bc4a7bb6431d6222d45175 P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:35.142537 3910 consensus_queue.cc:260] T 485f3e9350e245a9939133866b354302 P ddc0ad67020f45edb3ba9c83cab687a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:35.156778 3913 raft_consensus.cc:491] T 2e956665b7e4411f86cf77259093c8aa P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:35.157424 3913 raft_consensus.cc:513] T 2e956665b7e4411f86cf77259093c8aa P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:35.159416 3680 leader_election.cc:304] T f3a33aa1d146468c986f0b1ba7d5fb84 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9, 3d5b9823dfcd41cb92bd195c811cbf39; no voters: ddc0ad67020f45edb3ba9c83cab687a4
I20250625 03:31:35.159956 3913 leader_election.cc:290] T 2e956665b7e4411f86cf77259093c8aa P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041), ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353)
I20250625 03:31:35.160959 3951 leader_election.cc:290] T 6fc84ca2087c4ded91412fb32117af48 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353)
I20250625 03:31:35.161514 3951 raft_consensus.cc:2802] T f3a33aa1d146468c986f0b1ba7d5fb84 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:31:35.161990 3951 raft_consensus.cc:695] T f3a33aa1d146468c986f0b1ba7d5fb84 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 LEADER]: Becoming Leader. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Running, Role: LEADER
I20250625 03:31:35.162828 3951 consensus_queue.cc:237] T f3a33aa1d146468c986f0b1ba7d5fb84 P 3d5b9823dfcd41cb92bd195c811cbf39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:35.163365 3863 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6fc84ca2087c4ded91412fb32117af48" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:35.166056 3906 ts_tablet_manager.cc:1428] T b74d9f11c2bc4a7bb6431d6222d45175 P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.027s user 0.008s sys 0.000s
I20250625 03:31:35.166184 3715 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2e956665b7e4411f86cf77259093c8aa" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" is_pre_election: true
I20250625 03:31:35.167340 3906 tablet_bootstrap.cc:492] T 49d4fb2581ed4ef998f6a113ea67c323 P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
W20250625 03:31:35.168061 3754 leader_election.cc:343] T 2e956665b7e4411f86cf77259093c8aa P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041): Illegal state: must be running to vote when last-logged opid is not known
W20250625 03:31:35.169348 3679 leader_election.cc:343] T 6fc84ca2087c4ded91412fb32117af48 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:35.170251 3863 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2e956665b7e4411f86cf77259093c8aa" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:35.170943 3863 raft_consensus.cc:2466] T 2e956665b7e4411f86cf77259093c8aa P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841018313ad649679de64e006582f4c5 in term 0.
I20250625 03:31:35.172179 3753 leader_election.cc:304] T 2e956665b7e4411f86cf77259093c8aa P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841018313ad649679de64e006582f4c5, ddc0ad67020f45edb3ba9c83cab687a4; no voters: 3d5b9823dfcd41cb92bd195c811cbf39
I20250625 03:31:35.172344 3788 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6fc84ca2087c4ded91412fb32117af48" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
W20250625 03:31:35.173682 3680 leader_election.cc:343] T 6fc84ca2087c4ded91412fb32117af48 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841018313ad649679de64e006582f4c5 (127.0.106.131:39467): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:35.174166 3680 leader_election.cc:304] T 6fc84ca2087c4ded91412fb32117af48 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39; no voters: 841018313ad649679de64e006582f4c5, ddc0ad67020f45edb3ba9c83cab687a4
I20250625 03:31:35.175474 3913 raft_consensus.cc:2802] T 2e956665b7e4411f86cf77259093c8aa P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:31:35.175935 3913 raft_consensus.cc:491] T 2e956665b7e4411f86cf77259093c8aa P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:31:35.176385 3913 raft_consensus.cc:3058] T 2e956665b7e4411f86cf77259093c8aa P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:35.180876 3914 raft_consensus.cc:2747] T 6fc84ca2087c4ded91412fb32117af48 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:31:35.190460 3905 tablet_bootstrap.cc:492] T 3ecdd525d6fd47deacf323decbc5c329 P 841018313ad649679de64e006582f4c5: No bootstrap required, opened a new log
I20250625 03:31:35.191293 3905 ts_tablet_manager.cc:1397] T 3ecdd525d6fd47deacf323decbc5c329 P 841018313ad649679de64e006582f4c5: Time spent bootstrapping tablet: real 0.076s user 0.016s sys 0.001s
I20250625 03:31:35.195426 3905 raft_consensus.cc:357] T 3ecdd525d6fd47deacf323decbc5c329 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:35.196642 3905 raft_consensus.cc:383] T 3ecdd525d6fd47deacf323decbc5c329 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:35.197090 3905 raft_consensus.cc:738] T 3ecdd525d6fd47deacf323decbc5c329 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841018313ad649679de64e006582f4c5, State: Initialized, Role: FOLLOWER
I20250625 03:31:35.198125 3905 consensus_queue.cc:260] T 3ecdd525d6fd47deacf323decbc5c329 P 841018313ad649679de64e006582f4c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:35.195755 3913 raft_consensus.cc:513] T 2e956665b7e4411f86cf77259093c8aa P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:35.203086 3913 leader_election.cc:290] T 2e956665b7e4411f86cf77259093c8aa P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 election: Requested vote from peers 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041), ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353)
I20250625 03:31:35.204545 3863 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2e956665b7e4411f86cf77259093c8aa" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4"
I20250625 03:31:35.205197 3863 raft_consensus.cc:3058] T 2e956665b7e4411f86cf77259093c8aa P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:35.206694 3906 tablet_bootstrap.cc:654] T 49d4fb2581ed4ef998f6a113ea67c323 P 01873d289e0b4f9f9184b251369502a9: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:35.209546 3715 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2e956665b7e4411f86cf77259093c8aa" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
W20250625 03:31:35.211392 3754 leader_election.cc:343] T 2e956665b7e4411f86cf77259093c8aa P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:35.212738 3910 ts_tablet_manager.cc:1428] T 485f3e9350e245a9939133866b354302 P ddc0ad67020f45edb3ba9c83cab687a4: Time spent starting tablet: real 0.127s user 0.009s sys 0.000s
I20250625 03:31:35.215272 3863 raft_consensus.cc:2466] T 2e956665b7e4411f86cf77259093c8aa P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841018313ad649679de64e006582f4c5 in term 1.
I20250625 03:31:35.216439 3909 tablet_bootstrap.cc:492] T 3ecdd525d6fd47deacf323decbc5c329 P 3d5b9823dfcd41cb92bd195c811cbf39: No bootstrap required, opened a new log
I20250625 03:31:35.228093 3909 ts_tablet_manager.cc:1397] T 3ecdd525d6fd47deacf323decbc5c329 P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent bootstrapping tablet: real 0.083s user 0.033s sys 0.008s
I20250625 03:31:35.229728 3538 catalog_manager.cc:5582] T 7a8ecc65ca1140beb905dd6368bfaa2a P 01873d289e0b4f9f9184b251369502a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 01873d289e0b4f9f9184b251369502a9 (127.0.106.129). New cstate: current_term: 1 leader_uuid: "01873d289e0b4f9f9184b251369502a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:35.232940 3753 leader_election.cc:304] T 2e956665b7e4411f86cf77259093c8aa P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841018313ad649679de64e006582f4c5, ddc0ad67020f45edb3ba9c83cab687a4; no voters: 3d5b9823dfcd41cb92bd195c811cbf39
I20250625 03:31:35.234166 3913 raft_consensus.cc:2802] T 2e956665b7e4411f86cf77259093c8aa P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:31:35.234653 3913 raft_consensus.cc:695] T 2e956665b7e4411f86cf77259093c8aa P 841018313ad649679de64e006582f4c5 [term 1 LEADER]: Becoming Leader. State: Replica: 841018313ad649679de64e006582f4c5, State: Running, Role: LEADER
I20250625 03:31:35.234805 3909 raft_consensus.cc:357] T 3ecdd525d6fd47deacf323decbc5c329 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:35.235509 3913 consensus_queue.cc:237] T 2e956665b7e4411f86cf77259093c8aa P 841018313ad649679de64e006582f4c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:35.235884 3909 raft_consensus.cc:383] T 3ecdd525d6fd47deacf323decbc5c329 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:35.239166 3909 raft_consensus.cc:738] T 3ecdd525d6fd47deacf323decbc5c329 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Initialized, Role: FOLLOWER
I20250625 03:31:35.239948 3909 consensus_queue.cc:260] T 3ecdd525d6fd47deacf323decbc5c329 P 3d5b9823dfcd41cb92bd195c811cbf39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:35.218508 3535 catalog_manager.cc:5582] T f3a33aa1d146468c986f0b1ba7d5fb84 P 3d5b9823dfcd41cb92bd195c811cbf39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:35.244632 3909 ts_tablet_manager.cc:1428] T 3ecdd525d6fd47deacf323decbc5c329 P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent starting tablet: real 0.016s user 0.008s sys 0.000s
I20250625 03:31:35.245684 3909 tablet_bootstrap.cc:492] T bccba871bcd747fd80a890b25628ebe2 P 3d5b9823dfcd41cb92bd195c811cbf39: Bootstrap starting.
I20250625 03:31:35.251291 3910 tablet_bootstrap.cc:492] T b74d9f11c2bc4a7bb6431d6222d45175 P ddc0ad67020f45edb3ba9c83cab687a4: Bootstrap starting.
I20250625 03:31:35.258692 3910 tablet_bootstrap.cc:654] T b74d9f11c2bc4a7bb6431d6222d45175 P ddc0ad67020f45edb3ba9c83cab687a4: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:35.262240 3909 tablet_bootstrap.cc:654] T bccba871bcd747fd80a890b25628ebe2 P 3d5b9823dfcd41cb92bd195c811cbf39: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:35.268767 3905 ts_tablet_manager.cc:1428] T 3ecdd525d6fd47deacf323decbc5c329 P 841018313ad649679de64e006582f4c5: Time spent starting tablet: real 0.077s user 0.016s sys 0.040s
I20250625 03:31:35.269995 3905 tablet_bootstrap.cc:492] T bccba871bcd747fd80a890b25628ebe2 P 841018313ad649679de64e006582f4c5: Bootstrap starting.
I20250625 03:31:35.272722 3906 tablet_bootstrap.cc:492] T 49d4fb2581ed4ef998f6a113ea67c323 P 01873d289e0b4f9f9184b251369502a9: No bootstrap required, opened a new log
I20250625 03:31:35.272305 3535 catalog_manager.cc:5582] T 2e956665b7e4411f86cf77259093c8aa P 841018313ad649679de64e006582f4c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 841018313ad649679de64e006582f4c5 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "841018313ad649679de64e006582f4c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:35.273352 3906 ts_tablet_manager.cc:1397] T 49d4fb2581ed4ef998f6a113ea67c323 P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.106s user 0.020s sys 0.015s
I20250625 03:31:35.276898 3906 raft_consensus.cc:357] T 49d4fb2581ed4ef998f6a113ea67c323 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:35.277719 3906 raft_consensus.cc:383] T 49d4fb2581ed4ef998f6a113ea67c323 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:35.278039 3906 raft_consensus.cc:738] T 49d4fb2581ed4ef998f6a113ea67c323 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:35.281471 3905 tablet_bootstrap.cc:654] T bccba871bcd747fd80a890b25628ebe2 P 841018313ad649679de64e006582f4c5: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:35.281955 3909 tablet_bootstrap.cc:492] T bccba871bcd747fd80a890b25628ebe2 P 3d5b9823dfcd41cb92bd195c811cbf39: No bootstrap required, opened a new log
I20250625 03:31:35.282521 3909 ts_tablet_manager.cc:1397] T bccba871bcd747fd80a890b25628ebe2 P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent bootstrapping tablet: real 0.037s user 0.012s sys 0.000s
I20250625 03:31:35.278828 3906 consensus_queue.cc:260] T 49d4fb2581ed4ef998f6a113ea67c323 P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:35.291121 3906 ts_tablet_manager.cc:1428] T 49d4fb2581ed4ef998f6a113ea67c323 P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.017s user 0.008s sys 0.000s
I20250625 03:31:35.292328 3906 tablet_bootstrap.cc:492] T 5dc5a179a27f462989b291e8133742da P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:35.297220 3909 raft_consensus.cc:357] T bccba871bcd747fd80a890b25628ebe2 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:35.298048 3909 raft_consensus.cc:383] T bccba871bcd747fd80a890b25628ebe2 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:35.298348 3909 raft_consensus.cc:738] T bccba871bcd747fd80a890b25628ebe2 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Initialized, Role: FOLLOWER
I20250625 03:31:35.299057 3909 consensus_queue.cc:260] T bccba871bcd747fd80a890b25628ebe2 P 3d5b9823dfcd41cb92bd195c811cbf39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:35.303570 3909 ts_tablet_manager.cc:1428] T bccba871bcd747fd80a890b25628ebe2 P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent starting tablet: real 0.021s user 0.009s sys 0.000s
I20250625 03:31:35.306358 3909 tablet_bootstrap.cc:492] T 06f309640df64f97a4065b1420fea692 P 3d5b9823dfcd41cb92bd195c811cbf39: Bootstrap starting.
I20250625 03:31:35.310722 3910 tablet_bootstrap.cc:492] T b74d9f11c2bc4a7bb6431d6222d45175 P ddc0ad67020f45edb3ba9c83cab687a4: No bootstrap required, opened a new log
I20250625 03:31:35.311365 3910 ts_tablet_manager.cc:1397] T b74d9f11c2bc4a7bb6431d6222d45175 P ddc0ad67020f45edb3ba9c83cab687a4: Time spent bootstrapping tablet: real 0.060s user 0.026s sys 0.004s
I20250625 03:31:35.316386 3905 tablet_bootstrap.cc:492] T bccba871bcd747fd80a890b25628ebe2 P 841018313ad649679de64e006582f4c5: No bootstrap required, opened a new log
I20250625 03:31:35.316972 3905 ts_tablet_manager.cc:1397] T bccba871bcd747fd80a890b25628ebe2 P 841018313ad649679de64e006582f4c5: Time spent bootstrapping tablet: real 0.047s user 0.019s sys 0.000s
I20250625 03:31:35.318585 3910 raft_consensus.cc:357] T b74d9f11c2bc4a7bb6431d6222d45175 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:35.319478 3910 raft_consensus.cc:383] T b74d9f11c2bc4a7bb6431d6222d45175 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:35.319847 3910 raft_consensus.cc:738] T b74d9f11c2bc4a7bb6431d6222d45175 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Initialized, Role: FOLLOWER
I20250625 03:31:35.315258 3909 tablet_bootstrap.cc:654] T 06f309640df64f97a4065b1420fea692 P 3d5b9823dfcd41cb92bd195c811cbf39: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:35.320106 3905 raft_consensus.cc:357] T bccba871bcd747fd80a890b25628ebe2 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:35.320994 3905 raft_consensus.cc:383] T bccba871bcd747fd80a890b25628ebe2 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:35.321324 3905 raft_consensus.cc:738] T bccba871bcd747fd80a890b25628ebe2 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841018313ad649679de64e006582f4c5, State: Initialized, Role: FOLLOWER
I20250625 03:31:35.322062 3905 consensus_queue.cc:260] T bccba871bcd747fd80a890b25628ebe2 P 841018313ad649679de64e006582f4c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:35.321949 3910 consensus_queue.cc:260] T b74d9f11c2bc4a7bb6431d6222d45175 P ddc0ad67020f45edb3ba9c83cab687a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:35.322268 3906 tablet_bootstrap.cc:654] T 5dc5a179a27f462989b291e8133742da P 01873d289e0b4f9f9184b251369502a9: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:35.326721 3910 ts_tablet_manager.cc:1428] T b74d9f11c2bc4a7bb6431d6222d45175 P ddc0ad67020f45edb3ba9c83cab687a4: Time spent starting tablet: real 0.011s user 0.006s sys 0.000s
I20250625 03:31:35.327849 3910 tablet_bootstrap.cc:492] T a07d77259251401d957af853b296750a P ddc0ad67020f45edb3ba9c83cab687a4: Bootstrap starting.
I20250625 03:31:35.328382 3905 ts_tablet_manager.cc:1428] T bccba871bcd747fd80a890b25628ebe2 P 841018313ad649679de64e006582f4c5: Time spent starting tablet: real 0.011s user 0.008s sys 0.000s
I20250625 03:31:35.329502 3905 tablet_bootstrap.cc:492] T c0c8dfded31e4566b07bc439f6e58ef6 P 841018313ad649679de64e006582f4c5: Bootstrap starting.
I20250625 03:31:35.336382 3962 raft_consensus.cc:491] T bccba871bcd747fd80a890b25628ebe2 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:35.337020 3962 raft_consensus.cc:513] T bccba871bcd747fd80a890b25628ebe2 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:35.340821 3863 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bccba871bcd747fd80a890b25628ebe2" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:35.341919 3906 tablet_bootstrap.cc:492] T 5dc5a179a27f462989b291e8133742da P 01873d289e0b4f9f9184b251369502a9: No bootstrap required, opened a new log
I20250625 03:31:35.342198 3910 tablet_bootstrap.cc:654] T a07d77259251401d957af853b296750a P ddc0ad67020f45edb3ba9c83cab687a4: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:35.342490 3906 ts_tablet_manager.cc:1397] T 5dc5a179a27f462989b291e8133742da P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.050s user 0.006s sys 0.007s
I20250625 03:31:35.344501 3788 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bccba871bcd747fd80a890b25628ebe2" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:31:35.345239 3788 raft_consensus.cc:2466] T bccba871bcd747fd80a890b25628ebe2 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5b9823dfcd41cb92bd195c811cbf39 in term 0.
I20250625 03:31:35.345695 3906 raft_consensus.cc:357] T 5dc5a179a27f462989b291e8133742da P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:35.346534 3906 raft_consensus.cc:383] T 5dc5a179a27f462989b291e8133742da P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:35.346863 3906 raft_consensus.cc:738] T 5dc5a179a27f462989b291e8133742da P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:35.347148 3909 tablet_bootstrap.cc:492] T 06f309640df64f97a4065b1420fea692 P 3d5b9823dfcd41cb92bd195c811cbf39: No bootstrap required, opened a new log
I20250625 03:31:35.347335 3962 leader_election.cc:290] T bccba871bcd747fd80a890b25628ebe2 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353)
I20250625 03:31:35.347647 3909 ts_tablet_manager.cc:1397] T 06f309640df64f97a4065b1420fea692 P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent bootstrapping tablet: real 0.042s user 0.011s sys 0.000s
I20250625 03:31:35.348376 3906 consensus_queue.cc:260] T 5dc5a179a27f462989b291e8133742da P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:35.347720 3905 tablet_bootstrap.cc:654] T c0c8dfded31e4566b07bc439f6e58ef6 P 841018313ad649679de64e006582f4c5: Neither blocks nor log segments found. Creating new log.
W20250625 03:31:35.342409 3679 leader_election.cc:343] T bccba871bcd747fd80a890b25628ebe2 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:35.350878 3909 raft_consensus.cc:357] T 06f309640df64f97a4065b1420fea692 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:35.351557 3909 raft_consensus.cc:383] T 06f309640df64f97a4065b1420fea692 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:35.351876 3909 raft_consensus.cc:738] T 06f309640df64f97a4065b1420fea692 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Initialized, Role: FOLLOWER
I20250625 03:31:35.351655 3680 leader_election.cc:304] T bccba871bcd747fd80a890b25628ebe2 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, 841018313ad649679de64e006582f4c5; no voters: ddc0ad67020f45edb3ba9c83cab687a4
I20250625 03:31:35.352664 3909 consensus_queue.cc:260] T 06f309640df64f97a4065b1420fea692 P 3d5b9823dfcd41cb92bd195c811cbf39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:35.353016 3962 raft_consensus.cc:2802] T bccba871bcd747fd80a890b25628ebe2 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:31:35.353518 3962 raft_consensus.cc:491] T bccba871bcd747fd80a890b25628ebe2 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:31:35.360265 3962 raft_consensus.cc:3058] T bccba871bcd747fd80a890b25628ebe2 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:35.362272 3932 raft_consensus.cc:491] T c592f2c5305141c487b73e0867d0f36b P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:35.354804 3909 ts_tablet_manager.cc:1428] T 06f309640df64f97a4065b1420fea692 P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20250625 03:31:35.367309 3946 raft_consensus.cc:491] T b74d9f11c2bc4a7bb6431d6222d45175 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:35.357496 3910 tablet_bootstrap.cc:492] T a07d77259251401d957af853b296750a P ddc0ad67020f45edb3ba9c83cab687a4: No bootstrap required, opened a new log
I20250625 03:31:35.367861 3946 raft_consensus.cc:513] T b74d9f11c2bc4a7bb6431d6222d45175 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:35.368561 3910 ts_tablet_manager.cc:1397] T a07d77259251401d957af853b296750a P ddc0ad67020f45edb3ba9c83cab687a4: Time spent bootstrapping tablet: real 0.041s user 0.005s sys 0.007s
I20250625 03:31:35.357614 3906 ts_tablet_manager.cc:1428] T 5dc5a179a27f462989b291e8133742da P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.015s user 0.009s sys 0.000s
I20250625 03:31:35.362318 3905 tablet_bootstrap.cc:492] T c0c8dfded31e4566b07bc439f6e58ef6 P 841018313ad649679de64e006582f4c5: No bootstrap required, opened a new log
I20250625 03:31:35.370452 3905 ts_tablet_manager.cc:1397] T c0c8dfded31e4566b07bc439f6e58ef6 P 841018313ad649679de64e006582f4c5: Time spent bootstrapping tablet: real 0.041s user 0.009s sys 0.005s
I20250625 03:31:35.372936 3906 tablet_bootstrap.cc:492] T 3ecdd525d6fd47deacf323decbc5c329 P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:35.377419 3909 tablet_bootstrap.cc:492] T b1ece928b2e2452191ee263cf19ec4f8 P 3d5b9823dfcd41cb92bd195c811cbf39: Bootstrap starting.
I20250625 03:31:35.380120 3905 raft_consensus.cc:357] T c0c8dfded31e4566b07bc439f6e58ef6 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:35.380812 3905 raft_consensus.cc:383] T c0c8dfded31e4566b07bc439f6e58ef6 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:35.381083 3905 raft_consensus.cc:738] T c0c8dfded31e4566b07bc439f6e58ef6 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841018313ad649679de64e006582f4c5, State: Initialized, Role: FOLLOWER
I20250625 03:31:35.381702 3905 consensus_queue.cc:260] T c0c8dfded31e4566b07bc439f6e58ef6 P 841018313ad649679de64e006582f4c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:35.385919 3910 raft_consensus.cc:357] T a07d77259251401d957af853b296750a P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:35.386766 3910 raft_consensus.cc:383] T a07d77259251401d957af853b296750a P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:35.387166 3910 raft_consensus.cc:738] T a07d77259251401d957af853b296750a P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Initialized, Role: FOLLOWER
I20250625 03:31:35.362851 3932 raft_consensus.cc:513] T c592f2c5305141c487b73e0867d0f36b P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:35.389093 3946 leader_election.cc:290] T b74d9f11c2bc4a7bb6431d6222d45175 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353)
I20250625 03:31:35.389662 3788 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b74d9f11c2bc4a7bb6431d6222d45175" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:31:35.390133 3932 leader_election.cc:290] T c592f2c5305141c487b73e0867d0f36b P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:31:35.390332 3788 raft_consensus.cc:2466] T b74d9f11c2bc4a7bb6431d6222d45175 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01873d289e0b4f9f9184b251369502a9 in term 0.
I20250625 03:31:35.390671 3932 raft_consensus.cc:491] T 485f3e9350e245a9939133866b354302 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:35.391114 3932 raft_consensus.cc:513] T 485f3e9350e245a9939133866b354302 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:35.391731 3605 leader_election.cc:304] T b74d9f11c2bc4a7bb6431d6222d45175 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9, 841018313ad649679de64e006582f4c5; no voters:
I20250625 03:31:35.393533 3946 raft_consensus.cc:2802] T b74d9f11c2bc4a7bb6431d6222d45175 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:31:35.394632 3946 raft_consensus.cc:491] T b74d9f11c2bc4a7bb6431d6222d45175 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:31:35.387954 3910 consensus_queue.cc:260] T a07d77259251401d957af853b296750a P ddc0ad67020f45edb3ba9c83cab687a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:35.396171 3946 raft_consensus.cc:3058] T b74d9f11c2bc4a7bb6431d6222d45175 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:35.397630 3906 tablet_bootstrap.cc:654] T 3ecdd525d6fd47deacf323decbc5c329 P 01873d289e0b4f9f9184b251369502a9: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:35.394054 3932 leader_election.cc:290] T 485f3e9350e245a9939133866b354302 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:31:35.398272 3932 raft_consensus.cc:491] T b74d9f11c2bc4a7bb6431d6222d45175 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:35.383920 3905 ts_tablet_manager.cc:1428] T c0c8dfded31e4566b07bc439f6e58ef6 P 841018313ad649679de64e006582f4c5: Time spent starting tablet: real 0.013s user 0.004s sys 0.002s
I20250625 03:31:35.400369 3905 tablet_bootstrap.cc:492] T 49d4fb2581ed4ef998f6a113ea67c323 P 841018313ad649679de64e006582f4c5: Bootstrap starting.
I20250625 03:31:35.398816 3932 raft_consensus.cc:513] T b74d9f11c2bc4a7bb6431d6222d45175 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:35.405725 3962 raft_consensus.cc:513] T bccba871bcd747fd80a890b25628ebe2 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:35.413194 3962 leader_election.cc:290] T bccba871bcd747fd80a890b25628ebe2 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 election: Requested vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353)
I20250625 03:31:35.407511 3932 leader_election.cc:290] T b74d9f11c2bc4a7bb6431d6222d45175 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
W20250625 03:31:35.414480 3585 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20250625 03:31:35.415740 3909 tablet_bootstrap.cc:654] T b1ece928b2e2452191ee263cf19ec4f8 P 3d5b9823dfcd41cb92bd195c811cbf39: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:35.418634 3788 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bccba871bcd747fd80a890b25628ebe2" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5"
I20250625 03:31:35.419494 3788 raft_consensus.cc:3058] T bccba871bcd747fd80a890b25628ebe2 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:35.410835 3951 raft_consensus.cc:491] T 06f309640df64f97a4065b1420fea692 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:35.420262 3951 raft_consensus.cc:513] T 06f309640df64f97a4065b1420fea692 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:35.422282 3951 leader_election.cc:290] T 06f309640df64f97a4065b1420fea692 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 841018313ad649679de64e006582f4c5 (127.0.106.131:39467)
I20250625 03:31:35.423096 3951 raft_consensus.cc:491] T 3ecdd525d6fd47deacf323decbc5c329 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:35.423202 3909 tablet_bootstrap.cc:492] T b1ece928b2e2452191ee263cf19ec4f8 P 3d5b9823dfcd41cb92bd195c811cbf39: No bootstrap required, opened a new log
I20250625 03:31:35.423565 3951 raft_consensus.cc:513] T 3ecdd525d6fd47deacf323decbc5c329 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:35.424106 3909 ts_tablet_manager.cc:1397] T b1ece928b2e2452191ee263cf19ec4f8 P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent bootstrapping tablet: real 0.047s user 0.012s sys 0.000s
I20250625 03:31:35.397850 3910 ts_tablet_manager.cc:1428] T a07d77259251401d957af853b296750a P ddc0ad67020f45edb3ba9c83cab687a4: Time spent starting tablet: real 0.029s user 0.007s sys 0.001s
I20250625 03:31:35.425854 3910 tablet_bootstrap.cc:492] T 5dc5a179a27f462989b291e8133742da P ddc0ad67020f45edb3ba9c83cab687a4: Bootstrap starting.
I20250625 03:31:35.425732 3640 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "06f309640df64f97a4065b1420fea692" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:35.427233 3789 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "06f309640df64f97a4065b1420fea692" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:31:35.426803 3951 leader_election.cc:290] T 3ecdd525d6fd47deacf323decbc5c329 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 841018313ad649679de64e006582f4c5 (127.0.106.131:39467)
I20250625 03:31:35.428501 3909 raft_consensus.cc:357] T b1ece928b2e2452191ee263cf19ec4f8 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:35.429576 3909 raft_consensus.cc:383] T b1ece928b2e2452191ee263cf19ec4f8 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:35.429997 3909 raft_consensus.cc:738] T b1ece928b2e2452191ee263cf19ec4f8 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Initialized, Role: FOLLOWER
I20250625 03:31:35.427874 3789 raft_consensus.cc:2466] T 06f309640df64f97a4065b1420fea692 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5b9823dfcd41cb92bd195c811cbf39 in term 0.
I20250625 03:31:35.430948 3909 consensus_queue.cc:260] T b1ece928b2e2452191ee263cf19ec4f8 P 3d5b9823dfcd41cb92bd195c811cbf39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:35.434192 3909 ts_tablet_manager.cc:1428] T b1ece928b2e2452191ee263cf19ec4f8 P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
I20250625 03:31:35.437296 3640 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3ecdd525d6fd47deacf323decbc5c329" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:35.439675 3789 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3ecdd525d6fd47deacf323decbc5c329" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:31:35.440374 3789 raft_consensus.cc:2466] T 3ecdd525d6fd47deacf323decbc5c329 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5b9823dfcd41cb92bd195c811cbf39 in term 0.
I20250625 03:31:35.440827 3946 raft_consensus.cc:513] T b74d9f11c2bc4a7bb6431d6222d45175 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:35.442431 3905 tablet_bootstrap.cc:654] T 49d4fb2581ed4ef998f6a113ea67c323 P 841018313ad649679de64e006582f4c5: Neither blocks nor log segments found. Creating new log.
W20250625 03:31:35.442117 3680 leader_election.cc:343] T 06f309640df64f97a4065b1420fea692 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
W20250625 03:31:35.443521 3680 leader_election.cc:343] T 3ecdd525d6fd47deacf323decbc5c329 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:35.444319 3680 leader_election.cc:304] T 06f309640df64f97a4065b1420fea692 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, 841018313ad649679de64e006582f4c5; no voters: 01873d289e0b4f9f9184b251369502a9
I20250625 03:31:35.445225 3951 raft_consensus.cc:2802] T 06f309640df64f97a4065b1420fea692 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:31:35.445585 3951 raft_consensus.cc:491] T 06f309640df64f97a4065b1420fea692 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:31:35.445938 3951 raft_consensus.cc:3058] T 06f309640df64f97a4065b1420fea692 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:35.446076 3680 leader_election.cc:304] T 3ecdd525d6fd47deacf323decbc5c329 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, 841018313ad649679de64e006582f4c5; no voters: 01873d289e0b4f9f9184b251369502a9
I20250625 03:31:35.449620 3962 raft_consensus.cc:2802] T 3ecdd525d6fd47deacf323decbc5c329 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:31:35.450083 3962 raft_consensus.cc:491] T 3ecdd525d6fd47deacf323decbc5c329 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:31:35.450487 3962 raft_consensus.cc:3058] T 3ecdd525d6fd47deacf323decbc5c329 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:35.451253 3909 tablet_bootstrap.cc:492] T 2e956665b7e4411f86cf77259093c8aa P 3d5b9823dfcd41cb92bd195c811cbf39: Bootstrap starting.
I20250625 03:31:35.453790 3789 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b74d9f11c2bc4a7bb6431d6222d45175" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5"
I20250625 03:31:35.454485 3789 raft_consensus.cc:3058] T b74d9f11c2bc4a7bb6431d6222d45175 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:35.470060 3910 tablet_bootstrap.cc:654] T 5dc5a179a27f462989b291e8133742da P ddc0ad67020f45edb3ba9c83cab687a4: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:35.476337 3951 raft_consensus.cc:513] T 06f309640df64f97a4065b1420fea692 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:35.478565 3951 leader_election.cc:290] T 06f309640df64f97a4065b1420fea692 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 election: Requested vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 841018313ad649679de64e006582f4c5 (127.0.106.131:39467)
I20250625 03:31:35.480969 3640 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "06f309640df64f97a4065b1420fea692" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9"
I20250625 03:31:35.481717 3906 tablet_bootstrap.cc:492] T 3ecdd525d6fd47deacf323decbc5c329 P 01873d289e0b4f9f9184b251369502a9: No bootstrap required, opened a new log
I20250625 03:31:35.482254 3906 ts_tablet_manager.cc:1397] T 3ecdd525d6fd47deacf323decbc5c329 P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.110s user 0.018s sys 0.021s
I20250625 03:31:35.482337 3787 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "06f309640df64f97a4065b1420fea692" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5"
I20250625 03:31:35.482504 3788 raft_consensus.cc:2466] T bccba871bcd747fd80a890b25628ebe2 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5b9823dfcd41cb92bd195c811cbf39 in term 1.
I20250625 03:31:35.483042 3787 raft_consensus.cc:3058] T 06f309640df64f97a4065b1420fea692 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:35.485345 3906 raft_consensus.cc:357] T 3ecdd525d6fd47deacf323decbc5c329 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:35.486119 3906 raft_consensus.cc:383] T 3ecdd525d6fd47deacf323decbc5c329 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:35.486402 3906 raft_consensus.cc:738] T 3ecdd525d6fd47deacf323decbc5c329 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:35.487130 3906 consensus_queue.cc:260] T 3ecdd525d6fd47deacf323decbc5c329 P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:35.469521 3946 leader_election.cc:290] T b74d9f11c2bc4a7bb6431d6222d45175 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 election: Requested vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353)
I20250625 03:31:35.489077 3909 tablet_bootstrap.cc:654] T 2e956665b7e4411f86cf77259093c8aa P 3d5b9823dfcd41cb92bd195c811cbf39: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:35.492740 3932 raft_consensus.cc:491] T b1ece928b2e2452191ee263cf19ec4f8 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:35.493281 3932 raft_consensus.cc:513] T b1ece928b2e2452191ee263cf19ec4f8 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:35.494140 3715 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c592f2c5305141c487b73e0867d0f36b" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" is_pre_election: true
I20250625 03:31:35.494321 3788 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "485f3e9350e245a9939133866b354302" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:31:35.495028 3788 raft_consensus.cc:2466] T 485f3e9350e245a9939133866b354302 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddc0ad67020f45edb3ba9c83cab687a4 in term 0.
I20250625 03:31:35.495311 3932 leader_election.cc:290] T b1ece928b2e2452191ee263cf19ec4f8 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041), 841018313ad649679de64e006582f4c5 (127.0.106.131:39467)
I20250625 03:31:35.494140 3906 ts_tablet_manager.cc:1428] T 3ecdd525d6fd47deacf323decbc5c329 P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.012s user 0.009s sys 0.000s
I20250625 03:31:35.498939 3906 tablet_bootstrap.cc:492] T 06f309640df64f97a4065b1420fea692 P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:35.479362 3962 raft_consensus.cc:513] T 3ecdd525d6fd47deacf323decbc5c329 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:35.507911 3905 tablet_bootstrap.cc:492] T 49d4fb2581ed4ef998f6a113ea67c323 P 841018313ad649679de64e006582f4c5: No bootstrap required, opened a new log
I20250625 03:31:35.507525 3938 consensus_queue.cc:1035] T 7a8ecc65ca1140beb905dd6368bfaa2a P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:31:35.508440 3905 ts_tablet_manager.cc:1397] T 49d4fb2581ed4ef998f6a113ea67c323 P 841018313ad649679de64e006582f4c5: Time spent bootstrapping tablet: real 0.108s user 0.012s sys 0.009s
W20250625 03:31:35.500744 3680 leader_election.cc:343] T 06f309640df64f97a4065b1420fea692 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:35.511807 3905 raft_consensus.cc:357] T 49d4fb2581ed4ef998f6a113ea67c323 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:35.512585 3905 raft_consensus.cc:383] T 49d4fb2581ed4ef998f6a113ea67c323 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:35.512966 3905 raft_consensus.cc:738] T 49d4fb2581ed4ef998f6a113ea67c323 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841018313ad649679de64e006582f4c5, State: Initialized, Role: FOLLOWER
I20250625 03:31:35.513131 3680 leader_election.cc:304] T bccba871bcd747fd80a890b25628ebe2 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, 841018313ad649679de64e006582f4c5; no voters:
I20250625 03:31:35.513689 3905 consensus_queue.cc:260] T 49d4fb2581ed4ef998f6a113ea67c323 P 841018313ad649679de64e006582f4c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:35.514431 3914 raft_consensus.cc:2802] T bccba871bcd747fd80a890b25628ebe2 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:31:35.519124 3787 raft_consensus.cc:2466] T 06f309640df64f97a4065b1420fea692 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5b9823dfcd41cb92bd195c811cbf39 in term 1.
I20250625 03:31:35.520850 3680 leader_election.cc:304] T 06f309640df64f97a4065b1420fea692 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, 841018313ad649679de64e006582f4c5; no voters: 01873d289e0b4f9f9184b251369502a9
I20250625 03:31:35.497108 3951 raft_consensus.cc:491] T b1ece928b2e2452191ee263cf19ec4f8 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:35.525576 3964 raft_consensus.cc:491] T c0c8dfded31e4566b07bc439f6e58ef6 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:35.526484 3787 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b74d9f11c2bc4a7bb6431d6222d45175" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:31:35.526222 3964 raft_consensus.cc:513] T c0c8dfded31e4566b07bc439f6e58ef6 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:35.527124 3789 raft_consensus.cc:2466] T b74d9f11c2bc4a7bb6431d6222d45175 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01873d289e0b4f9f9184b251369502a9 in term 1.
I20250625 03:31:35.529515 3905 ts_tablet_manager.cc:1428] T 49d4fb2581ed4ef998f6a113ea67c323 P 841018313ad649679de64e006582f4c5: Time spent starting tablet: real 0.021s user 0.007s sys 0.000s
I20250625 03:31:35.531423 3605 leader_election.cc:304] T b74d9f11c2bc4a7bb6431d6222d45175 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9, 841018313ad649679de64e006582f4c5; no voters:
I20250625 03:31:35.524526 3951 raft_consensus.cc:513] T b1ece928b2e2452191ee263cf19ec4f8 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:35.534236 3951 leader_election.cc:290] T b1ece928b2e2452191ee263cf19ec4f8 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353)
I20250625 03:31:35.534930 3951 raft_consensus.cc:2802] T 06f309640df64f97a4065b1420fea692 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:31:35.535387 3951 raft_consensus.cc:695] T 06f309640df64f97a4065b1420fea692 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 LEADER]: Becoming Leader. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Running, Role: LEADER
I20250625 03:31:35.535437 3962 leader_election.cc:290] T 3ecdd525d6fd47deacf323decbc5c329 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 election: Requested vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 841018313ad649679de64e006582f4c5 (127.0.106.131:39467)
I20250625 03:31:35.536613 3863 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bccba871bcd747fd80a890b25628ebe2" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4"
I20250625 03:31:35.537364 3714 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c0c8dfded31e4566b07bc439f6e58ef6" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" is_pre_election: true
I20250625 03:31:35.537441 3640 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c0c8dfded31e4566b07bc439f6e58ef6" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:35.529044 3964 leader_election.cc:290] T c0c8dfded31e4566b07bc439f6e58ef6 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:31:35.535398 3938 raft_consensus.cc:2802] T b74d9f11c2bc4a7bb6431d6222d45175 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Leader election won for term 1
W20250625 03:31:35.539594 3754 leader_election.cc:343] T c0c8dfded31e4566b07bc439f6e58ef6 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:35.539770 3938 raft_consensus.cc:695] T b74d9f11c2bc4a7bb6431d6222d45175 P 01873d289e0b4f9f9184b251369502a9 [term 1 LEADER]: Becoming Leader. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Running, Role: LEADER
I20250625 03:31:35.540791 3863 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b74d9f11c2bc4a7bb6431d6222d45175" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:35.540664 3951 consensus_queue.cc:237] T 06f309640df64f97a4065b1420fea692 P 3d5b9823dfcd41cb92bd195c811cbf39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:35.541431 3863 raft_consensus.cc:2466] T b74d9f11c2bc4a7bb6431d6222d45175 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01873d289e0b4f9f9184b251369502a9 in term 0.
I20250625 03:31:35.541034 3938 consensus_queue.cc:237] T b74d9f11c2bc4a7bb6431d6222d45175 P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:35.543013 3863 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b74d9f11c2bc4a7bb6431d6222d45175" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4"
I20250625 03:31:35.543538 3863 raft_consensus.cc:3058] T b74d9f11c2bc4a7bb6431d6222d45175 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:35.531069 3905 tablet_bootstrap.cc:492] T 6fc84ca2087c4ded91412fb32117af48 P 841018313ad649679de64e006582f4c5: Bootstrap starting.
I20250625 03:31:35.551070 3714 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b1ece928b2e2452191ee263cf19ec4f8" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" is_pre_election: true
I20250625 03:31:35.552070 3714 raft_consensus.cc:2466] T b1ece928b2e2452191ee263cf19ec4f8 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddc0ad67020f45edb3ba9c83cab687a4 in term 0.
W20250625 03:31:35.552726 3754 leader_election.cc:343] T c0c8dfded31e4566b07bc439f6e58ef6 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:35.553217 3754 leader_election.cc:304] T c0c8dfded31e4566b07bc439f6e58ef6 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841018313ad649679de64e006582f4c5; no voters: 01873d289e0b4f9f9184b251369502a9, 3d5b9823dfcd41cb92bd195c811cbf39
W20250625 03:31:35.553989 3679 leader_election.cc:343] T bccba871bcd747fd80a890b25628ebe2 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:35.556567 3950 consensus_queue.cc:1035] T 7e92fd94b9f24b1097e9a7373896cb26 P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:31:35.558007 3828 leader_election.cc:304] T 485f3e9350e245a9939133866b354302 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841018313ad649679de64e006582f4c5, ddc0ad67020f45edb3ba9c83cab687a4; no voters:
I20250625 03:31:35.559250 3975 raft_consensus.cc:491] T a07d77259251401d957af853b296750a P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:35.559535 3787 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b1ece928b2e2452191ee263cf19ec4f8" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:31:35.559613 3974 raft_consensus.cc:2802] T 485f3e9350e245a9939133866b354302 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:31:35.559758 3975 raft_consensus.cc:513] T a07d77259251401d957af853b296750a P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:35.561108 3974 raft_consensus.cc:491] T 485f3e9350e245a9939133866b354302 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:31:35.561525 3974 raft_consensus.cc:3058] T 485f3e9350e245a9939133866b354302 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:35.555272 3964 raft_consensus.cc:2747] T c0c8dfded31e4566b07bc439f6e58ef6 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:31:35.566848 3975 leader_election.cc:290] T a07d77259251401d957af853b296750a P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:31:35.570051 3863 raft_consensus.cc:2466] T b74d9f11c2bc4a7bb6431d6222d45175 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01873d289e0b4f9f9184b251369502a9 in term 1.
W20250625 03:31:35.559790 3828 leader_election.cc:343] T c592f2c5305141c487b73e0867d0f36b P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:35.561756 3914 raft_consensus.cc:695] T bccba871bcd747fd80a890b25628ebe2 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 LEADER]: Becoming Leader. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Running, Role: LEADER
I20250625 03:31:35.574620 3910 tablet_bootstrap.cc:492] T 5dc5a179a27f462989b291e8133742da P ddc0ad67020f45edb3ba9c83cab687a4: No bootstrap required, opened a new log
I20250625 03:31:35.583101 3910 ts_tablet_manager.cc:1397] T 5dc5a179a27f462989b291e8133742da P ddc0ad67020f45edb3ba9c83cab687a4: Time spent bootstrapping tablet: real 0.157s user 0.016s sys 0.023s
I20250625 03:31:35.583367 3914 consensus_queue.cc:237] T bccba871bcd747fd80a890b25628ebe2 P 3d5b9823dfcd41cb92bd195c811cbf39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:35.575326 3950 consensus_queue.cc:1035] T 7a8ecc65ca1140beb905dd6368bfaa2a P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:31:35.577378 3906 tablet_bootstrap.cc:654] T 06f309640df64f97a4065b1420fea692 P 01873d289e0b4f9f9184b251369502a9: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:35.581008 3905 tablet_bootstrap.cc:654] T 6fc84ca2087c4ded91412fb32117af48 P 841018313ad649679de64e006582f4c5: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:35.582211 3974 raft_consensus.cc:513] T 485f3e9350e245a9939133866b354302 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
W20250625 03:31:35.572491 3680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.131:39467, user_credentials={real_user=slave}} blocked reactor thread for 51736.1us
I20250625 03:31:35.585938 3910 raft_consensus.cc:357] T 5dc5a179a27f462989b291e8133742da P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:35.606132 3910 raft_consensus.cc:383] T 5dc5a179a27f462989b291e8133742da P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:35.595834 3828 leader_election.cc:304] T b1ece928b2e2452191ee263cf19ec4f8 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, ddc0ad67020f45edb3ba9c83cab687a4; no voters:
I20250625 03:31:35.610071 3910 raft_consensus.cc:738] T 5dc5a179a27f462989b291e8133742da P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Initialized, Role: FOLLOWER
I20250625 03:31:35.612709 3789 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b1ece928b2e2452191ee263cf19ec4f8" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:31:35.612797 3910 consensus_queue.cc:260] T 5dc5a179a27f462989b291e8133742da P ddc0ad67020f45edb3ba9c83cab687a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:35.615257 3910 ts_tablet_manager.cc:1428] T 5dc5a179a27f462989b291e8133742da P ddc0ad67020f45edb3ba9c83cab687a4: Time spent starting tablet: real 0.032s user 0.006s sys 0.001s
I20250625 03:31:35.616102 3975 raft_consensus.cc:2802] T b1ece928b2e2452191ee263cf19ec4f8 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:31:35.616519 3975 raft_consensus.cc:491] T b1ece928b2e2452191ee263cf19ec4f8 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:31:35.616842 3975 raft_consensus.cc:3058] T b1ece928b2e2452191ee263cf19ec4f8 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Advancing to term 1
W20250625 03:31:35.616879 3828 leader_election.cc:343] T b1ece928b2e2452191ee263cf19ec4f8 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841018313ad649679de64e006582f4c5 (127.0.106.131:39467): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:35.620033 3639 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c592f2c5305141c487b73e0867d0f36b" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:35.620986 3713 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a07d77259251401d957af853b296750a" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" is_pre_election: true
I20250625 03:31:35.621937 3713 raft_consensus.cc:2466] T a07d77259251401d957af853b296750a P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddc0ad67020f45edb3ba9c83cab687a4 in term 0.
I20250625 03:31:35.608100 3974 leader_election.cc:290] T 485f3e9350e245a9939133866b354302 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 election: Requested vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:31:35.631707 3863 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b1ece928b2e2452191ee263cf19ec4f8" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:35.623417 3640 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3ecdd525d6fd47deacf323decbc5c329" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9"
I20250625 03:31:35.633395 3640 raft_consensus.cc:3058] T 3ecdd525d6fd47deacf323decbc5c329 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:35.623266 3788 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "485f3e9350e245a9939133866b354302" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5"
W20250625 03:31:35.637849 3680 leader_election.cc:343] T b1ece928b2e2452191ee263cf19ec4f8 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841018313ad649679de64e006582f4c5 (127.0.106.131:39467): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:35.637939 3788 raft_consensus.cc:3058] T 485f3e9350e245a9939133866b354302 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:35.638139 3638 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b74d9f11c2bc4a7bb6431d6222d45175" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:35.637131 3639 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "485f3e9350e245a9939133866b354302" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:35.637369 3789 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3ecdd525d6fd47deacf323decbc5c329" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5"
I20250625 03:31:35.640425 3789 raft_consensus.cc:3058] T 3ecdd525d6fd47deacf323decbc5c329 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:35.641009 3828 leader_election.cc:304] T a07d77259251401d957af853b296750a P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, ddc0ad67020f45edb3ba9c83cab687a4; no voters:
W20250625 03:31:35.641957 3828 leader_election.cc:343] T c592f2c5305141c487b73e0867d0f36b P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:35.642378 3828 leader_election.cc:304] T c592f2c5305141c487b73e0867d0f36b P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddc0ad67020f45edb3ba9c83cab687a4; no voters: 01873d289e0b4f9f9184b251369502a9, 3d5b9823dfcd41cb92bd195c811cbf39
I20250625 03:31:35.643486 3828 leader_election.cc:304] T b74d9f11c2bc4a7bb6431d6222d45175 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddc0ad67020f45edb3ba9c83cab687a4; no voters: 01873d289e0b4f9f9184b251369502a9, 841018313ad649679de64e006582f4c5
I20250625 03:31:35.644222 3932 raft_consensus.cc:2747] T c592f2c5305141c487b73e0867d0f36b P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:31:35.643581 3974 raft_consensus.cc:2802] T a07d77259251401d957af853b296750a P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:31:35.644974 3974 raft_consensus.cc:491] T a07d77259251401d957af853b296750a P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:31:35.645313 3974 raft_consensus.cc:3058] T a07d77259251401d957af853b296750a P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:35.647233 3909 tablet_bootstrap.cc:492] T 2e956665b7e4411f86cf77259093c8aa P 3d5b9823dfcd41cb92bd195c811cbf39: No bootstrap required, opened a new log
I20250625 03:31:35.647666 3909 ts_tablet_manager.cc:1397] T 2e956665b7e4411f86cf77259093c8aa P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent bootstrapping tablet: real 0.197s user 0.016s sys 0.016s
I20250625 03:31:35.650523 3932 raft_consensus.cc:2747] T b74d9f11c2bc4a7bb6431d6222d45175 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:31:35.654214 3789 raft_consensus.cc:2466] T 3ecdd525d6fd47deacf323decbc5c329 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5b9823dfcd41cb92bd195c811cbf39 in term 1.
I20250625 03:31:35.654278 3639 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a07d77259251401d957af853b296750a" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:35.654839 3788 raft_consensus.cc:2466] T 485f3e9350e245a9939133866b354302 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddc0ad67020f45edb3ba9c83cab687a4 in term 1.
W20250625 03:31:35.659086 3828 leader_election.cc:343] T 485f3e9350e245a9939133866b354302 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:35.660485 3828 leader_election.cc:304] T 485f3e9350e245a9939133866b354302 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841018313ad649679de64e006582f4c5, ddc0ad67020f45edb3ba9c83cab687a4; no voters:
I20250625 03:31:35.661348 3932 raft_consensus.cc:2802] T 485f3e9350e245a9939133866b354302 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:31:35.662194 3938 raft_consensus.cc:491] T 49d4fb2581ed4ef998f6a113ea67c323 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:35.662398 3639 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "485f3e9350e245a9939133866b354302" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9"
I20250625 03:31:35.662703 3938 raft_consensus.cc:513] T 49d4fb2581ed4ef998f6a113ea67c323 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:35.663990 3680 leader_election.cc:304] T 3ecdd525d6fd47deacf323decbc5c329 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, 841018313ad649679de64e006582f4c5; no voters:
I20250625 03:31:35.664805 3951 raft_consensus.cc:2802] T 3ecdd525d6fd47deacf323decbc5c329 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:31:35.665309 3951 raft_consensus.cc:695] T 3ecdd525d6fd47deacf323decbc5c329 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 LEADER]: Becoming Leader. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Running, Role: LEADER
I20250625 03:31:35.665558 3974 raft_consensus.cc:513] T a07d77259251401d957af853b296750a P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:35.666185 3951 consensus_queue.cc:237] T 3ecdd525d6fd47deacf323decbc5c329 P 3d5b9823dfcd41cb92bd195c811cbf39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:35.667655 3910 tablet_bootstrap.cc:492] T f3a33aa1d146468c986f0b1ba7d5fb84 P ddc0ad67020f45edb3ba9c83cab687a4: Bootstrap starting.
I20250625 03:31:35.667578 3974 leader_election.cc:290] T a07d77259251401d957af853b296750a P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 election: Requested vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:31:35.669430 3938 leader_election.cc:290] T 49d4fb2581ed4ef998f6a113ea67c323 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353)
I20250625 03:31:35.673061 3909 raft_consensus.cc:357] T 2e956665b7e4411f86cf77259093c8aa P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:35.673972 3983 consensus_queue.cc:1035] T f3a33aa1d146468c986f0b1ba7d5fb84 P 3d5b9823dfcd41cb92bd195c811cbf39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:31:35.674429 3909 raft_consensus.cc:383] T 2e956665b7e4411f86cf77259093c8aa P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:35.674816 3909 raft_consensus.cc:738] T 2e956665b7e4411f86cf77259093c8aa P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Initialized, Role: FOLLOWER
W20250625 03:31:35.676422 3828 leader_election.cc:343] T a07d77259251401d957af853b296750a P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:35.682520 3536 catalog_manager.cc:5582] T b74d9f11c2bc4a7bb6431d6222d45175 P 01873d289e0b4f9f9184b251369502a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 01873d289e0b4f9f9184b251369502a9 (127.0.106.129). New cstate: current_term: 1 leader_uuid: "01873d289e0b4f9f9184b251369502a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: HEALTHY } } }
W20250625 03:31:35.687337 3754 consensus_peers.cc:487] T 2e956665b7e4411f86cf77259093c8aa P 841018313ad649679de64e006582f4c5 -> Peer 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041): Couldn't send request to peer 3d5b9823dfcd41cb92bd195c811cbf39. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:35.683367 3789 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "49d4fb2581ed4ef998f6a113ea67c323" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:31:35.677801 3909 consensus_queue.cc:260] T 2e956665b7e4411f86cf77259093c8aa P 3d5b9823dfcd41cb92bd195c811cbf39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:35.697839 3789 raft_consensus.cc:2466] T 49d4fb2581ed4ef998f6a113ea67c323 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01873d289e0b4f9f9184b251369502a9 in term 0.
W20250625 03:31:35.701099 3605 consensus_peers.cc:487] T 7e92fd94b9f24b1097e9a7373896cb26 P 01873d289e0b4f9f9184b251369502a9 -> Peer 841018313ad649679de64e006582f4c5 (127.0.106.131:39467): Couldn't send request to peer 841018313ad649679de64e006582f4c5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:35.701962 3605 leader_election.cc:304] T 49d4fb2581ed4ef998f6a113ea67c323 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9, 841018313ad649679de64e006582f4c5; no voters:
I20250625 03:31:35.702780 3640 raft_consensus.cc:2466] T 3ecdd525d6fd47deacf323decbc5c329 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5b9823dfcd41cb92bd195c811cbf39 in term 1.
I20250625 03:31:35.703109 3946 raft_consensus.cc:2802] T 49d4fb2581ed4ef998f6a113ea67c323 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:31:35.703704 3946 raft_consensus.cc:491] T 49d4fb2581ed4ef998f6a113ea67c323 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:31:35.704197 3946 raft_consensus.cc:3058] T 49d4fb2581ed4ef998f6a113ea67c323 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:35.711838 3909 ts_tablet_manager.cc:1428] T 2e956665b7e4411f86cf77259093c8aa P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent starting tablet: real 0.064s user 0.008s sys 0.000s
I20250625 03:31:35.713335 3909 tablet_bootstrap.cc:492] T 5dc5a179a27f462989b291e8133742da P 3d5b9823dfcd41cb92bd195c811cbf39: Bootstrap starting.
W20250625 03:31:35.679698 3828 leader_election.cc:343] T 485f3e9350e245a9939133866b354302 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:35.695607 3975 raft_consensus.cc:513] T b1ece928b2e2452191ee263cf19ec4f8 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:35.722851 3714 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a07d77259251401d957af853b296750a" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
I20250625 03:31:35.723098 3863 raft_consensus.cc:2391] T b1ece928b2e2452191ee263cf19ec4f8 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d5b9823dfcd41cb92bd195c811cbf39 in current term 1: Already voted for candidate ddc0ad67020f45edb3ba9c83cab687a4 in this term.
I20250625 03:31:35.723539 3714 raft_consensus.cc:3058] T a07d77259251401d957af853b296750a P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:35.725811 3906 tablet_bootstrap.cc:492] T 06f309640df64f97a4065b1420fea692 P 01873d289e0b4f9f9184b251369502a9: No bootstrap required, opened a new log
I20250625 03:31:35.727718 3946 raft_consensus.cc:513] T 49d4fb2581ed4ef998f6a113ea67c323 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:35.728492 3906 ts_tablet_manager.cc:1397] T 06f309640df64f97a4065b1420fea692 P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.230s user 0.015s sys 0.011s
I20250625 03:31:35.724263 3640 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a07d77259251401d957af853b296750a" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9"
I20250625 03:31:35.731035 3946 leader_election.cc:290] T 49d4fb2581ed4ef998f6a113ea67c323 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 election: Requested vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353)
I20250625 03:31:35.723943 3975 leader_election.cc:290] T b1ece928b2e2452191ee263cf19ec4f8 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 election: Requested vote from peers 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041), 841018313ad649679de64e006582f4c5 (127.0.106.131:39467)
I20250625 03:31:35.715898 3932 raft_consensus.cc:695] T 485f3e9350e245a9939133866b354302 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 LEADER]: Becoming Leader. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Running, Role: LEADER
I20250625 03:31:35.726935 3910 tablet_bootstrap.cc:654] T f3a33aa1d146468c986f0b1ba7d5fb84 P ddc0ad67020f45edb3ba9c83cab687a4: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:35.732348 3932 consensus_queue.cc:237] T 485f3e9350e245a9939133866b354302 P ddc0ad67020f45edb3ba9c83cab687a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:35.733433 3788 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "49d4fb2581ed4ef998f6a113ea67c323" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5"
I20250625 03:31:35.734074 3788 raft_consensus.cc:3058] T 49d4fb2581ed4ef998f6a113ea67c323 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:35.736163 3863 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "49d4fb2581ed4ef998f6a113ea67c323" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:35.736686 3906 raft_consensus.cc:357] T 06f309640df64f97a4065b1420fea692 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
W20250625 03:31:35.737411 3828 leader_election.cc:343] T a07d77259251401d957af853b296750a P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:35.738920 3789 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b1ece928b2e2452191ee263cf19ec4f8" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5"
I20250625 03:31:35.740454 3905 tablet_bootstrap.cc:492] T 6fc84ca2087c4ded91412fb32117af48 P 841018313ad649679de64e006582f4c5: No bootstrap required, opened a new log
I20250625 03:31:35.737594 3906 raft_consensus.cc:383] T 06f309640df64f97a4065b1420fea692 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:35.741883 3906 raft_consensus.cc:738] T 06f309640df64f97a4065b1420fea692 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:35.742630 3906 consensus_queue.cc:260] T 06f309640df64f97a4065b1420fea692 P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:35.742698 3536 catalog_manager.cc:5582] T bccba871bcd747fd80a890b25628ebe2 P 3d5b9823dfcd41cb92bd195c811cbf39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:35.743739 3905 ts_tablet_manager.cc:1397] T 6fc84ca2087c4ded91412fb32117af48 P 841018313ad649679de64e006582f4c5: Time spent bootstrapping tablet: real 0.213s user 0.014s sys 0.019s
I20250625 03:31:35.740821 3715 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b1ece928b2e2452191ee263cf19ec4f8" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
I20250625 03:31:35.738119 3679 leader_election.cc:304] T b1ece928b2e2452191ee263cf19ec4f8 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39; no voters: 841018313ad649679de64e006582f4c5, ddc0ad67020f45edb3ba9c83cab687a4
I20250625 03:31:35.747959 3714 raft_consensus.cc:2466] T a07d77259251401d957af853b296750a P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddc0ad67020f45edb3ba9c83cab687a4 in term 1.
I20250625 03:31:35.748101 3715 raft_consensus.cc:3058] T b1ece928b2e2452191ee263cf19ec4f8 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Advancing to term 1
W20250625 03:31:35.749253 3679 consensus_peers.cc:487] T f3a33aa1d146468c986f0b1ba7d5fb84 P 3d5b9823dfcd41cb92bd195c811cbf39 -> Peer ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353): Couldn't send request to peer ddc0ad67020f45edb3ba9c83cab687a4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:35.747030 3909 tablet_bootstrap.cc:654] T 5dc5a179a27f462989b291e8133742da P 3d5b9823dfcd41cb92bd195c811cbf39: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:35.737779 3862 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "49d4fb2581ed4ef998f6a113ea67c323" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4"
I20250625 03:31:35.750247 3905 raft_consensus.cc:357] T 6fc84ca2087c4ded91412fb32117af48 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:35.750830 3536 catalog_manager.cc:5582] T 06f309640df64f97a4065b1420fea692 P 3d5b9823dfcd41cb92bd195c811cbf39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:35.754273 3905 raft_consensus.cc:383] T 6fc84ca2087c4ded91412fb32117af48 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:35.754644 3905 raft_consensus.cc:738] T 6fc84ca2087c4ded91412fb32117af48 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841018313ad649679de64e006582f4c5, State: Initialized, Role: FOLLOWER
I20250625 03:31:35.755316 3905 consensus_queue.cc:260] T 6fc84ca2087c4ded91412fb32117af48 P 841018313ad649679de64e006582f4c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
W20250625 03:31:35.756319 3604 leader_election.cc:343] T 49d4fb2581ed4ef998f6a113ea67c323 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:35.757063 3906 ts_tablet_manager.cc:1428] T 06f309640df64f97a4065b1420fea692 P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.028s user 0.005s sys 0.002s
I20250625 03:31:35.757686 3905 ts_tablet_manager.cc:1428] T 6fc84ca2087c4ded91412fb32117af48 P 841018313ad649679de64e006582f4c5: Time spent starting tablet: real 0.010s user 0.005s sys 0.000s
I20250625 03:31:35.758080 3938 raft_consensus.cc:491] T 06f309640df64f97a4065b1420fea692 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:35.758726 3905 tablet_bootstrap.cc:492] T 7e92fd94b9f24b1097e9a7373896cb26 P 841018313ad649679de64e006582f4c5: Bootstrap starting.
I20250625 03:31:35.758607 3938 raft_consensus.cc:513] T 06f309640df64f97a4065b1420fea692 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:35.759431 3906 tablet_bootstrap.cc:492] T 485f3e9350e245a9939133866b354302 P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
W20250625 03:31:35.764573 3604 leader_election.cc:343] T 49d4fb2581ed4ef998f6a113ea67c323 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:35.761830 3715 raft_consensus.cc:2466] T b1ece928b2e2452191ee263cf19ec4f8 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddc0ad67020f45edb3ba9c83cab687a4 in term 1.
I20250625 03:31:35.768733 3914 raft_consensus.cc:2747] T b1ece928b2e2452191ee263cf19ec4f8 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:31:35.771497 3906 tablet_bootstrap.cc:654] T 485f3e9350e245a9939133866b354302 P 01873d289e0b4f9f9184b251369502a9: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:35.775485 3938 leader_election.cc:290] T 06f309640df64f97a4065b1420fea692 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041), 841018313ad649679de64e006582f4c5 (127.0.106.131:39467)
I20250625 03:31:35.779424 3715 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "06f309640df64f97a4065b1420fea692" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" is_pre_election: true
I20250625 03:31:35.779532 3787 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "06f309640df64f97a4065b1420fea692" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:31:35.780977 3787 raft_consensus.cc:2391] T 06f309640df64f97a4065b1420fea692 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01873d289e0b4f9f9184b251369502a9 in current term 1: Already voted for candidate 3d5b9823dfcd41cb92bd195c811cbf39 in this term.
W20250625 03:31:35.781633 3828 leader_election.cc:343] T b1ece928b2e2452191ee263cf19ec4f8 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 841018313ad649679de64e006582f4c5 (127.0.106.131:39467): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:35.785674 3910 tablet_bootstrap.cc:492] T f3a33aa1d146468c986f0b1ba7d5fb84 P ddc0ad67020f45edb3ba9c83cab687a4: No bootstrap required, opened a new log
I20250625 03:31:35.786374 3910 ts_tablet_manager.cc:1397] T f3a33aa1d146468c986f0b1ba7d5fb84 P ddc0ad67020f45edb3ba9c83cab687a4: Time spent bootstrapping tablet: real 0.130s user 0.018s sys 0.002s
I20250625 03:31:35.787892 3605 leader_election.cc:304] T 06f309640df64f97a4065b1420fea692 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9; no voters: 3d5b9823dfcd41cb92bd195c811cbf39, 841018313ad649679de64e006582f4c5
I20250625 03:31:35.789068 3910 raft_consensus.cc:357] T f3a33aa1d146468c986f0b1ba7d5fb84 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:35.789785 3910 raft_consensus.cc:383] T f3a33aa1d146468c986f0b1ba7d5fb84 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:35.790061 3910 raft_consensus.cc:738] T f3a33aa1d146468c986f0b1ba7d5fb84 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Initialized, Role: FOLLOWER
I20250625 03:31:35.787935 3905 tablet_bootstrap.cc:654] T 7e92fd94b9f24b1097e9a7373896cb26 P 841018313ad649679de64e006582f4c5: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:35.791370 3914 raft_consensus.cc:491] T 2e956665b7e4411f86cf77259093c8aa P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:35.791532 3996 raft_consensus.cc:3058] T 06f309640df64f97a4065b1420fea692 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:35.791827 3914 raft_consensus.cc:513] T 2e956665b7e4411f86cf77259093c8aa P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:35.794122 3914 leader_election.cc:290] T 2e956665b7e4411f86cf77259093c8aa P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353)
I20250625 03:31:35.794941 3787 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2e956665b7e4411f86cf77259093c8aa" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:31:35.790663 3910 consensus_queue.cc:260] T f3a33aa1d146468c986f0b1ba7d5fb84 P ddc0ad67020f45edb3ba9c83cab687a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:35.796361 3938 raft_consensus.cc:491] T 5dc5a179a27f462989b291e8133742da P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:35.797045 3938 raft_consensus.cc:513] T 5dc5a179a27f462989b291e8133742da P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:35.799103 3862 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2e956665b7e4411f86cf77259093c8aa" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:35.800290 3910 ts_tablet_manager.cc:1428] T f3a33aa1d146468c986f0b1ba7d5fb84 P ddc0ad67020f45edb3ba9c83cab687a4: Time spent starting tablet: real 0.014s user 0.006s sys 0.001s
I20250625 03:31:35.800194 3862 raft_consensus.cc:2391] T 2e956665b7e4411f86cf77259093c8aa P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d5b9823dfcd41cb92bd195c811cbf39 in current term 1: Already voted for candidate 841018313ad649679de64e006582f4c5 in this term.
I20250625 03:31:35.803525 3715 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5dc5a179a27f462989b291e8133742da" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" is_pre_election: true
W20250625 03:31:35.816267 3605 leader_election.cc:343] T 5dc5a179a27f462989b291e8133742da P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:35.815371 3535 catalog_manager.cc:5582] T 3ecdd525d6fd47deacf323decbc5c329 P 3d5b9823dfcd41cb92bd195c811cbf39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:35.800139 3938 leader_election.cc:290] T 5dc5a179a27f462989b291e8133742da P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:31:35.818480 3964 consensus_queue.cc:1035] T 2e956665b7e4411f86cf77259093c8aa P 841018313ad649679de64e006582f4c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:31:35.804867 3910 tablet_bootstrap.cc:492] T bccba871bcd747fd80a890b25628ebe2 P ddc0ad67020f45edb3ba9c83cab687a4: Bootstrap starting.
I20250625 03:31:35.815665 3996 raft_consensus.cc:2747] T 06f309640df64f97a4065b1420fea692 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:31:35.801836 3828 leader_election.cc:304] T a07d77259251401d957af853b296750a P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, ddc0ad67020f45edb3ba9c83cab687a4; no voters: 01873d289e0b4f9f9184b251369502a9
I20250625 03:31:35.822408 3994 raft_consensus.cc:2802] T a07d77259251401d957af853b296750a P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:31:35.823037 3788 raft_consensus.cc:2466] T 49d4fb2581ed4ef998f6a113ea67c323 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01873d289e0b4f9f9184b251369502a9 in term 1.
I20250625 03:31:35.823156 3994 raft_consensus.cc:695] T a07d77259251401d957af853b296750a P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 LEADER]: Becoming Leader. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Running, Role: LEADER
I20250625 03:31:35.824417 3605 leader_election.cc:304] T 49d4fb2581ed4ef998f6a113ea67c323 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9, 841018313ad649679de64e006582f4c5; no voters: ddc0ad67020f45edb3ba9c83cab687a4
I20250625 03:31:35.824668 3994 consensus_queue.cc:237] T a07d77259251401d957af853b296750a P ddc0ad67020f45edb3ba9c83cab687a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:35.826431 3996 raft_consensus.cc:2802] T 49d4fb2581ed4ef998f6a113ea67c323 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:31:35.827095 3996 raft_consensus.cc:695] T 49d4fb2581ed4ef998f6a113ea67c323 P 01873d289e0b4f9f9184b251369502a9 [term 1 LEADER]: Becoming Leader. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Running, Role: LEADER
I20250625 03:31:35.827934 3996 consensus_queue.cc:237] T 49d4fb2581ed4ef998f6a113ea67c323 P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:35.831383 3909 tablet_bootstrap.cc:492] T 5dc5a179a27f462989b291e8133742da P 3d5b9823dfcd41cb92bd195c811cbf39: No bootstrap required, opened a new log
I20250625 03:31:35.832511 3909 ts_tablet_manager.cc:1397] T 5dc5a179a27f462989b291e8133742da P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent bootstrapping tablet: real 0.119s user 0.020s sys 0.005s
I20250625 03:31:35.834794 3828 leader_election.cc:304] T b1ece928b2e2452191ee263cf19ec4f8 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, ddc0ad67020f45edb3ba9c83cab687a4; no voters: 841018313ad649679de64e006582f4c5
I20250625 03:31:35.835134 3909 raft_consensus.cc:357] T 5dc5a179a27f462989b291e8133742da P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:35.838562 3909 raft_consensus.cc:383] T 5dc5a179a27f462989b291e8133742da P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:35.838891 3909 raft_consensus.cc:738] T 5dc5a179a27f462989b291e8133742da P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Initialized, Role: FOLLOWER
I20250625 03:31:35.839413 3932 raft_consensus.cc:2802] T b1ece928b2e2452191ee263cf19ec4f8 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:31:35.839967 3932 raft_consensus.cc:695] T b1ece928b2e2452191ee263cf19ec4f8 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 LEADER]: Becoming Leader. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Running, Role: LEADER
I20250625 03:31:35.836320 3905 tablet_bootstrap.cc:492] T 7e92fd94b9f24b1097e9a7373896cb26 P 841018313ad649679de64e006582f4c5: No bootstrap required, opened a new log
I20250625 03:31:35.840626 3905 ts_tablet_manager.cc:1397] T 7e92fd94b9f24b1097e9a7373896cb26 P 841018313ad649679de64e006582f4c5: Time spent bootstrapping tablet: real 0.082s user 0.015s sys 0.003s
I20250625 03:31:35.839602 3909 consensus_queue.cc:260] T 5dc5a179a27f462989b291e8133742da P 3d5b9823dfcd41cb92bd195c811cbf39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:35.840828 3932 consensus_queue.cc:237] T b1ece928b2e2452191ee263cf19ec4f8 P ddc0ad67020f45edb3ba9c83cab687a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:35.842149 3910 tablet_bootstrap.cc:654] T bccba871bcd747fd80a890b25628ebe2 P ddc0ad67020f45edb3ba9c83cab687a4: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:35.844236 3909 ts_tablet_manager.cc:1428] T 5dc5a179a27f462989b291e8133742da P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent starting tablet: real 0.011s user 0.006s sys 0.001s
I20250625 03:31:35.845326 3909 tablet_bootstrap.cc:492] T 5e59ae16ec1a4c69aac820531e504206 P 3d5b9823dfcd41cb92bd195c811cbf39: Bootstrap starting.
I20250625 03:31:35.845682 3679 leader_election.cc:304] T 2e956665b7e4411f86cf77259093c8aa P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39; no voters: 841018313ad649679de64e006582f4c5, ddc0ad67020f45edb3ba9c83cab687a4
I20250625 03:31:35.846840 3862 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5dc5a179a27f462989b291e8133742da" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:35.847502 3905 raft_consensus.cc:357] T 7e92fd94b9f24b1097e9a7373896cb26 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:35.847507 3862 raft_consensus.cc:2466] T 5dc5a179a27f462989b291e8133742da P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01873d289e0b4f9f9184b251369502a9 in term 0.
I20250625 03:31:35.848224 3914 raft_consensus.cc:3058] T 2e956665b7e4411f86cf77259093c8aa P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:35.852717 3905 raft_consensus.cc:383] T 7e92fd94b9f24b1097e9a7373896cb26 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:35.853068 3905 raft_consensus.cc:738] T 7e92fd94b9f24b1097e9a7373896cb26 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841018313ad649679de64e006582f4c5, State: Initialized, Role: FOLLOWER
I20250625 03:31:35.853893 3905 consensus_queue.cc:260] T 7e92fd94b9f24b1097e9a7373896cb26 P 841018313ad649679de64e006582f4c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:35.855213 3906 tablet_bootstrap.cc:492] T 485f3e9350e245a9939133866b354302 P 01873d289e0b4f9f9184b251369502a9: No bootstrap required, opened a new log
I20250625 03:31:35.855852 3906 ts_tablet_manager.cc:1397] T 485f3e9350e245a9939133866b354302 P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.097s user 0.011s sys 0.001s
I20250625 03:31:35.850759 3538 catalog_manager.cc:5582] T 485f3e9350e245a9939133866b354302 P ddc0ad67020f45edb3ba9c83cab687a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132). New cstate: current_term: 1 leader_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:35.860216 3909 tablet_bootstrap.cc:654] T 5e59ae16ec1a4c69aac820531e504206 P 3d5b9823dfcd41cb92bd195c811cbf39: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:35.863718 3604 leader_election.cc:304] T 5dc5a179a27f462989b291e8133742da P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9, ddc0ad67020f45edb3ba9c83cab687a4; no voters: 3d5b9823dfcd41cb92bd195c811cbf39
I20250625 03:31:35.865355 3938 raft_consensus.cc:2802] T 5dc5a179a27f462989b291e8133742da P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:31:35.865837 3938 raft_consensus.cc:491] T 5dc5a179a27f462989b291e8133742da P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:31:35.866250 3938 raft_consensus.cc:3058] T 5dc5a179a27f462989b291e8133742da P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:35.868561 3914 raft_consensus.cc:2747] T 2e956665b7e4411f86cf77259093c8aa P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:31:35.873543 3905 ts_tablet_manager.cc:1428] T 7e92fd94b9f24b1097e9a7373896cb26 P 841018313ad649679de64e006582f4c5: Time spent starting tablet: real 0.033s user 0.011s sys 0.000s
I20250625 03:31:35.875510 3938 raft_consensus.cc:513] T 5dc5a179a27f462989b291e8133742da P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:35.879689 3909 tablet_bootstrap.cc:492] T 5e59ae16ec1a4c69aac820531e504206 P 3d5b9823dfcd41cb92bd195c811cbf39: No bootstrap required, opened a new log
I20250625 03:31:35.879609 3862 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5dc5a179a27f462989b291e8133742da" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4"
I20250625 03:31:35.882350 3862 raft_consensus.cc:3058] T 5dc5a179a27f462989b291e8133742da P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:35.883674 3909 ts_tablet_manager.cc:1397] T 5e59ae16ec1a4c69aac820531e504206 P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent bootstrapping tablet: real 0.039s user 0.003s sys 0.010s
I20250625 03:31:35.885020 3715 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5dc5a179a27f462989b291e8133742da" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
I20250625 03:31:35.885628 3715 raft_consensus.cc:3058] T 5dc5a179a27f462989b291e8133742da P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:35.883855 3906 raft_consensus.cc:357] T 485f3e9350e245a9939133866b354302 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:35.887385 3906 raft_consensus.cc:383] T 485f3e9350e245a9939133866b354302 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:35.887652 3910 tablet_bootstrap.cc:492] T bccba871bcd747fd80a890b25628ebe2 P ddc0ad67020f45edb3ba9c83cab687a4: No bootstrap required, opened a new log
I20250625 03:31:35.887801 3906 raft_consensus.cc:738] T 485f3e9350e245a9939133866b354302 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:35.888293 3910 ts_tablet_manager.cc:1397] T bccba871bcd747fd80a890b25628ebe2 P ddc0ad67020f45edb3ba9c83cab687a4: Time spent bootstrapping tablet: real 0.084s user 0.014s sys 0.004s
I20250625 03:31:35.883523 3938 leader_election.cc:290] T 5dc5a179a27f462989b291e8133742da P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 election: Requested vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:31:35.889034 3906 consensus_queue.cc:260] T 485f3e9350e245a9939133866b354302 P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:35.891844 3906 ts_tablet_manager.cc:1428] T 485f3e9350e245a9939133866b354302 P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.036s user 0.006s sys 0.000s
I20250625 03:31:35.892441 3538 catalog_manager.cc:5582] T a07d77259251401d957af853b296750a P ddc0ad67020f45edb3ba9c83cab687a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132). New cstate: current_term: 1 leader_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:35.893725 3905 tablet_bootstrap.cc:492] T 002d4371d5414440b756829fe3343d07 P 841018313ad649679de64e006582f4c5: Bootstrap starting.
I20250625 03:31:35.893625 3538 catalog_manager.cc:5582] T b1ece928b2e2452191ee263cf19ec4f8 P ddc0ad67020f45edb3ba9c83cab687a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132). New cstate: current_term: 1 leader_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: HEALTHY } } }
I20250625 03:31:35.895673 3906 tablet_bootstrap.cc:492] T a07d77259251401d957af853b296750a P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:35.902184 3906 tablet_bootstrap.cc:654] T a07d77259251401d957af853b296750a P 01873d289e0b4f9f9184b251369502a9: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:35.903810 3932 raft_consensus.cc:491] T f3a33aa1d146468c986f0b1ba7d5fb84 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:35.904390 3932 raft_consensus.cc:513] T f3a33aa1d146468c986f0b1ba7d5fb84 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:35.909862 3932 leader_election.cc:290] T f3a33aa1d146468c986f0b1ba7d5fb84 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:31:35.911150 3905 tablet_bootstrap.cc:654] T 002d4371d5414440b756829fe3343d07 P 841018313ad649679de64e006582f4c5: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:35.912442 3714 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f3a33aa1d146468c986f0b1ba7d5fb84" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" is_pre_election: true
I20250625 03:31:35.914621 3639 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f3a33aa1d146468c986f0b1ba7d5fb84" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:35.915355 4013 raft_consensus.cc:491] T 7e92fd94b9f24b1097e9a7373896cb26 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:35.915935 3715 raft_consensus.cc:2466] T 5dc5a179a27f462989b291e8133742da P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01873d289e0b4f9f9184b251369502a9 in term 1.
I20250625 03:31:35.915900 4013 raft_consensus.cc:513] T 7e92fd94b9f24b1097e9a7373896cb26 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:35.918705 3605 leader_election.cc:304] T 5dc5a179a27f462989b291e8133742da P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9, 3d5b9823dfcd41cb92bd195c811cbf39; no voters:
I20250625 03:31:35.919649 3996 raft_consensus.cc:2802] T 5dc5a179a27f462989b291e8133742da P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:31:35.920132 4013 leader_election.cc:290] T 7e92fd94b9f24b1097e9a7373896cb26 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:31:35.916934 3862 raft_consensus.cc:2466] T 5dc5a179a27f462989b291e8133742da P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01873d289e0b4f9f9184b251369502a9 in term 1.
I20250625 03:31:35.917759 3828 leader_election.cc:304] T f3a33aa1d146468c986f0b1ba7d5fb84 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddc0ad67020f45edb3ba9c83cab687a4; no voters: 01873d289e0b4f9f9184b251369502a9, 3d5b9823dfcd41cb92bd195c811cbf39
I20250625 03:31:35.904587 3536 catalog_manager.cc:5582] T 49d4fb2581ed4ef998f6a113ea67c323 P 01873d289e0b4f9f9184b251369502a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 01873d289e0b4f9f9184b251369502a9 (127.0.106.129). New cstate: current_term: 1 leader_uuid: "01873d289e0b4f9f9184b251369502a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: HEALTHY } } }
I20250625 03:31:35.921792 3639 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7e92fd94b9f24b1097e9a7373896cb26" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:35.920535 3909 raft_consensus.cc:357] T 5e59ae16ec1a4c69aac820531e504206 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:35.930713 3909 raft_consensus.cc:383] T 5e59ae16ec1a4c69aac820531e504206 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:35.930868 3932 raft_consensus.cc:2747] T f3a33aa1d146468c986f0b1ba7d5fb84 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:31:35.931013 3909 raft_consensus.cc:738] T 5e59ae16ec1a4c69aac820531e504206 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Initialized, Role: FOLLOWER
I20250625 03:31:35.920409 3910 raft_consensus.cc:357] T bccba871bcd747fd80a890b25628ebe2 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:35.932111 3910 raft_consensus.cc:383] T bccba871bcd747fd80a890b25628ebe2 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:35.931896 3909 consensus_queue.cc:260] T 5e59ae16ec1a4c69aac820531e504206 P 3d5b9823dfcd41cb92bd195c811cbf39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:35.922371 3996 raft_consensus.cc:695] T 5dc5a179a27f462989b291e8133742da P 01873d289e0b4f9f9184b251369502a9 [term 1 LEADER]: Becoming Leader. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Running, Role: LEADER
I20250625 03:31:35.932435 3910 raft_consensus.cc:738] T bccba871bcd747fd80a890b25628ebe2 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Initialized, Role: FOLLOWER
I20250625 03:31:35.933379 3996 consensus_queue.cc:237] T 5dc5a179a27f462989b291e8133742da P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:35.933461 3910 consensus_queue.cc:260] T bccba871bcd747fd80a890b25628ebe2 P ddc0ad67020f45edb3ba9c83cab687a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:35.929697 3906 tablet_bootstrap.cc:492] T a07d77259251401d957af853b296750a P 01873d289e0b4f9f9184b251369502a9: No bootstrap required, opened a new log
I20250625 03:31:35.934478 3909 ts_tablet_manager.cc:1428] T 5e59ae16ec1a4c69aac820531e504206 P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent starting tablet: real 0.051s user 0.009s sys 0.002s
I20250625 03:31:35.935482 3909 tablet_bootstrap.cc:492] T d08de4c2326d46bab26f42d8d483ebd0 P 3d5b9823dfcd41cb92bd195c811cbf39: Bootstrap starting.
I20250625 03:31:35.935849 3906 ts_tablet_manager.cc:1397] T a07d77259251401d957af853b296750a P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.043s user 0.012s sys 0.000s
I20250625 03:31:35.938565 3906 raft_consensus.cc:357] T a07d77259251401d957af853b296750a P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:35.942252 3906 raft_consensus.cc:383] T a07d77259251401d957af853b296750a P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:35.942668 3906 raft_consensus.cc:738] T a07d77259251401d957af853b296750a P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:35.925468 3715 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7e92fd94b9f24b1097e9a7373896cb26" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" is_pre_election: true
I20250625 03:31:35.943511 3906 consensus_queue.cc:260] T a07d77259251401d957af853b296750a P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:35.945271 3754 leader_election.cc:304] T 7e92fd94b9f24b1097e9a7373896cb26 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841018313ad649679de64e006582f4c5; no voters: 01873d289e0b4f9f9184b251369502a9, 3d5b9823dfcd41cb92bd195c811cbf39
I20250625 03:31:35.946085 3906 ts_tablet_manager.cc:1428] T a07d77259251401d957af853b296750a P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.010s user 0.006s sys 0.000s
I20250625 03:31:35.946405 3905 tablet_bootstrap.cc:492] T 002d4371d5414440b756829fe3343d07 P 841018313ad649679de64e006582f4c5: No bootstrap required, opened a new log
I20250625 03:31:35.946432 4013 raft_consensus.cc:2747] T 7e92fd94b9f24b1097e9a7373896cb26 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:31:35.947078 3905 ts_tablet_manager.cc:1397] T 002d4371d5414440b756829fe3343d07 P 841018313ad649679de64e006582f4c5: Time spent bootstrapping tablet: real 0.054s user 0.012s sys 0.002s
I20250625 03:31:35.947407 3906 tablet_bootstrap.cc:492] T d08de4c2326d46bab26f42d8d483ebd0 P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:35.941208 3909 tablet_bootstrap.cc:654] T d08de4c2326d46bab26f42d8d483ebd0 P 3d5b9823dfcd41cb92bd195c811cbf39: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:35.940209 3910 ts_tablet_manager.cc:1428] T bccba871bcd747fd80a890b25628ebe2 P ddc0ad67020f45edb3ba9c83cab687a4: Time spent starting tablet: real 0.052s user 0.005s sys 0.002s
I20250625 03:31:35.950376 3910 tablet_bootstrap.cc:492] T 1e9c146f8cd743f7ac35dc61d9226d1d P ddc0ad67020f45edb3ba9c83cab687a4: Bootstrap starting.
I20250625 03:31:35.954402 3905 raft_consensus.cc:357] T 002d4371d5414440b756829fe3343d07 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:35.955143 3905 raft_consensus.cc:383] T 002d4371d5414440b756829fe3343d07 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:35.955391 3905 raft_consensus.cc:738] T 002d4371d5414440b756829fe3343d07 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841018313ad649679de64e006582f4c5, State: Initialized, Role: FOLLOWER
I20250625 03:31:35.956103 3905 consensus_queue.cc:260] T 002d4371d5414440b756829fe3343d07 P 841018313ad649679de64e006582f4c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:35.958294 3905 ts_tablet_manager.cc:1428] T 002d4371d5414440b756829fe3343d07 P 841018313ad649679de64e006582f4c5: Time spent starting tablet: real 0.011s user 0.006s sys 0.000s
I20250625 03:31:35.960085 3910 tablet_bootstrap.cc:654] T 1e9c146f8cd743f7ac35dc61d9226d1d P ddc0ad67020f45edb3ba9c83cab687a4: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:35.962061 3909 tablet_bootstrap.cc:492] T d08de4c2326d46bab26f42d8d483ebd0 P 3d5b9823dfcd41cb92bd195c811cbf39: No bootstrap required, opened a new log
I20250625 03:31:35.961584 3536 catalog_manager.cc:5582] T 5dc5a179a27f462989b291e8133742da P 01873d289e0b4f9f9184b251369502a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 01873d289e0b4f9f9184b251369502a9 (127.0.106.129). New cstate: current_term: 1 leader_uuid: "01873d289e0b4f9f9184b251369502a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:35.962534 3909 ts_tablet_manager.cc:1397] T d08de4c2326d46bab26f42d8d483ebd0 P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent bootstrapping tablet: real 0.027s user 0.007s sys 0.003s
I20250625 03:31:35.965114 3909 raft_consensus.cc:357] T d08de4c2326d46bab26f42d8d483ebd0 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:35.965791 3909 raft_consensus.cc:383] T d08de4c2326d46bab26f42d8d483ebd0 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:35.966073 3909 raft_consensus.cc:738] T d08de4c2326d46bab26f42d8d483ebd0 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Initialized, Role: FOLLOWER
I20250625 03:31:35.966806 3909 consensus_queue.cc:260] T d08de4c2326d46bab26f42d8d483ebd0 P 3d5b9823dfcd41cb92bd195c811cbf39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:35.967741 3906 tablet_bootstrap.cc:654] T d08de4c2326d46bab26f42d8d483ebd0 P 01873d289e0b4f9f9184b251369502a9: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:35.968928 3909 ts_tablet_manager.cc:1428] T d08de4c2326d46bab26f42d8d483ebd0 P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent starting tablet: real 0.006s user 0.006s sys 0.001s
I20250625 03:31:35.965132 3905 tablet_bootstrap.cc:492] T b1ece928b2e2452191ee263cf19ec4f8 P 841018313ad649679de64e006582f4c5: Bootstrap starting.
I20250625 03:31:35.971884 3909 tablet_bootstrap.cc:492] T c0c8dfded31e4566b07bc439f6e58ef6 P 3d5b9823dfcd41cb92bd195c811cbf39: Bootstrap starting.
I20250625 03:31:35.977360 3909 tablet_bootstrap.cc:654] T c0c8dfded31e4566b07bc439f6e58ef6 P 3d5b9823dfcd41cb92bd195c811cbf39: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:35.989022 3905 tablet_bootstrap.cc:654] T b1ece928b2e2452191ee263cf19ec4f8 P 841018313ad649679de64e006582f4c5: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:36.002472 3905 tablet_bootstrap.cc:492] T b1ece928b2e2452191ee263cf19ec4f8 P 841018313ad649679de64e006582f4c5: No bootstrap required, opened a new log
I20250625 03:31:36.003149 3905 ts_tablet_manager.cc:1397] T b1ece928b2e2452191ee263cf19ec4f8 P 841018313ad649679de64e006582f4c5: Time spent bootstrapping tablet: real 0.038s user 0.013s sys 0.005s
I20250625 03:31:36.006762 3905 raft_consensus.cc:357] T b1ece928b2e2452191ee263cf19ec4f8 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:36.007727 3905 raft_consensus.cc:383] T b1ece928b2e2452191ee263cf19ec4f8 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:36.008095 3905 raft_consensus.cc:738] T b1ece928b2e2452191ee263cf19ec4f8 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841018313ad649679de64e006582f4c5, State: Initialized, Role: FOLLOWER
I20250625 03:31:36.009106 3905 consensus_queue.cc:260] T b1ece928b2e2452191ee263cf19ec4f8 P 841018313ad649679de64e006582f4c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:36.010659 3910 tablet_bootstrap.cc:492] T 1e9c146f8cd743f7ac35dc61d9226d1d P ddc0ad67020f45edb3ba9c83cab687a4: No bootstrap required, opened a new log
I20250625 03:31:36.011198 3910 ts_tablet_manager.cc:1397] T 1e9c146f8cd743f7ac35dc61d9226d1d P ddc0ad67020f45edb3ba9c83cab687a4: Time spent bootstrapping tablet: real 0.061s user 0.009s sys 0.001s
I20250625 03:31:36.012084 3905 ts_tablet_manager.cc:1428] T b1ece928b2e2452191ee263cf19ec4f8 P 841018313ad649679de64e006582f4c5: Time spent starting tablet: real 0.009s user 0.006s sys 0.004s
I20250625 03:31:36.013427 3905 tablet_bootstrap.cc:492] T 1e9c146f8cd743f7ac35dc61d9226d1d P 841018313ad649679de64e006582f4c5: Bootstrap starting.
I20250625 03:31:36.013278 3910 raft_consensus.cc:357] T 1e9c146f8cd743f7ac35dc61d9226d1d P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:36.014030 3910 raft_consensus.cc:383] T 1e9c146f8cd743f7ac35dc61d9226d1d P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:36.014287 3910 raft_consensus.cc:738] T 1e9c146f8cd743f7ac35dc61d9226d1d P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Initialized, Role: FOLLOWER
I20250625 03:31:36.014866 3910 consensus_queue.cc:260] T 1e9c146f8cd743f7ac35dc61d9226d1d P ddc0ad67020f45edb3ba9c83cab687a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:36.015739 3909 tablet_bootstrap.cc:492] T c0c8dfded31e4566b07bc439f6e58ef6 P 3d5b9823dfcd41cb92bd195c811cbf39: No bootstrap required, opened a new log
I20250625 03:31:36.016302 3909 ts_tablet_manager.cc:1397] T c0c8dfded31e4566b07bc439f6e58ef6 P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent bootstrapping tablet: real 0.045s user 0.021s sys 0.019s
I20250625 03:31:36.016778 3996 consensus_queue.cc:1035] T b74d9f11c2bc4a7bb6431d6222d45175 P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:31:36.019201 3905 tablet_bootstrap.cc:654] T 1e9c146f8cd743f7ac35dc61d9226d1d P 841018313ad649679de64e006582f4c5: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:36.018848 3909 raft_consensus.cc:357] T c0c8dfded31e4566b07bc439f6e58ef6 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:36.019613 3909 raft_consensus.cc:383] T c0c8dfded31e4566b07bc439f6e58ef6 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:36.019917 3909 raft_consensus.cc:738] T c0c8dfded31e4566b07bc439f6e58ef6 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Initialized, Role: FOLLOWER
I20250625 03:31:36.020615 3910 ts_tablet_manager.cc:1428] T 1e9c146f8cd743f7ac35dc61d9226d1d P ddc0ad67020f45edb3ba9c83cab687a4: Time spent starting tablet: real 0.009s user 0.006s sys 0.001s
I20250625 03:31:36.020706 3909 consensus_queue.cc:260] T c0c8dfded31e4566b07bc439f6e58ef6 P 3d5b9823dfcd41cb92bd195c811cbf39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:36.021828 3910 tablet_bootstrap.cc:492] T 49d4fb2581ed4ef998f6a113ea67c323 P ddc0ad67020f45edb3ba9c83cab687a4: Bootstrap starting.
I20250625 03:31:36.027292 3909 ts_tablet_manager.cc:1428] T c0c8dfded31e4566b07bc439f6e58ef6 P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent starting tablet: real 0.011s user 0.002s sys 0.004s
I20250625 03:31:36.028398 3909 tablet_bootstrap.cc:492] T eeca5a85dddf4d1884917690e01ff81d P 3d5b9823dfcd41cb92bd195c811cbf39: Bootstrap starting.
I20250625 03:31:36.030019 3906 tablet_bootstrap.cc:492] T d08de4c2326d46bab26f42d8d483ebd0 P 01873d289e0b4f9f9184b251369502a9: No bootstrap required, opened a new log
I20250625 03:31:36.032719 3914 consensus_queue.cc:1035] T 06f309640df64f97a4065b1420fea692 P 3d5b9823dfcd41cb92bd195c811cbf39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:31:36.035701 3909 tablet_bootstrap.cc:654] T eeca5a85dddf4d1884917690e01ff81d P 3d5b9823dfcd41cb92bd195c811cbf39: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:36.038563 4013 raft_consensus.cc:491] T 6fc84ca2087c4ded91412fb32117af48 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:36.039149 4013 raft_consensus.cc:513] T 6fc84ca2087c4ded91412fb32117af48 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:36.041520 4013 leader_election.cc:290] T 6fc84ca2087c4ded91412fb32117af48 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041), ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353)
I20250625 03:31:36.041587 3914 consensus_queue.cc:1035] T bccba871bcd747fd80a890b25628ebe2 P 3d5b9823dfcd41cb92bd195c811cbf39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:31:36.043229 3715 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6fc84ca2087c4ded91412fb32117af48" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" is_pre_election: true
I20250625 03:31:36.044035 3715 raft_consensus.cc:2466] T 6fc84ca2087c4ded91412fb32117af48 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841018313ad649679de64e006582f4c5 in term 0.
I20250625 03:31:36.042448 3905 tablet_bootstrap.cc:492] T 1e9c146f8cd743f7ac35dc61d9226d1d P 841018313ad649679de64e006582f4c5: No bootstrap required, opened a new log
I20250625 03:31:36.046020 3754 leader_election.cc:304] T 6fc84ca2087c4ded91412fb32117af48 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, 841018313ad649679de64e006582f4c5; no voters:
I20250625 03:31:36.046840 3905 ts_tablet_manager.cc:1397] T 1e9c146f8cd743f7ac35dc61d9226d1d P 841018313ad649679de64e006582f4c5: Time spent bootstrapping tablet: real 0.034s user 0.008s sys 0.013s
I20250625 03:31:36.049533 3861 raft_consensus.cc:3058] T bccba871bcd747fd80a890b25628ebe2 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:36.049870 3905 raft_consensus.cc:357] T 1e9c146f8cd743f7ac35dc61d9226d1d P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:36.050954 4008 raft_consensus.cc:2802] T 6fc84ca2087c4ded91412fb32117af48 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:31:36.050987 3905 raft_consensus.cc:383] T 1e9c146f8cd743f7ac35dc61d9226d1d P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:36.051512 4008 raft_consensus.cc:491] T 6fc84ca2087c4ded91412fb32117af48 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:31:36.044075 3862 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6fc84ca2087c4ded91412fb32117af48" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:36.051874 3905 raft_consensus.cc:738] T 1e9c146f8cd743f7ac35dc61d9226d1d P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841018313ad649679de64e006582f4c5, State: Initialized, Role: FOLLOWER
I20250625 03:31:36.051941 4008 raft_consensus.cc:3058] T 6fc84ca2087c4ded91412fb32117af48 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:36.052194 3906 ts_tablet_manager.cc:1397] T d08de4c2326d46bab26f42d8d483ebd0 P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.105s user 0.026s sys 0.023s
I20250625 03:31:36.055284 3906 raft_consensus.cc:357] T d08de4c2326d46bab26f42d8d483ebd0 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:36.057153 3932 raft_consensus.cc:491] T 1e9c146f8cd743f7ac35dc61d9226d1d P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:36.057654 3932 raft_consensus.cc:513] T 1e9c146f8cd743f7ac35dc61d9226d1d P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
W20250625 03:31:36.058413 3753 leader_election.cc:343] T 6fc84ca2087c4ded91412fb32117af48 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:36.059634 3932 leader_election.cc:290] T 1e9c146f8cd743f7ac35dc61d9226d1d P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:31:36.061162 3910 tablet_bootstrap.cc:654] T 49d4fb2581ed4ef998f6a113ea67c323 P ddc0ad67020f45edb3ba9c83cab687a4: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:36.065614 4008 raft_consensus.cc:513] T 6fc84ca2087c4ded91412fb32117af48 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:36.066156 3639 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1e9c146f8cd743f7ac35dc61d9226d1d" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:36.067867 3909 tablet_bootstrap.cc:492] T eeca5a85dddf4d1884917690e01ff81d P 3d5b9823dfcd41cb92bd195c811cbf39: No bootstrap required, opened a new log
I20250625 03:31:36.067052 3905 consensus_queue.cc:260] T 1e9c146f8cd743f7ac35dc61d9226d1d P 841018313ad649679de64e006582f4c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:36.055923 3906 raft_consensus.cc:383] T d08de4c2326d46bab26f42d8d483ebd0 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:36.068408 3909 ts_tablet_manager.cc:1397] T eeca5a85dddf4d1884917690e01ff81d P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent bootstrapping tablet: real 0.040s user 0.009s sys 0.002s
I20250625 03:31:36.068840 3789 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1e9c146f8cd743f7ac35dc61d9226d1d" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:31:36.084869 3789 raft_consensus.cc:2466] T 1e9c146f8cd743f7ac35dc61d9226d1d P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddc0ad67020f45edb3ba9c83cab687a4 in term 0.
W20250625 03:31:36.069072 3828 leader_election.cc:343] T 1e9c146f8cd743f7ac35dc61d9226d1d P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:36.086766 3909 raft_consensus.cc:357] T eeca5a85dddf4d1884917690e01ff81d P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:36.087515 3909 raft_consensus.cc:383] T eeca5a85dddf4d1884917690e01ff81d P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:36.087599 3910 tablet_bootstrap.cc:492] T 49d4fb2581ed4ef998f6a113ea67c323 P ddc0ad67020f45edb3ba9c83cab687a4: No bootstrap required, opened a new log
I20250625 03:31:36.072770 4008 leader_election.cc:290] T 6fc84ca2087c4ded91412fb32117af48 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 election: Requested vote from peers 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041), ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353)
I20250625 03:31:36.088243 3910 ts_tablet_manager.cc:1397] T 49d4fb2581ed4ef998f6a113ea67c323 P ddc0ad67020f45edb3ba9c83cab687a4: Time spent bootstrapping tablet: real 0.067s user 0.014s sys 0.000s
I20250625 03:31:36.076539 3996 consensus_queue.cc:1035] T b74d9f11c2bc4a7bb6431d6222d45175 P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20250625 03:31:36.075727 3962 consensus_queue.cc:1035] T 06f309640df64f97a4065b1420fea692 P 3d5b9823dfcd41cb92bd195c811cbf39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20250625 03:31:36.079315 3862 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6fc84ca2087c4ded91412fb32117af48" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4"
I20250625 03:31:36.091009 3910 raft_consensus.cc:357] T 49d4fb2581ed4ef998f6a113ea67c323 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:36.091778 3910 raft_consensus.cc:383] T 49d4fb2581ed4ef998f6a113ea67c323 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:36.092106 3910 raft_consensus.cc:738] T 49d4fb2581ed4ef998f6a113ea67c323 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Initialized, Role: FOLLOWER
I20250625 03:31:36.093327 3910 consensus_queue.cc:260] T 49d4fb2581ed4ef998f6a113ea67c323 P ddc0ad67020f45edb3ba9c83cab687a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:36.087862 3909 raft_consensus.cc:738] T eeca5a85dddf4d1884917690e01ff81d P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Initialized, Role: FOLLOWER
I20250625 03:31:36.096098 3910 ts_tablet_manager.cc:1428] T 49d4fb2581ed4ef998f6a113ea67c323 P ddc0ad67020f45edb3ba9c83cab687a4: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20250625 03:31:36.095872 3909 consensus_queue.cc:260] T eeca5a85dddf4d1884917690e01ff81d P 3d5b9823dfcd41cb92bd195c811cbf39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
W20250625 03:31:36.096664 3753 leader_election.cc:343] T 6fc84ca2087c4ded91412fb32117af48 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:36.097103 3910 tablet_bootstrap.cc:492] T d08de4c2326d46bab26f42d8d483ebd0 P ddc0ad67020f45edb3ba9c83cab687a4: Bootstrap starting.
I20250625 03:31:36.098533 3909 ts_tablet_manager.cc:1428] T eeca5a85dddf4d1884917690e01ff81d P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent starting tablet: real 0.014s user 0.006s sys 0.000s
I20250625 03:31:36.099432 3909 tablet_bootstrap.cc:492] T c592f2c5305141c487b73e0867d0f36b P 3d5b9823dfcd41cb92bd195c811cbf39: Bootstrap starting.
I20250625 03:31:36.082001 3714 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6fc84ca2087c4ded91412fb32117af48" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
I20250625 03:31:36.101169 3714 raft_consensus.cc:3058] T 6fc84ca2087c4ded91412fb32117af48 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:36.102955 3910 tablet_bootstrap.cc:654] T d08de4c2326d46bab26f42d8d483ebd0 P ddc0ad67020f45edb3ba9c83cab687a4: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:36.070873 3905 ts_tablet_manager.cc:1428] T 1e9c146f8cd743f7ac35dc61d9226d1d P 841018313ad649679de64e006582f4c5: Time spent starting tablet: real 0.024s user 0.006s sys 0.000s
I20250625 03:31:36.104763 3909 tablet_bootstrap.cc:654] T c592f2c5305141c487b73e0867d0f36b P 3d5b9823dfcd41cb92bd195c811cbf39: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:36.105029 3905 tablet_bootstrap.cc:492] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 841018313ad649679de64e006582f4c5: Bootstrap starting.
I20250625 03:31:36.088285 3828 leader_election.cc:304] T 1e9c146f8cd743f7ac35dc61d9226d1d P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841018313ad649679de64e006582f4c5, ddc0ad67020f45edb3ba9c83cab687a4; no voters: 01873d289e0b4f9f9184b251369502a9
I20250625 03:31:36.108250 3932 raft_consensus.cc:2802] T 1e9c146f8cd743f7ac35dc61d9226d1d P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:31:36.108765 3932 raft_consensus.cc:491] T 1e9c146f8cd743f7ac35dc61d9226d1d P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:31:36.109191 3932 raft_consensus.cc:3058] T 1e9c146f8cd743f7ac35dc61d9226d1d P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:36.113387 3914 consensus_queue.cc:1035] T bccba871bcd747fd80a890b25628ebe2 P 3d5b9823dfcd41cb92bd195c811cbf39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:31:36.114835 3910 tablet_bootstrap.cc:492] T d08de4c2326d46bab26f42d8d483ebd0 P ddc0ad67020f45edb3ba9c83cab687a4: No bootstrap required, opened a new log
I20250625 03:31:36.115398 3910 ts_tablet_manager.cc:1397] T d08de4c2326d46bab26f42d8d483ebd0 P ddc0ad67020f45edb3ba9c83cab687a4: Time spent bootstrapping tablet: real 0.019s user 0.011s sys 0.004s
I20250625 03:31:36.117936 3914 consensus_queue.cc:1035] T 3ecdd525d6fd47deacf323decbc5c329 P 3d5b9823dfcd41cb92bd195c811cbf39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:31:36.077586 3906 raft_consensus.cc:738] T d08de4c2326d46bab26f42d8d483ebd0 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:36.121210 3906 consensus_queue.cc:260] T d08de4c2326d46bab26f42d8d483ebd0 P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:36.129552 3905 tablet_bootstrap.cc:654] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 841018313ad649679de64e006582f4c5: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:36.129153 3910 raft_consensus.cc:357] T d08de4c2326d46bab26f42d8d483ebd0 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:36.131021 3910 raft_consensus.cc:383] T d08de4c2326d46bab26f42d8d483ebd0 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:36.131320 3910 raft_consensus.cc:738] T d08de4c2326d46bab26f42d8d483ebd0 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Initialized, Role: FOLLOWER
I20250625 03:31:36.129241 3906 ts_tablet_manager.cc:1428] T d08de4c2326d46bab26f42d8d483ebd0 P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.076s user 0.005s sys 0.000s
I20250625 03:31:36.133081 3910 consensus_queue.cc:260] T d08de4c2326d46bab26f42d8d483ebd0 P ddc0ad67020f45edb3ba9c83cab687a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:36.133004 3909 tablet_bootstrap.cc:492] T c592f2c5305141c487b73e0867d0f36b P 3d5b9823dfcd41cb92bd195c811cbf39: No bootstrap required, opened a new log
I20250625 03:31:36.134869 3909 ts_tablet_manager.cc:1397] T c592f2c5305141c487b73e0867d0f36b P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent bootstrapping tablet: real 0.036s user 0.008s sys 0.011s
I20250625 03:31:36.135571 3906 tablet_bootstrap.cc:492] T c592f2c5305141c487b73e0867d0f36b P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:36.137490 3910 ts_tablet_manager.cc:1428] T d08de4c2326d46bab26f42d8d483ebd0 P ddc0ad67020f45edb3ba9c83cab687a4: Time spent starting tablet: real 0.022s user 0.004s sys 0.004s
I20250625 03:31:36.140192 3914 raft_consensus.cc:491] T c0c8dfded31e4566b07bc439f6e58ef6 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:36.140911 3914 raft_consensus.cc:513] T c0c8dfded31e4566b07bc439f6e58ef6 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:36.139804 3910 tablet_bootstrap.cc:492] T 6fc84ca2087c4ded91412fb32117af48 P ddc0ad67020f45edb3ba9c83cab687a4: Bootstrap starting.
I20250625 03:31:36.142910 3914 leader_election.cc:290] T c0c8dfded31e4566b07bc439f6e58ef6 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 841018313ad649679de64e006582f4c5 (127.0.106.131:39467)
I20250625 03:31:36.144057 3638 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c0c8dfded31e4566b07bc439f6e58ef6" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
W20250625 03:31:36.145577 3680 leader_election.cc:343] T c0c8dfded31e4566b07bc439f6e58ef6 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:36.145550 3994 consensus_queue.cc:1035] T 485f3e9350e245a9939133866b354302 P ddc0ad67020f45edb3ba9c83cab687a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:31:36.147987 3910 tablet_bootstrap.cc:654] T 6fc84ca2087c4ded91412fb32117af48 P ddc0ad67020f45edb3ba9c83cab687a4: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:36.151362 3789 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c0c8dfded31e4566b07bc439f6e58ef6" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:31:36.137267 3909 raft_consensus.cc:357] T c592f2c5305141c487b73e0867d0f36b P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:36.152109 3909 raft_consensus.cc:383] T c592f2c5305141c487b73e0867d0f36b P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:36.152127 3789 raft_consensus.cc:2466] T c0c8dfded31e4566b07bc439f6e58ef6 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5b9823dfcd41cb92bd195c811cbf39 in term 0.
I20250625 03:31:36.153306 3909 raft_consensus.cc:738] T c592f2c5305141c487b73e0867d0f36b P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Initialized, Role: FOLLOWER
I20250625 03:31:36.153429 3905 tablet_bootstrap.cc:492] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 841018313ad649679de64e006582f4c5: No bootstrap required, opened a new log
I20250625 03:31:36.154131 3680 leader_election.cc:304] T c0c8dfded31e4566b07bc439f6e58ef6 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, 841018313ad649679de64e006582f4c5; no voters: 01873d289e0b4f9f9184b251369502a9
I20250625 03:31:36.154904 3905 ts_tablet_manager.cc:1397] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 841018313ad649679de64e006582f4c5: Time spent bootstrapping tablet: real 0.050s user 0.006s sys 0.006s
I20250625 03:31:36.154214 3909 consensus_queue.cc:260] T c592f2c5305141c487b73e0867d0f36b P 3d5b9823dfcd41cb92bd195c811cbf39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:36.155885 3984 raft_consensus.cc:2802] T c0c8dfded31e4566b07bc439f6e58ef6 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:31:36.156344 3984 raft_consensus.cc:491] T c0c8dfded31e4566b07bc439f6e58ef6 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:31:36.156651 3984 raft_consensus.cc:3058] T c0c8dfded31e4566b07bc439f6e58ef6 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:36.157442 3905 raft_consensus.cc:357] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:36.158140 3905 raft_consensus.cc:383] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:36.158217 3909 ts_tablet_manager.cc:1428] T c592f2c5305141c487b73e0867d0f36b P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent starting tablet: real 0.023s user 0.007s sys 0.000s
I20250625 03:31:36.158442 3905 raft_consensus.cc:738] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841018313ad649679de64e006582f4c5, State: Initialized, Role: FOLLOWER
I20250625 03:31:36.159330 3909 tablet_bootstrap.cc:492] T 3d5b503929b24663a1f868ffaec34157 P 3d5b9823dfcd41cb92bd195c811cbf39: Bootstrap starting.
I20250625 03:31:36.159106 3905 consensus_queue.cc:260] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 841018313ad649679de64e006582f4c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:36.152943 3906 tablet_bootstrap.cc:654] T c592f2c5305141c487b73e0867d0f36b P 01873d289e0b4f9f9184b251369502a9: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:36.164047 3932 raft_consensus.cc:513] T 1e9c146f8cd743f7ac35dc61d9226d1d P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:36.167273 3788 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1e9c146f8cd743f7ac35dc61d9226d1d" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5"
I20250625 03:31:36.168114 3788 raft_consensus.cc:3058] T 1e9c146f8cd743f7ac35dc61d9226d1d P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:36.169775 3905 ts_tablet_manager.cc:1428] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 841018313ad649679de64e006582f4c5: Time spent starting tablet: real 0.015s user 0.006s sys 0.000s
I20250625 03:31:36.169582 3914 consensus_queue.cc:1035] T 3ecdd525d6fd47deacf323decbc5c329 P 3d5b9823dfcd41cb92bd195c811cbf39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:31:36.133407 3714 raft_consensus.cc:2466] T 6fc84ca2087c4ded91412fb32117af48 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841018313ad649679de64e006582f4c5 in term 1.
I20250625 03:31:36.170841 3905 tablet_bootstrap.cc:492] T eeca5a85dddf4d1884917690e01ff81d P 841018313ad649679de64e006582f4c5: Bootstrap starting.
I20250625 03:31:36.172283 3754 leader_election.cc:304] T 6fc84ca2087c4ded91412fb32117af48 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, 841018313ad649679de64e006582f4c5; no voters: ddc0ad67020f45edb3ba9c83cab687a4
I20250625 03:31:36.172343 4008 raft_consensus.cc:491] T 002d4371d5414440b756829fe3343d07 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:36.173859 3984 raft_consensus.cc:513] T c0c8dfded31e4566b07bc439f6e58ef6 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:36.174053 4008 raft_consensus.cc:513] T 002d4371d5414440b756829fe3343d07 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:36.173403 3946 raft_consensus.cc:491] T 485f3e9350e245a9939133866b354302 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:36.176237 3946 raft_consensus.cc:513] T 485f3e9350e245a9939133866b354302 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:36.177439 3909 tablet_bootstrap.cc:654] T 3d5b503929b24663a1f868ffaec34157 P 3d5b9823dfcd41cb92bd195c811cbf39: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:36.178603 3946 leader_election.cc:290] T 485f3e9350e245a9939133866b354302 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353)
I20250625 03:31:36.178050 3788 raft_consensus.cc:2466] T 1e9c146f8cd743f7ac35dc61d9226d1d P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddc0ad67020f45edb3ba9c83cab687a4 in term 1.
I20250625 03:31:36.179898 3862 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "485f3e9350e245a9939133866b354302" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:36.182399 3788 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "485f3e9350e245a9939133866b354302" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:31:36.175948 4008 leader_election.cc:290] T 002d4371d5414440b756829fe3343d07 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:31:36.183686 4008 raft_consensus.cc:2802] T 6fc84ca2087c4ded91412fb32117af48 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:31:36.183979 3605 leader_election.cc:304] T 485f3e9350e245a9939133866b354302 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9; no voters: 841018313ad649679de64e006582f4c5, ddc0ad67020f45edb3ba9c83cab687a4
I20250625 03:31:36.184378 4008 raft_consensus.cc:695] T 6fc84ca2087c4ded91412fb32117af48 P 841018313ad649679de64e006582f4c5 [term 1 LEADER]: Becoming Leader. State: Replica: 841018313ad649679de64e006582f4c5, State: Running, Role: LEADER
I20250625 03:31:36.185403 3950 raft_consensus.cc:2747] T 485f3e9350e245a9939133866b354302 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:31:36.186009 4008 consensus_queue.cc:237] T 6fc84ca2087c4ded91412fb32117af48 P 841018313ad649679de64e006582f4c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:36.187392 3983 raft_consensus.cc:491] T d08de4c2326d46bab26f42d8d483ebd0 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:36.188083 3983 raft_consensus.cc:513] T d08de4c2326d46bab26f42d8d483ebd0 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:36.190922 3983 leader_election.cc:290] T d08de4c2326d46bab26f42d8d483ebd0 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:31:36.191493 3640 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c0c8dfded31e4566b07bc439f6e58ef6" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9"
I20250625 03:31:36.192135 3862 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d08de4c2326d46bab26f42d8d483ebd0" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:36.192821 3862 raft_consensus.cc:2466] T d08de4c2326d46bab26f42d8d483ebd0 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5b9823dfcd41cb92bd195c811cbf39 in term 0.
I20250625 03:31:36.193228 3909 tablet_bootstrap.cc:492] T 3d5b503929b24663a1f868ffaec34157 P 3d5b9823dfcd41cb92bd195c811cbf39: No bootstrap required, opened a new log
I20250625 03:31:36.193938 3984 leader_election.cc:290] T c0c8dfded31e4566b07bc439f6e58ef6 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 election: Requested vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 841018313ad649679de64e006582f4c5 (127.0.106.131:39467)
I20250625 03:31:36.193954 3909 ts_tablet_manager.cc:1397] T 3d5b503929b24663a1f868ffaec34157 P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent bootstrapping tablet: real 0.035s user 0.006s sys 0.012s
I20250625 03:31:36.194671 3950 raft_consensus.cc:491] T d08de4c2326d46bab26f42d8d483ebd0 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20250625 03:31:36.195039 3680 leader_election.cc:343] T c0c8dfded31e4566b07bc439f6e58ef6 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:36.195521 3905 tablet_bootstrap.cc:654] T eeca5a85dddf4d1884917690e01ff81d P 841018313ad649679de64e006582f4c5: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:36.195189 3950 raft_consensus.cc:513] T d08de4c2326d46bab26f42d8d483ebd0 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:36.195616 3788 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c0c8dfded31e4566b07bc439f6e58ef6" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5"
I20250625 03:31:36.196466 3788 raft_consensus.cc:3058] T c0c8dfded31e4566b07bc439f6e58ef6 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:36.197371 3950 leader_election.cc:290] T d08de4c2326d46bab26f42d8d483ebd0 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:31:36.197719 3828 leader_election.cc:304] T 1e9c146f8cd743f7ac35dc61d9226d1d P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841018313ad649679de64e006582f4c5, ddc0ad67020f45edb3ba9c83cab687a4; no voters:
I20250625 03:31:36.198505 3640 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d08de4c2326d46bab26f42d8d483ebd0" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:36.198961 3994 raft_consensus.cc:2802] T 1e9c146f8cd743f7ac35dc61d9226d1d P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:31:36.199151 3640 raft_consensus.cc:2466] T d08de4c2326d46bab26f42d8d483ebd0 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5b9823dfcd41cb92bd195c811cbf39 in term 0.
I20250625 03:31:36.199497 3994 raft_consensus.cc:695] T 1e9c146f8cd743f7ac35dc61d9226d1d P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 LEADER]: Becoming Leader. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Running, Role: LEADER
I20250625 03:31:36.200284 3638 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "002d4371d5414440b756829fe3343d07" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:36.201233 3994 consensus_queue.cc:237] T 1e9c146f8cd743f7ac35dc61d9226d1d P ddc0ad67020f45edb3ba9c83cab687a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:36.194149 3679 leader_election.cc:304] T d08de4c2326d46bab26f42d8d483ebd0 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, ddc0ad67020f45edb3ba9c83cab687a4; no voters:
I20250625 03:31:36.206552 3862 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d08de4c2326d46bab26f42d8d483ebd0" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:36.207238 3862 raft_consensus.cc:2466] T d08de4c2326d46bab26f42d8d483ebd0 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01873d289e0b4f9f9184b251369502a9 in term 0.
I20250625 03:31:36.207875 3715 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "002d4371d5414440b756829fe3343d07" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" is_pre_election: true
I20250625 03:31:36.208285 3604 leader_election.cc:304] T d08de4c2326d46bab26f42d8d483ebd0 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9, ddc0ad67020f45edb3ba9c83cab687a4; no voters:
I20250625 03:31:36.209818 3909 raft_consensus.cc:357] T 3d5b503929b24663a1f868ffaec34157 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:36.210846 3909 raft_consensus.cc:383] T 3d5b503929b24663a1f868ffaec34157 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:36.211234 3909 raft_consensus.cc:738] T 3d5b503929b24663a1f868ffaec34157 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Initialized, Role: FOLLOWER
I20250625 03:31:36.212170 3909 consensus_queue.cc:260] T 3d5b503929b24663a1f868ffaec34157 P 3d5b9823dfcd41cb92bd195c811cbf39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:36.213856 3983 raft_consensus.cc:2802] T d08de4c2326d46bab26f42d8d483ebd0 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:31:36.218829 3983 raft_consensus.cc:491] T d08de4c2326d46bab26f42d8d483ebd0 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:31:36.219199 3983 raft_consensus.cc:3058] T d08de4c2326d46bab26f42d8d483ebd0 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:36.223582 3909 ts_tablet_manager.cc:1428] T 3d5b503929b24663a1f868ffaec34157 P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent starting tablet: real 0.029s user 0.008s sys 0.000s
I20250625 03:31:36.206504 3714 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d08de4c2326d46bab26f42d8d483ebd0" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" is_pre_election: true
I20250625 03:31:36.213829 3996 raft_consensus.cc:2802] T d08de4c2326d46bab26f42d8d483ebd0 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:31:36.224992 3996 raft_consensus.cc:491] T d08de4c2326d46bab26f42d8d483ebd0 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:31:36.225487 3996 raft_consensus.cc:3058] T d08de4c2326d46bab26f42d8d483ebd0 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:36.230108 3638 raft_consensus.cc:3058] T 485f3e9350e245a9939133866b354302 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Advancing to term 1
W20250625 03:31:36.213506 3754 leader_election.cc:343] T 002d4371d5414440b756829fe3343d07 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
W20250625 03:31:36.233992 3754 leader_election.cc:343] T 002d4371d5414440b756829fe3343d07 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:36.234565 3754 leader_election.cc:304] T 002d4371d5414440b756829fe3343d07 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841018313ad649679de64e006582f4c5; no voters: 01873d289e0b4f9f9184b251369502a9, 3d5b9823dfcd41cb92bd195c811cbf39
I20250625 03:31:36.235579 4013 raft_consensus.cc:2747] T 002d4371d5414440b756829fe3343d07 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:31:36.231758 3788 raft_consensus.cc:2466] T c0c8dfded31e4566b07bc439f6e58ef6 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5b9823dfcd41cb92bd195c811cbf39 in term 1.
I20250625 03:31:36.239383 3680 leader_election.cc:304] T c0c8dfded31e4566b07bc439f6e58ef6 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, 841018313ad649679de64e006582f4c5; no voters: 01873d289e0b4f9f9184b251369502a9
I20250625 03:31:36.243069 3984 raft_consensus.cc:2802] T c0c8dfded31e4566b07bc439f6e58ef6 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:31:36.257862 3975 raft_consensus.cc:491] T 49d4fb2581ed4ef998f6a113ea67c323 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:36.258487 3975 raft_consensus.cc:513] T 49d4fb2581ed4ef998f6a113ea67c323 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:36.260485 3789 raft_consensus.cc:3058] T 7e92fd94b9f24b1097e9a7373896cb26 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:36.260903 3975 leader_election.cc:290] T 49d4fb2581ed4ef998f6a113ea67c323 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:31:36.266439 3909 tablet_bootstrap.cc:492] T 002d4371d5414440b756829fe3343d07 P 3d5b9823dfcd41cb92bd195c811cbf39: Bootstrap starting.
I20250625 03:31:36.252602 3984 raft_consensus.cc:695] T c0c8dfded31e4566b07bc439f6e58ef6 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 LEADER]: Becoming Leader. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Running, Role: LEADER
I20250625 03:31:36.255303 4013 raft_consensus.cc:491] T b1ece928b2e2452191ee263cf19ec4f8 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:36.263012 3640 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "49d4fb2581ed4ef998f6a113ea67c323" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:36.272918 4013 raft_consensus.cc:513] T b1ece928b2e2452191ee263cf19ec4f8 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:36.263013 3785 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "49d4fb2581ed4ef998f6a113ea67c323" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:31:36.274070 3785 raft_consensus.cc:2391] T 49d4fb2581ed4ef998f6a113ea67c323 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddc0ad67020f45edb3ba9c83cab687a4 in current term 1: Already voted for candidate 01873d289e0b4f9f9184b251369502a9 in this term.
I20250625 03:31:36.274920 4013 leader_election.cc:290] T b1ece928b2e2452191ee263cf19ec4f8 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041), ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353)
I20250625 03:31:36.279742 3914 raft_consensus.cc:491] T c592f2c5305141c487b73e0867d0f36b P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:36.282586 3914 raft_consensus.cc:513] T c592f2c5305141c487b73e0867d0f36b P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:36.280571 4013 raft_consensus.cc:491] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:36.283830 4013 raft_consensus.cc:513] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:36.284039 3828 leader_election.cc:304] T 49d4fb2581ed4ef998f6a113ea67c323 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddc0ad67020f45edb3ba9c83cab687a4; no voters: 01873d289e0b4f9f9184b251369502a9, 841018313ad649679de64e006582f4c5
I20250625 03:31:36.284610 3914 leader_election.cc:290] T c592f2c5305141c487b73e0867d0f36b P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:31:36.285422 3862 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b1ece928b2e2452191ee263cf19ec4f8" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:36.285742 3640 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1e9c146f8cd743f7ac35dc61d9226d1d" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9"
I20250625 03:31:36.285218 3984 consensus_queue.cc:237] T c0c8dfded31e4566b07bc439f6e58ef6 P 3d5b9823dfcd41cb92bd195c811cbf39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:36.288524 3863 raft_consensus.cc:3058] T 49d4fb2581ed4ef998f6a113ea67c323 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:36.275660 3932 leader_election.cc:290] T 1e9c146f8cd743f7ac35dc61d9226d1d P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 election: Requested vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:31:36.268353 3996 raft_consensus.cc:513] T d08de4c2326d46bab26f42d8d483ebd0 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:36.311254 3715 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b1ece928b2e2452191ee263cf19ec4f8" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" is_pre_election: true
I20250625 03:31:36.312301 3715 raft_consensus.cc:2391] T b1ece928b2e2452191ee263cf19ec4f8 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841018313ad649679de64e006582f4c5 in current term 1: Already voted for candidate ddc0ad67020f45edb3ba9c83cab687a4 in this term.
I20250625 03:31:36.312228 3785 raft_consensus.cc:3058] T b1ece928b2e2452191ee263cf19ec4f8 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:36.315984 3754 leader_election.cc:304] T b1ece928b2e2452191ee263cf19ec4f8 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841018313ad649679de64e006582f4c5; no voters: 3d5b9823dfcd41cb92bd195c811cbf39, ddc0ad67020f45edb3ba9c83cab687a4
I20250625 03:31:36.326542 4008 raft_consensus.cc:2747] T b1ece928b2e2452191ee263cf19ec4f8 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:31:36.327185 3996 leader_election.cc:290] T d08de4c2326d46bab26f42d8d483ebd0 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 election: Requested vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:31:36.326396 3715 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d08de4c2326d46bab26f42d8d483ebd0" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
I20250625 03:31:36.330300 3910 tablet_bootstrap.cc:492] T 6fc84ca2087c4ded91412fb32117af48 P ddc0ad67020f45edb3ba9c83cab687a4: No bootstrap required, opened a new log
I20250625 03:31:36.332125 3910 ts_tablet_manager.cc:1397] T 6fc84ca2087c4ded91412fb32117af48 P ddc0ad67020f45edb3ba9c83cab687a4: Time spent bootstrapping tablet: real 0.193s user 0.023s sys 0.030s
I20250625 03:31:36.334347 3914 raft_consensus.cc:491] T eeca5a85dddf4d1884917690e01ff81d P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:36.335052 3914 raft_consensus.cc:513] T eeca5a85dddf4d1884917690e01ff81d P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:36.337749 3914 leader_election.cc:290] T eeca5a85dddf4d1884917690e01ff81d P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353)
I20250625 03:31:36.339447 4013 leader_election.cc:290] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:31:36.340059 3639 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c592f2c5305141c487b73e0867d0f36b" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:36.342135 3910 raft_consensus.cc:357] T 6fc84ca2087c4ded91412fb32117af48 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:36.342844 3910 raft_consensus.cc:383] T 6fc84ca2087c4ded91412fb32117af48 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:36.343142 3910 raft_consensus.cc:738] T 6fc84ca2087c4ded91412fb32117af48 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Initialized, Role: FOLLOWER
I20250625 03:31:36.343046 3784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "eeca5a85dddf4d1884917690e01ff81d" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:31:36.344122 3910 consensus_queue.cc:260] T 6fc84ca2087c4ded91412fb32117af48 P ddc0ad67020f45edb3ba9c83cab687a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
W20250625 03:31:36.345201 3828 leader_election.cc:343] T 1e9c146f8cd743f7ac35dc61d9226d1d P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:36.345733 3862 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2c4bb2d21b5242d387f6bc6ada60b4d5" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:36.347028 4045 consensus_queue.cc:1035] T 485f3e9350e245a9939133866b354302 P ddc0ad67020f45edb3ba9c83cab687a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20250625 03:31:36.347687 3680 leader_election.cc:343] T eeca5a85dddf4d1884917690e01ff81d P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841018313ad649679de64e006582f4c5 (127.0.106.131:39467): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:36.356209 3910 ts_tablet_manager.cc:1428] T 6fc84ca2087c4ded91412fb32117af48 P ddc0ad67020f45edb3ba9c83cab687a4: Time spent starting tablet: real 0.024s user 0.007s sys 0.000s
I20250625 03:31:36.357339 3910 tablet_bootstrap.cc:492] T 5e59ae16ec1a4c69aac820531e504206 P ddc0ad67020f45edb3ba9c83cab687a4: Bootstrap starting.
I20250625 03:31:36.358448 3905 tablet_bootstrap.cc:492] T eeca5a85dddf4d1884917690e01ff81d P 841018313ad649679de64e006582f4c5: No bootstrap required, opened a new log
I20250625 03:31:36.358893 3905 ts_tablet_manager.cc:1397] T eeca5a85dddf4d1884917690e01ff81d P 841018313ad649679de64e006582f4c5: Time spent bootstrapping tablet: real 0.188s user 0.013s sys 0.007s
W20250625 03:31:36.354485 3680 leader_election.cc:343] T c592f2c5305141c487b73e0867d0f36b P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:36.362362 3862 raft_consensus.cc:3058] T f3a33aa1d146468c986f0b1ba7d5fb84 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:36.362775 3860 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c592f2c5305141c487b73e0867d0f36b" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:36.363502 3860 raft_consensus.cc:2466] T c592f2c5305141c487b73e0867d0f36b P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5b9823dfcd41cb92bd195c811cbf39 in term 0.
I20250625 03:31:36.365305 3909 tablet_bootstrap.cc:654] T 002d4371d5414440b756829fe3343d07 P 3d5b9823dfcd41cb92bd195c811cbf39: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:36.365767 3860 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "eeca5a85dddf4d1884917690e01ff81d" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:36.367244 3639 raft_consensus.cc:3058] T a07d77259251401d957af853b296750a P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Advancing to term 1
W20250625 03:31:36.356112 3753 leader_election.cc:343] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:36.370450 3905 raft_consensus.cc:357] T eeca5a85dddf4d1884917690e01ff81d P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:36.371165 3905 raft_consensus.cc:383] T eeca5a85dddf4d1884917690e01ff81d P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:36.371435 3905 raft_consensus.cc:738] T eeca5a85dddf4d1884917690e01ff81d P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841018313ad649679de64e006582f4c5, State: Initialized, Role: FOLLOWER
I20250625 03:31:36.372167 3905 consensus_queue.cc:260] T eeca5a85dddf4d1884917690e01ff81d P 841018313ad649679de64e006582f4c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:36.374645 3905 ts_tablet_manager.cc:1428] T eeca5a85dddf4d1884917690e01ff81d P 841018313ad649679de64e006582f4c5: Time spent starting tablet: real 0.015s user 0.006s sys 0.000s
I20250625 03:31:36.377193 3905 tablet_bootstrap.cc:492] T d00ad2472fd74bfc9065d9dc4808e0c1 P 841018313ad649679de64e006582f4c5: Bootstrap starting.
I20250625 03:31:36.357879 3638 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2c4bb2d21b5242d387f6bc6ada60b4d5" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:36.376255 3679 leader_election.cc:304] T c592f2c5305141c487b73e0867d0f36b P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, ddc0ad67020f45edb3ba9c83cab687a4; no voters: 01873d289e0b4f9f9184b251369502a9
I20250625 03:31:36.389441 3984 raft_consensus.cc:491] T 3d5b503929b24663a1f868ffaec34157 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:36.400877 3914 raft_consensus.cc:2802] T c592f2c5305141c487b73e0867d0f36b P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:31:36.404946 3914 raft_consensus.cc:491] T c592f2c5305141c487b73e0867d0f36b P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:31:36.405328 3914 raft_consensus.cc:3058] T c592f2c5305141c487b73e0867d0f36b P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Advancing to term 1
W20250625 03:31:36.402546 3754 leader_election.cc:343] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
W20250625 03:31:36.406271 3679 leader_election.cc:343] T eeca5a85dddf4d1884917690e01ff81d P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:36.406847 3754 leader_election.cc:304] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841018313ad649679de64e006582f4c5; no voters: 01873d289e0b4f9f9184b251369502a9, ddc0ad67020f45edb3ba9c83cab687a4
I20250625 03:31:36.406934 3679 leader_election.cc:304] T eeca5a85dddf4d1884917690e01ff81d P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39; no voters: 841018313ad649679de64e006582f4c5, ddc0ad67020f45edb3ba9c83cab687a4
I20250625 03:31:36.407949 4013 raft_consensus.cc:2747] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:31:36.407999 3962 raft_consensus.cc:2747] T eeca5a85dddf4d1884917690e01ff81d P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:31:36.409672 3861 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d08de4c2326d46bab26f42d8d483ebd0" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4"
I20250625 03:31:36.410303 3861 raft_consensus.cc:3058] T d08de4c2326d46bab26f42d8d483ebd0 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:36.402765 3984 raft_consensus.cc:513] T 3d5b503929b24663a1f868ffaec34157 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:36.410665 3906 tablet_bootstrap.cc:492] T c592f2c5305141c487b73e0867d0f36b P 01873d289e0b4f9f9184b251369502a9: No bootstrap required, opened a new log
I20250625 03:31:36.411132 3906 ts_tablet_manager.cc:1397] T c592f2c5305141c487b73e0867d0f36b P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.276s user 0.018s sys 0.041s
I20250625 03:31:36.412732 3996 consensus_queue.cc:1035] T 49d4fb2581ed4ef998f6a113ea67c323 P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:31:36.413403 3638 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3d5b503929b24663a1f868ffaec34157" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:36.404491 3983 raft_consensus.cc:513] T d08de4c2326d46bab26f42d8d483ebd0 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
W20250625 03:31:36.414841 3680 leader_election.cc:343] T 3d5b503929b24663a1f868ffaec34157 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:36.416456 3983 leader_election.cc:290] T d08de4c2326d46bab26f42d8d483ebd0 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 election: Requested vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:31:36.418577 3905 tablet_bootstrap.cc:654] T d00ad2472fd74bfc9065d9dc4808e0c1 P 841018313ad649679de64e006582f4c5: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:36.418826 3983 raft_consensus.cc:491] T 5e59ae16ec1a4c69aac820531e504206 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:36.419339 3983 raft_consensus.cc:513] T 5e59ae16ec1a4c69aac820531e504206 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:36.419775 3714 raft_consensus.cc:2391] T d08de4c2326d46bab26f42d8d483ebd0 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01873d289e0b4f9f9184b251369502a9 in current term 1: Already voted for candidate 3d5b9823dfcd41cb92bd195c811cbf39 in this term.
I20250625 03:31:36.420065 3984 leader_election.cc:290] T 3d5b503929b24663a1f868ffaec34157 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:31:36.420150 4044 consensus_queue.cc:1035] T b1ece928b2e2452191ee263cf19ec4f8 P ddc0ad67020f45edb3ba9c83cab687a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20250625 03:31:36.421290 3906 raft_consensus.cc:357] T c592f2c5305141c487b73e0867d0f36b P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:36.421995 3906 raft_consensus.cc:383] T c592f2c5305141c487b73e0867d0f36b P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:36.426510 3906 raft_consensus.cc:738] T c592f2c5305141c487b73e0867d0f36b P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:36.427150 3906 consensus_queue.cc:260] T c592f2c5305141c487b73e0867d0f36b P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:36.435087 3538 catalog_manager.cc:5582] T 6fc84ca2087c4ded91412fb32117af48 P 841018313ad649679de64e006582f4c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 841018313ad649679de64e006582f4c5 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "841018313ad649679de64e006582f4c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:36.421648 3983 leader_election.cc:290] T 5e59ae16ec1a4c69aac820531e504206 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353)
I20250625 03:31:36.444270 3638 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d08de4c2326d46bab26f42d8d483ebd0" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9"
I20250625 03:31:36.449532 3906 ts_tablet_manager.cc:1428] T c592f2c5305141c487b73e0867d0f36b P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.038s user 0.007s sys 0.000s
I20250625 03:31:36.450892 3906 tablet_bootstrap.cc:492] T c0c8dfded31e4566b07bc439f6e58ef6 P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:36.450656 3535 catalog_manager.cc:5582] T c0c8dfded31e4566b07bc439f6e58ef6 P 3d5b9823dfcd41cb92bd195c811cbf39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:36.445542 3638 raft_consensus.cc:2391] T d08de4c2326d46bab26f42d8d483ebd0 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d5b9823dfcd41cb92bd195c811cbf39 in current term 1: Already voted for candidate 01873d289e0b4f9f9184b251369502a9 in this term.
I20250625 03:31:36.456911 3787 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5e59ae16ec1a4c69aac820531e504206" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:31:36.441351 3914 raft_consensus.cc:513] T c592f2c5305141c487b73e0867d0f36b P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:36.460759 3914 leader_election.cc:290] T c592f2c5305141c487b73e0867d0f36b P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 election: Requested vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:31:36.461617 3909 tablet_bootstrap.cc:492] T 002d4371d5414440b756829fe3343d07 P 3d5b9823dfcd41cb92bd195c811cbf39: No bootstrap required, opened a new log
I20250625 03:31:36.462136 3909 ts_tablet_manager.cc:1397] T 002d4371d5414440b756829fe3343d07 P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent bootstrapping tablet: real 0.196s user 0.022s sys 0.021s
I20250625 03:31:36.464893 3975 raft_consensus.cc:2747] T 49d4fb2581ed4ef998f6a113ea67c323 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250625 03:31:36.466188 3680 leader_election.cc:343] T 5e59ae16ec1a4c69aac820531e504206 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841018313ad649679de64e006582f4c5 (127.0.106.131:39467): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:36.467356 3638 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c592f2c5305141c487b73e0867d0f36b" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9"
I20250625 03:31:36.468042 3638 raft_consensus.cc:3058] T c592f2c5305141c487b73e0867d0f36b P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:36.473299 3946 raft_consensus.cc:491] T a07d77259251401d957af853b296750a P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:36.473855 3946 raft_consensus.cc:513] T a07d77259251401d957af853b296750a P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:36.474310 3909 raft_consensus.cc:357] T 002d4371d5414440b756829fe3343d07 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:36.474897 3909 raft_consensus.cc:383] T 002d4371d5414440b756829fe3343d07 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:36.475104 3909 raft_consensus.cc:738] T 002d4371d5414440b756829fe3343d07 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Initialized, Role: FOLLOWER
I20250625 03:31:36.475307 3638 raft_consensus.cc:2466] T c592f2c5305141c487b73e0867d0f36b P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5b9823dfcd41cb92bd195c811cbf39 in term 1.
I20250625 03:31:36.475651 3909 consensus_queue.cc:260] T 002d4371d5414440b756829fe3343d07 P 3d5b9823dfcd41cb92bd195c811cbf39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:36.476596 3680 leader_election.cc:304] T c592f2c5305141c487b73e0867d0f36b P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9, 3d5b9823dfcd41cb92bd195c811cbf39; no voters:
I20250625 03:31:36.478232 3910 tablet_bootstrap.cc:654] T 5e59ae16ec1a4c69aac820531e504206 P ddc0ad67020f45edb3ba9c83cab687a4: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:36.478556 3909 ts_tablet_manager.cc:1428] T 002d4371d5414440b756829fe3343d07 P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent starting tablet: real 0.016s user 0.005s sys 0.001s
I20250625 03:31:36.479286 3909 tablet_bootstrap.cc:492] T 39da7c80318f4c408f8cdaf2229b0c96 P 3d5b9823dfcd41cb92bd195c811cbf39: Bootstrap starting.
I20250625 03:31:36.481809 3984 raft_consensus.cc:2802] T c592f2c5305141c487b73e0867d0f36b P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:31:36.482350 3984 raft_consensus.cc:695] T c592f2c5305141c487b73e0867d0f36b P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 LEADER]: Becoming Leader. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Running, Role: LEADER
I20250625 03:31:36.483198 3984 consensus_queue.cc:237] T c592f2c5305141c487b73e0867d0f36b P 3d5b9823dfcd41cb92bd195c811cbf39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:36.484344 3860 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d08de4c2326d46bab26f42d8d483ebd0" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4"
I20250625 03:31:36.485118 3863 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3d5b503929b24663a1f868ffaec34157" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:36.487136 3860 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c592f2c5305141c487b73e0867d0f36b" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4"
I20250625 03:31:36.487924 3860 raft_consensus.cc:3058] T c592f2c5305141c487b73e0867d0f36b P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:36.488083 3863 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5e59ae16ec1a4c69aac820531e504206" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:36.495960 3679 leader_election.cc:304] T d08de4c2326d46bab26f42d8d483ebd0 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39; no voters: 01873d289e0b4f9f9184b251369502a9, ddc0ad67020f45edb3ba9c83cab687a4
W20250625 03:31:36.497339 3679 leader_election.cc:343] T 3d5b503929b24663a1f868ffaec34157 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:36.497782 3679 leader_election.cc:304] T 3d5b503929b24663a1f868ffaec34157 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39; no voters: 01873d289e0b4f9f9184b251369502a9, ddc0ad67020f45edb3ba9c83cab687a4
I20250625 03:31:36.499051 3906 tablet_bootstrap.cc:654] T c0c8dfded31e4566b07bc439f6e58ef6 P 01873d289e0b4f9f9184b251369502a9: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:36.499472 3962 raft_consensus.cc:2747] T d08de4c2326d46bab26f42d8d483ebd0 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20250625 03:31:36.500170 3962 raft_consensus.cc:2747] T 3d5b503929b24663a1f868ffaec34157 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:31:36.501340 3950 consensus_queue.cc:1035] T 49d4fb2581ed4ef998f6a113ea67c323 P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250625 03:31:36.498927 3679 leader_election.cc:343] T 5e59ae16ec1a4c69aac820531e504206 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:36.505493 3932 raft_consensus.cc:491] T 6fc84ca2087c4ded91412fb32117af48 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:36.508381 3932 raft_consensus.cc:513] T 6fc84ca2087c4ded91412fb32117af48 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:36.510850 3932 leader_election.cc:290] T 6fc84ca2087c4ded91412fb32117af48 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041), 841018313ad649679de64e006582f4c5 (127.0.106.131:39467)
I20250625 03:31:36.505537 3679 leader_election.cc:304] T 5e59ae16ec1a4c69aac820531e504206 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39; no voters: 841018313ad649679de64e006582f4c5, ddc0ad67020f45edb3ba9c83cab687a4
I20250625 03:31:36.512439 3914 raft_consensus.cc:2747] T 5e59ae16ec1a4c69aac820531e504206 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:31:36.506772 3983 raft_consensus.cc:491] T 002d4371d5414440b756829fe3343d07 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:36.513382 3983 raft_consensus.cc:513] T 002d4371d5414440b756829fe3343d07 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
W20250625 03:31:36.531927 4050 log.cc:927] Time spent T f3a33aa1d146468c986f0b1ba7d5fb84 P ddc0ad67020f45edb3ba9c83cab687a4: Append to log took a long time: real 0.088s user 0.001s sys 0.000s
I20250625 03:31:36.547478 3909 tablet_bootstrap.cc:654] T 39da7c80318f4c408f8cdaf2229b0c96 P 3d5b9823dfcd41cb92bd195c811cbf39: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:36.548620 3788 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "002d4371d5414440b756829fe3343d07" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:31:36.549353 3788 raft_consensus.cc:2466] T 002d4371d5414440b756829fe3343d07 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5b9823dfcd41cb92bd195c811cbf39 in term 0.
I20250625 03:31:36.551702 3680 leader_election.cc:304] T 002d4371d5414440b756829fe3343d07 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, 841018313ad649679de64e006582f4c5; no voters:
I20250625 03:31:36.552513 3914 raft_consensus.cc:2802] T 002d4371d5414440b756829fe3343d07 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:31:36.552901 3914 raft_consensus.cc:491] T 002d4371d5414440b756829fe3343d07 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:31:36.553021 3909 tablet_bootstrap.cc:492] T 39da7c80318f4c408f8cdaf2229b0c96 P 3d5b9823dfcd41cb92bd195c811cbf39: No bootstrap required, opened a new log
I20250625 03:31:36.553324 3914 raft_consensus.cc:3058] T 002d4371d5414440b756829fe3343d07 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:36.553678 3909 ts_tablet_manager.cc:1397] T 39da7c80318f4c408f8cdaf2229b0c96 P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent bootstrapping tablet: real 0.075s user 0.013s sys 0.000s
I20250625 03:31:36.556362 3909 raft_consensus.cc:357] T 39da7c80318f4c408f8cdaf2229b0c96 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:36.557057 3909 raft_consensus.cc:383] T 39da7c80318f4c408f8cdaf2229b0c96 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:36.557323 3909 raft_consensus.cc:738] T 39da7c80318f4c408f8cdaf2229b0c96 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Initialized, Role: FOLLOWER
I20250625 03:31:36.553031 3905 tablet_bootstrap.cc:492] T d00ad2472fd74bfc9065d9dc4808e0c1 P 841018313ad649679de64e006582f4c5: No bootstrap required, opened a new log
I20250625 03:31:36.559511 3975 consensus_queue.cc:1035] T a07d77259251401d957af853b296750a P ddc0ad67020f45edb3ba9c83cab687a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:31:36.559799 3932 consensus_queue.cc:1035] T b1ece928b2e2452191ee263cf19ec4f8 P ddc0ad67020f45edb3ba9c83cab687a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:31:36.561009 3932 consensus_queue.cc:1035] T a07d77259251401d957af853b296750a P ddc0ad67020f45edb3ba9c83cab687a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:31:36.561134 3789 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6fc84ca2087c4ded91412fb32117af48" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:31:36.558173 3905 ts_tablet_manager.cc:1397] T d00ad2472fd74bfc9065d9dc4808e0c1 P 841018313ad649679de64e006582f4c5: Time spent bootstrapping tablet: real 0.181s user 0.032s sys 0.017s
I20250625 03:31:36.562466 3714 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6fc84ca2087c4ded91412fb32117af48" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" is_pre_election: true
I20250625 03:31:36.563324 3714 raft_consensus.cc:2391] T 6fc84ca2087c4ded91412fb32117af48 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddc0ad67020f45edb3ba9c83cab687a4 in current term 1: Already voted for candidate 841018313ad649679de64e006582f4c5 in this term.
I20250625 03:31:36.563545 3860 raft_consensus.cc:2466] T c592f2c5305141c487b73e0867d0f36b P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5b9823dfcd41cb92bd195c811cbf39 in term 1.
I20250625 03:31:36.564116 3983 leader_election.cc:290] T 002d4371d5414440b756829fe3343d07 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 841018313ad649679de64e006582f4c5 (127.0.106.131:39467)
I20250625 03:31:36.565455 3905 raft_consensus.cc:357] T d00ad2472fd74bfc9065d9dc4808e0c1 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:36.566423 3905 raft_consensus.cc:383] T d00ad2472fd74bfc9065d9dc4808e0c1 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:36.566797 3905 raft_consensus.cc:738] T d00ad2472fd74bfc9065d9dc4808e0c1 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841018313ad649679de64e006582f4c5, State: Initialized, Role: FOLLOWER
I20250625 03:31:36.567437 3905 consensus_queue.cc:260] T d00ad2472fd74bfc9065d9dc4808e0c1 P 841018313ad649679de64e006582f4c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:36.569067 3905 ts_tablet_manager.cc:1428] T d00ad2472fd74bfc9065d9dc4808e0c1 P 841018313ad649679de64e006582f4c5: Time spent starting tablet: real 0.006s user 0.003s sys 0.002s
I20250625 03:31:36.570004 3905 tablet_bootstrap.cc:492] T 5ece5f5b2a904c9cbef3065e210e9a30 P 841018313ad649679de64e006582f4c5: Bootstrap starting.
W20250625 03:31:36.572304 3585 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20250625 03:31:36.572170 3909 consensus_queue.cc:260] T 39da7c80318f4c408f8cdaf2229b0c96 P 3d5b9823dfcd41cb92bd195c811cbf39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:36.573834 4011 raft_consensus.cc:491] T eeca5a85dddf4d1884917690e01ff81d P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:36.574365 4011 raft_consensus.cc:513] T eeca5a85dddf4d1884917690e01ff81d P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:36.577530 4011 leader_election.cc:290] T eeca5a85dddf4d1884917690e01ff81d P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041), ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353)
I20250625 03:31:36.580096 3714 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "eeca5a85dddf4d1884917690e01ff81d" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" is_pre_election: true
I20250625 03:31:36.580956 3714 raft_consensus.cc:2466] T eeca5a85dddf4d1884917690e01ff81d P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841018313ad649679de64e006582f4c5 in term 0.
I20250625 03:31:36.581139 3906 tablet_bootstrap.cc:492] T c0c8dfded31e4566b07bc439f6e58ef6 P 01873d289e0b4f9f9184b251369502a9: No bootstrap required, opened a new log
I20250625 03:31:36.581845 3906 ts_tablet_manager.cc:1397] T c0c8dfded31e4566b07bc439f6e58ef6 P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.131s user 0.015s sys 0.000s
I20250625 03:31:36.582228 3754 leader_election.cc:304] T eeca5a85dddf4d1884917690e01ff81d P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, 841018313ad649679de64e006582f4c5; no voters:
I20250625 03:31:36.583909 3914 raft_consensus.cc:513] T 002d4371d5414440b756829fe3343d07 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:36.584570 3906 raft_consensus.cc:357] T c0c8dfded31e4566b07bc439f6e58ef6 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:36.585433 3906 raft_consensus.cc:383] T c0c8dfded31e4566b07bc439f6e58ef6 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:36.585772 3860 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "eeca5a85dddf4d1884917690e01ff81d" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
W20250625 03:31:36.587244 3753 leader_election.cc:343] T eeca5a85dddf4d1884917690e01ff81d P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:36.587337 3909 ts_tablet_manager.cc:1428] T 39da7c80318f4c408f8cdaf2229b0c96 P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent starting tablet: real 0.033s user 0.007s sys 0.000s
I20250625 03:31:36.587440 3861 raft_consensus.cc:2466] T d08de4c2326d46bab26f42d8d483ebd0 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01873d289e0b4f9f9184b251369502a9 in term 1.
I20250625 03:31:36.588511 3909 tablet_bootstrap.cc:492] T 526951ad467a4708926096ed1162a722 P 3d5b9823dfcd41cb92bd195c811cbf39: Bootstrap starting.
I20250625 03:31:36.589972 3786 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "002d4371d5414440b756829fe3343d07" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5"
I20250625 03:31:36.590726 3786 raft_consensus.cc:3058] T 002d4371d5414440b756829fe3343d07 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:36.594632 3909 tablet_bootstrap.cc:654] T 526951ad467a4708926096ed1162a722 P 3d5b9823dfcd41cb92bd195c811cbf39: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:36.585752 3906 raft_consensus.cc:738] T c0c8dfded31e4566b07bc439f6e58ef6 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:36.596614 3906 consensus_queue.cc:260] T c0c8dfded31e4566b07bc439f6e58ef6 P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:36.601214 3905 tablet_bootstrap.cc:654] T 5ece5f5b2a904c9cbef3065e210e9a30 P 841018313ad649679de64e006582f4c5: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:36.598696 4011 raft_consensus.cc:2802] T eeca5a85dddf4d1884917690e01ff81d P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:31:36.598050 3914 leader_election.cc:290] T 002d4371d5414440b756829fe3343d07 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 election: Requested vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 841018313ad649679de64e006582f4c5 (127.0.106.131:39467)
I20250625 03:31:36.610675 3713 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a07d77259251401d957af853b296750a" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" is_pre_election: true
I20250625 03:31:36.613994 3636 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "002d4371d5414440b756829fe3343d07" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9"
I20250625 03:31:36.598174 3950 consensus_queue.cc:1035] T 5dc5a179a27f462989b291e8133742da P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20250625 03:31:36.607738 3638 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "002d4371d5414440b756829fe3343d07" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:36.609189 3946 leader_election.cc:290] T a07d77259251401d957af853b296750a P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:31:36.609756 4011 raft_consensus.cc:491] T eeca5a85dddf4d1884917690e01ff81d P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:31:36.617234 3786 raft_consensus.cc:2466] T 002d4371d5414440b756829fe3343d07 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5b9823dfcd41cb92bd195c811cbf39 in term 1.
W20250625 03:31:36.618665 3680 leader_election.cc:343] T 002d4371d5414440b756829fe3343d07 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:36.617383 4011 raft_consensus.cc:3058] T eeca5a85dddf4d1884917690e01ff81d P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Advancing to term 1
W20250625 03:31:36.621968 3680 leader_election.cc:343] T 002d4371d5414440b756829fe3343d07 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:36.627943 3910 tablet_bootstrap.cc:492] T 5e59ae16ec1a4c69aac820531e504206 P ddc0ad67020f45edb3ba9c83cab687a4: No bootstrap required, opened a new log
I20250625 03:31:36.628561 3910 ts_tablet_manager.cc:1397] T 5e59ae16ec1a4c69aac820531e504206 P ddc0ad67020f45edb3ba9c83cab687a4: Time spent bootstrapping tablet: real 0.271s user 0.016s sys 0.005s
I20250625 03:31:36.629736 3946 raft_consensus.cc:491] T c0c8dfded31e4566b07bc439f6e58ef6 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:36.630507 3946 raft_consensus.cc:513] T c0c8dfded31e4566b07bc439f6e58ef6 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:36.632128 3910 raft_consensus.cc:357] T 5e59ae16ec1a4c69aac820531e504206 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:36.632834 3910 raft_consensus.cc:383] T 5e59ae16ec1a4c69aac820531e504206 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:36.633131 3910 raft_consensus.cc:738] T 5e59ae16ec1a4c69aac820531e504206 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Initialized, Role: FOLLOWER
I20250625 03:31:36.633803 3910 consensus_queue.cc:260] T 5e59ae16ec1a4c69aac820531e504206 P ddc0ad67020f45edb3ba9c83cab687a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:36.629968 3906 ts_tablet_manager.cc:1428] T c0c8dfded31e4566b07bc439f6e58ef6 P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.048s user 0.010s sys 0.000s
I20250625 03:31:36.641880 3906 tablet_bootstrap.cc:492] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:36.615839 3828 leader_election.cc:304] T 6fc84ca2087c4ded91412fb32117af48 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddc0ad67020f45edb3ba9c83cab687a4; no voters: 3d5b9823dfcd41cb92bd195c811cbf39, 841018313ad649679de64e006582f4c5
I20250625 03:31:36.648399 3932 raft_consensus.cc:3058] T 6fc84ca2087c4ded91412fb32117af48 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:36.653532 3604 leader_election.cc:304] T d08de4c2326d46bab26f42d8d483ebd0 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9, ddc0ad67020f45edb3ba9c83cab687a4; no voters: 3d5b9823dfcd41cb92bd195c811cbf39
I20250625 03:31:36.653946 3680 leader_election.cc:304] T 002d4371d5414440b756829fe3343d07 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, 841018313ad649679de64e006582f4c5; no voters: 01873d289e0b4f9f9184b251369502a9
I20250625 03:31:36.655192 3938 raft_consensus.cc:2802] T d08de4c2326d46bab26f42d8d483ebd0 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:31:36.655625 3984 raft_consensus.cc:2802] T 002d4371d5414440b756829fe3343d07 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:31:36.655896 3938 raft_consensus.cc:695] T d08de4c2326d46bab26f42d8d483ebd0 P 01873d289e0b4f9f9184b251369502a9 [term 1 LEADER]: Becoming Leader. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Running, Role: LEADER
I20250625 03:31:36.656451 3984 raft_consensus.cc:695] T 002d4371d5414440b756829fe3343d07 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 LEADER]: Becoming Leader. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Running, Role: LEADER
I20250625 03:31:36.657694 3984 consensus_queue.cc:237] T 002d4371d5414440b756829fe3343d07 P 3d5b9823dfcd41cb92bd195c811cbf39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:36.658910 3861 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a07d77259251401d957af853b296750a" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:36.657235 3938 consensus_queue.cc:237] T d08de4c2326d46bab26f42d8d483ebd0 P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:36.647377 3712 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c0c8dfded31e4566b07bc439f6e58ef6" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" is_pre_election: true
I20250625 03:31:36.663152 3946 leader_election.cc:290] T c0c8dfded31e4566b07bc439f6e58ef6 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041), 841018313ad649679de64e006582f4c5 (127.0.106.131:39467)
I20250625 03:31:36.663410 3996 consensus_queue.cc:1035] T 5dc5a179a27f462989b291e8133742da P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:31:36.667106 3789 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c0c8dfded31e4566b07bc439f6e58ef6" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:31:36.670569 3910 ts_tablet_manager.cc:1428] T 5e59ae16ec1a4c69aac820531e504206 P ddc0ad67020f45edb3ba9c83cab687a4: Time spent starting tablet: real 0.042s user 0.004s sys 0.002s
I20250625 03:31:36.671952 3789 raft_consensus.cc:2391] T c0c8dfded31e4566b07bc439f6e58ef6 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01873d289e0b4f9f9184b251369502a9 in current term 1: Already voted for candidate 3d5b9823dfcd41cb92bd195c811cbf39 in this term.
I20250625 03:31:36.676496 3604 leader_election.cc:304] T a07d77259251401d957af853b296750a P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9; no voters: 3d5b9823dfcd41cb92bd195c811cbf39, ddc0ad67020f45edb3ba9c83cab687a4
I20250625 03:31:36.688179 3605 leader_election.cc:304] T c0c8dfded31e4566b07bc439f6e58ef6 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9; no voters: 3d5b9823dfcd41cb92bd195c811cbf39, 841018313ad649679de64e006582f4c5
I20250625 03:31:36.689419 3996 raft_consensus.cc:2747] T a07d77259251401d957af853b296750a P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250625 03:31:36.690045 3996 raft_consensus.cc:3058] T c0c8dfded31e4566b07bc439f6e58ef6 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:36.702545 3906 tablet_bootstrap.cc:654] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 01873d289e0b4f9f9184b251369502a9: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:36.717881 3910 tablet_bootstrap.cc:492] T 3d5b503929b24663a1f868ffaec34157 P ddc0ad67020f45edb3ba9c83cab687a4: Bootstrap starting.
I20250625 03:31:36.683132 4011 raft_consensus.cc:513] T eeca5a85dddf4d1884917690e01ff81d P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:36.712069 3996 raft_consensus.cc:2747] T c0c8dfded31e4566b07bc439f6e58ef6 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:31:36.734930 3932 raft_consensus.cc:2747] T 6fc84ca2087c4ded91412fb32117af48 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:31:36.745332 3905 tablet_bootstrap.cc:492] T 5ece5f5b2a904c9cbef3065e210e9a30 P 841018313ad649679de64e006582f4c5: No bootstrap required, opened a new log
I20250625 03:31:36.745815 3905 ts_tablet_manager.cc:1397] T 5ece5f5b2a904c9cbef3065e210e9a30 P 841018313ad649679de64e006582f4c5: Time spent bootstrapping tablet: real 0.176s user 0.047s sys 0.032s
I20250625 03:31:36.753242 3712 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "eeca5a85dddf4d1884917690e01ff81d" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
I20250625 03:31:36.753235 4011 leader_election.cc:290] T eeca5a85dddf4d1884917690e01ff81d P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 election: Requested vote from peers 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041), ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353)
I20250625 03:31:36.754057 3712 raft_consensus.cc:3058] T eeca5a85dddf4d1884917690e01ff81d P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:36.754927 3861 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "eeca5a85dddf4d1884917690e01ff81d" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4"
W20250625 03:31:36.756429 3753 leader_election.cc:343] T eeca5a85dddf4d1884917690e01ff81d P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:36.761888 3712 raft_consensus.cc:2466] T eeca5a85dddf4d1884917690e01ff81d P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841018313ad649679de64e006582f4c5 in term 1.
I20250625 03:31:36.763164 3754 leader_election.cc:304] T eeca5a85dddf4d1884917690e01ff81d P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, 841018313ad649679de64e006582f4c5; no voters: ddc0ad67020f45edb3ba9c83cab687a4
I20250625 03:31:36.768401 3905 raft_consensus.cc:357] T 5ece5f5b2a904c9cbef3065e210e9a30 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:36.769181 3905 raft_consensus.cc:383] T 5ece5f5b2a904c9cbef3065e210e9a30 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:36.769553 3905 raft_consensus.cc:738] T 5ece5f5b2a904c9cbef3065e210e9a30 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841018313ad649679de64e006582f4c5, State: Initialized, Role: FOLLOWER
I20250625 03:31:36.770197 3905 consensus_queue.cc:260] T 5ece5f5b2a904c9cbef3065e210e9a30 P 841018313ad649679de64e006582f4c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:36.772425 3905 ts_tablet_manager.cc:1428] T 5ece5f5b2a904c9cbef3065e210e9a30 P 841018313ad649679de64e006582f4c5: Time spent starting tablet: real 0.026s user 0.007s sys 0.000s
I20250625 03:31:36.767035 3984 consensus_queue.cc:1035] T c0c8dfded31e4566b07bc439f6e58ef6 P 3d5b9823dfcd41cb92bd195c811cbf39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20250625 03:31:36.775678 3537 catalog_manager.cc:5582] T 002d4371d5414440b756829fe3343d07 P 3d5b9823dfcd41cb92bd195c811cbf39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:36.778015 3537 catalog_manager.cc:5582] T c592f2c5305141c487b73e0867d0f36b P 3d5b9823dfcd41cb92bd195c811cbf39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: HEALTHY } } }
I20250625 03:31:36.767011 4011 raft_consensus.cc:2802] T eeca5a85dddf4d1884917690e01ff81d P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:31:36.784070 4011 raft_consensus.cc:695] T eeca5a85dddf4d1884917690e01ff81d P 841018313ad649679de64e006582f4c5 [term 1 LEADER]: Becoming Leader. State: Replica: 841018313ad649679de64e006582f4c5, State: Running, Role: LEADER
I20250625 03:31:36.784540 3909 tablet_bootstrap.cc:492] T 526951ad467a4708926096ed1162a722 P 3d5b9823dfcd41cb92bd195c811cbf39: No bootstrap required, opened a new log
I20250625 03:31:36.785049 3909 ts_tablet_manager.cc:1397] T 526951ad467a4708926096ed1162a722 P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent bootstrapping tablet: real 0.197s user 0.024s sys 0.000s
I20250625 03:31:36.784971 4011 consensus_queue.cc:237] T eeca5a85dddf4d1884917690e01ff81d P 841018313ad649679de64e006582f4c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:36.790664 3909 raft_consensus.cc:357] T 526951ad467a4708926096ed1162a722 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:36.793641 3909 raft_consensus.cc:383] T 526951ad467a4708926096ed1162a722 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:36.794267 3909 raft_consensus.cc:738] T 526951ad467a4708926096ed1162a722 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Initialized, Role: FOLLOWER
I20250625 03:31:36.795467 3905 tablet_bootstrap.cc:492] T 39da7c80318f4c408f8cdaf2229b0c96 P 841018313ad649679de64e006582f4c5: Bootstrap starting.
I20250625 03:31:36.795943 3909 consensus_queue.cc:260] T 526951ad467a4708926096ed1162a722 P 3d5b9823dfcd41cb92bd195c811cbf39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:36.795967 3932 consensus_queue.cc:1035] T 1e9c146f8cd743f7ac35dc61d9226d1d P ddc0ad67020f45edb3ba9c83cab687a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:31:36.792920 3910 tablet_bootstrap.cc:654] T 3d5b503929b24663a1f868ffaec34157 P ddc0ad67020f45edb3ba9c83cab687a4: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:36.798645 3538 catalog_manager.cc:5582] T d08de4c2326d46bab26f42d8d483ebd0 P 01873d289e0b4f9f9184b251369502a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 01873d289e0b4f9f9184b251369502a9 (127.0.106.129). New cstate: current_term: 1 leader_uuid: "01873d289e0b4f9f9184b251369502a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:36.798687 3909 ts_tablet_manager.cc:1428] T 526951ad467a4708926096ed1162a722 P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent starting tablet: real 0.013s user 0.002s sys 0.003s
I20250625 03:31:36.801707 3905 tablet_bootstrap.cc:654] T 39da7c80318f4c408f8cdaf2229b0c96 P 841018313ad649679de64e006582f4c5: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:36.801079 3909 tablet_bootstrap.cc:492] T 5ece5f5b2a904c9cbef3065e210e9a30 P 3d5b9823dfcd41cb92bd195c811cbf39: Bootstrap starting.
I20250625 03:31:36.808909 3909 tablet_bootstrap.cc:654] T 5ece5f5b2a904c9cbef3065e210e9a30 P 3d5b9823dfcd41cb92bd195c811cbf39: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:36.811022 3984 raft_consensus.cc:491] T 526951ad467a4708926096ed1162a722 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:36.812290 3984 raft_consensus.cc:513] T 526951ad467a4708926096ed1162a722 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:36.813570 3536 catalog_manager.cc:5582] T 1e9c146f8cd743f7ac35dc61d9226d1d P ddc0ad67020f45edb3ba9c83cab687a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132). New cstate: current_term: 1 leader_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:36.816123 3975 raft_consensus.cc:491] T 5e59ae16ec1a4c69aac820531e504206 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:36.816334 3861 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "526951ad467a4708926096ed1162a722" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:36.816409 3638 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "526951ad467a4708926096ed1162a722" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:36.816646 3975 raft_consensus.cc:513] T 5e59ae16ec1a4c69aac820531e504206 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:36.814344 3984 leader_election.cc:290] T 526951ad467a4708926096ed1162a722 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
W20250625 03:31:36.818158 3679 leader_election.cc:343] T 526951ad467a4708926096ed1162a722 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353): Illegal state: must be running to vote when last-logged opid is not known
W20250625 03:31:36.818706 3680 leader_election.cc:343] T 526951ad467a4708926096ed1162a722 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:36.819320 3680 leader_election.cc:304] T 526951ad467a4708926096ed1162a722 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39; no voters: 01873d289e0b4f9f9184b251369502a9, ddc0ad67020f45edb3ba9c83cab687a4
I20250625 03:31:36.819851 3713 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5e59ae16ec1a4c69aac820531e504206" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" is_pre_election: true
I20250625 03:31:36.820560 3713 raft_consensus.cc:2466] T 5e59ae16ec1a4c69aac820531e504206 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddc0ad67020f45edb3ba9c83cab687a4 in term 0.
I20250625 03:31:36.820847 3984 raft_consensus.cc:2747] T 526951ad467a4708926096ed1162a722 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:31:36.818696 3975 leader_election.cc:290] T 5e59ae16ec1a4c69aac820531e504206 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041), 841018313ad649679de64e006582f4c5 (127.0.106.131:39467)
I20250625 03:31:36.823242 3786 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5e59ae16ec1a4c69aac820531e504206" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
W20250625 03:31:36.830585 3828 leader_election.cc:343] T 5e59ae16ec1a4c69aac820531e504206 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841018313ad649679de64e006582f4c5 (127.0.106.131:39467): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:36.831565 3828 leader_election.cc:304] T 5e59ae16ec1a4c69aac820531e504206 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, ddc0ad67020f45edb3ba9c83cab687a4; no voters: 841018313ad649679de64e006582f4c5
I20250625 03:31:36.835489 3975 raft_consensus.cc:2802] T 5e59ae16ec1a4c69aac820531e504206 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:31:36.835932 3975 raft_consensus.cc:491] T 5e59ae16ec1a4c69aac820531e504206 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:31:36.836325 3975 raft_consensus.cc:3058] T 5e59ae16ec1a4c69aac820531e504206 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:36.839795 4013 consensus_queue.cc:1035] T 6fc84ca2087c4ded91412fb32117af48 P 841018313ad649679de64e006582f4c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:31:36.840557 3914 consensus_queue.cc:1035] T c0c8dfded31e4566b07bc439f6e58ef6 P 3d5b9823dfcd41cb92bd195c811cbf39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:31:36.842670 3951 raft_consensus.cc:491] T 39da7c80318f4c408f8cdaf2229b0c96 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:36.843228 3951 raft_consensus.cc:513] T 39da7c80318f4c408f8cdaf2229b0c96 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:36.845218 3951 leader_election.cc:290] T 39da7c80318f4c408f8cdaf2229b0c96 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 841018313ad649679de64e006582f4c5 (127.0.106.131:39467)
I20250625 03:31:36.848104 3638 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "39da7c80318f4c408f8cdaf2229b0c96" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:36.853873 3788 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "39da7c80318f4c408f8cdaf2229b0c96" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:31:36.862442 4013 consensus_queue.cc:1035] T 6fc84ca2087c4ded91412fb32117af48 P 841018313ad649679de64e006582f4c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250625 03:31:36.865736 3680 leader_election.cc:343] T 39da7c80318f4c408f8cdaf2229b0c96 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841018313ad649679de64e006582f4c5 (127.0.106.131:39467): Illegal state: must be running to vote when last-logged opid is not known
W20250625 03:31:36.866518 3680 leader_election.cc:343] T 39da7c80318f4c408f8cdaf2229b0c96 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:36.867094 3680 leader_election.cc:304] T 39da7c80318f4c408f8cdaf2229b0c96 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39; no voters: 01873d289e0b4f9f9184b251369502a9, 841018313ad649679de64e006582f4c5
W20250625 03:31:36.870061 3828 consensus_peers.cc:487] T 1e9c146f8cd743f7ac35dc61d9226d1d P ddc0ad67020f45edb3ba9c83cab687a4 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:36.872535 3905 tablet_bootstrap.cc:492] T 39da7c80318f4c408f8cdaf2229b0c96 P 841018313ad649679de64e006582f4c5: No bootstrap required, opened a new log
I20250625 03:31:36.873188 3905 ts_tablet_manager.cc:1397] T 39da7c80318f4c408f8cdaf2229b0c96 P 841018313ad649679de64e006582f4c5: Time spent bootstrapping tablet: real 0.078s user 0.017s sys 0.015s
I20250625 03:31:36.876945 3914 raft_consensus.cc:2747] T 39da7c80318f4c408f8cdaf2229b0c96 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:31:36.877398 3906 tablet_bootstrap.cc:492] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 01873d289e0b4f9f9184b251369502a9: No bootstrap required, opened a new log
I20250625 03:31:36.877974 3906 ts_tablet_manager.cc:1397] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.242s user 0.014s sys 0.001s
I20250625 03:31:36.878374 3910 tablet_bootstrap.cc:492] T 3d5b503929b24663a1f868ffaec34157 P ddc0ad67020f45edb3ba9c83cab687a4: No bootstrap required, opened a new log
I20250625 03:31:36.878983 3910 ts_tablet_manager.cc:1397] T 3d5b503929b24663a1f868ffaec34157 P ddc0ad67020f45edb3ba9c83cab687a4: Time spent bootstrapping tablet: real 0.163s user 0.010s sys 0.003s
I20250625 03:31:36.880851 3906 raft_consensus.cc:357] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:36.881618 3906 raft_consensus.cc:383] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:36.881955 3906 raft_consensus.cc:738] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:36.881668 3910 raft_consensus.cc:357] T 3d5b503929b24663a1f868ffaec34157 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:36.876351 3905 raft_consensus.cc:357] T 39da7c80318f4c408f8cdaf2229b0c96 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:36.882645 3906 consensus_queue.cc:260] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:36.882969 3984 consensus_queue.cc:1035] T c592f2c5305141c487b73e0867d0f36b P 3d5b9823dfcd41cb92bd195c811cbf39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:31:36.883368 3905 raft_consensus.cc:383] T 39da7c80318f4c408f8cdaf2229b0c96 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:36.883771 3905 raft_consensus.cc:738] T 39da7c80318f4c408f8cdaf2229b0c96 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841018313ad649679de64e006582f4c5, State: Initialized, Role: FOLLOWER
I20250625 03:31:36.884588 3905 consensus_queue.cc:260] T 39da7c80318f4c408f8cdaf2229b0c96 P 841018313ad649679de64e006582f4c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:36.888293 3909 tablet_bootstrap.cc:492] T 5ece5f5b2a904c9cbef3065e210e9a30 P 3d5b9823dfcd41cb92bd195c811cbf39: No bootstrap required, opened a new log
I20250625 03:31:36.889215 3909 ts_tablet_manager.cc:1397] T 5ece5f5b2a904c9cbef3065e210e9a30 P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent bootstrapping tablet: real 0.088s user 0.011s sys 0.000s
I20250625 03:31:36.889954 3906 ts_tablet_manager.cc:1428] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.011s user 0.005s sys 0.000s
I20250625 03:31:36.890376 3905 ts_tablet_manager.cc:1428] T 39da7c80318f4c408f8cdaf2229b0c96 P 841018313ad649679de64e006582f4c5: Time spent starting tablet: real 0.017s user 0.007s sys 0.000s
I20250625 03:31:36.890910 3906 tablet_bootstrap.cc:492] T 1e9c146f8cd743f7ac35dc61d9226d1d P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:36.891352 3905 tablet_bootstrap.cc:492] T 9d985eca3d6f497c86b94c53f16c8ae5 P 841018313ad649679de64e006582f4c5: Bootstrap starting.
I20250625 03:31:36.891016 3975 raft_consensus.cc:513] T 5e59ae16ec1a4c69aac820531e504206 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:36.892261 3909 raft_consensus.cc:357] T 5ece5f5b2a904c9cbef3065e210e9a30 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:36.892980 3909 raft_consensus.cc:383] T 5ece5f5b2a904c9cbef3065e210e9a30 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:36.893294 3909 raft_consensus.cc:738] T 5ece5f5b2a904c9cbef3065e210e9a30 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Initialized, Role: FOLLOWER
I20250625 03:31:36.894277 3909 consensus_queue.cc:260] T 5ece5f5b2a904c9cbef3065e210e9a30 P 3d5b9823dfcd41cb92bd195c811cbf39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:36.896111 3910 raft_consensus.cc:383] T 3d5b503929b24663a1f868ffaec34157 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:36.896529 3910 raft_consensus.cc:738] T 3d5b503929b24663a1f868ffaec34157 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Initialized, Role: FOLLOWER
I20250625 03:31:36.897120 3909 ts_tablet_manager.cc:1428] T 5ece5f5b2a904c9cbef3065e210e9a30 P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20250625 03:31:36.897259 3910 consensus_queue.cc:260] T 3d5b503929b24663a1f868ffaec34157 P ddc0ad67020f45edb3ba9c83cab687a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:36.897136 3906 tablet_bootstrap.cc:654] T 1e9c146f8cd743f7ac35dc61d9226d1d P 01873d289e0b4f9f9184b251369502a9: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:36.898411 3909 tablet_bootstrap.cc:492] T caea215a97a344e88348ecb21035902d P 3d5b9823dfcd41cb92bd195c811cbf39: Bootstrap starting.
I20250625 03:31:36.903090 3975 leader_election.cc:290] T 5e59ae16ec1a4c69aac820531e504206 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 election: Requested vote from peers 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041), 841018313ad649679de64e006582f4c5 (127.0.106.131:39467)
I20250625 03:31:36.904691 3713 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5e59ae16ec1a4c69aac820531e504206" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
I20250625 03:31:36.905332 3713 raft_consensus.cc:3058] T 5e59ae16ec1a4c69aac820531e504206 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:36.908248 3983 consensus_queue.cc:1035] T c592f2c5305141c487b73e0867d0f36b P 3d5b9823dfcd41cb92bd195c811cbf39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:31:36.908342 3788 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5e59ae16ec1a4c69aac820531e504206" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5"
W20250625 03:31:36.910179 3828 leader_election.cc:343] T 5e59ae16ec1a4c69aac820531e504206 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 841018313ad649679de64e006582f4c5 (127.0.106.131:39467): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:36.913748 3909 tablet_bootstrap.cc:654] T caea215a97a344e88348ecb21035902d P 3d5b9823dfcd41cb92bd195c811cbf39: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:36.917287 3535 catalog_manager.cc:5582] T eeca5a85dddf4d1884917690e01ff81d P 841018313ad649679de64e006582f4c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 841018313ad649679de64e006582f4c5 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "841018313ad649679de64e006582f4c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:36.928393 3910 ts_tablet_manager.cc:1428] T 3d5b503929b24663a1f868ffaec34157 P ddc0ad67020f45edb3ba9c83cab687a4: Time spent starting tablet: real 0.049s user 0.007s sys 0.001s
I20250625 03:31:36.929471 3910 tablet_bootstrap.cc:492] T a6b45bf21adf457d9a920f57d758ba15 P ddc0ad67020f45edb3ba9c83cab687a4: Bootstrap starting.
I20250625 03:31:36.919642 3713 raft_consensus.cc:2466] T 5e59ae16ec1a4c69aac820531e504206 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddc0ad67020f45edb3ba9c83cab687a4 in term 1.
I20250625 03:31:36.933421 3909 tablet_bootstrap.cc:492] T caea215a97a344e88348ecb21035902d P 3d5b9823dfcd41cb92bd195c811cbf39: No bootstrap required, opened a new log
I20250625 03:31:36.934113 3909 ts_tablet_manager.cc:1397] T caea215a97a344e88348ecb21035902d P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent bootstrapping tablet: real 0.036s user 0.015s sys 0.003s
I20250625 03:31:36.934384 3828 leader_election.cc:304] T 5e59ae16ec1a4c69aac820531e504206 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, ddc0ad67020f45edb3ba9c83cab687a4; no voters: 841018313ad649679de64e006582f4c5
I20250625 03:31:36.944453 3975 raft_consensus.cc:2802] T 5e59ae16ec1a4c69aac820531e504206 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:31:36.944950 3975 raft_consensus.cc:695] T 5e59ae16ec1a4c69aac820531e504206 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 LEADER]: Becoming Leader. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Running, Role: LEADER
I20250625 03:31:36.945776 3975 consensus_queue.cc:237] T 5e59ae16ec1a4c69aac820531e504206 P ddc0ad67020f45edb3ba9c83cab687a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:36.948496 3909 raft_consensus.cc:357] T caea215a97a344e88348ecb21035902d P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:36.949227 3909 raft_consensus.cc:383] T caea215a97a344e88348ecb21035902d P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:36.949592 3909 raft_consensus.cc:738] T caea215a97a344e88348ecb21035902d P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Initialized, Role: FOLLOWER
I20250625 03:31:36.937695 3905 tablet_bootstrap.cc:654] T 9d985eca3d6f497c86b94c53f16c8ae5 P 841018313ad649679de64e006582f4c5: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:36.950424 3909 consensus_queue.cc:260] T caea215a97a344e88348ecb21035902d P 3d5b9823dfcd41cb92bd195c811cbf39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:36.951715 3906 tablet_bootstrap.cc:492] T 1e9c146f8cd743f7ac35dc61d9226d1d P 01873d289e0b4f9f9184b251369502a9: No bootstrap required, opened a new log
I20250625 03:31:36.952230 3906 ts_tablet_manager.cc:1397] T 1e9c146f8cd743f7ac35dc61d9226d1d P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.062s user 0.014s sys 0.000s
I20250625 03:31:36.952829 3909 ts_tablet_manager.cc:1428] T caea215a97a344e88348ecb21035902d P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20250625 03:31:36.953820 3909 tablet_bootstrap.cc:492] T 9d985eca3d6f497c86b94c53f16c8ae5 P 3d5b9823dfcd41cb92bd195c811cbf39: Bootstrap starting.
I20250625 03:31:36.954525 3906 raft_consensus.cc:357] T 1e9c146f8cd743f7ac35dc61d9226d1d P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:36.955209 3906 raft_consensus.cc:383] T 1e9c146f8cd743f7ac35dc61d9226d1d P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:36.955475 3906 raft_consensus.cc:738] T 1e9c146f8cd743f7ac35dc61d9226d1d P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:36.942499 3910 tablet_bootstrap.cc:654] T a6b45bf21adf457d9a920f57d758ba15 P ddc0ad67020f45edb3ba9c83cab687a4: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:36.960279 3909 tablet_bootstrap.cc:654] T 9d985eca3d6f497c86b94c53f16c8ae5 P 3d5b9823dfcd41cb92bd195c811cbf39: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:36.961585 3906 consensus_queue.cc:260] T 1e9c146f8cd743f7ac35dc61d9226d1d P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:36.964429 3905 tablet_bootstrap.cc:492] T 9d985eca3d6f497c86b94c53f16c8ae5 P 841018313ad649679de64e006582f4c5: No bootstrap required, opened a new log
I20250625 03:31:36.964948 3905 ts_tablet_manager.cc:1397] T 9d985eca3d6f497c86b94c53f16c8ae5 P 841018313ad649679de64e006582f4c5: Time spent bootstrapping tablet: real 0.074s user 0.008s sys 0.006s
I20250625 03:31:36.972455 3905 raft_consensus.cc:357] T 9d985eca3d6f497c86b94c53f16c8ae5 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:36.972981 3905 raft_consensus.cc:383] T 9d985eca3d6f497c86b94c53f16c8ae5 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:36.973212 3905 raft_consensus.cc:738] T 9d985eca3d6f497c86b94c53f16c8ae5 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841018313ad649679de64e006582f4c5, State: Initialized, Role: FOLLOWER
I20250625 03:31:36.973752 3905 consensus_queue.cc:260] T 9d985eca3d6f497c86b94c53f16c8ae5 P 841018313ad649679de64e006582f4c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:36.975790 3905 ts_tablet_manager.cc:1428] T 9d985eca3d6f497c86b94c53f16c8ae5 P 841018313ad649679de64e006582f4c5: Time spent starting tablet: real 0.011s user 0.003s sys 0.000s
I20250625 03:31:36.979275 3910 tablet_bootstrap.cc:492] T a6b45bf21adf457d9a920f57d758ba15 P ddc0ad67020f45edb3ba9c83cab687a4: No bootstrap required, opened a new log
I20250625 03:31:36.980072 3910 ts_tablet_manager.cc:1397] T a6b45bf21adf457d9a920f57d758ba15 P ddc0ad67020f45edb3ba9c83cab687a4: Time spent bootstrapping tablet: real 0.051s user 0.011s sys 0.000s
I20250625 03:31:36.980363 3538 catalog_manager.cc:5582] T 5e59ae16ec1a4c69aac820531e504206 P ddc0ad67020f45edb3ba9c83cab687a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132). New cstate: current_term: 1 leader_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: HEALTHY } } }
I20250625 03:31:36.982424 4079 raft_consensus.cc:491] T d00ad2472fd74bfc9065d9dc4808e0c1 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:36.982998 4079 raft_consensus.cc:513] T d00ad2472fd74bfc9065d9dc4808e0c1 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:36.984163 3906 ts_tablet_manager.cc:1428] T 1e9c146f8cd743f7ac35dc61d9226d1d P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.032s user 0.007s sys 0.000s
I20250625 03:31:36.985370 4079 leader_election.cc:290] T d00ad2472fd74bfc9065d9dc4808e0c1 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:31:36.985563 3906 tablet_bootstrap.cc:492] T 002d4371d5414440b756829fe3343d07 P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:36.987826 3639 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d00ad2472fd74bfc9065d9dc4808e0c1" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:36.987910 3713 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d00ad2472fd74bfc9065d9dc4808e0c1" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" is_pre_election: true
W20250625 03:31:36.989729 3754 leader_election.cc:343] T d00ad2472fd74bfc9065d9dc4808e0c1 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041): Illegal state: must be running to vote when last-logged opid is not known
W20250625 03:31:36.990427 3754 leader_election.cc:343] T d00ad2472fd74bfc9065d9dc4808e0c1 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:36.990839 3754 leader_election.cc:304] T d00ad2472fd74bfc9065d9dc4808e0c1 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841018313ad649679de64e006582f4c5; no voters: 01873d289e0b4f9f9184b251369502a9, 3d5b9823dfcd41cb92bd195c811cbf39
I20250625 03:31:36.993145 3905 tablet_bootstrap.cc:492] T 5e59ae16ec1a4c69aac820531e504206 P 841018313ad649679de64e006582f4c5: Bootstrap starting.
I20250625 03:31:36.993613 4079 raft_consensus.cc:2747] T d00ad2472fd74bfc9065d9dc4808e0c1 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:31:36.995905 3909 tablet_bootstrap.cc:492] T 9d985eca3d6f497c86b94c53f16c8ae5 P 3d5b9823dfcd41cb92bd195c811cbf39: No bootstrap required, opened a new log
I20250625 03:31:36.996488 3909 ts_tablet_manager.cc:1397] T 9d985eca3d6f497c86b94c53f16c8ae5 P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent bootstrapping tablet: real 0.043s user 0.019s sys 0.023s
I20250625 03:31:36.997599 3906 tablet_bootstrap.cc:654] T 002d4371d5414440b756829fe3343d07 P 01873d289e0b4f9f9184b251369502a9: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:36.999157 3909 raft_consensus.cc:357] T 9d985eca3d6f497c86b94c53f16c8ae5 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:36.999955 3909 raft_consensus.cc:383] T 9d985eca3d6f497c86b94c53f16c8ae5 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:37.000362 3909 raft_consensus.cc:738] T 9d985eca3d6f497c86b94c53f16c8ae5 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Initialized, Role: FOLLOWER
I20250625 03:31:36.983350 3910 raft_consensus.cc:357] T a6b45bf21adf457d9a920f57d758ba15 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:37.001053 3910 raft_consensus.cc:383] T a6b45bf21adf457d9a920f57d758ba15 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:37.001332 3910 raft_consensus.cc:738] T a6b45bf21adf457d9a920f57d758ba15 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Initialized, Role: FOLLOWER
I20250625 03:31:37.002043 3905 tablet_bootstrap.cc:654] T 5e59ae16ec1a4c69aac820531e504206 P 841018313ad649679de64e006582f4c5: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:37.002167 3910 consensus_queue.cc:260] T a6b45bf21adf457d9a920f57d758ba15 P ddc0ad67020f45edb3ba9c83cab687a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:37.004603 3910 ts_tablet_manager.cc:1428] T a6b45bf21adf457d9a920f57d758ba15 P ddc0ad67020f45edb3ba9c83cab687a4: Time spent starting tablet: real 0.024s user 0.007s sys 0.000s
I20250625 03:31:37.005623 3910 tablet_bootstrap.cc:492] T 5ece5f5b2a904c9cbef3065e210e9a30 P ddc0ad67020f45edb3ba9c83cab687a4: Bootstrap starting.
I20250625 03:31:37.007591 3906 tablet_bootstrap.cc:492] T 002d4371d5414440b756829fe3343d07 P 01873d289e0b4f9f9184b251369502a9: No bootstrap required, opened a new log
I20250625 03:31:37.008258 3906 ts_tablet_manager.cc:1397] T 002d4371d5414440b756829fe3343d07 P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.023s user 0.013s sys 0.000s
I20250625 03:31:37.010798 3906 raft_consensus.cc:357] T 002d4371d5414440b756829fe3343d07 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:37.001320 3909 consensus_queue.cc:260] T 9d985eca3d6f497c86b94c53f16c8ae5 P 3d5b9823dfcd41cb92bd195c811cbf39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:37.011448 3906 raft_consensus.cc:383] T 002d4371d5414440b756829fe3343d07 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:37.011793 3983 raft_consensus.cc:491] T 9d985eca3d6f497c86b94c53f16c8ae5 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:37.012316 3983 raft_consensus.cc:513] T 9d985eca3d6f497c86b94c53f16c8ae5 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:37.014941 3983 leader_election.cc:290] T 9d985eca3d6f497c86b94c53f16c8ae5 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 841018313ad649679de64e006582f4c5 (127.0.106.131:39467)
I20250625 03:31:37.011741 3906 raft_consensus.cc:738] T 002d4371d5414440b756829fe3343d07 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:37.016659 3639 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9d985eca3d6f497c86b94c53f16c8ae5" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
W20250625 03:31:37.019007 3680 leader_election.cc:343] T 9d985eca3d6f497c86b94c53f16c8ae5 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:37.017253 3786 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9d985eca3d6f497c86b94c53f16c8ae5" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:31:37.019507 3909 ts_tablet_manager.cc:1428] T 9d985eca3d6f497c86b94c53f16c8ae5 P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent starting tablet: real 0.023s user 0.006s sys 0.000s
I20250625 03:31:37.019837 3786 raft_consensus.cc:2466] T 9d985eca3d6f497c86b94c53f16c8ae5 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5b9823dfcd41cb92bd195c811cbf39 in term 0.
I20250625 03:31:37.020727 3909 tablet_bootstrap.cc:492] T a6b45bf21adf457d9a920f57d758ba15 P 3d5b9823dfcd41cb92bd195c811cbf39: Bootstrap starting.
I20250625 03:31:37.021108 3680 leader_election.cc:304] T 9d985eca3d6f497c86b94c53f16c8ae5 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, 841018313ad649679de64e006582f4c5; no voters: 01873d289e0b4f9f9184b251369502a9
I20250625 03:31:37.021914 3983 raft_consensus.cc:2802] T 9d985eca3d6f497c86b94c53f16c8ae5 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:31:37.022296 3983 raft_consensus.cc:491] T 9d985eca3d6f497c86b94c53f16c8ae5 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:31:37.022640 3983 raft_consensus.cc:3058] T 9d985eca3d6f497c86b94c53f16c8ae5 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:37.024489 3906 consensus_queue.cc:260] T 002d4371d5414440b756829fe3343d07 P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:37.026865 3906 ts_tablet_manager.cc:1428] T 002d4371d5414440b756829fe3343d07 P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.018s user 0.006s sys 0.000s
I20250625 03:31:37.027889 3906 tablet_bootstrap.cc:492] T 526951ad467a4708926096ed1162a722 P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:37.022778 3910 tablet_bootstrap.cc:654] T 5ece5f5b2a904c9cbef3065e210e9a30 P ddc0ad67020f45edb3ba9c83cab687a4: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:37.032181 3983 raft_consensus.cc:513] T 9d985eca3d6f497c86b94c53f16c8ae5 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:37.033783 3906 tablet_bootstrap.cc:654] T 526951ad467a4708926096ed1162a722 P 01873d289e0b4f9f9184b251369502a9: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:37.033775 3909 tablet_bootstrap.cc:654] T a6b45bf21adf457d9a920f57d758ba15 P 3d5b9823dfcd41cb92bd195c811cbf39: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:37.037200 3639 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9d985eca3d6f497c86b94c53f16c8ae5" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9"
I20250625 03:31:37.038543 3905 tablet_bootstrap.cc:492] T 5e59ae16ec1a4c69aac820531e504206 P 841018313ad649679de64e006582f4c5: No bootstrap required, opened a new log
W20250625 03:31:37.038986 3680 leader_election.cc:343] T 9d985eca3d6f497c86b94c53f16c8ae5 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:37.039220 3905 ts_tablet_manager.cc:1397] T 5e59ae16ec1a4c69aac820531e504206 P 841018313ad649679de64e006582f4c5: Time spent bootstrapping tablet: real 0.046s user 0.007s sys 0.008s
I20250625 03:31:37.042837 3905 raft_consensus.cc:357] T 5e59ae16ec1a4c69aac820531e504206 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:37.047818 3909 tablet_bootstrap.cc:492] T a6b45bf21adf457d9a920f57d758ba15 P 3d5b9823dfcd41cb92bd195c811cbf39: No bootstrap required, opened a new log
I20250625 03:31:37.048780 3983 leader_election.cc:290] T 9d985eca3d6f497c86b94c53f16c8ae5 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 election: Requested vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 841018313ad649679de64e006582f4c5 (127.0.106.131:39467)
I20250625 03:31:37.043802 3905 raft_consensus.cc:383] T 5e59ae16ec1a4c69aac820531e504206 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:37.049892 3905 raft_consensus.cc:738] T 5e59ae16ec1a4c69aac820531e504206 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841018313ad649679de64e006582f4c5, State: Initialized, Role: FOLLOWER
I20250625 03:31:37.050510 3906 tablet_bootstrap.cc:492] T 526951ad467a4708926096ed1162a722 P 01873d289e0b4f9f9184b251369502a9: No bootstrap required, opened a new log
I20250625 03:31:37.051070 3906 ts_tablet_manager.cc:1397] T 526951ad467a4708926096ed1162a722 P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.023s user 0.011s sys 0.002s
I20250625 03:31:37.050905 3905 consensus_queue.cc:260] T 5e59ae16ec1a4c69aac820531e504206 P 841018313ad649679de64e006582f4c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:37.054472 3938 raft_consensus.cc:491] T 002d4371d5414440b756829fe3343d07 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:37.055150 3938 raft_consensus.cc:513] T 002d4371d5414440b756829fe3343d07 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:37.056325 3786 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9d985eca3d6f497c86b94c53f16c8ae5" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5"
I20250625 03:31:37.056967 3786 raft_consensus.cc:3058] T 9d985eca3d6f497c86b94c53f16c8ae5 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:37.057147 3938 leader_election.cc:290] T 002d4371d5414440b756829fe3343d07 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041), 841018313ad649679de64e006582f4c5 (127.0.106.131:39467)
I20250625 03:31:37.059458 3905 ts_tablet_manager.cc:1428] T 5e59ae16ec1a4c69aac820531e504206 P 841018313ad649679de64e006582f4c5: Time spent starting tablet: real 0.020s user 0.007s sys 0.003s
I20250625 03:31:37.060946 3905 tablet_bootstrap.cc:492] T 007d68495d594a73a5e2748f51e7c44c P 841018313ad649679de64e006582f4c5: Bootstrap starting.
I20250625 03:31:37.064844 3788 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "002d4371d5414440b756829fe3343d07" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:31:37.065667 3788 raft_consensus.cc:2391] T 002d4371d5414440b756829fe3343d07 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01873d289e0b4f9f9184b251369502a9 in current term 1: Already voted for candidate 3d5b9823dfcd41cb92bd195c811cbf39 in this term.
I20250625 03:31:37.048836 3909 ts_tablet_manager.cc:1397] T a6b45bf21adf457d9a920f57d758ba15 P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent bootstrapping tablet: real 0.028s user 0.012s sys 0.000s
I20250625 03:31:37.060822 3713 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "002d4371d5414440b756829fe3343d07" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" is_pre_election: true
I20250625 03:31:37.069290 3905 tablet_bootstrap.cc:654] T 007d68495d594a73a5e2748f51e7c44c P 841018313ad649679de64e006582f4c5: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:37.070204 3605 leader_election.cc:304] T 002d4371d5414440b756829fe3343d07 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9; no voters: 3d5b9823dfcd41cb92bd195c811cbf39, 841018313ad649679de64e006582f4c5
I20250625 03:31:37.072196 3996 raft_consensus.cc:3058] T 002d4371d5414440b756829fe3343d07 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:37.065294 3906 raft_consensus.cc:357] T 526951ad467a4708926096ed1162a722 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:37.086067 3906 raft_consensus.cc:383] T 526951ad467a4708926096ed1162a722 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:37.088172 3906 raft_consensus.cc:738] T 526951ad467a4708926096ed1162a722 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:37.084081 3786 raft_consensus.cc:2466] T 9d985eca3d6f497c86b94c53f16c8ae5 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5b9823dfcd41cb92bd195c811cbf39 in term 1.
I20250625 03:31:37.089007 3906 consensus_queue.cc:260] T 526951ad467a4708926096ed1162a722 P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:37.068482 3909 raft_consensus.cc:357] T a6b45bf21adf457d9a920f57d758ba15 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:37.097158 3909 raft_consensus.cc:383] T a6b45bf21adf457d9a920f57d758ba15 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:37.097498 3909 raft_consensus.cc:738] T a6b45bf21adf457d9a920f57d758ba15 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Initialized, Role: FOLLOWER
I20250625 03:31:37.098241 3996 raft_consensus.cc:2747] T 002d4371d5414440b756829fe3343d07 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:31:37.100664 3909 consensus_queue.cc:260] T a6b45bf21adf457d9a920f57d758ba15 P 3d5b9823dfcd41cb92bd195c811cbf39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:37.105681 3951 consensus_queue.cc:1035] T 002d4371d5414440b756829fe3343d07 P 3d5b9823dfcd41cb92bd195c811cbf39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:31:37.107089 3906 ts_tablet_manager.cc:1428] T 526951ad467a4708926096ed1162a722 P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.056s user 0.005s sys 0.000s
I20250625 03:31:37.108099 3906 tablet_bootstrap.cc:492] T 007d68495d594a73a5e2748f51e7c44c P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:37.088331 3946 consensus_queue.cc:1035] T d08de4c2326d46bab26f42d8d483ebd0 P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20250625 03:31:37.115816 3975 raft_consensus.cc:491] T 3d5b503929b24663a1f868ffaec34157 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:37.116569 3975 raft_consensus.cc:513] T 3d5b503929b24663a1f868ffaec34157 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:37.118048 4079 raft_consensus.cc:491] T 5ece5f5b2a904c9cbef3065e210e9a30 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:37.118511 3906 tablet_bootstrap.cc:654] T 007d68495d594a73a5e2748f51e7c44c P 01873d289e0b4f9f9184b251369502a9: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:37.118575 4079 raft_consensus.cc:513] T 5ece5f5b2a904c9cbef3065e210e9a30 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:37.120361 3638 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3d5b503929b24663a1f868ffaec34157" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:37.120787 4079 leader_election.cc:290] T 5ece5f5b2a904c9cbef3065e210e9a30 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041), ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353)
I20250625 03:31:37.122217 3713 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5ece5f5b2a904c9cbef3065e210e9a30" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" is_pre_election: true
I20250625 03:31:37.122373 4079 raft_consensus.cc:491] T 39da7c80318f4c408f8cdaf2229b0c96 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:37.122915 3713 raft_consensus.cc:2466] T 5ece5f5b2a904c9cbef3065e210e9a30 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841018313ad649679de64e006582f4c5 in term 0.
I20250625 03:31:37.122951 4079 raft_consensus.cc:513] T 39da7c80318f4c408f8cdaf2229b0c96 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:37.123553 3680 leader_election.cc:304] T 9d985eca3d6f497c86b94c53f16c8ae5 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, 841018313ad649679de64e006582f4c5; no voters: 01873d289e0b4f9f9184b251369502a9
W20250625 03:31:37.122427 3828 leader_election.cc:343] T 3d5b503929b24663a1f868ffaec34157 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:37.124285 3754 leader_election.cc:304] T 5ece5f5b2a904c9cbef3065e210e9a30 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, 841018313ad649679de64e006582f4c5; no voters:
I20250625 03:31:37.124428 3862 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5ece5f5b2a904c9cbef3065e210e9a30" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:37.125409 3975 leader_election.cc:290] T 3d5b503929b24663a1f868ffaec34157 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:31:37.125697 4011 raft_consensus.cc:2802] T 5ece5f5b2a904c9cbef3065e210e9a30 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20250625 03:31:37.126253 3753 leader_election.cc:343] T 5ece5f5b2a904c9cbef3065e210e9a30 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:37.126420 3712 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3d5b503929b24663a1f868ffaec34157" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" is_pre_election: true
I20250625 03:31:37.127712 4079 leader_election.cc:290] T 39da7c80318f4c408f8cdaf2229b0c96 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:31:37.134776 3713 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "39da7c80318f4c408f8cdaf2229b0c96" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" is_pre_election: true
I20250625 03:31:37.137887 3905 tablet_bootstrap.cc:492] T 007d68495d594a73a5e2748f51e7c44c P 841018313ad649679de64e006582f4c5: No bootstrap required, opened a new log
I20250625 03:31:37.138530 3905 ts_tablet_manager.cc:1397] T 007d68495d594a73a5e2748f51e7c44c P 841018313ad649679de64e006582f4c5: Time spent bootstrapping tablet: real 0.078s user 0.021s sys 0.000s
I20250625 03:31:37.140522 3910 tablet_bootstrap.cc:492] T 5ece5f5b2a904c9cbef3065e210e9a30 P ddc0ad67020f45edb3ba9c83cab687a4: No bootstrap required, opened a new log
I20250625 03:31:37.140936 3910 ts_tablet_manager.cc:1397] T 5ece5f5b2a904c9cbef3065e210e9a30 P ddc0ad67020f45edb3ba9c83cab687a4: Time spent bootstrapping tablet: real 0.136s user 0.027s sys 0.042s
I20250625 03:31:37.141515 3909 ts_tablet_manager.cc:1428] T a6b45bf21adf457d9a920f57d758ba15 P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent starting tablet: real 0.075s user 0.006s sys 0.000s
I20250625 03:31:37.142266 3909 tablet_bootstrap.cc:492] T 03c46dae805341fdb9ec29725fa182a2 P 3d5b9823dfcd41cb92bd195c811cbf39: Bootstrap starting.
I20250625 03:31:37.133684 3951 raft_consensus.cc:2802] T 9d985eca3d6f497c86b94c53f16c8ae5 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:31:37.144770 3638 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "39da7c80318f4c408f8cdaf2229b0c96" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:37.135468 3713 raft_consensus.cc:2466] T 39da7c80318f4c408f8cdaf2229b0c96 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841018313ad649679de64e006582f4c5 in term 0.
I20250625 03:31:37.146178 3951 raft_consensus.cc:695] T 9d985eca3d6f497c86b94c53f16c8ae5 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 LEADER]: Becoming Leader. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Running, Role: LEADER
W20250625 03:31:37.146271 3754 leader_election.cc:343] T 39da7c80318f4c408f8cdaf2229b0c96 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:37.137632 3712 raft_consensus.cc:2466] T 3d5b503929b24663a1f868ffaec34157 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddc0ad67020f45edb3ba9c83cab687a4 in term 0.
I20250625 03:31:37.147116 3951 consensus_queue.cc:237] T 9d985eca3d6f497c86b94c53f16c8ae5 P 3d5b9823dfcd41cb92bd195c811cbf39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:37.148404 3828 leader_election.cc:304] T 3d5b503929b24663a1f868ffaec34157 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, ddc0ad67020f45edb3ba9c83cab687a4; no voters: 01873d289e0b4f9f9184b251369502a9
I20250625 03:31:37.149837 3975 raft_consensus.cc:2802] T 3d5b503929b24663a1f868ffaec34157 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:31:37.150310 3975 raft_consensus.cc:491] T 3d5b503929b24663a1f868ffaec34157 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:31:37.129789 4011 raft_consensus.cc:491] T 5ece5f5b2a904c9cbef3065e210e9a30 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:31:37.150723 3975 raft_consensus.cc:3058] T 3d5b503929b24663a1f868ffaec34157 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:37.153972 3754 leader_election.cc:304] T 39da7c80318f4c408f8cdaf2229b0c96 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, 841018313ad649679de64e006582f4c5; no voters: 01873d289e0b4f9f9184b251369502a9
I20250625 03:31:37.157066 3909 tablet_bootstrap.cc:654] T 03c46dae805341fdb9ec29725fa182a2 P 3d5b9823dfcd41cb92bd195c811cbf39: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:37.150840 4011 raft_consensus.cc:3058] T 5ece5f5b2a904c9cbef3065e210e9a30 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:37.167520 4008 raft_consensus.cc:2802] T 39da7c80318f4c408f8cdaf2229b0c96 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:31:37.168171 4008 raft_consensus.cc:491] T 39da7c80318f4c408f8cdaf2229b0c96 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:31:37.168627 4008 raft_consensus.cc:3058] T 39da7c80318f4c408f8cdaf2229b0c96 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:37.163864 3905 raft_consensus.cc:357] T 007d68495d594a73a5e2748f51e7c44c P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:37.178333 3905 raft_consensus.cc:383] T 007d68495d594a73a5e2748f51e7c44c P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:37.178640 3905 raft_consensus.cc:738] T 007d68495d594a73a5e2748f51e7c44c P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841018313ad649679de64e006582f4c5, State: Initialized, Role: FOLLOWER
I20250625 03:31:37.179385 4079 raft_consensus.cc:491] T 5e59ae16ec1a4c69aac820531e504206 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:37.179538 4096 raft_consensus.cc:491] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:37.180157 4079 raft_consensus.cc:513] T 5e59ae16ec1a4c69aac820531e504206 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:37.180203 4096 raft_consensus.cc:513] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:37.182644 4096 leader_election.cc:290] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353)
I20250625 03:31:37.183254 4079 leader_election.cc:290] T 5e59ae16ec1a4c69aac820531e504206 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041), ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353)
I20250625 03:31:37.179283 3905 consensus_queue.cc:260] T 007d68495d594a73a5e2748f51e7c44c P 841018313ad649679de64e006582f4c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:37.184415 3862 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2c4bb2d21b5242d387f6bc6ada60b4d5" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
W20250625 03:31:37.186148 3604 leader_election.cc:343] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:37.186386 3905 ts_tablet_manager.cc:1428] T 007d68495d594a73a5e2748f51e7c44c P 841018313ad649679de64e006582f4c5: Time spent starting tablet: real 0.047s user 0.005s sys 0.000s
I20250625 03:31:37.187084 3712 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5e59ae16ec1a4c69aac820531e504206" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" is_pre_election: true
I20250625 03:31:37.188270 3712 raft_consensus.cc:2391] T 5e59ae16ec1a4c69aac820531e504206 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841018313ad649679de64e006582f4c5 in current term 1: Already voted for candidate ddc0ad67020f45edb3ba9c83cab687a4 in this term.
I20250625 03:31:37.188709 3905 tablet_bootstrap.cc:492] T e7d3871088394a3ba7a6d18baae1feba P 841018313ad649679de64e006582f4c5: Bootstrap starting.
I20250625 03:31:37.189611 3910 raft_consensus.cc:357] T 5ece5f5b2a904c9cbef3065e210e9a30 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:37.189961 3862 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5e59ae16ec1a4c69aac820531e504206" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:37.190286 3910 raft_consensus.cc:383] T 5ece5f5b2a904c9cbef3065e210e9a30 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:37.190575 3910 raft_consensus.cc:738] T 5ece5f5b2a904c9cbef3065e210e9a30 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Initialized, Role: FOLLOWER
I20250625 03:31:37.192095 3753 leader_election.cc:304] T 5e59ae16ec1a4c69aac820531e504206 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841018313ad649679de64e006582f4c5; no voters: 3d5b9823dfcd41cb92bd195c811cbf39, ddc0ad67020f45edb3ba9c83cab687a4
I20250625 03:31:37.193557 4079 raft_consensus.cc:3058] T 5e59ae16ec1a4c69aac820531e504206 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:37.192171 3788 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2c4bb2d21b5242d387f6bc6ada60b4d5" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:31:37.196398 3788 raft_consensus.cc:2466] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01873d289e0b4f9f9184b251369502a9 in term 0.
I20250625 03:31:37.199503 3914 raft_consensus.cc:491] T a6b45bf21adf457d9a920f57d758ba15 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:37.200083 3914 raft_consensus.cc:513] T a6b45bf21adf457d9a920f57d758ba15 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:37.202378 3905 tablet_bootstrap.cc:654] T e7d3871088394a3ba7a6d18baae1feba P 841018313ad649679de64e006582f4c5: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:37.191409 3910 consensus_queue.cc:260] T 5ece5f5b2a904c9cbef3065e210e9a30 P ddc0ad67020f45edb3ba9c83cab687a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:37.204805 3605 leader_election.cc:304] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9, 841018313ad649679de64e006582f4c5; no voters: ddc0ad67020f45edb3ba9c83cab687a4
I20250625 03:31:37.206084 4096 raft_consensus.cc:2802] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:31:37.206434 4096 raft_consensus.cc:491] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:31:37.206772 4096 raft_consensus.cc:3058] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:37.207420 3862 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a6b45bf21adf457d9a920f57d758ba15" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:37.208093 3862 raft_consensus.cc:2466] T a6b45bf21adf457d9a920f57d758ba15 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5b9823dfcd41cb92bd195c811cbf39 in term 0.
I20250625 03:31:37.209622 3679 leader_election.cc:304] T a6b45bf21adf457d9a920f57d758ba15 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, ddc0ad67020f45edb3ba9c83cab687a4; no voters:
I20250625 03:31:37.210565 3962 raft_consensus.cc:2802] T a6b45bf21adf457d9a920f57d758ba15 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:31:37.210942 3962 raft_consensus.cc:491] T a6b45bf21adf457d9a920f57d758ba15 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:31:37.211288 3962 raft_consensus.cc:3058] T a6b45bf21adf457d9a920f57d758ba15 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:37.217509 3910 ts_tablet_manager.cc:1428] T 5ece5f5b2a904c9cbef3065e210e9a30 P ddc0ad67020f45edb3ba9c83cab687a4: Time spent starting tablet: real 0.076s user 0.005s sys 0.002s
I20250625 03:31:37.226568 3910 tablet_bootstrap.cc:492] T 007d68495d594a73a5e2748f51e7c44c P ddc0ad67020f45edb3ba9c83cab687a4: Bootstrap starting.
I20250625 03:31:37.231832 3938 consensus_queue.cc:1035] T d08de4c2326d46bab26f42d8d483ebd0 P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:31:37.232939 3910 tablet_bootstrap.cc:654] T 007d68495d594a73a5e2748f51e7c44c P ddc0ad67020f45edb3ba9c83cab687a4: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:37.233187 3786 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a6b45bf21adf457d9a920f57d758ba15" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:31:37.202766 3914 leader_election.cc:290] T a6b45bf21adf457d9a920f57d758ba15 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353)
I20250625 03:31:37.236308 4079 raft_consensus.cc:2747] T 5e59ae16ec1a4c69aac820531e504206 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:31:37.239770 3951 consensus_queue.cc:1035] T 002d4371d5414440b756829fe3343d07 P 3d5b9823dfcd41cb92bd195c811cbf39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250625 03:31:37.239950 3680 leader_election.cc:343] T a6b45bf21adf457d9a920f57d758ba15 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841018313ad649679de64e006582f4c5 (127.0.106.131:39467): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:37.245695 3975 raft_consensus.cc:513] T 3d5b503929b24663a1f868ffaec34157 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:37.246433 3909 tablet_bootstrap.cc:492] T 03c46dae805341fdb9ec29725fa182a2 P 3d5b9823dfcd41cb92bd195c811cbf39: No bootstrap required, opened a new log
I20250625 03:31:37.246958 3909 ts_tablet_manager.cc:1397] T 03c46dae805341fdb9ec29725fa182a2 P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent bootstrapping tablet: real 0.105s user 0.014s sys 0.003s
I20250625 03:31:37.251506 3975 leader_election.cc:290] T 3d5b503929b24663a1f868ffaec34157 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 election: Requested vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:31:37.251902 3909 raft_consensus.cc:357] T 03c46dae805341fdb9ec29725fa182a2 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:37.252584 3638 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3d5b503929b24663a1f868ffaec34157" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9"
I20250625 03:31:37.253008 3713 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3d5b503929b24663a1f868ffaec34157" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
I20250625 03:31:37.253567 3713 raft_consensus.cc:3058] T 3d5b503929b24663a1f868ffaec34157 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:37.253832 3909 raft_consensus.cc:383] T 03c46dae805341fdb9ec29725fa182a2 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:37.254263 3909 raft_consensus.cc:738] T 03c46dae805341fdb9ec29725fa182a2 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Initialized, Role: FOLLOWER
W20250625 03:31:37.254369 3828 leader_election.cc:343] T 3d5b503929b24663a1f868ffaec34157 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:37.255285 3909 consensus_queue.cc:260] T 03c46dae805341fdb9ec29725fa182a2 P 3d5b9823dfcd41cb92bd195c811cbf39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:37.258011 3906 tablet_bootstrap.cc:492] T 007d68495d594a73a5e2748f51e7c44c P 01873d289e0b4f9f9184b251369502a9: No bootstrap required, opened a new log
I20250625 03:31:37.258527 3906 ts_tablet_manager.cc:1397] T 007d68495d594a73a5e2748f51e7c44c P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.151s user 0.014s sys 0.005s
I20250625 03:31:37.260998 3909 ts_tablet_manager.cc:1428] T 03c46dae805341fdb9ec29725fa182a2 P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent starting tablet: real 0.014s user 0.009s sys 0.000s
I20250625 03:31:37.261251 3713 raft_consensus.cc:2466] T 3d5b503929b24663a1f868ffaec34157 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddc0ad67020f45edb3ba9c83cab687a4 in term 1.
I20250625 03:31:37.261897 3906 raft_consensus.cc:357] T 007d68495d594a73a5e2748f51e7c44c P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:37.262703 3906 raft_consensus.cc:383] T 007d68495d594a73a5e2748f51e7c44c P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:37.262497 3828 leader_election.cc:304] T 3d5b503929b24663a1f868ffaec34157 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, ddc0ad67020f45edb3ba9c83cab687a4; no voters: 01873d289e0b4f9f9184b251369502a9
I20250625 03:31:37.263144 3906 raft_consensus.cc:738] T 007d68495d594a73a5e2748f51e7c44c P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:37.264490 3906 consensus_queue.cc:260] T 007d68495d594a73a5e2748f51e7c44c P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:37.262403 3909 tablet_bootstrap.cc:492] T e638ce3a86d242fcadb10cdf57f5960d P 3d5b9823dfcd41cb92bd195c811cbf39: Bootstrap starting.
I20250625 03:31:37.266887 3906 ts_tablet_manager.cc:1428] T 007d68495d594a73a5e2748f51e7c44c P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20250625 03:31:37.267388 3975 raft_consensus.cc:2802] T 3d5b503929b24663a1f868ffaec34157 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:31:37.268746 3906 tablet_bootstrap.cc:492] T e638ce3a86d242fcadb10cdf57f5960d P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:37.270030 4096 raft_consensus.cc:513] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:37.273816 4008 raft_consensus.cc:513] T 39da7c80318f4c408f8cdaf2229b0c96 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:37.274576 3909 tablet_bootstrap.cc:654] T e638ce3a86d242fcadb10cdf57f5960d P 3d5b9823dfcd41cb92bd195c811cbf39: Neither blocks nor log segments found. Creating new log.
W20250625 03:31:37.275352 3753 consensus_peers.cc:487] T eeca5a85dddf4d1884917690e01ff81d P 841018313ad649679de64e006582f4c5 -> Peer ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353): Couldn't send request to peer ddc0ad67020f45edb3ba9c83cab687a4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:37.276719 3638 raft_consensus.cc:3058] T 1e9c146f8cd743f7ac35dc61d9226d1d P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:37.299067 3975 raft_consensus.cc:695] T 3d5b503929b24663a1f868ffaec34157 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 LEADER]: Becoming Leader. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Running, Role: LEADER
I20250625 03:31:37.310685 3975 consensus_queue.cc:237] T 3d5b503929b24663a1f868ffaec34157 P ddc0ad67020f45edb3ba9c83cab687a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:37.311579 4008 leader_election.cc:290] T 39da7c80318f4c408f8cdaf2229b0c96 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 election: Requested vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:31:37.304348 3962 raft_consensus.cc:513] T a6b45bf21adf457d9a920f57d758ba15 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:37.313150 3713 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "39da7c80318f4c408f8cdaf2229b0c96" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
I20250625 03:31:37.313771 3713 raft_consensus.cc:3058] T 39da7c80318f4c408f8cdaf2229b0c96 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:37.316437 3639 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "39da7c80318f4c408f8cdaf2229b0c96" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9"
W20250625 03:31:37.317950 3754 leader_election.cc:343] T 39da7c80318f4c408f8cdaf2229b0c96 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:37.324971 3962 leader_election.cc:290] T a6b45bf21adf457d9a920f57d758ba15 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 election: Requested vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353)
I20250625 03:31:37.325680 3536 catalog_manager.cc:5582] T 9d985eca3d6f497c86b94c53f16c8ae5 P 3d5b9823dfcd41cb92bd195c811cbf39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:37.328361 3788 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a6b45bf21adf457d9a920f57d758ba15" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5"
I20250625 03:31:37.330351 3906 tablet_bootstrap.cc:654] T e638ce3a86d242fcadb10cdf57f5960d P 01873d289e0b4f9f9184b251369502a9: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:37.331581 3862 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a6b45bf21adf457d9a920f57d758ba15" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4"
I20250625 03:31:37.337466 3910 tablet_bootstrap.cc:492] T 007d68495d594a73a5e2748f51e7c44c P ddc0ad67020f45edb3ba9c83cab687a4: No bootstrap required, opened a new log
W20250625 03:31:37.337719 3680 leader_election.cc:343] T a6b45bf21adf457d9a920f57d758ba15 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 841018313ad649679de64e006582f4c5 (127.0.106.131:39467): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:37.338055 3910 ts_tablet_manager.cc:1397] T 007d68495d594a73a5e2748f51e7c44c P ddc0ad67020f45edb3ba9c83cab687a4: Time spent bootstrapping tablet: real 0.112s user 0.015s sys 0.004s
I20250625 03:31:37.339434 3788 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2c4bb2d21b5242d387f6bc6ada60b4d5" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5"
I20250625 03:31:37.340067 3788 raft_consensus.cc:3058] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:37.340642 3910 raft_consensus.cc:357] T 007d68495d594a73a5e2748f51e7c44c P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:37.341341 3910 raft_consensus.cc:383] T 007d68495d594a73a5e2748f51e7c44c P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:37.341593 3910 raft_consensus.cc:738] T 007d68495d594a73a5e2748f51e7c44c P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Initialized, Role: FOLLOWER
I20250625 03:31:37.342223 3910 consensus_queue.cc:260] T 007d68495d594a73a5e2748f51e7c44c P ddc0ad67020f45edb3ba9c83cab687a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:37.343128 3862 raft_consensus.cc:3058] T a6b45bf21adf457d9a920f57d758ba15 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:37.276000 4011 raft_consensus.cc:513] T 5ece5f5b2a904c9cbef3065e210e9a30 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:37.349362 3905 tablet_bootstrap.cc:492] T e7d3871088394a3ba7a6d18baae1feba P 841018313ad649679de64e006582f4c5: No bootstrap required, opened a new log
I20250625 03:31:37.351348 3905 ts_tablet_manager.cc:1397] T e7d3871088394a3ba7a6d18baae1feba P 841018313ad649679de64e006582f4c5: Time spent bootstrapping tablet: real 0.163s user 0.024s sys 0.001s
I20250625 03:31:37.349871 3910 ts_tablet_manager.cc:1428] T 007d68495d594a73a5e2748f51e7c44c P ddc0ad67020f45edb3ba9c83cab687a4: Time spent starting tablet: real 0.011s user 0.007s sys 0.000s
I20250625 03:31:37.354964 3910 tablet_bootstrap.cc:492] T 526951ad467a4708926096ed1162a722 P ddc0ad67020f45edb3ba9c83cab687a4: Bootstrap starting.
I20250625 03:31:37.362406 3905 raft_consensus.cc:357] T e7d3871088394a3ba7a6d18baae1feba P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:37.363468 3905 raft_consensus.cc:383] T e7d3871088394a3ba7a6d18baae1feba P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:37.364140 3905 raft_consensus.cc:738] T e7d3871088394a3ba7a6d18baae1feba P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841018313ad649679de64e006582f4c5, State: Initialized, Role: FOLLOWER
I20250625 03:31:37.366075 3932 raft_consensus.cc:491] T 5ece5f5b2a904c9cbef3065e210e9a30 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:37.366612 3932 raft_consensus.cc:513] T 5ece5f5b2a904c9cbef3065e210e9a30 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:37.369002 3905 consensus_queue.cc:260] T e7d3871088394a3ba7a6d18baae1feba P 841018313ad649679de64e006582f4c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:37.376714 3788 raft_consensus.cc:2466] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01873d289e0b4f9f9184b251369502a9 in term 1.
I20250625 03:31:37.382488 3605 leader_election.cc:304] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9, 841018313ad649679de64e006582f4c5; no voters:
I20250625 03:31:37.383263 3905 ts_tablet_manager.cc:1428] T e7d3871088394a3ba7a6d18baae1feba P 841018313ad649679de64e006582f4c5: Time spent starting tablet: real 0.032s user 0.008s sys 0.000s
I20250625 03:31:37.386564 3950 raft_consensus.cc:2802] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:31:37.386706 3861 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2c4bb2d21b5242d387f6bc6ada60b4d5" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4"
I20250625 03:31:37.387181 3950 raft_consensus.cc:695] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 01873d289e0b4f9f9184b251369502a9 [term 1 LEADER]: Becoming Leader. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Running, Role: LEADER
I20250625 03:31:37.388111 3950 consensus_queue.cc:237] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
W20250625 03:31:37.389593 3604 leader_election.cc:343] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:37.396514 3910 tablet_bootstrap.cc:654] T 526951ad467a4708926096ed1162a722 P ddc0ad67020f45edb3ba9c83cab687a4: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:37.384171 4096 leader_election.cc:290] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 election: Requested vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353)
I20250625 03:31:37.383383 4013 consensus_queue.cc:1035] T eeca5a85dddf4d1884917690e01ff81d P 841018313ad649679de64e006582f4c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20250625 03:31:37.403221 3714 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5ece5f5b2a904c9cbef3065e210e9a30" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" is_pre_election: true
I20250625 03:31:37.403944 3714 raft_consensus.cc:2466] T 5ece5f5b2a904c9cbef3065e210e9a30 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddc0ad67020f45edb3ba9c83cab687a4 in term 0.
I20250625 03:31:37.406849 3996 raft_consensus.cc:491] T 007d68495d594a73a5e2748f51e7c44c P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:37.407407 3996 raft_consensus.cc:513] T 007d68495d594a73a5e2748f51e7c44c P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:37.409564 3996 leader_election.cc:290] T 007d68495d594a73a5e2748f51e7c44c P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353)
I20250625 03:31:37.409648 3788 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5ece5f5b2a904c9cbef3065e210e9a30" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:31:37.410789 3788 raft_consensus.cc:2391] T 5ece5f5b2a904c9cbef3065e210e9a30 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddc0ad67020f45edb3ba9c83cab687a4 in current term 1: Already voted for candidate 841018313ad649679de64e006582f4c5 in this term.
I20250625 03:31:37.394835 3932 leader_election.cc:290] T 5ece5f5b2a904c9cbef3065e210e9a30 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041), 841018313ad649679de64e006582f4c5 (127.0.106.131:39467)
I20250625 03:31:37.416601 3786 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "007d68495d594a73a5e2748f51e7c44c" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:31:37.418084 3909 tablet_bootstrap.cc:492] T e638ce3a86d242fcadb10cdf57f5960d P 3d5b9823dfcd41cb92bd195c811cbf39: No bootstrap required, opened a new log
I20250625 03:31:37.418236 3786 raft_consensus.cc:2466] T 007d68495d594a73a5e2748f51e7c44c P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01873d289e0b4f9f9184b251369502a9 in term 0.
I20250625 03:31:37.418599 3909 ts_tablet_manager.cc:1397] T e638ce3a86d242fcadb10cdf57f5960d P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent bootstrapping tablet: real 0.156s user 0.007s sys 0.013s
I20250625 03:31:37.419328 3605 leader_election.cc:304] T 007d68495d594a73a5e2748f51e7c44c P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9, 841018313ad649679de64e006582f4c5; no voters:
I20250625 03:31:37.420333 3996 raft_consensus.cc:2802] T 007d68495d594a73a5e2748f51e7c44c P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:31:37.420715 3996 raft_consensus.cc:491] T 007d68495d594a73a5e2748f51e7c44c P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:31:37.421080 3996 raft_consensus.cc:3058] T 007d68495d594a73a5e2748f51e7c44c P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:37.422350 3861 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "007d68495d594a73a5e2748f51e7c44c" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:37.423067 3861 raft_consensus.cc:2466] T 007d68495d594a73a5e2748f51e7c44c P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01873d289e0b4f9f9184b251369502a9 in term 0.
I20250625 03:31:37.424342 3828 leader_election.cc:304] T 5ece5f5b2a904c9cbef3065e210e9a30 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, ddc0ad67020f45edb3ba9c83cab687a4; no voters:
I20250625 03:31:37.429138 3909 raft_consensus.cc:357] T e638ce3a86d242fcadb10cdf57f5960d P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:37.429908 3909 raft_consensus.cc:383] T e638ce3a86d242fcadb10cdf57f5960d P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:37.430177 3909 raft_consensus.cc:738] T e638ce3a86d242fcadb10cdf57f5960d P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Initialized, Role: FOLLOWER
I20250625 03:31:37.430853 3909 consensus_queue.cc:260] T e638ce3a86d242fcadb10cdf57f5960d P 3d5b9823dfcd41cb92bd195c811cbf39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:37.440372 3983 raft_consensus.cc:491] T caea215a97a344e88348ecb21035902d P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:37.448364 3983 raft_consensus.cc:513] T caea215a97a344e88348ecb21035902d P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:37.449532 3712 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5ece5f5b2a904c9cbef3065e210e9a30" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
I20250625 03:31:37.450198 3712 raft_consensus.cc:3058] T 5ece5f5b2a904c9cbef3065e210e9a30 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:37.450527 3983 leader_election.cc:290] T caea215a97a344e88348ecb21035902d P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353)
I20250625 03:31:37.453603 3906 tablet_bootstrap.cc:492] T e638ce3a86d242fcadb10cdf57f5960d P 01873d289e0b4f9f9184b251369502a9: No bootstrap required, opened a new log
I20250625 03:31:37.453428 3788 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "caea215a97a344e88348ecb21035902d" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:31:37.454164 3906 ts_tablet_manager.cc:1397] T e638ce3a86d242fcadb10cdf57f5960d P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.186s user 0.018s sys 0.006s
W20250625 03:31:37.455399 3680 leader_election.cc:343] T caea215a97a344e88348ecb21035902d P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841018313ad649679de64e006582f4c5 (127.0.106.131:39467): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:37.440604 3932 raft_consensus.cc:2802] T 5ece5f5b2a904c9cbef3065e210e9a30 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:31:37.456130 3932 raft_consensus.cc:491] T 5ece5f5b2a904c9cbef3065e210e9a30 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:31:37.456637 3932 raft_consensus.cc:3058] T 5ece5f5b2a904c9cbef3065e210e9a30 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:37.457489 3861 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "caea215a97a344e88348ecb21035902d" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
W20250625 03:31:37.459106 3679 leader_election.cc:343] T caea215a97a344e88348ecb21035902d P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:37.459578 3679 leader_election.cc:304] T caea215a97a344e88348ecb21035902d P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39; no voters: 841018313ad649679de64e006582f4c5, ddc0ad67020f45edb3ba9c83cab687a4
I20250625 03:31:37.461151 3962 raft_consensus.cc:2747] T caea215a97a344e88348ecb21035902d P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:31:37.464287 3906 raft_consensus.cc:357] T e638ce3a86d242fcadb10cdf57f5960d P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:37.464906 3906 raft_consensus.cc:383] T e638ce3a86d242fcadb10cdf57f5960d P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:37.465124 3906 raft_consensus.cc:738] T e638ce3a86d242fcadb10cdf57f5960d P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:37.465602 3906 consensus_queue.cc:260] T e638ce3a86d242fcadb10cdf57f5960d P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:37.468153 3861 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5ece5f5b2a904c9cbef3065e210e9a30" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4"
I20250625 03:31:37.471789 3909 ts_tablet_manager.cc:1428] T e638ce3a86d242fcadb10cdf57f5960d P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent starting tablet: real 0.053s user 0.005s sys 0.003s
I20250625 03:31:37.472918 3909 tablet_bootstrap.cc:492] T 4b38a4199d1d44988233b6d8604d1a96 P 3d5b9823dfcd41cb92bd195c811cbf39: Bootstrap starting.
I20250625 03:31:37.469373 3712 raft_consensus.cc:2466] T 5ece5f5b2a904c9cbef3065e210e9a30 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841018313ad649679de64e006582f4c5 in term 1.
I20250625 03:31:37.476464 3906 ts_tablet_manager.cc:1428] T e638ce3a86d242fcadb10cdf57f5960d P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.022s user 0.007s sys 0.001s
I20250625 03:31:37.469681 4011 leader_election.cc:290] T 5ece5f5b2a904c9cbef3065e210e9a30 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 election: Requested vote from peers 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041), ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353)
I20250625 03:31:37.476665 3905 tablet_bootstrap.cc:492] T a6b45bf21adf457d9a920f57d758ba15 P 841018313ad649679de64e006582f4c5: Bootstrap starting.
I20250625 03:31:37.482052 3906 tablet_bootstrap.cc:492] T d00ad2472fd74bfc9065d9dc4808e0c1 P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
W20250625 03:31:37.471571 3605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.130:42041, user_credentials={real_user=slave}} blocked reactor thread for 43673.6us
I20250625 03:31:37.486776 3754 leader_election.cc:304] T 5ece5f5b2a904c9cbef3065e210e9a30 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, 841018313ad649679de64e006582f4c5; no voters:
I20250625 03:31:37.489349 4011 raft_consensus.cc:2802] T 5ece5f5b2a904c9cbef3065e210e9a30 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:31:37.490082 4011 raft_consensus.cc:695] T 5ece5f5b2a904c9cbef3065e210e9a30 P 841018313ad649679de64e006582f4c5 [term 1 LEADER]: Becoming Leader. State: Replica: 841018313ad649679de64e006582f4c5, State: Running, Role: LEADER
I20250625 03:31:37.494705 3713 raft_consensus.cc:2466] T 39da7c80318f4c408f8cdaf2229b0c96 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841018313ad649679de64e006582f4c5 in term 1.
I20250625 03:31:37.490942 4011 consensus_queue.cc:237] T 5ece5f5b2a904c9cbef3065e210e9a30 P 841018313ad649679de64e006582f4c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:37.496326 3914 raft_consensus.cc:491] T e638ce3a86d242fcadb10cdf57f5960d P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:37.496914 3914 raft_consensus.cc:513] T e638ce3a86d242fcadb10cdf57f5960d P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:37.481206 3996 raft_consensus.cc:513] T 007d68495d594a73a5e2748f51e7c44c P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:37.496356 3754 leader_election.cc:304] T 39da7c80318f4c408f8cdaf2229b0c96 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, 841018313ad649679de64e006582f4c5; no voters: 01873d289e0b4f9f9184b251369502a9
I20250625 03:31:37.509575 4013 raft_consensus.cc:2802] T 39da7c80318f4c408f8cdaf2229b0c96 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:31:37.510142 4013 raft_consensus.cc:695] T 39da7c80318f4c408f8cdaf2229b0c96 P 841018313ad649679de64e006582f4c5 [term 1 LEADER]: Becoming Leader. State: Replica: 841018313ad649679de64e006582f4c5, State: Running, Role: LEADER
I20250625 03:31:37.510903 3914 leader_election.cc:290] T e638ce3a86d242fcadb10cdf57f5960d P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:31:37.510996 4013 consensus_queue.cc:237] T 39da7c80318f4c408f8cdaf2229b0c96 P 841018313ad649679de64e006582f4c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:37.511982 3639 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e638ce3a86d242fcadb10cdf57f5960d" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:37.512703 3639 raft_consensus.cc:2466] T e638ce3a86d242fcadb10cdf57f5960d P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5b9823dfcd41cb92bd195c811cbf39 in term 0.
I20250625 03:31:37.514207 3680 leader_election.cc:304] T e638ce3a86d242fcadb10cdf57f5960d P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9, 3d5b9823dfcd41cb92bd195c811cbf39; no voters:
I20250625 03:31:37.516263 3962 raft_consensus.cc:2802] T e638ce3a86d242fcadb10cdf57f5960d P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:31:37.516693 3962 raft_consensus.cc:491] T e638ce3a86d242fcadb10cdf57f5960d P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:31:37.517066 3962 raft_consensus.cc:3058] T e638ce3a86d242fcadb10cdf57f5960d P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:37.520646 3863 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "007d68495d594a73a5e2748f51e7c44c" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4"
I20250625 03:31:37.508698 3862 raft_consensus.cc:2466] T a6b45bf21adf457d9a920f57d758ba15 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5b9823dfcd41cb92bd195c811cbf39 in term 1.
I20250625 03:31:37.522536 3996 leader_election.cc:290] T 007d68495d594a73a5e2748f51e7c44c P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 election: Requested vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353)
I20250625 03:31:37.522547 3679 leader_election.cc:304] T a6b45bf21adf457d9a920f57d758ba15 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, ddc0ad67020f45edb3ba9c83cab687a4; no voters: 841018313ad649679de64e006582f4c5
I20250625 03:31:37.525384 3983 raft_consensus.cc:2802] T a6b45bf21adf457d9a920f57d758ba15 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:31:37.525907 3983 raft_consensus.cc:695] T a6b45bf21adf457d9a920f57d758ba15 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 LEADER]: Becoming Leader. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Running, Role: LEADER
I20250625 03:31:37.526722 3983 consensus_queue.cc:237] T a6b45bf21adf457d9a920f57d758ba15 P 3d5b9823dfcd41cb92bd195c811cbf39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:37.520924 3860 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e638ce3a86d242fcadb10cdf57f5960d" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:37.521356 3863 raft_consensus.cc:3058] T 007d68495d594a73a5e2748f51e7c44c P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:37.528563 3786 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "007d68495d594a73a5e2748f51e7c44c" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5"
I20250625 03:31:37.529222 3786 raft_consensus.cc:3058] T 007d68495d594a73a5e2748f51e7c44c P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:37.535260 3535 catalog_manager.cc:5582] T 3d5b503929b24663a1f868ffaec34157 P ddc0ad67020f45edb3ba9c83cab687a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132). New cstate: current_term: 1 leader_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: UNKNOWN } } }
W20250625 03:31:37.534621 3679 leader_election.cc:343] T e638ce3a86d242fcadb10cdf57f5960d P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:37.549324 4110 consensus_queue.cc:1035] T 5e59ae16ec1a4c69aac820531e504206 P ddc0ad67020f45edb3ba9c83cab687a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:31:37.537840 3905 tablet_bootstrap.cc:654] T a6b45bf21adf457d9a920f57d758ba15 P 841018313ad649679de64e006582f4c5: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:37.553529 3938 raft_consensus.cc:491] T 1e9c146f8cd743f7ac35dc61d9226d1d P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddc0ad67020f45edb3ba9c83cab687a4)
I20250625 03:31:37.554132 3938 raft_consensus.cc:513] T 1e9c146f8cd743f7ac35dc61d9226d1d P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:37.558087 3909 tablet_bootstrap.cc:654] T 4b38a4199d1d44988233b6d8604d1a96 P 3d5b9823dfcd41cb92bd195c811cbf39: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:37.539412 4096 raft_consensus.cc:491] T 526951ad467a4708926096ed1162a722 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:37.559326 4096 raft_consensus.cc:513] T 526951ad467a4708926096ed1162a722 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:37.551894 3962 raft_consensus.cc:513] T e638ce3a86d242fcadb10cdf57f5960d P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:37.563159 3910 tablet_bootstrap.cc:492] T 526951ad467a4708926096ed1162a722 P ddc0ad67020f45edb3ba9c83cab687a4: No bootstrap required, opened a new log
I20250625 03:31:37.564538 3910 ts_tablet_manager.cc:1397] T 526951ad467a4708926096ed1162a722 P ddc0ad67020f45edb3ba9c83cab687a4: Time spent bootstrapping tablet: real 0.210s user 0.013s sys 0.000s
I20250625 03:31:37.528968 3534 catalog_manager.cc:5582] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 01873d289e0b4f9f9184b251369502a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 01873d289e0b4f9f9184b251369502a9 (127.0.106.129). New cstate: current_term: 1 leader_uuid: "01873d289e0b4f9f9184b251369502a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: HEALTHY } } }
I20250625 03:31:37.567082 3863 raft_consensus.cc:2466] T 007d68495d594a73a5e2748f51e7c44c P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01873d289e0b4f9f9184b251369502a9 in term 1.
I20250625 03:31:37.570528 3788 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1e9c146f8cd743f7ac35dc61d9226d1d" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:31:37.571998 3938 leader_election.cc:290] T 1e9c146f8cd743f7ac35dc61d9226d1d P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353)
I20250625 03:31:37.573375 3786 raft_consensus.cc:2466] T 007d68495d594a73a5e2748f51e7c44c P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01873d289e0b4f9f9184b251369502a9 in term 1.
I20250625 03:31:37.575323 3863 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e638ce3a86d242fcadb10cdf57f5960d" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4"
I20250625 03:31:37.575914 3975 consensus_queue.cc:1035] T 5e59ae16ec1a4c69aac820531e504206 P ddc0ad67020f45edb3ba9c83cab687a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20250625 03:31:37.577697 3535 catalog_manager.cc:5582] T a6b45bf21adf457d9a920f57d758ba15 P 3d5b9823dfcd41cb92bd195c811cbf39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:37.586548 3909 tablet_bootstrap.cc:492] T 4b38a4199d1d44988233b6d8604d1a96 P 3d5b9823dfcd41cb92bd195c811cbf39: No bootstrap required, opened a new log
I20250625 03:31:37.587117 3909 ts_tablet_manager.cc:1397] T 4b38a4199d1d44988233b6d8604d1a96 P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent bootstrapping tablet: real 0.114s user 0.010s sys 0.008s
I20250625 03:31:37.589604 3604 leader_election.cc:304] T 007d68495d594a73a5e2748f51e7c44c P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9, ddc0ad67020f45edb3ba9c83cab687a4; no voters:
I20250625 03:31:37.590130 3862 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1e9c146f8cd743f7ac35dc61d9226d1d" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:37.591581 3996 raft_consensus.cc:2802] T 007d68495d594a73a5e2748f51e7c44c P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:31:37.592125 3996 raft_consensus.cc:695] T 007d68495d594a73a5e2748f51e7c44c P 01873d289e0b4f9f9184b251369502a9 [term 1 LEADER]: Becoming Leader. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Running, Role: LEADER
I20250625 03:31:37.592964 3996 consensus_queue.cc:237] T 007d68495d594a73a5e2748f51e7c44c P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:37.593428 3639 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e638ce3a86d242fcadb10cdf57f5960d" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9"
I20250625 03:31:37.594252 3639 raft_consensus.cc:3058] T e638ce3a86d242fcadb10cdf57f5960d P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:37.596480 4096 leader_election.cc:290] T 526951ad467a4708926096ed1162a722 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:31:37.569022 3962 leader_election.cc:290] T e638ce3a86d242fcadb10cdf57f5960d P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 election: Requested vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:31:37.599014 3536 catalog_manager.cc:5582] T 5ece5f5b2a904c9cbef3065e210e9a30 P 841018313ad649679de64e006582f4c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 841018313ad649679de64e006582f4c5 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "841018313ad649679de64e006582f4c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: UNKNOWN } } }
W20250625 03:31:37.601212 3679 leader_election.cc:343] T e638ce3a86d242fcadb10cdf57f5960d P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:37.605244 3906 tablet_bootstrap.cc:654] T d00ad2472fd74bfc9065d9dc4808e0c1 P 01873d289e0b4f9f9184b251369502a9: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:37.578464 3932 raft_consensus.cc:513] T 5ece5f5b2a904c9cbef3065e210e9a30 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:37.610381 3713 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "526951ad467a4708926096ed1162a722" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" is_pre_election: true
I20250625 03:31:37.615123 3536 catalog_manager.cc:5582] T 39da7c80318f4c408f8cdaf2229b0c96 P 841018313ad649679de64e006582f4c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 841018313ad649679de64e006582f4c5 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "841018313ad649679de64e006582f4c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: HEALTHY } } }
I20250625 03:31:37.618647 3713 raft_consensus.cc:2466] T 526951ad467a4708926096ed1162a722 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01873d289e0b4f9f9184b251369502a9 in term 0.
I20250625 03:31:37.619053 3861 raft_consensus.cc:2391] T 5ece5f5b2a904c9cbef3065e210e9a30 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 841018313ad649679de64e006582f4c5 in current term 1: Already voted for candidate ddc0ad67020f45edb3ba9c83cab687a4 in this term.
I20250625 03:31:37.619853 3932 leader_election.cc:290] T 5ece5f5b2a904c9cbef3065e210e9a30 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 election: Requested vote from peers 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041), 841018313ad649679de64e006582f4c5 (127.0.106.131:39467)
I20250625 03:31:37.622309 3605 leader_election.cc:304] T 526951ad467a4708926096ed1162a722 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9, 3d5b9823dfcd41cb92bd195c811cbf39; no voters:
I20250625 03:31:37.622424 3604 leader_election.cc:304] T 1e9c146f8cd743f7ac35dc61d9226d1d P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9; no voters: 841018313ad649679de64e006582f4c5, ddc0ad67020f45edb3ba9c83cab687a4
I20250625 03:31:37.624217 3938 raft_consensus.cc:2802] T 526951ad467a4708926096ed1162a722 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:31:37.624608 3938 raft_consensus.cc:491] T 526951ad467a4708926096ed1162a722 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:31:37.624955 3938 raft_consensus.cc:3058] T 526951ad467a4708926096ed1162a722 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:37.625780 3861 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "526951ad467a4708926096ed1162a722" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:37.627146 4096 raft_consensus.cc:2747] T 1e9c146f8cd743f7ac35dc61d9226d1d P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250625 03:31:37.631768 3713 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5ece5f5b2a904c9cbef3065e210e9a30" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
I20250625 03:31:37.632660 3713 raft_consensus.cc:2391] T 5ece5f5b2a904c9cbef3065e210e9a30 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ddc0ad67020f45edb3ba9c83cab687a4 in current term 1: Already voted for candidate 841018313ad649679de64e006582f4c5 in this term.
I20250625 03:31:37.632601 3962 consensus_queue.cc:1035] T 9d985eca3d6f497c86b94c53f16c8ae5 P 3d5b9823dfcd41cb92bd195c811cbf39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:31:37.613150 3910 raft_consensus.cc:357] T 526951ad467a4708926096ed1162a722 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:37.643273 3910 raft_consensus.cc:383] T 526951ad467a4708926096ed1162a722 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:37.643659 3910 raft_consensus.cc:738] T 526951ad467a4708926096ed1162a722 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Initialized, Role: FOLLOWER
I20250625 03:31:37.644554 3910 consensus_queue.cc:260] T 526951ad467a4708926096ed1162a722 P ddc0ad67020f45edb3ba9c83cab687a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:37.646739 3910 ts_tablet_manager.cc:1428] T 526951ad467a4708926096ed1162a722 P ddc0ad67020f45edb3ba9c83cab687a4: Time spent starting tablet: real 0.082s user 0.005s sys 0.000s
I20250625 03:31:37.642295 3909 raft_consensus.cc:357] T 4b38a4199d1d44988233b6d8604d1a96 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:37.651381 3909 raft_consensus.cc:383] T 4b38a4199d1d44988233b6d8604d1a96 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:37.651837 3909 raft_consensus.cc:738] T 4b38a4199d1d44988233b6d8604d1a96 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Initialized, Role: FOLLOWER
I20250625 03:31:37.653041 3909 consensus_queue.cc:260] T 4b38a4199d1d44988233b6d8604d1a96 P 3d5b9823dfcd41cb92bd195c811cbf39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:37.654505 3906 tablet_bootstrap.cc:492] T d00ad2472fd74bfc9065d9dc4808e0c1 P 01873d289e0b4f9f9184b251369502a9: No bootstrap required, opened a new log
I20250625 03:31:37.655010 3906 ts_tablet_manager.cc:1397] T d00ad2472fd74bfc9065d9dc4808e0c1 P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.173s user 0.010s sys 0.009s
I20250625 03:31:37.656713 3910 tablet_bootstrap.cc:492] T 036dfe9e6b844fc6964b3b5e371f8c95 P ddc0ad67020f45edb3ba9c83cab687a4: Bootstrap starting.
I20250625 03:31:37.660712 3938 raft_consensus.cc:513] T 526951ad467a4708926096ed1162a722 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:37.661687 3909 ts_tablet_manager.cc:1428] T 4b38a4199d1d44988233b6d8604d1a96 P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent starting tablet: real 0.074s user 0.004s sys 0.005s
I20250625 03:31:37.663117 3983 raft_consensus.cc:491] T 03c46dae805341fdb9ec29725fa182a2 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:37.664952 3789 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5ece5f5b2a904c9cbef3065e210e9a30" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5"
I20250625 03:31:37.667249 3909 tablet_bootstrap.cc:492] T d00ad2472fd74bfc9065d9dc4808e0c1 P 3d5b9823dfcd41cb92bd195c811cbf39: Bootstrap starting.
I20250625 03:31:37.651758 3861 raft_consensus.cc:2466] T 526951ad467a4708926096ed1162a722 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01873d289e0b4f9f9184b251369502a9 in term 0.
I20250625 03:31:37.671397 3639 raft_consensus.cc:2466] T e638ce3a86d242fcadb10cdf57f5960d P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5b9823dfcd41cb92bd195c811cbf39 in term 1.
I20250625 03:31:37.659610 4013 raft_consensus.cc:491] T e7d3871088394a3ba7a6d18baae1feba P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:37.673710 3983 raft_consensus.cc:513] T 03c46dae805341fdb9ec29725fa182a2 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:37.691179 3680 leader_election.cc:304] T e638ce3a86d242fcadb10cdf57f5960d P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9, 3d5b9823dfcd41cb92bd195c811cbf39; no voters: ddc0ad67020f45edb3ba9c83cab687a4
I20250625 03:31:37.699699 3962 raft_consensus.cc:2802] T e638ce3a86d242fcadb10cdf57f5960d P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:31:37.700255 3962 raft_consensus.cc:695] T e638ce3a86d242fcadb10cdf57f5960d P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 LEADER]: Becoming Leader. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Running, Role: LEADER
I20250625 03:31:37.701085 3962 consensus_queue.cc:237] T e638ce3a86d242fcadb10cdf57f5960d P 3d5b9823dfcd41cb92bd195c811cbf39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:37.703081 3714 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "526951ad467a4708926096ed1162a722" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
I20250625 03:31:37.703711 3714 raft_consensus.cc:3058] T 526951ad467a4708926096ed1162a722 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:37.706470 3938 leader_election.cc:290] T 526951ad467a4708926096ed1162a722 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 election: Requested vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:31:37.686558 4013 raft_consensus.cc:513] T e7d3871088394a3ba7a6d18baae1feba P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:37.703732 3983 leader_election.cc:290] T 03c46dae805341fdb9ec29725fa182a2 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:31:37.720074 3639 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "03c46dae805341fdb9ec29725fa182a2" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:37.723460 3862 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "526951ad467a4708926096ed1162a722" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4"
I20250625 03:31:37.724171 3862 raft_consensus.cc:3058] T 526951ad467a4708926096ed1162a722 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:37.726420 3861 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e7d3871088394a3ba7a6d18baae1feba" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:37.727138 3910 tablet_bootstrap.cc:654] T 036dfe9e6b844fc6964b3b5e371f8c95 P ddc0ad67020f45edb3ba9c83cab687a4: Neither blocks nor log segments found. Creating new log.
W20250625 03:31:37.727898 3753 leader_election.cc:343] T e7d3871088394a3ba7a6d18baae1feba P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:37.728657 3863 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "03c46dae805341fdb9ec29725fa182a2" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:37.721791 3828 leader_election.cc:304] T 5ece5f5b2a904c9cbef3065e210e9a30 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddc0ad67020f45edb3ba9c83cab687a4; no voters: 3d5b9823dfcd41cb92bd195c811cbf39, 841018313ad649679de64e006582f4c5
I20250625 03:31:37.728789 4013 leader_election.cc:290] T e7d3871088394a3ba7a6d18baae1feba P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:31:37.729732 3906 raft_consensus.cc:357] T d00ad2472fd74bfc9065d9dc4808e0c1 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:37.731400 3906 raft_consensus.cc:383] T d00ad2472fd74bfc9065d9dc4808e0c1 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:37.731679 3906 raft_consensus.cc:738] T d00ad2472fd74bfc9065d9dc4808e0c1 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:37.732228 4045 raft_consensus.cc:2747] T 5ece5f5b2a904c9cbef3065e210e9a30 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20250625 03:31:37.732457 3639 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e7d3871088394a3ba7a6d18baae1feba" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:37.734391 3906 consensus_queue.cc:260] T d00ad2472fd74bfc9065d9dc4808e0c1 P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
W20250625 03:31:37.733915 3754 leader_election.cc:343] T e7d3871088394a3ba7a6d18baae1feba P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:37.735531 3754 leader_election.cc:304] T e7d3871088394a3ba7a6d18baae1feba P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841018313ad649679de64e006582f4c5; no voters: 01873d289e0b4f9f9184b251369502a9, ddc0ad67020f45edb3ba9c83cab687a4
I20250625 03:31:37.743244 3951 raft_consensus.cc:491] T 4b38a4199d1d44988233b6d8604d1a96 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:37.743813 3951 raft_consensus.cc:513] T 4b38a4199d1d44988233b6d8604d1a96 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
W20250625 03:31:37.744853 3680 leader_election.cc:343] T 03c46dae805341fdb9ec29725fa182a2 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:37.745787 3951 leader_election.cc:290] T 4b38a4199d1d44988233b6d8604d1a96 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:31:37.759357 3905 tablet_bootstrap.cc:492] T a6b45bf21adf457d9a920f57d758ba15 P 841018313ad649679de64e006582f4c5: No bootstrap required, opened a new log
I20250625 03:31:37.759825 3905 ts_tablet_manager.cc:1397] T a6b45bf21adf457d9a920f57d758ba15 P 841018313ad649679de64e006582f4c5: Time spent bootstrapping tablet: real 0.283s user 0.020s sys 0.004s
I20250625 03:31:37.764318 3906 ts_tablet_manager.cc:1428] T d00ad2472fd74bfc9065d9dc4808e0c1 P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.109s user 0.007s sys 0.000s
I20250625 03:31:37.754269 4013 raft_consensus.cc:2747] T e7d3871088394a3ba7a6d18baae1feba P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250625 03:31:37.765287 3585 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
W20250625 03:31:37.774345 3679 leader_election.cc:343] T 03c46dae805341fdb9ec29725fa182a2 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:37.774894 3679 leader_election.cc:304] T 03c46dae805341fdb9ec29725fa182a2 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39; no voters: 01873d289e0b4f9f9184b251369502a9, ddc0ad67020f45edb3ba9c83cab687a4
I20250625 03:31:37.776631 3909 tablet_bootstrap.cc:654] T d00ad2472fd74bfc9065d9dc4808e0c1 P 3d5b9823dfcd41cb92bd195c811cbf39: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:37.773274 3639 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4b38a4199d1d44988233b6d8604d1a96" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:37.780241 3983 raft_consensus.cc:2747] T 03c46dae805341fdb9ec29725fa182a2 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:31:37.793815 3862 raft_consensus.cc:2466] T 526951ad467a4708926096ed1162a722 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01873d289e0b4f9f9184b251369502a9 in term 1.
W20250625 03:31:37.797657 3680 leader_election.cc:343] T 4b38a4199d1d44988233b6d8604d1a96 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
W20250625 03:31:37.800109 3680 consensus_peers.cc:487] T 9d985eca3d6f497c86b94c53f16c8ae5 P 3d5b9823dfcd41cb92bd195c811cbf39 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:37.801714 3863 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4b38a4199d1d44988233b6d8604d1a96" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:37.807165 3905 raft_consensus.cc:357] T a6b45bf21adf457d9a920f57d758ba15 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:37.807912 3905 raft_consensus.cc:383] T a6b45bf21adf457d9a920f57d758ba15 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:37.808235 3905 raft_consensus.cc:738] T a6b45bf21adf457d9a920f57d758ba15 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841018313ad649679de64e006582f4c5, State: Initialized, Role: FOLLOWER
I20250625 03:31:37.808971 3905 consensus_queue.cc:260] T a6b45bf21adf457d9a920f57d758ba15 P 841018313ad649679de64e006582f4c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:37.809513 3604 leader_election.cc:304] T 526951ad467a4708926096ed1162a722 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9, ddc0ad67020f45edb3ba9c83cab687a4; no voters:
I20250625 03:31:37.810698 4096 raft_consensus.cc:2802] T 526951ad467a4708926096ed1162a722 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:31:37.811187 4096 raft_consensus.cc:695] T 526951ad467a4708926096ed1162a722 P 01873d289e0b4f9f9184b251369502a9 [term 1 LEADER]: Becoming Leader. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Running, Role: LEADER
I20250625 03:31:37.811462 3905 ts_tablet_manager.cc:1428] T a6b45bf21adf457d9a920f57d758ba15 P 841018313ad649679de64e006582f4c5: Time spent starting tablet: real 0.051s user 0.005s sys 0.000s
I20250625 03:31:37.812495 3905 tablet_bootstrap.cc:492] T 28cf5da85c864698894ed4e1ee38cd86 P 841018313ad649679de64e006582f4c5: Bootstrap starting.
I20250625 03:31:37.812054 4096 consensus_queue.cc:237] T 526951ad467a4708926096ed1162a722 P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:37.818522 3910 tablet_bootstrap.cc:492] T 036dfe9e6b844fc6964b3b5e371f8c95 P ddc0ad67020f45edb3ba9c83cab687a4: No bootstrap required, opened a new log
I20250625 03:31:37.819137 3910 ts_tablet_manager.cc:1397] T 036dfe9e6b844fc6964b3b5e371f8c95 P ddc0ad67020f45edb3ba9c83cab687a4: Time spent bootstrapping tablet: real 0.163s user 0.024s sys 0.034s
I20250625 03:31:37.824663 3906 tablet_bootstrap.cc:492] T e7d3871088394a3ba7a6d18baae1feba P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:37.829829 3535 catalog_manager.cc:5582] T e638ce3a86d242fcadb10cdf57f5960d P 3d5b9823dfcd41cb92bd195c811cbf39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: HEALTHY } } }
W20250625 03:31:37.831221 3679 leader_election.cc:343] T 4b38a4199d1d44988233b6d8604d1a96 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:37.831750 3679 leader_election.cc:304] T 4b38a4199d1d44988233b6d8604d1a96 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39; no voters: 01873d289e0b4f9f9184b251369502a9, ddc0ad67020f45edb3ba9c83cab687a4
I20250625 03:31:37.833084 3951 raft_consensus.cc:2747] T 4b38a4199d1d44988233b6d8604d1a96 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:31:37.821759 3910 raft_consensus.cc:357] T 036dfe9e6b844fc6964b3b5e371f8c95 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:37.834820 3910 raft_consensus.cc:383] T 036dfe9e6b844fc6964b3b5e371f8c95 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:37.835158 3910 raft_consensus.cc:738] T 036dfe9e6b844fc6964b3b5e371f8c95 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Initialized, Role: FOLLOWER
I20250625 03:31:37.835947 3910 consensus_queue.cc:260] T 036dfe9e6b844fc6964b3b5e371f8c95 P ddc0ad67020f45edb3ba9c83cab687a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:37.815770 3714 raft_consensus.cc:2466] T 526951ad467a4708926096ed1162a722 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01873d289e0b4f9f9184b251369502a9 in term 1.
W20250625 03:31:37.843575 3604 consensus_peers.cc:487] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 01873d289e0b4f9f9184b251369502a9 -> Peer ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353): Couldn't send request to peer ddc0ad67020f45edb3ba9c83cab687a4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:37.847795 3906 tablet_bootstrap.cc:654] T e7d3871088394a3ba7a6d18baae1feba P 01873d289e0b4f9f9184b251369502a9: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:37.849264 3910 ts_tablet_manager.cc:1428] T 036dfe9e6b844fc6964b3b5e371f8c95 P ddc0ad67020f45edb3ba9c83cab687a4: Time spent starting tablet: real 0.030s user 0.006s sys 0.000s
I20250625 03:31:37.849376 3905 tablet_bootstrap.cc:654] T 28cf5da85c864698894ed4e1ee38cd86 P 841018313ad649679de64e006582f4c5: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:37.850541 3910 tablet_bootstrap.cc:492] T e638ce3a86d242fcadb10cdf57f5960d P ddc0ad67020f45edb3ba9c83cab687a4: Bootstrap starting.
I20250625 03:31:37.855515 3909 tablet_bootstrap.cc:492] T d00ad2472fd74bfc9065d9dc4808e0c1 P 3d5b9823dfcd41cb92bd195c811cbf39: No bootstrap required, opened a new log
I20250625 03:31:37.856088 3909 ts_tablet_manager.cc:1397] T d00ad2472fd74bfc9065d9dc4808e0c1 P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent bootstrapping tablet: real 0.189s user 0.013s sys 0.000s
I20250625 03:31:37.856848 3910 tablet_bootstrap.cc:654] T e638ce3a86d242fcadb10cdf57f5960d P ddc0ad67020f45edb3ba9c83cab687a4: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:37.862272 3909 raft_consensus.cc:357] T d00ad2472fd74bfc9065d9dc4808e0c1 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:37.863306 3909 raft_consensus.cc:383] T d00ad2472fd74bfc9065d9dc4808e0c1 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:37.863615 3909 raft_consensus.cc:738] T d00ad2472fd74bfc9065d9dc4808e0c1 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Initialized, Role: FOLLOWER
I20250625 03:31:37.864686 3909 consensus_queue.cc:260] T d00ad2472fd74bfc9065d9dc4808e0c1 P 3d5b9823dfcd41cb92bd195c811cbf39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:37.867065 3906 tablet_bootstrap.cc:492] T e7d3871088394a3ba7a6d18baae1feba P 01873d289e0b4f9f9184b251369502a9: No bootstrap required, opened a new log
I20250625 03:31:37.867117 3909 ts_tablet_manager.cc:1428] T d00ad2472fd74bfc9065d9dc4808e0c1 P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent starting tablet: real 0.011s user 0.005s sys 0.000s
I20250625 03:31:37.867695 3906 ts_tablet_manager.cc:1397] T e7d3871088394a3ba7a6d18baae1feba P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.043s user 0.007s sys 0.002s
I20250625 03:31:37.868270 3909 tablet_bootstrap.cc:492] T 6a179f065ae046df819a9bd88194dae6 P 3d5b9823dfcd41cb92bd195c811cbf39: Bootstrap starting.
I20250625 03:31:37.870350 3906 raft_consensus.cc:357] T e7d3871088394a3ba7a6d18baae1feba P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:37.871053 3906 raft_consensus.cc:383] T e7d3871088394a3ba7a6d18baae1feba P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:37.871344 3906 raft_consensus.cc:738] T e7d3871088394a3ba7a6d18baae1feba P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:37.872118 3906 consensus_queue.cc:260] T e7d3871088394a3ba7a6d18baae1feba P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:37.871683 3536 catalog_manager.cc:5582] T 007d68495d594a73a5e2748f51e7c44c P 01873d289e0b4f9f9184b251369502a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 01873d289e0b4f9f9184b251369502a9 (127.0.106.129). New cstate: current_term: 1 leader_uuid: "01873d289e0b4f9f9184b251369502a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: HEALTHY } } }
I20250625 03:31:37.874593 3906 ts_tablet_manager.cc:1428] T e7d3871088394a3ba7a6d18baae1feba P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20250625 03:31:37.875617 3906 tablet_bootstrap.cc:492] T 9d985eca3d6f497c86b94c53f16c8ae5 P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:37.879534 3905 tablet_bootstrap.cc:492] T 28cf5da85c864698894ed4e1ee38cd86 P 841018313ad649679de64e006582f4c5: No bootstrap required, opened a new log
I20250625 03:31:37.880110 3905 ts_tablet_manager.cc:1397] T 28cf5da85c864698894ed4e1ee38cd86 P 841018313ad649679de64e006582f4c5: Time spent bootstrapping tablet: real 0.068s user 0.013s sys 0.004s
I20250625 03:31:37.880303 3910 tablet_bootstrap.cc:492] T e638ce3a86d242fcadb10cdf57f5960d P ddc0ad67020f45edb3ba9c83cab687a4: No bootstrap required, opened a new log
I20250625 03:31:37.880828 3910 ts_tablet_manager.cc:1397] T e638ce3a86d242fcadb10cdf57f5960d P ddc0ad67020f45edb3ba9c83cab687a4: Time spent bootstrapping tablet: real 0.031s user 0.009s sys 0.007s
I20250625 03:31:37.882274 3909 tablet_bootstrap.cc:654] T 6a179f065ae046df819a9bd88194dae6 P 3d5b9823dfcd41cb92bd195c811cbf39: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:37.883247 3910 raft_consensus.cc:357] T e638ce3a86d242fcadb10cdf57f5960d P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:37.883984 3910 raft_consensus.cc:383] T e638ce3a86d242fcadb10cdf57f5960d P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:37.884282 3910 raft_consensus.cc:738] T e638ce3a86d242fcadb10cdf57f5960d P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Initialized, Role: FOLLOWER
I20250625 03:31:37.882550 3905 raft_consensus.cc:357] T 28cf5da85c864698894ed4e1ee38cd86 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:37.884969 3910 consensus_queue.cc:260] T e638ce3a86d242fcadb10cdf57f5960d P ddc0ad67020f45edb3ba9c83cab687a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:37.885744 3905 raft_consensus.cc:383] T 28cf5da85c864698894ed4e1ee38cd86 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:37.886091 3905 raft_consensus.cc:738] T 28cf5da85c864698894ed4e1ee38cd86 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841018313ad649679de64e006582f4c5, State: Initialized, Role: FOLLOWER
I20250625 03:31:37.888314 3905 consensus_queue.cc:260] T 28cf5da85c864698894ed4e1ee38cd86 P 841018313ad649679de64e006582f4c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:37.893473 3909 tablet_bootstrap.cc:492] T 6a179f065ae046df819a9bd88194dae6 P 3d5b9823dfcd41cb92bd195c811cbf39: No bootstrap required, opened a new log
I20250625 03:31:37.893725 3906 tablet_bootstrap.cc:654] T 9d985eca3d6f497c86b94c53f16c8ae5 P 01873d289e0b4f9f9184b251369502a9: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:37.894012 3909 ts_tablet_manager.cc:1397] T 6a179f065ae046df819a9bd88194dae6 P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent bootstrapping tablet: real 0.026s user 0.015s sys 0.000s
I20250625 03:31:37.895651 3910 ts_tablet_manager.cc:1428] T e638ce3a86d242fcadb10cdf57f5960d P ddc0ad67020f45edb3ba9c83cab687a4: Time spent starting tablet: real 0.015s user 0.002s sys 0.004s
I20250625 03:31:37.896713 3910 tablet_bootstrap.cc:492] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P ddc0ad67020f45edb3ba9c83cab687a4: Bootstrap starting.
I20250625 03:31:37.899693 3905 ts_tablet_manager.cc:1428] T 28cf5da85c864698894ed4e1ee38cd86 P 841018313ad649679de64e006582f4c5: Time spent starting tablet: real 0.019s user 0.006s sys 0.000s
I20250625 03:31:37.902156 3910 tablet_bootstrap.cc:654] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P ddc0ad67020f45edb3ba9c83cab687a4: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:37.905793 3905 tablet_bootstrap.cc:492] T 036dfe9e6b844fc6964b3b5e371f8c95 P 841018313ad649679de64e006582f4c5: Bootstrap starting.
I20250625 03:31:37.907414 3909 raft_consensus.cc:357] T 6a179f065ae046df819a9bd88194dae6 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:37.908130 3909 raft_consensus.cc:383] T 6a179f065ae046df819a9bd88194dae6 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:37.908411 3909 raft_consensus.cc:738] T 6a179f065ae046df819a9bd88194dae6 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Initialized, Role: FOLLOWER
I20250625 03:31:37.912210 3909 consensus_queue.cc:260] T 6a179f065ae046df819a9bd88194dae6 P 3d5b9823dfcd41cb92bd195c811cbf39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:37.914678 3910 tablet_bootstrap.cc:492] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P ddc0ad67020f45edb3ba9c83cab687a4: No bootstrap required, opened a new log
I20250625 03:31:37.914894 3909 ts_tablet_manager.cc:1428] T 6a179f065ae046df819a9bd88194dae6 P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent starting tablet: real 0.021s user 0.007s sys 0.000s
I20250625 03:31:37.915230 3910 ts_tablet_manager.cc:1397] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P ddc0ad67020f45edb3ba9c83cab687a4: Time spent bootstrapping tablet: real 0.019s user 0.009s sys 0.000s
I20250625 03:31:37.916205 3909 tablet_bootstrap.cc:492] T e91e209dcfdb4fd0bebe666bbbe16b75 P 3d5b9823dfcd41cb92bd195c811cbf39: Bootstrap starting.
W20250625 03:31:37.916535 3828 consensus_peers.cc:487] T 3d5b503929b24663a1f868ffaec34157 P ddc0ad67020f45edb3ba9c83cab687a4 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:37.920368 3910 raft_consensus.cc:357] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:37.921180 3910 raft_consensus.cc:383] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:37.921259 3905 tablet_bootstrap.cc:654] T 036dfe9e6b844fc6964b3b5e371f8c95 P 841018313ad649679de64e006582f4c5: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:37.921496 3910 raft_consensus.cc:738] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Initialized, Role: FOLLOWER
I20250625 03:31:37.923039 3909 tablet_bootstrap.cc:654] T e91e209dcfdb4fd0bebe666bbbe16b75 P 3d5b9823dfcd41cb92bd195c811cbf39: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:37.923628 3906 tablet_bootstrap.cc:492] T 9d985eca3d6f497c86b94c53f16c8ae5 P 01873d289e0b4f9f9184b251369502a9: No bootstrap required, opened a new log
I20250625 03:31:37.924181 3906 ts_tablet_manager.cc:1397] T 9d985eca3d6f497c86b94c53f16c8ae5 P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.049s user 0.015s sys 0.000s
I20250625 03:31:37.926700 3906 raft_consensus.cc:357] T 9d985eca3d6f497c86b94c53f16c8ae5 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:37.927436 3906 raft_consensus.cc:383] T 9d985eca3d6f497c86b94c53f16c8ae5 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:37.927698 3906 raft_consensus.cc:738] T 9d985eca3d6f497c86b94c53f16c8ae5 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:37.926966 3536 catalog_manager.cc:5582] T 526951ad467a4708926096ed1162a722 P 01873d289e0b4f9f9184b251369502a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 01873d289e0b4f9f9184b251369502a9 (127.0.106.129). New cstate: current_term: 1 leader_uuid: "01873d289e0b4f9f9184b251369502a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:37.928289 3787 raft_consensus.cc:3058] T a6b45bf21adf457d9a920f57d758ba15 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:37.930133 3906 consensus_queue.cc:260] T 9d985eca3d6f497c86b94c53f16c8ae5 P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:37.932344 3906 ts_tablet_manager.cc:1428] T 9d985eca3d6f497c86b94c53f16c8ae5 P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.008s user 0.005s sys 0.001s
I20250625 03:31:37.933248 3906 tablet_bootstrap.cc:492] T 39da7c80318f4c408f8cdaf2229b0c96 P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:37.936290 3910 consensus_queue.cc:260] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P ddc0ad67020f45edb3ba9c83cab687a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:37.938973 3910 ts_tablet_manager.cc:1428] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P ddc0ad67020f45edb3ba9c83cab687a4: Time spent starting tablet: real 0.023s user 0.007s sys 0.001s
I20250625 03:31:37.939857 3910 tablet_bootstrap.cc:492] T 03c46dae805341fdb9ec29725fa182a2 P ddc0ad67020f45edb3ba9c83cab687a4: Bootstrap starting.
I20250625 03:31:37.944144 3905 tablet_bootstrap.cc:492] T 036dfe9e6b844fc6964b3b5e371f8c95 P 841018313ad649679de64e006582f4c5: No bootstrap required, opened a new log
I20250625 03:31:37.944665 3905 ts_tablet_manager.cc:1397] T 036dfe9e6b844fc6964b3b5e371f8c95 P 841018313ad649679de64e006582f4c5: Time spent bootstrapping tablet: real 0.044s user 0.016s sys 0.008s
I20250625 03:31:37.945959 4013 raft_consensus.cc:491] T 28cf5da85c864698894ed4e1ee38cd86 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:37.946521 4013 raft_consensus.cc:513] T 28cf5da85c864698894ed4e1ee38cd86 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:37.948462 4013 leader_election.cc:290] T 28cf5da85c864698894ed4e1ee38cd86 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:31:37.948851 3910 tablet_bootstrap.cc:654] T 03c46dae805341fdb9ec29725fa182a2 P ddc0ad67020f45edb3ba9c83cab687a4: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:37.949998 3638 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "28cf5da85c864698894ed4e1ee38cd86" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
W20250625 03:31:37.951474 3754 leader_election.cc:343] T 28cf5da85c864698894ed4e1ee38cd86 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:37.952476 4130 consensus_queue.cc:1035] T 3d5b503929b24663a1f868ffaec34157 P ddc0ad67020f45edb3ba9c83cab687a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:31:37.954814 3906 tablet_bootstrap.cc:654] T 39da7c80318f4c408f8cdaf2229b0c96 P 01873d289e0b4f9f9184b251369502a9: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:37.955359 3862 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "28cf5da85c864698894ed4e1ee38cd86" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:37.955502 3996 consensus_queue.cc:1035] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:31:37.953764 3905 raft_consensus.cc:357] T 036dfe9e6b844fc6964b3b5e371f8c95 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:37.957386 3905 raft_consensus.cc:383] T 036dfe9e6b844fc6964b3b5e371f8c95 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:37.957683 3905 raft_consensus.cc:738] T 036dfe9e6b844fc6964b3b5e371f8c95 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841018313ad649679de64e006582f4c5, State: Initialized, Role: FOLLOWER
W20250625 03:31:37.959544 3753 leader_election.cc:343] T 28cf5da85c864698894ed4e1ee38cd86 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:37.960057 3753 leader_election.cc:304] T 28cf5da85c864698894ed4e1ee38cd86 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841018313ad649679de64e006582f4c5; no voters: 01873d289e0b4f9f9184b251369502a9, ddc0ad67020f45edb3ba9c83cab687a4
I20250625 03:31:37.958438 3905 consensus_queue.cc:260] T 036dfe9e6b844fc6964b3b5e371f8c95 P 841018313ad649679de64e006582f4c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:37.961546 4013 raft_consensus.cc:2747] T 28cf5da85c864698894ed4e1ee38cd86 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:31:37.964484 3951 raft_consensus.cc:491] T d00ad2472fd74bfc9065d9dc4808e0c1 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:37.964704 3905 ts_tablet_manager.cc:1428] T 036dfe9e6b844fc6964b3b5e371f8c95 P 841018313ad649679de64e006582f4c5: Time spent starting tablet: real 0.020s user 0.006s sys 0.001s
I20250625 03:31:37.964993 3906 tablet_bootstrap.cc:492] T 39da7c80318f4c408f8cdaf2229b0c96 P 01873d289e0b4f9f9184b251369502a9: No bootstrap required, opened a new log
I20250625 03:31:37.965009 3951 raft_consensus.cc:513] T d00ad2472fd74bfc9065d9dc4808e0c1 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:37.965641 3906 ts_tablet_manager.cc:1397] T 39da7c80318f4c408f8cdaf2229b0c96 P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.033s user 0.006s sys 0.007s
I20250625 03:31:37.965747 3905 tablet_bootstrap.cc:492] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 841018313ad649679de64e006582f4c5: Bootstrap starting.
I20250625 03:31:37.967293 3951 leader_election.cc:290] T d00ad2472fd74bfc9065d9dc4808e0c1 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 841018313ad649679de64e006582f4c5 (127.0.106.131:39467)
I20250625 03:31:37.968489 3906 raft_consensus.cc:357] T 39da7c80318f4c408f8cdaf2229b0c96 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:37.969210 3906 raft_consensus.cc:383] T 39da7c80318f4c408f8cdaf2229b0c96 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:37.969365 3638 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d00ad2472fd74bfc9065d9dc4808e0c1" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:37.970055 3638 raft_consensus.cc:2466] T d00ad2472fd74bfc9065d9dc4808e0c1 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5b9823dfcd41cb92bd195c811cbf39 in term 0.
I20250625 03:31:37.969288 3788 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d00ad2472fd74bfc9065d9dc4808e0c1" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:31:37.971675 3680 leader_election.cc:304] T d00ad2472fd74bfc9065d9dc4808e0c1 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9, 3d5b9823dfcd41cb92bd195c811cbf39; no voters:
I20250625 03:31:37.971800 3788 raft_consensus.cc:2466] T d00ad2472fd74bfc9065d9dc4808e0c1 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5b9823dfcd41cb92bd195c811cbf39 in term 0.
I20250625 03:31:37.972246 3910 tablet_bootstrap.cc:492] T 03c46dae805341fdb9ec29725fa182a2 P ddc0ad67020f45edb3ba9c83cab687a4: No bootstrap required, opened a new log
I20250625 03:31:37.972745 3951 raft_consensus.cc:2802] T d00ad2472fd74bfc9065d9dc4808e0c1 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:31:37.973209 3951 raft_consensus.cc:491] T d00ad2472fd74bfc9065d9dc4808e0c1 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:31:37.973119 4079 consensus_queue.cc:1035] T 39da7c80318f4c408f8cdaf2229b0c96 P 841018313ad649679de64e006582f4c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:31:37.973749 3951 raft_consensus.cc:3058] T d00ad2472fd74bfc9065d9dc4808e0c1 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:37.969547 3906 raft_consensus.cc:738] T 39da7c80318f4c408f8cdaf2229b0c96 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:37.976454 3906 consensus_queue.cc:260] T 39da7c80318f4c408f8cdaf2229b0c96 P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:37.977556 3909 tablet_bootstrap.cc:492] T e91e209dcfdb4fd0bebe666bbbe16b75 P 3d5b9823dfcd41cb92bd195c811cbf39: No bootstrap required, opened a new log
I20250625 03:31:37.978092 3909 ts_tablet_manager.cc:1397] T e91e209dcfdb4fd0bebe666bbbe16b75 P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent bootstrapping tablet: real 0.062s user 0.011s sys 0.008s
I20250625 03:31:37.978554 3906 ts_tablet_manager.cc:1428] T 39da7c80318f4c408f8cdaf2229b0c96 P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.013s user 0.004s sys 0.000s
I20250625 03:31:37.979521 3906 tablet_bootstrap.cc:492] T 3d5b503929b24663a1f868ffaec34157 P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:37.982076 3951 raft_consensus.cc:513] T d00ad2472fd74bfc9065d9dc4808e0c1 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:37.985631 3638 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d00ad2472fd74bfc9065d9dc4808e0c1" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9"
I20250625 03:31:37.986342 3638 raft_consensus.cc:3058] T d00ad2472fd74bfc9065d9dc4808e0c1 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:37.988844 4133 consensus_queue.cc:1035] T a6b45bf21adf457d9a920f57d758ba15 P 3d5b9823dfcd41cb92bd195c811cbf39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20250625 03:31:37.993304 3905 tablet_bootstrap.cc:654] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 841018313ad649679de64e006582f4c5: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:37.998975 3906 tablet_bootstrap.cc:654] T 3d5b503929b24663a1f868ffaec34157 P 01873d289e0b4f9f9184b251369502a9: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:37.972725 3910 ts_tablet_manager.cc:1397] T 03c46dae805341fdb9ec29725fa182a2 P ddc0ad67020f45edb3ba9c83cab687a4: Time spent bootstrapping tablet: real 0.033s user 0.016s sys 0.000s
I20250625 03:31:38.000907 3909 raft_consensus.cc:357] T e91e209dcfdb4fd0bebe666bbbe16b75 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:38.001741 3909 raft_consensus.cc:383] T e91e209dcfdb4fd0bebe666bbbe16b75 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:38.002060 3909 raft_consensus.cc:738] T e91e209dcfdb4fd0bebe666bbbe16b75 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Initialized, Role: FOLLOWER
I20250625 03:31:38.002755 3909 consensus_queue.cc:260] T e91e209dcfdb4fd0bebe666bbbe16b75 P 3d5b9823dfcd41cb92bd195c811cbf39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:38.004280 3788 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d00ad2472fd74bfc9065d9dc4808e0c1" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5"
I20250625 03:31:38.021390 3788 raft_consensus.cc:3058] T d00ad2472fd74bfc9065d9dc4808e0c1 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:38.011816 3910 raft_consensus.cc:357] T 03c46dae805341fdb9ec29725fa182a2 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:38.028226 3910 raft_consensus.cc:383] T 03c46dae805341fdb9ec29725fa182a2 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:38.013406 3951 leader_election.cc:290] T d00ad2472fd74bfc9065d9dc4808e0c1 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 election: Requested vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 841018313ad649679de64e006582f4c5 (127.0.106.131:39467)
I20250625 03:31:38.028604 3910 raft_consensus.cc:738] T 03c46dae805341fdb9ec29725fa182a2 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Initialized, Role: FOLLOWER
I20250625 03:31:38.014605 3638 raft_consensus.cc:2466] T d00ad2472fd74bfc9065d9dc4808e0c1 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5b9823dfcd41cb92bd195c811cbf39 in term 1.
I20250625 03:31:38.033303 3680 leader_election.cc:304] T d00ad2472fd74bfc9065d9dc4808e0c1 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9, 3d5b9823dfcd41cb92bd195c811cbf39; no voters:
I20250625 03:31:38.034639 3951 raft_consensus.cc:2802] T d00ad2472fd74bfc9065d9dc4808e0c1 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:31:38.035620 3951 raft_consensus.cc:695] T d00ad2472fd74bfc9065d9dc4808e0c1 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 LEADER]: Becoming Leader. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Running, Role: LEADER
I20250625 03:31:38.029485 3910 consensus_queue.cc:260] T 03c46dae805341fdb9ec29725fa182a2 P ddc0ad67020f45edb3ba9c83cab687a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:38.036768 3951 consensus_queue.cc:237] T d00ad2472fd74bfc9065d9dc4808e0c1 P 3d5b9823dfcd41cb92bd195c811cbf39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:38.038904 3910 ts_tablet_manager.cc:1428] T 03c46dae805341fdb9ec29725fa182a2 P ddc0ad67020f45edb3ba9c83cab687a4: Time spent starting tablet: real 0.039s user 0.003s sys 0.003s
I20250625 03:31:38.042129 4011 consensus_queue.cc:1035] T 5ece5f5b2a904c9cbef3065e210e9a30 P 841018313ad649679de64e006582f4c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:31:38.047343 4096 consensus_queue.cc:1035] T 007d68495d594a73a5e2748f51e7c44c P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:31:38.049361 3909 ts_tablet_manager.cc:1428] T e91e209dcfdb4fd0bebe666bbbe16b75 P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent starting tablet: real 0.071s user 0.004s sys 0.002s
I20250625 03:31:38.050382 3909 tablet_bootstrap.cc:492] T 5350a260b3364354b73176e6bdd77940 P 3d5b9823dfcd41cb92bd195c811cbf39: Bootstrap starting.
I20250625 03:31:38.054584 3910 tablet_bootstrap.cc:492] T e7d3871088394a3ba7a6d18baae1feba P ddc0ad67020f45edb3ba9c83cab687a4: Bootstrap starting.
I20250625 03:31:38.057166 3914 consensus_queue.cc:1035] T a6b45bf21adf457d9a920f57d758ba15 P 3d5b9823dfcd41cb92bd195c811cbf39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:31:38.061105 3788 raft_consensus.cc:2466] T d00ad2472fd74bfc9065d9dc4808e0c1 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5b9823dfcd41cb92bd195c811cbf39 in term 1.
I20250625 03:31:38.079481 3938 raft_consensus.cc:491] T 39da7c80318f4c408f8cdaf2229b0c96 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:38.080037 3938 raft_consensus.cc:513] T 39da7c80318f4c408f8cdaf2229b0c96 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:38.087121 3938 leader_election.cc:290] T 39da7c80318f4c408f8cdaf2229b0c96 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041), 841018313ad649679de64e006582f4c5 (127.0.106.131:39467)
I20250625 03:31:38.089347 3638 raft_consensus.cc:3058] T 39da7c80318f4c408f8cdaf2229b0c96 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:38.095177 4013 consensus_queue.cc:1035] T 5ece5f5b2a904c9cbef3065e210e9a30 P 841018313ad649679de64e006582f4c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:31:38.099503 3909 tablet_bootstrap.cc:654] T 5350a260b3364354b73176e6bdd77940 P 3d5b9823dfcd41cb92bd195c811cbf39: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:38.101914 3910 tablet_bootstrap.cc:654] T e7d3871088394a3ba7a6d18baae1feba P ddc0ad67020f45edb3ba9c83cab687a4: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:38.108759 3786 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "39da7c80318f4c408f8cdaf2229b0c96" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:31:38.110908 4115 consensus_queue.cc:1035] T 007d68495d594a73a5e2748f51e7c44c P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:31:38.115684 3905 tablet_bootstrap.cc:492] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 841018313ad649679de64e006582f4c5: No bootstrap required, opened a new log
I20250625 03:31:38.116426 3905 ts_tablet_manager.cc:1397] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 841018313ad649679de64e006582f4c5: Time spent bootstrapping tablet: real 0.151s user 0.023s sys 0.038s
I20250625 03:31:38.119028 3905 raft_consensus.cc:357] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:38.119753 3905 raft_consensus.cc:383] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:38.120065 3905 raft_consensus.cc:738] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841018313ad649679de64e006582f4c5, State: Initialized, Role: FOLLOWER
I20250625 03:31:38.120805 3712 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "39da7c80318f4c408f8cdaf2229b0c96" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" is_pre_election: true
I20250625 03:31:38.128619 3914 consensus_queue.cc:1035] T e638ce3a86d242fcadb10cdf57f5960d P 3d5b9823dfcd41cb92bd195c811cbf39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:31:38.120885 3905 consensus_queue.cc:260] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 841018313ad649679de64e006582f4c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:38.131153 3906 tablet_bootstrap.cc:492] T 3d5b503929b24663a1f868ffaec34157 P 01873d289e0b4f9f9184b251369502a9: No bootstrap required, opened a new log
I20250625 03:31:38.131618 3906 ts_tablet_manager.cc:1397] T 3d5b503929b24663a1f868ffaec34157 P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.152s user 0.018s sys 0.038s
I20250625 03:31:38.133107 3905 ts_tablet_manager.cc:1428] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 841018313ad649679de64e006582f4c5: Time spent starting tablet: real 0.016s user 0.004s sys 0.002s
I20250625 03:31:38.136615 3905 tablet_bootstrap.cc:492] T caea215a97a344e88348ecb21035902d P 841018313ad649679de64e006582f4c5: Bootstrap starting.
I20250625 03:31:38.139778 4011 consensus_queue.cc:1035] T 39da7c80318f4c408f8cdaf2229b0c96 P 841018313ad649679de64e006582f4c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:31:38.128782 3605 leader_election.cc:304] T 39da7c80318f4c408f8cdaf2229b0c96 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9; no voters: 3d5b9823dfcd41cb92bd195c811cbf39, 841018313ad649679de64e006582f4c5
I20250625 03:31:38.142202 3534 catalog_manager.cc:5582] T d00ad2472fd74bfc9065d9dc4808e0c1 P 3d5b9823dfcd41cb92bd195c811cbf39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:38.142966 3938 raft_consensus.cc:2747] T 39da7c80318f4c408f8cdaf2229b0c96 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:31:38.145114 3862 raft_consensus.cc:3058] T e638ce3a86d242fcadb10cdf57f5960d P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:38.146966 3905 tablet_bootstrap.cc:654] T caea215a97a344e88348ecb21035902d P 841018313ad649679de64e006582f4c5: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:38.133580 3906 raft_consensus.cc:357] T 3d5b503929b24663a1f868ffaec34157 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:38.147837 3906 raft_consensus.cc:383] T 3d5b503929b24663a1f868ffaec34157 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:38.148157 3906 raft_consensus.cc:738] T 3d5b503929b24663a1f868ffaec34157 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:38.148835 3906 consensus_queue.cc:260] T 3d5b503929b24663a1f868ffaec34157 P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:38.151548 4130 raft_consensus.cc:491] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:38.152117 4130 raft_consensus.cc:513] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:38.154273 4130 leader_election.cc:290] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:31:38.156303 3786 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2c4bb2d21b5242d387f6bc6ada60b4d5" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:31:38.156491 4133 consensus_queue.cc:1035] T e638ce3a86d242fcadb10cdf57f5960d P 3d5b9823dfcd41cb92bd195c811cbf39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:31:38.158248 3640 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2c4bb2d21b5242d387f6bc6ada60b4d5" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:38.160485 3828 leader_election.cc:304] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddc0ad67020f45edb3ba9c83cab687a4; no voters: 01873d289e0b4f9f9184b251369502a9, 841018313ad649679de64e006582f4c5
I20250625 03:31:38.174026 4130 raft_consensus.cc:2747] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:31:38.151188 3906 ts_tablet_manager.cc:1428] T 3d5b503929b24663a1f868ffaec34157 P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.019s user 0.002s sys 0.003s
I20250625 03:31:38.184820 3906 tablet_bootstrap.cc:492] T 036dfe9e6b844fc6964b3b5e371f8c95 P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:38.190786 3906 tablet_bootstrap.cc:654] T 036dfe9e6b844fc6964b3b5e371f8c95 P 01873d289e0b4f9f9184b251369502a9: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:38.200271 3938 raft_consensus.cc:491] T e7d3871088394a3ba7a6d18baae1feba P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:38.206212 3909 tablet_bootstrap.cc:492] T 5350a260b3364354b73176e6bdd77940 P 3d5b9823dfcd41cb92bd195c811cbf39: No bootstrap required, opened a new log
I20250625 03:31:38.206624 3938 raft_consensus.cc:513] T e7d3871088394a3ba7a6d18baae1feba P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:38.207569 3905 tablet_bootstrap.cc:492] T caea215a97a344e88348ecb21035902d P 841018313ad649679de64e006582f4c5: No bootstrap required, opened a new log
I20250625 03:31:38.208057 3905 ts_tablet_manager.cc:1397] T caea215a97a344e88348ecb21035902d P 841018313ad649679de64e006582f4c5: Time spent bootstrapping tablet: real 0.072s user 0.013s sys 0.001s
I20250625 03:31:38.208500 3938 leader_election.cc:290] T e7d3871088394a3ba7a6d18baae1feba P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353)
I20250625 03:31:38.208926 3909 ts_tablet_manager.cc:1397] T 5350a260b3364354b73176e6bdd77940 P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent bootstrapping tablet: real 0.157s user 0.013s sys 0.001s
I20250625 03:31:38.210398 3786 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e7d3871088394a3ba7a6d18baae1feba" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:31:38.210548 3905 raft_consensus.cc:357] T caea215a97a344e88348ecb21035902d P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:38.211253 3905 raft_consensus.cc:383] T caea215a97a344e88348ecb21035902d P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:38.211078 3786 raft_consensus.cc:2466] T e7d3871088394a3ba7a6d18baae1feba P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01873d289e0b4f9f9184b251369502a9 in term 0.
I20250625 03:31:38.211551 3905 raft_consensus.cc:738] T caea215a97a344e88348ecb21035902d P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841018313ad649679de64e006582f4c5, State: Initialized, Role: FOLLOWER
I20250625 03:31:38.211529 3863 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e7d3871088394a3ba7a6d18baae1feba" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:38.212584 3905 consensus_queue.cc:260] T caea215a97a344e88348ecb21035902d P 841018313ad649679de64e006582f4c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
W20250625 03:31:38.212865 3604 leader_election.cc:343] T e7d3871088394a3ba7a6d18baae1feba P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:38.213119 3909 raft_consensus.cc:357] T 5350a260b3364354b73176e6bdd77940 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:38.214476 3909 raft_consensus.cc:383] T 5350a260b3364354b73176e6bdd77940 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:38.214937 3905 ts_tablet_manager.cc:1428] T caea215a97a344e88348ecb21035902d P 841018313ad649679de64e006582f4c5: Time spent starting tablet: real 0.007s user 0.005s sys 0.001s
I20250625 03:31:38.214991 3909 raft_consensus.cc:738] T 5350a260b3364354b73176e6bdd77940 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Initialized, Role: FOLLOWER
I20250625 03:31:38.216943 3909 consensus_queue.cc:260] T 5350a260b3364354b73176e6bdd77940 P 3d5b9823dfcd41cb92bd195c811cbf39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:38.217612 3906 tablet_bootstrap.cc:492] T 036dfe9e6b844fc6964b3b5e371f8c95 P 01873d289e0b4f9f9184b251369502a9: No bootstrap required, opened a new log
I20250625 03:31:38.199633 3910 tablet_bootstrap.cc:492] T e7d3871088394a3ba7a6d18baae1feba P ddc0ad67020f45edb3ba9c83cab687a4: No bootstrap required, opened a new log
I20250625 03:31:38.218092 3906 ts_tablet_manager.cc:1397] T 036dfe9e6b844fc6964b3b5e371f8c95 P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.033s user 0.006s sys 0.004s
I20250625 03:31:38.218204 3910 ts_tablet_manager.cc:1397] T e7d3871088394a3ba7a6d18baae1feba P ddc0ad67020f45edb3ba9c83cab687a4: Time spent bootstrapping tablet: real 0.164s user 0.012s sys 0.000s
I20250625 03:31:38.219800 3905 tablet_bootstrap.cc:492] T c5a9463f96314a83b7955d80444b1c29 P 841018313ad649679de64e006582f4c5: Bootstrap starting.
I20250625 03:31:38.220095 3909 ts_tablet_manager.cc:1428] T 5350a260b3364354b73176e6bdd77940 P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent starting tablet: real 0.011s user 0.006s sys 0.000s
I20250625 03:31:38.220110 3910 raft_consensus.cc:357] T e7d3871088394a3ba7a6d18baae1feba P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:38.221113 3910 raft_consensus.cc:383] T e7d3871088394a3ba7a6d18baae1feba P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:38.221433 3910 raft_consensus.cc:738] T e7d3871088394a3ba7a6d18baae1feba P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Initialized, Role: FOLLOWER
I20250625 03:31:38.221951 3909 tablet_bootstrap.cc:492] T 0cf94f40d3434a11b3bfec277069c8c5 P 3d5b9823dfcd41cb92bd195c811cbf39: Bootstrap starting.
I20250625 03:31:38.222247 3910 consensus_queue.cc:260] T e7d3871088394a3ba7a6d18baae1feba P ddc0ad67020f45edb3ba9c83cab687a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
W20250625 03:31:38.222803 4156 log.cc:927] Time spent T 007d68495d594a73a5e2748f51e7c44c P ddc0ad67020f45edb3ba9c83cab687a4: Append to log took a long time: real 0.058s user 0.001s sys 0.000s
I20250625 03:31:38.224934 3910 ts_tablet_manager.cc:1428] T e7d3871088394a3ba7a6d18baae1feba P ddc0ad67020f45edb3ba9c83cab687a4: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20250625 03:31:38.225821 3910 tablet_bootstrap.cc:492] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P ddc0ad67020f45edb3ba9c83cab687a4: Bootstrap starting.
I20250625 03:31:38.225526 3906 raft_consensus.cc:357] T 036dfe9e6b844fc6964b3b5e371f8c95 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:38.226323 3906 raft_consensus.cc:383] T 036dfe9e6b844fc6964b3b5e371f8c95 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:38.226606 3906 raft_consensus.cc:738] T 036dfe9e6b844fc6964b3b5e371f8c95 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:38.227277 3906 consensus_queue.cc:260] T 036dfe9e6b844fc6964b3b5e371f8c95 P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:38.228662 3909 tablet_bootstrap.cc:654] T 0cf94f40d3434a11b3bfec277069c8c5 P 3d5b9823dfcd41cb92bd195c811cbf39: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:38.229442 3906 ts_tablet_manager.cc:1428] T 036dfe9e6b844fc6964b3b5e371f8c95 P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.011s user 0.007s sys 0.000s
I20250625 03:31:38.230075 3910 tablet_bootstrap.cc:654] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P ddc0ad67020f45edb3ba9c83cab687a4: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:38.230419 3906 tablet_bootstrap.cc:492] T 0cf94f40d3434a11b3bfec277069c8c5 P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:38.234730 3909 tablet_bootstrap.cc:492] T 0cf94f40d3434a11b3bfec277069c8c5 P 3d5b9823dfcd41cb92bd195c811cbf39: No bootstrap required, opened a new log
I20250625 03:31:38.235532 3909 ts_tablet_manager.cc:1397] T 0cf94f40d3434a11b3bfec277069c8c5 P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent bootstrapping tablet: real 0.014s user 0.009s sys 0.002s
I20250625 03:31:38.234905 3905 tablet_bootstrap.cc:654] T c5a9463f96314a83b7955d80444b1c29 P 841018313ad649679de64e006582f4c5: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:38.240450 3906 tablet_bootstrap.cc:654] T 0cf94f40d3434a11b3bfec277069c8c5 P 01873d289e0b4f9f9184b251369502a9: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:38.241020 3910 tablet_bootstrap.cc:492] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P ddc0ad67020f45edb3ba9c83cab687a4: No bootstrap required, opened a new log
I20250625 03:31:38.241492 3910 ts_tablet_manager.cc:1397] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P ddc0ad67020f45edb3ba9c83cab687a4: Time spent bootstrapping tablet: real 0.016s user 0.013s sys 0.000s
I20250625 03:31:38.241487 3909 raft_consensus.cc:357] T 0cf94f40d3434a11b3bfec277069c8c5 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:38.242151 3909 raft_consensus.cc:383] T 0cf94f40d3434a11b3bfec277069c8c5 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:38.242374 3909 raft_consensus.cc:738] T 0cf94f40d3434a11b3bfec277069c8c5 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Initialized, Role: FOLLOWER
I20250625 03:31:38.243011 3909 consensus_queue.cc:260] T 0cf94f40d3434a11b3bfec277069c8c5 P 3d5b9823dfcd41cb92bd195c811cbf39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:38.244053 3910 raft_consensus.cc:357] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:38.244706 3910 raft_consensus.cc:383] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:38.244915 3909 ts_tablet_manager.cc:1428] T 0cf94f40d3434a11b3bfec277069c8c5 P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent starting tablet: real 0.008s user 0.005s sys 0.000s
I20250625 03:31:38.244939 3906 tablet_bootstrap.cc:492] T 0cf94f40d3434a11b3bfec277069c8c5 P 01873d289e0b4f9f9184b251369502a9: No bootstrap required, opened a new log
I20250625 03:31:38.244979 3910 raft_consensus.cc:738] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Initialized, Role: FOLLOWER
I20250625 03:31:38.245652 3906 ts_tablet_manager.cc:1397] T 0cf94f40d3434a11b3bfec277069c8c5 P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.015s user 0.010s sys 0.000s
I20250625 03:31:38.245785 3909 tablet_bootstrap.cc:492] T 8ee7d6306b5146ed90a1b8392e062172 P 3d5b9823dfcd41cb92bd195c811cbf39: Bootstrap starting.
I20250625 03:31:38.245849 3910 consensus_queue.cc:260] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P ddc0ad67020f45edb3ba9c83cab687a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:38.248181 3910 ts_tablet_manager.cc:1428] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P ddc0ad67020f45edb3ba9c83cab687a4: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20250625 03:31:38.247998 3906 raft_consensus.cc:357] T 0cf94f40d3434a11b3bfec277069c8c5 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:38.248698 3906 raft_consensus.cc:383] T 0cf94f40d3434a11b3bfec277069c8c5 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:38.248972 3906 raft_consensus.cc:738] T 0cf94f40d3434a11b3bfec277069c8c5 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:38.249140 3910 tablet_bootstrap.cc:492] T eeca5a85dddf4d1884917690e01ff81d P ddc0ad67020f45edb3ba9c83cab687a4: Bootstrap starting.
I20250625 03:31:38.249603 3906 consensus_queue.cc:260] T 0cf94f40d3434a11b3bfec277069c8c5 P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:38.250375 3909 tablet_bootstrap.cc:654] T 8ee7d6306b5146ed90a1b8392e062172 P 3d5b9823dfcd41cb92bd195c811cbf39: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:38.251629 3906 ts_tablet_manager.cc:1428] T 0cf94f40d3434a11b3bfec277069c8c5 P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20250625 03:31:38.213929 3605 leader_election.cc:304] T e7d3871088394a3ba7a6d18baae1feba P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9, 841018313ad649679de64e006582f4c5; no voters: ddc0ad67020f45edb3ba9c83cab687a4
W20250625 03:31:38.303684 3605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.131:39467, user_credentials={real_user=slave}} blocked reactor thread for 89641.9us
I20250625 03:31:38.319022 4130 raft_consensus.cc:491] T 036dfe9e6b844fc6964b3b5e371f8c95 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:38.322502 3962 raft_consensus.cc:491] T 5350a260b3364354b73176e6bdd77940 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:38.320307 4130 raft_consensus.cc:513] T 036dfe9e6b844fc6964b3b5e371f8c95 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:38.323534 3962 raft_consensus.cc:513] T 5350a260b3364354b73176e6bdd77940 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:38.326047 3962 leader_election.cc:290] T 5350a260b3364354b73176e6bdd77940 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:31:38.310663 3938 raft_consensus.cc:2802] T e7d3871088394a3ba7a6d18baae1feba P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:31:38.327876 3938 raft_consensus.cc:491] T e7d3871088394a3ba7a6d18baae1feba P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:31:38.328356 3938 raft_consensus.cc:3058] T e7d3871088394a3ba7a6d18baae1feba P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:38.328428 4130 leader_election.cc:290] T 036dfe9e6b844fc6964b3b5e371f8c95 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:31:38.334152 4115 raft_consensus.cc:491] T 3d5b503929b24663a1f868ffaec34157 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:38.335230 4115 raft_consensus.cc:513] T 3d5b503929b24663a1f868ffaec34157 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:38.317080 3932 raft_consensus.cc:491] T 03c46dae805341fdb9ec29725fa182a2 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:38.341272 3932 raft_consensus.cc:513] T 03c46dae805341fdb9ec29725fa182a2 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:38.344252 3639 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "036dfe9e6b844fc6964b3b5e371f8c95" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:38.345769 3639 raft_consensus.cc:2466] T 036dfe9e6b844fc6964b3b5e371f8c95 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddc0ad67020f45edb3ba9c83cab687a4 in term 0.
I20250625 03:31:38.346251 3910 tablet_bootstrap.cc:654] T eeca5a85dddf4d1884917690e01ff81d P ddc0ad67020f45edb3ba9c83cab687a4: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:38.349181 3787 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "036dfe9e6b844fc6964b3b5e371f8c95" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:31:38.350378 3787 raft_consensus.cc:2466] T 036dfe9e6b844fc6964b3b5e371f8c95 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddc0ad67020f45edb3ba9c83cab687a4 in term 0.
I20250625 03:31:38.351415 3712 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3d5b503929b24663a1f868ffaec34157" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" is_pre_election: true
I20250625 03:31:38.357998 3640 raft_consensus.cc:3058] T 9d985eca3d6f497c86b94c53f16c8ae5 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:38.359342 3932 leader_election.cc:290] T 03c46dae805341fdb9ec29725fa182a2 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:31:38.360134 4115 leader_election.cc:290] T 3d5b503929b24663a1f868ffaec34157 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:31:38.384675 3914 raft_consensus.cc:491] T 6a179f065ae046df819a9bd88194dae6 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:38.384800 4011 raft_consensus.cc:491] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:38.392382 3712 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "03c46dae805341fdb9ec29725fa182a2" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" is_pre_election: true
I20250625 03:31:38.392804 3636 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "03c46dae805341fdb9ec29725fa182a2" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:38.393399 3712 raft_consensus.cc:2466] T 03c46dae805341fdb9ec29725fa182a2 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddc0ad67020f45edb3ba9c83cab687a4 in term 0.
I20250625 03:31:38.388667 3861 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5350a260b3364354b73176e6bdd77940" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:38.385794 3914 raft_consensus.cc:513] T 6a179f065ae046df819a9bd88194dae6 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:38.402513 3914 leader_election.cc:290] T 6a179f065ae046df819a9bd88194dae6 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 841018313ad649679de64e006582f4c5 (127.0.106.131:39467)
I20250625 03:31:38.404148 3636 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6a179f065ae046df819a9bd88194dae6" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:38.387077 3639 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5350a260b3364354b73176e6bdd77940" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
W20250625 03:31:38.406478 3680 leader_election.cc:343] T 6a179f065ae046df819a9bd88194dae6 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
W20250625 03:31:38.408881 3680 leader_election.cc:343] T 5350a260b3364354b73176e6bdd77940 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:38.404542 3787 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6a179f065ae046df819a9bd88194dae6" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:31:38.404146 3828 leader_election.cc:304] T 036dfe9e6b844fc6964b3b5e371f8c95 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9, ddc0ad67020f45edb3ba9c83cab687a4; no voters:
I20250625 03:31:38.411690 4130 raft_consensus.cc:2802] T 036dfe9e6b844fc6964b3b5e371f8c95 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:31:38.412247 4130 raft_consensus.cc:491] T 036dfe9e6b844fc6964b3b5e371f8c95 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:31:38.412688 4130 raft_consensus.cc:3058] T 036dfe9e6b844fc6964b3b5e371f8c95 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:38.387674 4011 raft_consensus.cc:513] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:38.420886 4011 leader_election.cc:290] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:31:38.421260 3863 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "559ad5ac1bd14e8c8da7a2e7419cfcc6" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:38.416208 3861 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3d5b503929b24663a1f868ffaec34157" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:38.422200 3863 raft_consensus.cc:2466] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841018313ad649679de64e006582f4c5 in term 0.
W20250625 03:31:38.424813 3680 leader_election.cc:343] T 6a179f065ae046df819a9bd88194dae6 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841018313ad649679de64e006582f4c5 (127.0.106.131:39467): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:38.425396 3680 leader_election.cc:304] T 6a179f065ae046df819a9bd88194dae6 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39; no voters: 01873d289e0b4f9f9184b251369502a9, 841018313ad649679de64e006582f4c5
I20250625 03:31:38.426791 3951 raft_consensus.cc:2747] T 6a179f065ae046df819a9bd88194dae6 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:31:38.425472 3638 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "559ad5ac1bd14e8c8da7a2e7419cfcc6" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:38.425542 3753 leader_election.cc:304] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841018313ad649679de64e006582f4c5, ddc0ad67020f45edb3ba9c83cab687a4; no voters:
I20250625 03:31:38.432958 4013 raft_consensus.cc:2802] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:31:38.433539 4013 raft_consensus.cc:491] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:31:38.434048 4013 raft_consensus.cc:3058] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:38.437994 4011 raft_consensus.cc:491] T caea215a97a344e88348ecb21035902d P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20250625 03:31:38.438953 3754 leader_election.cc:343] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:38.439664 4011 raft_consensus.cc:513] T caea215a97a344e88348ecb21035902d P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:38.444437 3906 tablet_bootstrap.cc:492] T 8ee7d6306b5146ed90a1b8392e062172 P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:38.449856 3909 tablet_bootstrap.cc:492] T 8ee7d6306b5146ed90a1b8392e062172 P 3d5b9823dfcd41cb92bd195c811cbf39: No bootstrap required, opened a new log
I20250625 03:31:38.462435 3905 tablet_bootstrap.cc:492] T c5a9463f96314a83b7955d80444b1c29 P 841018313ad649679de64e006582f4c5: No bootstrap required, opened a new log
I20250625 03:31:38.462493 3962 raft_consensus.cc:491] T e91e209dcfdb4fd0bebe666bbbe16b75 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:38.464516 3962 raft_consensus.cc:513] T e91e209dcfdb4fd0bebe666bbbe16b75 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:38.467018 4096 consensus_queue.cc:1035] T 526951ad467a4708926096ed1162a722 P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:31:38.468592 3962 leader_election.cc:290] T e91e209dcfdb4fd0bebe666bbbe16b75 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353)
I20250625 03:31:38.471019 4115 raft_consensus.cc:491] T 0cf94f40d3434a11b3bfec277069c8c5 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:38.471740 4115 raft_consensus.cc:513] T 0cf94f40d3434a11b3bfec277069c8c5 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:38.472366 4013 raft_consensus.cc:513] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:38.474954 4115 leader_election.cc:290] T 0cf94f40d3434a11b3bfec277069c8c5 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041), 841018313ad649679de64e006582f4c5 (127.0.106.131:39467)
I20250625 03:31:38.475436 4013 leader_election.cc:290] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 election: Requested vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:31:38.477917 3638 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "559ad5ac1bd14e8c8da7a2e7419cfcc6" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9"
I20250625 03:31:38.478032 3714 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0cf94f40d3434a11b3bfec277069c8c5" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" is_pre_election: true
I20250625 03:31:38.478963 3714 raft_consensus.cc:2466] T 0cf94f40d3434a11b3bfec277069c8c5 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01873d289e0b4f9f9184b251369502a9 in term 0.
I20250625 03:31:38.478561 3905 ts_tablet_manager.cc:1397] T c5a9463f96314a83b7955d80444b1c29 P 841018313ad649679de64e006582f4c5: Time spent bootstrapping tablet: real 0.259s user 0.004s sys 0.017s
W20250625 03:31:38.479755 3754 leader_election.cc:343] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:38.480476 3605 leader_election.cc:304] T 0cf94f40d3434a11b3bfec277069c8c5 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9, 3d5b9823dfcd41cb92bd195c811cbf39; no voters:
I20250625 03:31:38.482628 3909 ts_tablet_manager.cc:1397] T 8ee7d6306b5146ed90a1b8392e062172 P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent bootstrapping tablet: real 0.237s user 0.023s sys 0.013s
I20250625 03:31:38.482503 3962 consensus_queue.cc:1035] T d00ad2472fd74bfc9065d9dc4808e0c1 P 3d5b9823dfcd41cb92bd195c811cbf39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:31:38.483989 3910 tablet_bootstrap.cc:492] T eeca5a85dddf4d1884917690e01ff81d P ddc0ad67020f45edb3ba9c83cab687a4: No bootstrap required, opened a new log
I20250625 03:31:38.484071 3905 raft_consensus.cc:357] T c5a9463f96314a83b7955d80444b1c29 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:38.484869 3910 ts_tablet_manager.cc:1397] T eeca5a85dddf4d1884917690e01ff81d P ddc0ad67020f45edb3ba9c83cab687a4: Time spent bootstrapping tablet: real 0.236s user 0.010s sys 0.011s
I20250625 03:31:38.485014 3905 raft_consensus.cc:383] T c5a9463f96314a83b7955d80444b1c29 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:38.485349 3905 raft_consensus.cc:738] T c5a9463f96314a83b7955d80444b1c29 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841018313ad649679de64e006582f4c5, State: Initialized, Role: FOLLOWER
I20250625 03:31:38.486104 3909 raft_consensus.cc:357] T 8ee7d6306b5146ed90a1b8392e062172 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:38.487434 4096 raft_consensus.cc:2802] T 0cf94f40d3434a11b3bfec277069c8c5 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:31:38.487854 4096 raft_consensus.cc:491] T 0cf94f40d3434a11b3bfec277069c8c5 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:31:38.488401 4096 raft_consensus.cc:3058] T 0cf94f40d3434a11b3bfec277069c8c5 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:38.488951 3863 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "559ad5ac1bd14e8c8da7a2e7419cfcc6" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4"
I20250625 03:31:38.489626 3863 raft_consensus.cc:3058] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:38.489277 3910 raft_consensus.cc:357] T eeca5a85dddf4d1884917690e01ff81d P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:38.490136 3910 raft_consensus.cc:383] T eeca5a85dddf4d1884917690e01ff81d P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:38.490459 3910 raft_consensus.cc:738] T eeca5a85dddf4d1884917690e01ff81d P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Initialized, Role: FOLLOWER
I20250625 03:31:38.491204 3910 consensus_queue.cc:260] T eeca5a85dddf4d1884917690e01ff81d P ddc0ad67020f45edb3ba9c83cab687a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:38.459344 4130 raft_consensus.cc:513] T 036dfe9e6b844fc6964b3b5e371f8c95 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:38.493543 3910 ts_tablet_manager.cc:1428] T eeca5a85dddf4d1884917690e01ff81d P ddc0ad67020f45edb3ba9c83cab687a4: Time spent starting tablet: real 0.008s user 0.004s sys 0.003s
I20250625 03:31:38.493646 4130 leader_election.cc:290] T 036dfe9e6b844fc6964b3b5e371f8c95 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 election: Requested vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:31:38.494279 3787 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0cf94f40d3434a11b3bfec277069c8c5" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:31:38.494920 3910 tablet_bootstrap.cc:492] T 8ee7d6306b5146ed90a1b8392e062172 P ddc0ad67020f45edb3ba9c83cab687a4: Bootstrap starting.
W20250625 03:31:38.496433 3679 leader_election.cc:343] T 5350a260b3364354b73176e6bdd77940 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:38.497007 3679 leader_election.cc:304] T 5350a260b3364354b73176e6bdd77940 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39; no voters: 01873d289e0b4f9f9184b251369502a9, ddc0ad67020f45edb3ba9c83cab687a4
I20250625 03:31:38.499228 3787 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e91e209dcfdb4fd0bebe666bbbe16b75" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:31:38.500229 3861 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e91e209dcfdb4fd0bebe666bbbe16b75" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
W20250625 03:31:38.501227 3680 leader_election.cc:343] T e91e209dcfdb4fd0bebe666bbbe16b75 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841018313ad649679de64e006582f4c5 (127.0.106.131:39467): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:38.502209 3938 raft_consensus.cc:513] T e7d3871088394a3ba7a6d18baae1feba P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:38.503386 3828 leader_election.cc:304] T 03c46dae805341fdb9ec29725fa182a2 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, ddc0ad67020f45edb3ba9c83cab687a4; no voters:
I20250625 03:31:38.505738 3951 raft_consensus.cc:2747] T 5350a260b3364354b73176e6bdd77940 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:31:38.508121 3863 raft_consensus.cc:2466] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841018313ad649679de64e006582f4c5 in term 1.
I20250625 03:31:38.504410 3938 leader_election.cc:290] T e7d3871088394a3ba7a6d18baae1feba P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 election: Requested vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353)
I20250625 03:31:38.504627 3910 tablet_bootstrap.cc:654] T 8ee7d6306b5146ed90a1b8392e062172 P ddc0ad67020f45edb3ba9c83cab687a4: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:38.512789 3975 raft_consensus.cc:2802] T 03c46dae805341fdb9ec29725fa182a2 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:31:38.515178 3975 raft_consensus.cc:491] T 03c46dae805341fdb9ec29725fa182a2 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:31:38.515647 3975 raft_consensus.cc:3058] T 03c46dae805341fdb9ec29725fa182a2 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:38.516942 3713 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "caea215a97a344e88348ecb21035902d" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" is_pre_election: true
I20250625 03:31:38.517843 3753 leader_election.cc:304] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841018313ad649679de64e006582f4c5, ddc0ad67020f45edb3ba9c83cab687a4; no voters: 01873d289e0b4f9f9184b251369502a9
I20250625 03:31:38.519511 3713 raft_consensus.cc:2466] T caea215a97a344e88348ecb21035902d P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841018313ad649679de64e006582f4c5 in term 0.
I20250625 03:31:38.514606 4011 leader_election.cc:290] T caea215a97a344e88348ecb21035902d P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041), ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353)
I20250625 03:31:38.486913 3909 raft_consensus.cc:383] T 8ee7d6306b5146ed90a1b8392e062172 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:38.522786 3909 raft_consensus.cc:738] T 8ee7d6306b5146ed90a1b8392e062172 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Initialized, Role: FOLLOWER
I20250625 03:31:38.527097 3905 consensus_queue.cc:260] T c5a9463f96314a83b7955d80444b1c29 P 841018313ad649679de64e006582f4c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:38.529935 4079 raft_consensus.cc:2802] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:31:38.532577 3906 tablet_bootstrap.cc:654] T 8ee7d6306b5146ed90a1b8392e062172 P 01873d289e0b4f9f9184b251369502a9: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:38.537882 3909 consensus_queue.cc:260] T 8ee7d6306b5146ed90a1b8392e062172 P 3d5b9823dfcd41cb92bd195c811cbf39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:38.540186 4079 raft_consensus.cc:695] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 841018313ad649679de64e006582f4c5 [term 1 LEADER]: Becoming Leader. State: Replica: 841018313ad649679de64e006582f4c5, State: Running, Role: LEADER
I20250625 03:31:38.554852 4079 consensus_queue.cc:237] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 841018313ad649679de64e006582f4c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:38.556131 3962 consensus_queue.cc:1035] T d00ad2472fd74bfc9065d9dc4808e0c1 P 3d5b9823dfcd41cb92bd195c811cbf39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:31:38.558177 4096 raft_consensus.cc:513] T 0cf94f40d3434a11b3bfec277069c8c5 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:38.559525 3863 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "caea215a97a344e88348ecb21035902d" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:38.561012 3909 ts_tablet_manager.cc:1428] T 8ee7d6306b5146ed90a1b8392e062172 P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent starting tablet: real 0.078s user 0.006s sys 0.002s
I20250625 03:31:38.562458 3909 tablet_bootstrap.cc:492] T 162ddcc09f594ed7bcb752f842b6c97c P 3d5b9823dfcd41cb92bd195c811cbf39: Bootstrap starting.
W20250625 03:31:38.565675 3605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.131:39467, user_credentials={real_user=slave}} blocked reactor thread for 65142.4us
I20250625 03:31:38.569525 3905 ts_tablet_manager.cc:1428] T c5a9463f96314a83b7955d80444b1c29 P 841018313ad649679de64e006582f4c5: Time spent starting tablet: real 0.090s user 0.009s sys 0.000s
I20250625 03:31:38.571033 3905 tablet_bootstrap.cc:492] T 6de9e445ad834b008a2f513fac78dba1 P 841018313ad649679de64e006582f4c5: Bootstrap starting.
I20250625 03:31:38.574045 3714 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0cf94f40d3434a11b3bfec277069c8c5" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
W20250625 03:31:38.574323 3605 leader_election.cc:343] T 0cf94f40d3434a11b3bfec277069c8c5 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841018313ad649679de64e006582f4c5 (127.0.106.131:39467): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:38.574710 3714 raft_consensus.cc:3058] T 0cf94f40d3434a11b3bfec277069c8c5 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:38.585024 4096 leader_election.cc:290] T 0cf94f40d3434a11b3bfec277069c8c5 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 election: Requested vote from peers 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041), 841018313ad649679de64e006582f4c5 (127.0.106.131:39467)
W20250625 03:31:38.588289 3604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.132:37353, user_credentials={real_user=slave}} blocked reactor thread for 70450.5us
I20250625 03:31:38.589193 3909 tablet_bootstrap.cc:654] T 162ddcc09f594ed7bcb752f842b6c97c P 3d5b9823dfcd41cb92bd195c811cbf39: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:38.590276 3604 leader_election.cc:304] T 3d5b503929b24663a1f868ffaec34157 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9; no voters: 3d5b9823dfcd41cb92bd195c811cbf39, ddc0ad67020f45edb3ba9c83cab687a4
I20250625 03:31:38.591876 3996 raft_consensus.cc:2747] T 3d5b503929b24663a1f868ffaec34157 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:31:38.611423 3906 tablet_bootstrap.cc:492] T 8ee7d6306b5146ed90a1b8392e062172 P 01873d289e0b4f9f9184b251369502a9: No bootstrap required, opened a new log
I20250625 03:31:38.612154 3906 ts_tablet_manager.cc:1397] T 8ee7d6306b5146ed90a1b8392e062172 P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.234s user 0.006s sys 0.011s
W20250625 03:31:38.613319 3828 leader_election.cc:343] T 03c46dae805341fdb9ec29725fa182a2 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:38.622143 3863 raft_consensus.cc:3058] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:38.622431 3975 raft_consensus.cc:513] T 03c46dae805341fdb9ec29725fa182a2 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
W20250625 03:31:38.614500 3754 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.130:42041, user_credentials={real_user=slave}} blocked reactor thread for 83034.2us
I20250625 03:31:38.635686 3787 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e7d3871088394a3ba7a6d18baae1feba" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5"
I20250625 03:31:38.636451 3787 raft_consensus.cc:3058] T e7d3871088394a3ba7a6d18baae1feba P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:38.636572 3906 raft_consensus.cc:357] T 8ee7d6306b5146ed90a1b8392e062172 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:38.637368 3906 raft_consensus.cc:383] T 8ee7d6306b5146ed90a1b8392e062172 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:38.637672 3906 raft_consensus.cc:738] T 8ee7d6306b5146ed90a1b8392e062172 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:38.641268 3754 leader_election.cc:304] T caea215a97a344e88348ecb21035902d P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, 841018313ad649679de64e006582f4c5; no voters:
I20250625 03:31:38.646400 4011 raft_consensus.cc:2802] T caea215a97a344e88348ecb21035902d P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:31:38.646924 4011 raft_consensus.cc:491] T caea215a97a344e88348ecb21035902d P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:31:38.647320 4011 raft_consensus.cc:3058] T caea215a97a344e88348ecb21035902d P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:38.649580 3714 raft_consensus.cc:2466] T 0cf94f40d3434a11b3bfec277069c8c5 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01873d289e0b4f9f9184b251369502a9 in term 1.
I20250625 03:31:38.650064 3862 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e7d3871088394a3ba7a6d18baae1feba" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4"
I20250625 03:31:38.651683 3862 raft_consensus.cc:3058] T e7d3871088394a3ba7a6d18baae1feba P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:38.652604 3786 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0cf94f40d3434a11b3bfec277069c8c5" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5"
I20250625 03:31:38.657102 3640 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "036dfe9e6b844fc6964b3b5e371f8c95" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9"
I20250625 03:31:38.636672 3905 tablet_bootstrap.cc:654] T 6de9e445ad834b008a2f513fac78dba1 P 841018313ad649679de64e006582f4c5: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:38.657255 3906 consensus_queue.cc:260] T 8ee7d6306b5146ed90a1b8392e062172 P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:38.657828 3640 raft_consensus.cc:3058] T 036dfe9e6b844fc6964b3b5e371f8c95 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Advancing to term 1
W20250625 03:31:38.659866 3679 leader_election.cc:343] T e91e209dcfdb4fd0bebe666bbbe16b75 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:38.660454 3679 leader_election.cc:304] T e91e209dcfdb4fd0bebe666bbbe16b75 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39; no voters: 841018313ad649679de64e006582f4c5, ddc0ad67020f45edb3ba9c83cab687a4
I20250625 03:31:38.660730 3786 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "036dfe9e6b844fc6964b3b5e371f8c95" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5"
I20250625 03:31:38.661418 3786 raft_consensus.cc:3058] T 036dfe9e6b844fc6964b3b5e371f8c95 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:38.661737 4133 raft_consensus.cc:2747] T e91e209dcfdb4fd0bebe666bbbe16b75 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:31:38.664510 3862 raft_consensus.cc:2466] T e7d3871088394a3ba7a6d18baae1feba P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01873d289e0b4f9f9184b251369502a9 in term 1.
I20250625 03:31:38.670516 3975 leader_election.cc:290] T 03c46dae805341fdb9ec29725fa182a2 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 election: Requested vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:31:38.681107 3996 consensus_queue.cc:1035] T 526951ad467a4708926096ed1162a722 P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:31:38.666623 3640 raft_consensus.cc:2466] T 036dfe9e6b844fc6964b3b5e371f8c95 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddc0ad67020f45edb3ba9c83cab687a4 in term 1.
I20250625 03:31:38.670226 3636 raft_consensus.cc:3058] T 3d5b503929b24663a1f868ffaec34157 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:38.659823 3906 ts_tablet_manager.cc:1428] T 8ee7d6306b5146ed90a1b8392e062172 P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.047s user 0.005s sys 0.000s
I20250625 03:31:38.702335 3828 leader_election.cc:304] T 036dfe9e6b844fc6964b3b5e371f8c95 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9, ddc0ad67020f45edb3ba9c83cab687a4; no voters:
I20250625 03:31:38.691964 3786 raft_consensus.cc:2466] T 036dfe9e6b844fc6964b3b5e371f8c95 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddc0ad67020f45edb3ba9c83cab687a4 in term 1.
I20250625 03:31:38.691956 4011 raft_consensus.cc:513] T caea215a97a344e88348ecb21035902d P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:38.693032 3605 leader_election.cc:304] T 0cf94f40d3434a11b3bfec277069c8c5 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9, 3d5b9823dfcd41cb92bd195c811cbf39; no voters:
I20250625 03:31:38.704881 3906 tablet_bootstrap.cc:492] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:38.705734 3909 tablet_bootstrap.cc:492] T 162ddcc09f594ed7bcb752f842b6c97c P 3d5b9823dfcd41cb92bd195c811cbf39: No bootstrap required, opened a new log
I20250625 03:31:38.710282 3909 ts_tablet_manager.cc:1397] T 162ddcc09f594ed7bcb752f842b6c97c P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent bootstrapping tablet: real 0.148s user 0.009s sys 0.012s
I20250625 03:31:38.705240 4130 raft_consensus.cc:2802] T 036dfe9e6b844fc6964b3b5e371f8c95 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:31:38.713167 3996 raft_consensus.cc:2802] T 0cf94f40d3434a11b3bfec277069c8c5 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:31:38.702988 3604 leader_election.cc:304] T e7d3871088394a3ba7a6d18baae1feba P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9, ddc0ad67020f45edb3ba9c83cab687a4; no voters:
I20250625 03:31:38.711055 3787 raft_consensus.cc:2466] T e7d3871088394a3ba7a6d18baae1feba P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01873d289e0b4f9f9184b251369502a9 in term 1.
I20250625 03:31:38.722940 4011 leader_election.cc:290] T caea215a97a344e88348ecb21035902d P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 election: Requested vote from peers 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041), ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353)
I20250625 03:31:38.726527 3996 raft_consensus.cc:695] T 0cf94f40d3434a11b3bfec277069c8c5 P 01873d289e0b4f9f9184b251369502a9 [term 1 LEADER]: Becoming Leader. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Running, Role: LEADER
I20250625 03:31:38.727171 3713 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "03c46dae805341fdb9ec29725fa182a2" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
I20250625 03:31:38.727706 4172 raft_consensus.cc:2802] T e7d3871088394a3ba7a6d18baae1feba P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:31:38.727650 3996 consensus_queue.cc:237] T 0cf94f40d3434a11b3bfec277069c8c5 P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:38.727845 3713 raft_consensus.cc:3058] T 03c46dae805341fdb9ec29725fa182a2 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:38.715556 4130 raft_consensus.cc:695] T 036dfe9e6b844fc6964b3b5e371f8c95 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 LEADER]: Becoming Leader. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Running, Role: LEADER
I20250625 03:31:38.730609 3909 raft_consensus.cc:357] T 162ddcc09f594ed7bcb752f842b6c97c P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:38.731822 3909 raft_consensus.cc:383] T 162ddcc09f594ed7bcb752f842b6c97c P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:38.732136 3909 raft_consensus.cc:738] T 162ddcc09f594ed7bcb752f842b6c97c P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Initialized, Role: FOLLOWER
I20250625 03:31:38.724056 3714 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "caea215a97a344e88348ecb21035902d" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
I20250625 03:31:38.733062 3714 raft_consensus.cc:3058] T caea215a97a344e88348ecb21035902d P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:38.732790 4130 consensus_queue.cc:237] T 036dfe9e6b844fc6964b3b5e371f8c95 P ddc0ad67020f45edb3ba9c83cab687a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:38.714462 3640 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "03c46dae805341fdb9ec29725fa182a2" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9"
I20250625 03:31:38.734647 3909 consensus_queue.cc:260] T 162ddcc09f594ed7bcb752f842b6c97c P 3d5b9823dfcd41cb92bd195c811cbf39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:38.736725 4133 raft_consensus.cc:491] T 8ee7d6306b5146ed90a1b8392e062172 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:38.737284 4133 raft_consensus.cc:513] T 8ee7d6306b5146ed90a1b8392e062172 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:38.728534 4172 raft_consensus.cc:695] T e7d3871088394a3ba7a6d18baae1feba P 01873d289e0b4f9f9184b251369502a9 [term 1 LEADER]: Becoming Leader. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Running, Role: LEADER
I20250625 03:31:38.739421 4133 leader_election.cc:290] T 8ee7d6306b5146ed90a1b8392e062172 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
W20250625 03:31:38.747653 3828 leader_election.cc:343] T 03c46dae805341fdb9ec29725fa182a2 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:38.749092 3910 tablet_bootstrap.cc:492] T 8ee7d6306b5146ed90a1b8392e062172 P ddc0ad67020f45edb3ba9c83cab687a4: No bootstrap required, opened a new log
I20250625 03:31:38.749651 3910 ts_tablet_manager.cc:1397] T 8ee7d6306b5146ed90a1b8392e062172 P ddc0ad67020f45edb3ba9c83cab687a4: Time spent bootstrapping tablet: real 0.255s user 0.015s sys 0.000s
I20250625 03:31:38.751428 3639 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8ee7d6306b5146ed90a1b8392e062172" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:38.752163 3905 tablet_bootstrap.cc:492] T 6de9e445ad834b008a2f513fac78dba1 P 841018313ad649679de64e006582f4c5: No bootstrap required, opened a new log
I20250625 03:31:38.752144 3639 raft_consensus.cc:2466] T 8ee7d6306b5146ed90a1b8392e062172 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5b9823dfcd41cb92bd195c811cbf39 in term 0.
I20250625 03:31:38.752724 3905 ts_tablet_manager.cc:1397] T 6de9e445ad834b008a2f513fac78dba1 P 841018313ad649679de64e006582f4c5: Time spent bootstrapping tablet: real 0.182s user 0.011s sys 0.016s
I20250625 03:31:38.790163 3910 raft_consensus.cc:357] T 8ee7d6306b5146ed90a1b8392e062172 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:38.791239 3910 raft_consensus.cc:383] T 8ee7d6306b5146ed90a1b8392e062172 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:38.791886 3910 raft_consensus.cc:738] T 8ee7d6306b5146ed90a1b8392e062172 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Initialized, Role: FOLLOWER
I20250625 03:31:38.743506 4172 consensus_queue.cc:237] T e7d3871088394a3ba7a6d18baae1feba P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:38.795285 3909 ts_tablet_manager.cc:1428] T 162ddcc09f594ed7bcb752f842b6c97c P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent starting tablet: real 0.085s user 0.008s sys 0.000s
I20250625 03:31:38.796911 3909 tablet_bootstrap.cc:492] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 3d5b9823dfcd41cb92bd195c811cbf39: Bootstrap starting.
I20250625 03:31:38.788312 4013 raft_consensus.cc:491] T c5a9463f96314a83b7955d80444b1c29 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:38.798079 4013 raft_consensus.cc:513] T c5a9463f96314a83b7955d80444b1c29 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:38.798722 3910 consensus_queue.cc:260] T 8ee7d6306b5146ed90a1b8392e062172 P ddc0ad67020f45edb3ba9c83cab687a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:38.798323 3713 raft_consensus.cc:2466] T 03c46dae805341fdb9ec29725fa182a2 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddc0ad67020f45edb3ba9c83cab687a4 in term 1.
I20250625 03:31:38.800508 3828 leader_election.cc:304] T 03c46dae805341fdb9ec29725fa182a2 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, ddc0ad67020f45edb3ba9c83cab687a4; no voters: 01873d289e0b4f9f9184b251369502a9
I20250625 03:31:38.800779 3680 leader_election.cc:304] T 8ee7d6306b5146ed90a1b8392e062172 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9, 3d5b9823dfcd41cb92bd195c811cbf39; no voters:
I20250625 03:31:38.801270 3975 raft_consensus.cc:2802] T 03c46dae805341fdb9ec29725fa182a2 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:31:38.801755 3975 raft_consensus.cc:695] T 03c46dae805341fdb9ec29725fa182a2 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 LEADER]: Becoming Leader. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Running, Role: LEADER
I20250625 03:31:38.802603 3962 raft_consensus.cc:2802] T 8ee7d6306b5146ed90a1b8392e062172 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:31:38.802711 3975 consensus_queue.cc:237] T 03c46dae805341fdb9ec29725fa182a2 P ddc0ad67020f45edb3ba9c83cab687a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:38.803284 3962 raft_consensus.cc:491] T 8ee7d6306b5146ed90a1b8392e062172 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:31:38.808722 3909 tablet_bootstrap.cc:654] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 3d5b9823dfcd41cb92bd195c811cbf39: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:38.809317 3962 raft_consensus.cc:3058] T 8ee7d6306b5146ed90a1b8392e062172 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:38.822882 3906 tablet_bootstrap.cc:654] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 01873d289e0b4f9f9184b251369502a9: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:38.810493 4013 leader_election.cc:290] T c5a9463f96314a83b7955d80444b1c29 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
W20250625 03:31:38.813271 3753 leader_election.cc:343] T caea215a97a344e88348ecb21035902d P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:38.833894 3910 ts_tablet_manager.cc:1428] T 8ee7d6306b5146ed90a1b8392e062172 P ddc0ad67020f45edb3ba9c83cab687a4: Time spent starting tablet: real 0.084s user 0.007s sys 0.003s
I20250625 03:31:38.838719 3910 tablet_bootstrap.cc:492] T caea215a97a344e88348ecb21035902d P ddc0ad67020f45edb3ba9c83cab687a4: Bootstrap starting.
I20250625 03:31:38.839458 3905 raft_consensus.cc:357] T 6de9e445ad834b008a2f513fac78dba1 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:38.840674 3905 raft_consensus.cc:383] T 6de9e445ad834b008a2f513fac78dba1 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:38.840953 3905 raft_consensus.cc:738] T 6de9e445ad834b008a2f513fac78dba1 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841018313ad649679de64e006582f4c5, State: Initialized, Role: FOLLOWER
I20250625 03:31:38.843334 3905 consensus_queue.cc:260] T 6de9e445ad834b008a2f513fac78dba1 P 841018313ad649679de64e006582f4c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:38.843750 3714 raft_consensus.cc:2466] T caea215a97a344e88348ecb21035902d P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841018313ad649679de64e006582f4c5 in term 1.
I20250625 03:31:38.847996 3905 ts_tablet_manager.cc:1428] T 6de9e445ad834b008a2f513fac78dba1 P 841018313ad649679de64e006582f4c5: Time spent starting tablet: real 0.095s user 0.004s sys 0.002s
I20250625 03:31:38.849720 3905 tablet_bootstrap.cc:492] T 0cf94f40d3434a11b3bfec277069c8c5 P 841018313ad649679de64e006582f4c5: Bootstrap starting.
W20250625 03:31:38.855435 3605 leader_election.cc:343] T 0cf94f40d3434a11b3bfec277069c8c5 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 841018313ad649679de64e006582f4c5 (127.0.106.131:39467): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:38.835443 3862 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8ee7d6306b5146ed90a1b8392e062172" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:38.861531 3862 raft_consensus.cc:2466] T 8ee7d6306b5146ed90a1b8392e062172 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5b9823dfcd41cb92bd195c811cbf39 in term 0.
I20250625 03:31:38.860172 3861 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "caea215a97a344e88348ecb21035902d" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4"
I20250625 03:31:38.863253 3863 raft_consensus.cc:3058] T eeca5a85dddf4d1884917690e01ff81d P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:38.865768 3910 tablet_bootstrap.cc:654] T caea215a97a344e88348ecb21035902d P ddc0ad67020f45edb3ba9c83cab687a4: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:38.890205 3905 tablet_bootstrap.cc:654] T 0cf94f40d3434a11b3bfec277069c8c5 P 841018313ad649679de64e006582f4c5: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:38.895960 3636 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c5a9463f96314a83b7955d80444b1c29" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:38.900310 3909 tablet_bootstrap.cc:492] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 3d5b9823dfcd41cb92bd195c811cbf39: No bootstrap required, opened a new log
I20250625 03:31:38.900872 3909 ts_tablet_manager.cc:1397] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent bootstrapping tablet: real 0.104s user 0.019s sys 0.009s
I20250625 03:31:38.902588 3962 raft_consensus.cc:513] T 8ee7d6306b5146ed90a1b8392e062172 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:38.903604 3909 raft_consensus.cc:357] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:38.905786 3909 raft_consensus.cc:383] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:38.906132 3909 raft_consensus.cc:738] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Initialized, Role: FOLLOWER
I20250625 03:31:38.906531 3862 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8ee7d6306b5146ed90a1b8392e062172" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4"
I20250625 03:31:38.907402 3862 raft_consensus.cc:3058] T 8ee7d6306b5146ed90a1b8392e062172 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:38.908052 3909 consensus_queue.cc:260] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 3d5b9823dfcd41cb92bd195c811cbf39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:38.903632 3714 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c5a9463f96314a83b7955d80444b1c29" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" is_pre_election: true
W20250625 03:31:38.916291 3753 leader_election.cc:343] T caea215a97a344e88348ecb21035902d P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:38.923812 3906 tablet_bootstrap.cc:492] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 01873d289e0b4f9f9184b251369502a9: No bootstrap required, opened a new log
I20250625 03:31:38.924353 3906 ts_tablet_manager.cc:1397] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.224s user 0.021s sys 0.019s
I20250625 03:31:38.929836 3639 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8ee7d6306b5146ed90a1b8392e062172" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9"
I20250625 03:31:38.937585 3639 raft_consensus.cc:3058] T 8ee7d6306b5146ed90a1b8392e062172 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:38.938259 3910 tablet_bootstrap.cc:492] T caea215a97a344e88348ecb21035902d P ddc0ad67020f45edb3ba9c83cab687a4: No bootstrap required, opened a new log
I20250625 03:31:38.938764 3910 ts_tablet_manager.cc:1397] T caea215a97a344e88348ecb21035902d P ddc0ad67020f45edb3ba9c83cab687a4: Time spent bootstrapping tablet: real 0.100s user 0.011s sys 0.000s
I20250625 03:31:38.945900 4013 raft_consensus.cc:491] T 6de9e445ad834b008a2f513fac78dba1 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:38.946528 4013 raft_consensus.cc:513] T 6de9e445ad834b008a2f513fac78dba1 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:38.948659 4013 leader_election.cc:290] T 6de9e445ad834b008a2f513fac78dba1 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041), ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353)
I20250625 03:31:38.949539 4182 raft_consensus.cc:491] T 162ddcc09f594ed7bcb752f842b6c97c P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:38.950058 4182 raft_consensus.cc:513] T 162ddcc09f594ed7bcb752f842b6c97c P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:38.953246 3910 raft_consensus.cc:357] T caea215a97a344e88348ecb21035902d P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:38.954038 3910 raft_consensus.cc:383] T caea215a97a344e88348ecb21035902d P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:38.954502 3910 raft_consensus.cc:738] T caea215a97a344e88348ecb21035902d P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Initialized, Role: FOLLOWER
I20250625 03:31:38.954701 3861 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "162ddcc09f594ed7bcb752f842b6c97c" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:38.952908 3906 raft_consensus.cc:357] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:38.955418 3906 raft_consensus.cc:383] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:38.955185 3910 consensus_queue.cc:260] T caea215a97a344e88348ecb21035902d P ddc0ad67020f45edb3ba9c83cab687a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:38.955714 3906 raft_consensus.cc:738] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
W20250625 03:31:38.956627 3679 leader_election.cc:343] T 162ddcc09f594ed7bcb752f842b6c97c P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:38.956899 3910 ts_tablet_manager.cc:1428] T caea215a97a344e88348ecb21035902d P ddc0ad67020f45edb3ba9c83cab687a4: Time spent starting tablet: real 0.018s user 0.008s sys 0.000s
I20250625 03:31:38.954823 3909 ts_tablet_manager.cc:1428] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent starting tablet: real 0.054s user 0.007s sys 0.000s
I20250625 03:31:38.956573 3906 consensus_queue.cc:260] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:38.957598 4182 leader_election.cc:290] T 162ddcc09f594ed7bcb752f842b6c97c P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353)
I20250625 03:31:38.964308 3786 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "162ddcc09f594ed7bcb752f842b6c97c" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:31:38.965116 3906 ts_tablet_manager.cc:1428] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.040s user 0.007s sys 0.000s
I20250625 03:31:38.965687 3909 tablet_bootstrap.cc:492] T 41d33fbc861a40338ae6da1732fb696b P 3d5b9823dfcd41cb92bd195c811cbf39: Bootstrap starting.
I20250625 03:31:38.965634 3861 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6de9e445ad834b008a2f513fac78dba1" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
W20250625 03:31:38.967519 3680 leader_election.cc:343] T 162ddcc09f594ed7bcb752f842b6c97c P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841018313ad649679de64e006582f4c5 (127.0.106.131:39467): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:38.967837 3680 leader_election.cc:304] T 162ddcc09f594ed7bcb752f842b6c97c P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39; no voters: 841018313ad649679de64e006582f4c5, ddc0ad67020f45edb3ba9c83cab687a4
I20250625 03:31:38.943840 3862 raft_consensus.cc:2466] T 8ee7d6306b5146ed90a1b8392e062172 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5b9823dfcd41cb92bd195c811cbf39 in term 1.
I20250625 03:31:38.925729 3962 leader_election.cc:290] T 8ee7d6306b5146ed90a1b8392e062172 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 election: Requested vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:31:38.970389 3905 tablet_bootstrap.cc:492] T 0cf94f40d3434a11b3bfec277069c8c5 P 841018313ad649679de64e006582f4c5: No bootstrap required, opened a new log
I20250625 03:31:38.970806 3905 ts_tablet_manager.cc:1397] T 0cf94f40d3434a11b3bfec277069c8c5 P 841018313ad649679de64e006582f4c5: Time spent bootstrapping tablet: real 0.121s user 0.012s sys 0.003s
I20250625 03:31:38.971452 4182 raft_consensus.cc:2747] T 162ddcc09f594ed7bcb752f842b6c97c P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250625 03:31:38.971999 3753 leader_election.cc:343] T 6de9e445ad834b008a2f513fac78dba1 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:38.944242 3754 leader_election.cc:304] T caea215a97a344e88348ecb21035902d P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, 841018313ad649679de64e006582f4c5; no voters: ddc0ad67020f45edb3ba9c83cab687a4
W20250625 03:31:38.973973 3754 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:42041, user_credentials={real_user=slave}} blocked reactor thread for 46536.9us
I20250625 03:31:38.975461 3905 raft_consensus.cc:357] T 0cf94f40d3434a11b3bfec277069c8c5 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:38.976648 3905 raft_consensus.cc:383] T 0cf94f40d3434a11b3bfec277069c8c5 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:38.976951 3905 raft_consensus.cc:738] T 0cf94f40d3434a11b3bfec277069c8c5 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841018313ad649679de64e006582f4c5, State: Initialized, Role: FOLLOWER
I20250625 03:31:38.977597 4013 raft_consensus.cc:2802] T caea215a97a344e88348ecb21035902d P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Leader election won for term 1
W20250625 03:31:38.977051 3585 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20250625 03:31:38.977671 3905 consensus_queue.cc:260] T 0cf94f40d3434a11b3bfec277069c8c5 P 841018313ad649679de64e006582f4c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:38.979796 3713 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6de9e445ad834b008a2f513fac78dba1" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" is_pre_election: true
W20250625 03:31:38.980691 3754 leader_election.cc:343] T c5a9463f96314a83b7955d80444b1c29 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:38.979990 3636 raft_consensus.cc:3058] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Advancing to term 1
W20250625 03:31:38.981721 3754 leader_election.cc:343] T c5a9463f96314a83b7955d80444b1c29 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:38.982136 3754 leader_election.cc:304] T c5a9463f96314a83b7955d80444b1c29 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841018313ad649679de64e006582f4c5; no voters: 01873d289e0b4f9f9184b251369502a9, 3d5b9823dfcd41cb92bd195c811cbf39
I20250625 03:31:38.978192 4013 raft_consensus.cc:695] T caea215a97a344e88348ecb21035902d P 841018313ad649679de64e006582f4c5 [term 1 LEADER]: Becoming Leader. State: Replica: 841018313ad649679de64e006582f4c5, State: Running, Role: LEADER
I20250625 03:31:38.980870 3905 ts_tablet_manager.cc:1428] T 0cf94f40d3434a11b3bfec277069c8c5 P 841018313ad649679de64e006582f4c5: Time spent starting tablet: real 0.010s user 0.006s sys 0.000s
I20250625 03:31:38.993337 3905 tablet_bootstrap.cc:492] T 39880aedaeca464f81d899dc222a35b9 P 841018313ad649679de64e006582f4c5: Bootstrap starting.
I20250625 03:31:38.998481 3639 raft_consensus.cc:2466] T 8ee7d6306b5146ed90a1b8392e062172 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5b9823dfcd41cb92bd195c811cbf39 in term 1.
I20250625 03:31:38.998934 3679 leader_election.cc:304] T 8ee7d6306b5146ed90a1b8392e062172 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, ddc0ad67020f45edb3ba9c83cab687a4; no voters:
I20250625 03:31:38.999449 3909 tablet_bootstrap.cc:654] T 41d33fbc861a40338ae6da1732fb696b P 3d5b9823dfcd41cb92bd195c811cbf39: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:39.000341 4176 raft_consensus.cc:2747] T c5a9463f96314a83b7955d80444b1c29 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:31:39.002677 3914 raft_consensus.cc:2802] T 8ee7d6306b5146ed90a1b8392e062172 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:31:39.003207 3914 raft_consensus.cc:695] T 8ee7d6306b5146ed90a1b8392e062172 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 LEADER]: Becoming Leader. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Running, Role: LEADER
I20250625 03:31:39.004040 3914 consensus_queue.cc:237] T 8ee7d6306b5146ed90a1b8392e062172 P 3d5b9823dfcd41cb92bd195c811cbf39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:39.006263 4013 consensus_queue.cc:237] T caea215a97a344e88348ecb21035902d P 841018313ad649679de64e006582f4c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:39.023038 3535 catalog_manager.cc:5582] T e7d3871088394a3ba7a6d18baae1feba P 01873d289e0b4f9f9184b251369502a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 01873d289e0b4f9f9184b251369502a9 (127.0.106.129). New cstate: current_term: 1 leader_uuid: "01873d289e0b4f9f9184b251369502a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: HEALTHY } } }
I20250625 03:31:39.019799 3910 tablet_bootstrap.cc:492] T 4b38a4199d1d44988233b6d8604d1a96 P ddc0ad67020f45edb3ba9c83cab687a4: Bootstrap starting.
I20250625 03:31:39.028333 3535 catalog_manager.cc:5582] T 0cf94f40d3434a11b3bfec277069c8c5 P 01873d289e0b4f9f9184b251369502a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 01873d289e0b4f9f9184b251369502a9 (127.0.106.129). New cstate: current_term: 1 leader_uuid: "01873d289e0b4f9f9184b251369502a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:39.051162 4182 raft_consensus.cc:491] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:39.051766 4182 raft_consensus.cc:513] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:39.053831 4182 leader_election.cc:290] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 841018313ad649679de64e006582f4c5 (127.0.106.131:39467)
I20250625 03:31:39.057571 3905 tablet_bootstrap.cc:654] T 39880aedaeca464f81d899dc222a35b9 P 841018313ad649679de64e006582f4c5: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:39.065907 3786 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "db241b7e8b2a45f297e0bbd9ba86cdd8" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
W20250625 03:31:39.063984 3754 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.130:42041, user_credentials={real_user=slave}} blocked reactor thread for 80777.7us
I20250625 03:31:39.067456 3906 tablet_bootstrap.cc:492] T 03c46dae805341fdb9ec29725fa182a2 P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
W20250625 03:31:39.069607 3680 leader_election.cc:343] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841018313ad649679de64e006582f4c5 (127.0.106.131:39467): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:39.072714 4011 consensus_queue.cc:1035] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 841018313ad649679de64e006582f4c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:31:39.074523 3636 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "db241b7e8b2a45f297e0bbd9ba86cdd8" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
W20250625 03:31:39.067613 3754 leader_election.cc:343] T 6de9e445ad834b008a2f513fac78dba1 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041): Illegal state: must be running to vote when last-logged opid is not known
W20250625 03:31:39.085649 3680 leader_election.cc:343] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:39.086176 3680 leader_election.cc:304] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39; no voters: 01873d289e0b4f9f9184b251369502a9, 841018313ad649679de64e006582f4c5
I20250625 03:31:39.081346 3754 leader_election.cc:304] T 6de9e445ad834b008a2f513fac78dba1 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841018313ad649679de64e006582f4c5; no voters: 3d5b9823dfcd41cb92bd195c811cbf39, ddc0ad67020f45edb3ba9c83cab687a4
I20250625 03:31:39.087788 3951 raft_consensus.cc:2747] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:31:39.088161 4200 raft_consensus.cc:2747] T 6de9e445ad834b008a2f513fac78dba1 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:31:39.105712 3910 tablet_bootstrap.cc:654] T 4b38a4199d1d44988233b6d8604d1a96 P ddc0ad67020f45edb3ba9c83cab687a4: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:39.105970 3906 tablet_bootstrap.cc:654] T 03c46dae805341fdb9ec29725fa182a2 P 01873d289e0b4f9f9184b251369502a9: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:39.108518 4013 consensus_queue.cc:1035] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 841018313ad649679de64e006582f4c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20250625 03:31:39.112658 3534 catalog_manager.cc:5582] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 841018313ad649679de64e006582f4c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 841018313ad649679de64e006582f4c5 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "841018313ad649679de64e006582f4c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:39.142251 3909 tablet_bootstrap.cc:492] T 41d33fbc861a40338ae6da1732fb696b P 3d5b9823dfcd41cb92bd195c811cbf39: No bootstrap required, opened a new log
I20250625 03:31:39.142846 3909 ts_tablet_manager.cc:1397] T 41d33fbc861a40338ae6da1732fb696b P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent bootstrapping tablet: real 0.177s user 0.021s sys 0.010s
I20250625 03:31:39.145283 3905 tablet_bootstrap.cc:492] T 39880aedaeca464f81d899dc222a35b9 P 841018313ad649679de64e006582f4c5: No bootstrap required, opened a new log
I20250625 03:31:39.145792 3905 ts_tablet_manager.cc:1397] T 39880aedaeca464f81d899dc222a35b9 P 841018313ad649679de64e006582f4c5: Time spent bootstrapping tablet: real 0.153s user 0.020s sys 0.001s
I20250625 03:31:39.148455 3905 raft_consensus.cc:357] T 39880aedaeca464f81d899dc222a35b9 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:39.149132 3905 raft_consensus.cc:383] T 39880aedaeca464f81d899dc222a35b9 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:39.149431 3905 raft_consensus.cc:738] T 39880aedaeca464f81d899dc222a35b9 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841018313ad649679de64e006582f4c5, State: Initialized, Role: FOLLOWER
I20250625 03:31:39.159399 3909 raft_consensus.cc:357] T 41d33fbc861a40338ae6da1732fb696b P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:39.160254 3909 raft_consensus.cc:383] T 41d33fbc861a40338ae6da1732fb696b P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:39.152201 3905 consensus_queue.cc:260] T 39880aedaeca464f81d899dc222a35b9 P 841018313ad649679de64e006582f4c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:39.160529 3909 raft_consensus.cc:738] T 41d33fbc861a40338ae6da1732fb696b P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Initialized, Role: FOLLOWER
I20250625 03:31:39.161191 3909 consensus_queue.cc:260] T 41d33fbc861a40338ae6da1732fb696b P 3d5b9823dfcd41cb92bd195c811cbf39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:39.161604 3905 ts_tablet_manager.cc:1428] T 39880aedaeca464f81d899dc222a35b9 P 841018313ad649679de64e006582f4c5: Time spent starting tablet: real 0.016s user 0.006s sys 0.000s
I20250625 03:31:39.162787 3905 tablet_bootstrap.cc:492] T 162ddcc09f594ed7bcb752f842b6c97c P 841018313ad649679de64e006582f4c5: Bootstrap starting.
I20250625 03:31:39.165042 3909 ts_tablet_manager.cc:1428] T 41d33fbc861a40338ae6da1732fb696b P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent starting tablet: real 0.022s user 0.006s sys 0.000s
I20250625 03:31:39.166083 3909 tablet_bootstrap.cc:492] T c5a9463f96314a83b7955d80444b1c29 P 3d5b9823dfcd41cb92bd195c811cbf39: Bootstrap starting.
I20250625 03:31:39.168541 3910 tablet_bootstrap.cc:492] T 4b38a4199d1d44988233b6d8604d1a96 P ddc0ad67020f45edb3ba9c83cab687a4: No bootstrap required, opened a new log
I20250625 03:31:39.169543 3905 tablet_bootstrap.cc:654] T 162ddcc09f594ed7bcb752f842b6c97c P 841018313ad649679de64e006582f4c5: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:39.169291 3910 ts_tablet_manager.cc:1397] T 4b38a4199d1d44988233b6d8604d1a96 P ddc0ad67020f45edb3ba9c83cab687a4: Time spent bootstrapping tablet: real 0.150s user 0.021s sys 0.018s
I20250625 03:31:39.175922 3910 raft_consensus.cc:357] T 4b38a4199d1d44988233b6d8604d1a96 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:39.176949 3910 raft_consensus.cc:383] T 4b38a4199d1d44988233b6d8604d1a96 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:39.177349 3910 raft_consensus.cc:738] T 4b38a4199d1d44988233b6d8604d1a96 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Initialized, Role: FOLLOWER
I20250625 03:31:39.178249 3910 consensus_queue.cc:260] T 4b38a4199d1d44988233b6d8604d1a96 P ddc0ad67020f45edb3ba9c83cab687a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:39.178580 4130 consensus_queue.cc:1035] T 036dfe9e6b844fc6964b3b5e371f8c95 P ddc0ad67020f45edb3ba9c83cab687a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:31:39.189245 3906 tablet_bootstrap.cc:492] T 03c46dae805341fdb9ec29725fa182a2 P 01873d289e0b4f9f9184b251369502a9: No bootstrap required, opened a new log
I20250625 03:31:39.189888 3906 ts_tablet_manager.cc:1397] T 03c46dae805341fdb9ec29725fa182a2 P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.123s user 0.012s sys 0.010s
I20250625 03:31:39.197263 3975 raft_consensus.cc:491] T 4b38a4199d1d44988233b6d8604d1a96 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:39.198019 3975 raft_consensus.cc:513] T 4b38a4199d1d44988233b6d8604d1a96 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:39.194067 3906 raft_consensus.cc:357] T 03c46dae805341fdb9ec29725fa182a2 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:39.203966 3906 raft_consensus.cc:383] T 03c46dae805341fdb9ec29725fa182a2 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:39.204499 3906 raft_consensus.cc:738] T 03c46dae805341fdb9ec29725fa182a2 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:39.206452 3909 tablet_bootstrap.cc:654] T c5a9463f96314a83b7955d80444b1c29 P 3d5b9823dfcd41cb92bd195c811cbf39: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:39.207687 3906 consensus_queue.cc:260] T 03c46dae805341fdb9ec29725fa182a2 P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:39.210373 3975 leader_election.cc:290] T 4b38a4199d1d44988233b6d8604d1a96 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:31:39.210615 3636 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4b38a4199d1d44988233b6d8604d1a96" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:39.211469 3910 ts_tablet_manager.cc:1428] T 4b38a4199d1d44988233b6d8604d1a96 P ddc0ad67020f45edb3ba9c83cab687a4: Time spent starting tablet: real 0.041s user 0.010s sys 0.000s
I20250625 03:31:39.212909 3910 tablet_bootstrap.cc:492] T 28cf5da85c864698894ed4e1ee38cd86 P ddc0ad67020f45edb3ba9c83cab687a4: Bootstrap starting.
W20250625 03:31:39.215029 3828 leader_election.cc:343] T 4b38a4199d1d44988233b6d8604d1a96 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:39.212743 3713 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4b38a4199d1d44988233b6d8604d1a96" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" is_pre_election: true
I20250625 03:31:39.217757 3713 raft_consensus.cc:2466] T 4b38a4199d1d44988233b6d8604d1a96 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddc0ad67020f45edb3ba9c83cab687a4 in term 0.
I20250625 03:31:39.222502 3828 leader_election.cc:304] T 4b38a4199d1d44988233b6d8604d1a96 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, ddc0ad67020f45edb3ba9c83cab687a4; no voters: 01873d289e0b4f9f9184b251369502a9
I20250625 03:31:39.223286 3975 raft_consensus.cc:2802] T 4b38a4199d1d44988233b6d8604d1a96 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:31:39.223661 3975 raft_consensus.cc:491] T 4b38a4199d1d44988233b6d8604d1a96 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:31:39.224118 3975 raft_consensus.cc:3058] T 4b38a4199d1d44988233b6d8604d1a96 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:39.226784 3906 ts_tablet_manager.cc:1428] T 03c46dae805341fdb9ec29725fa182a2 P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.037s user 0.004s sys 0.009s
I20250625 03:31:39.236347 3906 tablet_bootstrap.cc:492] T 5350a260b3364354b73176e6bdd77940 P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:39.238444 3786 raft_consensus.cc:3058] T 0cf94f40d3434a11b3bfec277069c8c5 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:39.240404 3905 tablet_bootstrap.cc:492] T 162ddcc09f594ed7bcb752f842b6c97c P 841018313ad649679de64e006582f4c5: No bootstrap required, opened a new log
I20250625 03:31:39.245249 3905 ts_tablet_manager.cc:1397] T 162ddcc09f594ed7bcb752f842b6c97c P 841018313ad649679de64e006582f4c5: Time spent bootstrapping tablet: real 0.083s user 0.018s sys 0.018s
I20250625 03:31:39.241495 4172 consensus_queue.cc:1035] T e7d3871088394a3ba7a6d18baae1feba P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:31:39.253912 3906 tablet_bootstrap.cc:654] T 5350a260b3364354b73176e6bdd77940 P 01873d289e0b4f9f9184b251369502a9: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:39.239632 3536 catalog_manager.cc:5582] T 8ee7d6306b5146ed90a1b8392e062172 P 3d5b9823dfcd41cb92bd195c811cbf39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: HEALTHY } } }
I20250625 03:31:39.258023 3905 raft_consensus.cc:357] T 162ddcc09f594ed7bcb752f842b6c97c P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:39.258787 3905 raft_consensus.cc:383] T 162ddcc09f594ed7bcb752f842b6c97c P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:39.258975 3909 tablet_bootstrap.cc:492] T c5a9463f96314a83b7955d80444b1c29 P 3d5b9823dfcd41cb92bd195c811cbf39: No bootstrap required, opened a new log
I20250625 03:31:39.259076 3905 raft_consensus.cc:738] T 162ddcc09f594ed7bcb752f842b6c97c P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841018313ad649679de64e006582f4c5, State: Initialized, Role: FOLLOWER
I20250625 03:31:39.259769 3909 ts_tablet_manager.cc:1397] T c5a9463f96314a83b7955d80444b1c29 P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent bootstrapping tablet: real 0.094s user 0.008s sys 0.004s
I20250625 03:31:39.260119 3905 consensus_queue.cc:260] T 162ddcc09f594ed7bcb752f842b6c97c P 841018313ad649679de64e006582f4c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:39.262367 3905 ts_tablet_manager.cc:1428] T 162ddcc09f594ed7bcb752f842b6c97c P 841018313ad649679de64e006582f4c5: Time spent starting tablet: real 0.017s user 0.005s sys 0.000s
I20250625 03:31:39.259209 3932 consensus_queue.cc:1035] T 036dfe9e6b844fc6964b3b5e371f8c95 P ddc0ad67020f45edb3ba9c83cab687a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20250625 03:31:39.261503 3975 raft_consensus.cc:513] T 4b38a4199d1d44988233b6d8604d1a96 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:39.268752 4172 consensus_queue.cc:1035] T 0cf94f40d3434a11b3bfec277069c8c5 P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:31:39.269685 3975 leader_election.cc:290] T 4b38a4199d1d44988233b6d8604d1a96 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 election: Requested vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:31:39.273372 3639 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4b38a4199d1d44988233b6d8604d1a96" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9"
I20250625 03:31:39.275493 3714 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4b38a4199d1d44988233b6d8604d1a96" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
I20250625 03:31:39.276434 3714 raft_consensus.cc:3058] T 4b38a4199d1d44988233b6d8604d1a96 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Advancing to term 1
W20250625 03:31:39.281706 3828 leader_election.cc:343] T 4b38a4199d1d44988233b6d8604d1a96 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:39.285645 3910 tablet_bootstrap.cc:654] T 28cf5da85c864698894ed4e1ee38cd86 P ddc0ad67020f45edb3ba9c83cab687a4: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:39.275628 3535 catalog_manager.cc:5582] T caea215a97a344e88348ecb21035902d P 841018313ad649679de64e006582f4c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 841018313ad649679de64e006582f4c5 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "841018313ad649679de64e006582f4c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:39.325609 3639 raft_consensus.cc:3058] T 03c46dae805341fdb9ec29725fa182a2 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:39.288277 3909 raft_consensus.cc:357] T c5a9463f96314a83b7955d80444b1c29 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:39.299408 3932 raft_consensus.cc:491] T caea215a97a344e88348ecb21035902d P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:39.326498 3909 raft_consensus.cc:383] T c5a9463f96314a83b7955d80444b1c29 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:39.326846 3909 raft_consensus.cc:738] T c5a9463f96314a83b7955d80444b1c29 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Initialized, Role: FOLLOWER
I20250625 03:31:39.326676 3932 raft_consensus.cc:513] T caea215a97a344e88348ecb21035902d P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:39.300545 3714 raft_consensus.cc:2466] T 4b38a4199d1d44988233b6d8604d1a96 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddc0ad67020f45edb3ba9c83cab687a4 in term 1.
I20250625 03:31:39.310649 4172 consensus_queue.cc:1035] T e7d3871088394a3ba7a6d18baae1feba P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:31:39.327726 3909 consensus_queue.cc:260] T c5a9463f96314a83b7955d80444b1c29 P 3d5b9823dfcd41cb92bd195c811cbf39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:39.332547 3828 leader_election.cc:304] T 4b38a4199d1d44988233b6d8604d1a96 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, ddc0ad67020f45edb3ba9c83cab687a4; no voters: 01873d289e0b4f9f9184b251369502a9
I20250625 03:31:39.334282 4110 raft_consensus.cc:2802] T 4b38a4199d1d44988233b6d8604d1a96 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:31:39.334785 4110 raft_consensus.cc:695] T 4b38a4199d1d44988233b6d8604d1a96 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 LEADER]: Becoming Leader. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Running, Role: LEADER
I20250625 03:31:39.335601 4110 consensus_queue.cc:237] T 4b38a4199d1d44988233b6d8604d1a96 P ddc0ad67020f45edb3ba9c83cab687a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:39.336750 3932 leader_election.cc:290] T caea215a97a344e88348ecb21035902d P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041), 841018313ad649679de64e006582f4c5 (127.0.106.131:39467)
I20250625 03:31:39.313030 4115 consensus_queue.cc:1035] T 0cf94f40d3434a11b3bfec277069c8c5 P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:31:39.339636 4130 consensus_queue.cc:1035] T 03c46dae805341fdb9ec29725fa182a2 P ddc0ad67020f45edb3ba9c83cab687a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:31:39.339821 3714 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "caea215a97a344e88348ecb21035902d" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" is_pre_election: true
I20250625 03:31:39.340684 3714 raft_consensus.cc:2391] T caea215a97a344e88348ecb21035902d P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddc0ad67020f45edb3ba9c83cab687a4 in current term 1: Already voted for candidate 841018313ad649679de64e006582f4c5 in this term.
I20250625 03:31:39.339082 3906 tablet_bootstrap.cc:492] T 5350a260b3364354b73176e6bdd77940 P 01873d289e0b4f9f9184b251369502a9: No bootstrap required, opened a new log
I20250625 03:31:39.341557 3906 ts_tablet_manager.cc:1397] T 5350a260b3364354b73176e6bdd77940 P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.105s user 0.009s sys 0.023s
I20250625 03:31:39.346046 3786 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "caea215a97a344e88348ecb21035902d" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:31:39.347123 3906 raft_consensus.cc:357] T 5350a260b3364354b73176e6bdd77940 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:39.349234 3906 raft_consensus.cc:383] T 5350a260b3364354b73176e6bdd77940 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:39.349536 3906 raft_consensus.cc:738] T 5350a260b3364354b73176e6bdd77940 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:39.349817 3828 leader_election.cc:304] T caea215a97a344e88348ecb21035902d P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddc0ad67020f45edb3ba9c83cab687a4; no voters: 3d5b9823dfcd41cb92bd195c811cbf39, 841018313ad649679de64e006582f4c5
I20250625 03:31:39.351361 4130 raft_consensus.cc:3058] T caea215a97a344e88348ecb21035902d P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:39.310704 3905 tablet_bootstrap.cc:492] T ea706d649de940bf8652264ed57a901f P 841018313ad649679de64e006582f4c5: Bootstrap starting.
I20250625 03:31:39.354418 3906 consensus_queue.cc:260] T 5350a260b3364354b73176e6bdd77940 P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:39.354900 3537 catalog_manager.cc:5582] T 03c46dae805341fdb9ec29725fa182a2 P ddc0ad67020f45edb3ba9c83cab687a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132). New cstate: current_term: 1 leader_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:39.381145 3537 catalog_manager.cc:5582] T 036dfe9e6b844fc6964b3b5e371f8c95 P ddc0ad67020f45edb3ba9c83cab687a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132). New cstate: current_term: 1 leader_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:39.403457 3905 tablet_bootstrap.cc:654] T ea706d649de940bf8652264ed57a901f P 841018313ad649679de64e006582f4c5: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:39.401976 3914 raft_consensus.cc:491] T 41d33fbc861a40338ae6da1732fb696b P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:39.405292 3914 raft_consensus.cc:513] T 41d33fbc861a40338ae6da1732fb696b P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:39.409070 3784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "41d33fbc861a40338ae6da1732fb696b" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:31:39.412606 3914 leader_election.cc:290] T 41d33fbc861a40338ae6da1732fb696b P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353)
W20250625 03:31:39.417555 3680 leader_election.cc:343] T 41d33fbc861a40338ae6da1732fb696b P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841018313ad649679de64e006582f4c5 (127.0.106.131:39467): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:39.443707 3906 ts_tablet_manager.cc:1428] T 5350a260b3364354b73176e6bdd77940 P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.102s user 0.005s sys 0.002s
I20250625 03:31:39.447815 3909 ts_tablet_manager.cc:1428] T c5a9463f96314a83b7955d80444b1c29 P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent starting tablet: real 0.188s user 0.007s sys 0.000s
I20250625 03:31:39.464540 3910 tablet_bootstrap.cc:492] T 28cf5da85c864698894ed4e1ee38cd86 P ddc0ad67020f45edb3ba9c83cab687a4: No bootstrap required, opened a new log
I20250625 03:31:39.465345 3910 ts_tablet_manager.cc:1397] T 28cf5da85c864698894ed4e1ee38cd86 P ddc0ad67020f45edb3ba9c83cab687a4: Time spent bootstrapping tablet: real 0.253s user 0.058s sys 0.034s
I20250625 03:31:39.459852 3861 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "41d33fbc861a40338ae6da1732fb696b" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:39.458329 4130 raft_consensus.cc:2747] T caea215a97a344e88348ecb21035902d P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:31:39.469331 3910 raft_consensus.cc:357] T 28cf5da85c864698894ed4e1ee38cd86 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:39.470037 3910 raft_consensus.cc:383] T 28cf5da85c864698894ed4e1ee38cd86 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:39.470327 3910 raft_consensus.cc:738] T 28cf5da85c864698894ed4e1ee38cd86 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Initialized, Role: FOLLOWER
W20250625 03:31:39.477078 3679 leader_election.cc:343] T 41d33fbc861a40338ae6da1732fb696b P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:39.477640 3679 leader_election.cc:304] T 41d33fbc861a40338ae6da1732fb696b P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39; no voters: 841018313ad649679de64e006582f4c5, ddc0ad67020f45edb3ba9c83cab687a4
I20250625 03:31:39.478842 3951 raft_consensus.cc:2747] T 41d33fbc861a40338ae6da1732fb696b P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:31:39.471052 3910 consensus_queue.cc:260] T 28cf5da85c864698894ed4e1ee38cd86 P ddc0ad67020f45edb3ba9c83cab687a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:39.483952 3906 tablet_bootstrap.cc:492] T 6a179f065ae046df819a9bd88194dae6 P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:39.487375 4200 consensus_queue.cc:1035] T caea215a97a344e88348ecb21035902d P 841018313ad649679de64e006582f4c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:31:39.486574 3909 tablet_bootstrap.cc:492] T 6de9e445ad834b008a2f513fac78dba1 P 3d5b9823dfcd41cb92bd195c811cbf39: Bootstrap starting.
I20250625 03:31:39.497795 3906 tablet_bootstrap.cc:654] T 6a179f065ae046df819a9bd88194dae6 P 01873d289e0b4f9f9184b251369502a9: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:39.497552 3534 catalog_manager.cc:5582] T 4b38a4199d1d44988233b6d8604d1a96 P ddc0ad67020f45edb3ba9c83cab687a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132). New cstate: current_term: 1 leader_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:39.509140 3909 tablet_bootstrap.cc:654] T 6de9e445ad834b008a2f513fac78dba1 P 3d5b9823dfcd41cb92bd195c811cbf39: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:39.513803 3910 ts_tablet_manager.cc:1428] T 28cf5da85c864698894ed4e1ee38cd86 P ddc0ad67020f45edb3ba9c83cab687a4: Time spent starting tablet: real 0.048s user 0.006s sys 0.000s
I20250625 03:31:39.514989 3910 tablet_bootstrap.cc:492] T ea706d649de940bf8652264ed57a901f P ddc0ad67020f45edb3ba9c83cab687a4: Bootstrap starting.
I20250625 03:31:39.522403 3975 consensus_queue.cc:1035] T 03c46dae805341fdb9ec29725fa182a2 P ddc0ad67020f45edb3ba9c83cab687a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20250625 03:31:39.532091 3914 consensus_queue.cc:1035] T 8ee7d6306b5146ed90a1b8392e062172 P 3d5b9823dfcd41cb92bd195c811cbf39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:31:39.534962 3909 tablet_bootstrap.cc:492] T 6de9e445ad834b008a2f513fac78dba1 P 3d5b9823dfcd41cb92bd195c811cbf39: No bootstrap required, opened a new log
I20250625 03:31:39.535516 3909 ts_tablet_manager.cc:1397] T 6de9e445ad834b008a2f513fac78dba1 P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent bootstrapping tablet: real 0.052s user 0.008s sys 0.006s
I20250625 03:31:39.536183 3906 tablet_bootstrap.cc:492] T 6a179f065ae046df819a9bd88194dae6 P 01873d289e0b4f9f9184b251369502a9: No bootstrap required, opened a new log
I20250625 03:31:39.537518 3906 ts_tablet_manager.cc:1397] T 6a179f065ae046df819a9bd88194dae6 P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.067s user 0.021s sys 0.006s
I20250625 03:31:39.529307 4130 raft_consensus.cc:491] T 28cf5da85c864698894ed4e1ee38cd86 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:39.543282 3910 tablet_bootstrap.cc:654] T ea706d649de940bf8652264ed57a901f P ddc0ad67020f45edb3ba9c83cab687a4: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:39.546798 3905 tablet_bootstrap.cc:492] T ea706d649de940bf8652264ed57a901f P 841018313ad649679de64e006582f4c5: No bootstrap required, opened a new log
I20250625 03:31:39.547394 3905 ts_tablet_manager.cc:1397] T ea706d649de940bf8652264ed57a901f P 841018313ad649679de64e006582f4c5: Time spent bootstrapping tablet: real 0.237s user 0.020s sys 0.014s
I20250625 03:31:39.551430 4079 consensus_queue.cc:1035] T caea215a97a344e88348ecb21035902d P 841018313ad649679de64e006582f4c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:31:39.543265 4130 raft_consensus.cc:513] T 28cf5da85c864698894ed4e1ee38cd86 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:39.552608 4200 raft_consensus.cc:491] T 39880aedaeca464f81d899dc222a35b9 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:39.553144 4200 raft_consensus.cc:513] T 39880aedaeca464f81d899dc222a35b9 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:39.554010 4130 leader_election.cc:290] T 28cf5da85c864698894ed4e1ee38cd86 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:31:39.555231 4200 leader_election.cc:290] T 39880aedaeca464f81d899dc222a35b9 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:31:39.557247 3862 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "39880aedaeca464f81d899dc222a35b9" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:39.557351 3905 raft_consensus.cc:357] T ea706d649de940bf8652264ed57a901f P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:39.558115 3905 raft_consensus.cc:383] T ea706d649de940bf8652264ed57a901f P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:39.557118 3906 raft_consensus.cc:357] T 6a179f065ae046df819a9bd88194dae6 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:39.558516 3906 raft_consensus.cc:383] T 6a179f065ae046df819a9bd88194dae6 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20250625 03:31:39.558784 3753 leader_election.cc:343] T 39880aedaeca464f81d899dc222a35b9 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:39.558862 3905 raft_consensus.cc:738] T ea706d649de940bf8652264ed57a901f P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841018313ad649679de64e006582f4c5, State: Initialized, Role: FOLLOWER
I20250625 03:31:39.558784 3906 raft_consensus.cc:738] T 6a179f065ae046df819a9bd88194dae6 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:39.560336 3906 consensus_queue.cc:260] T 6a179f065ae046df819a9bd88194dae6 P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:39.560914 3905 consensus_queue.cc:260] T ea706d649de940bf8652264ed57a901f P 841018313ad649679de64e006582f4c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:39.562870 3906 ts_tablet_manager.cc:1428] T 6a179f065ae046df819a9bd88194dae6 P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.025s user 0.005s sys 0.002s
I20250625 03:31:39.564106 3906 tablet_bootstrap.cc:492] T 4b38a4199d1d44988233b6d8604d1a96 P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:39.564383 3639 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "39880aedaeca464f81d899dc222a35b9" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:39.558913 3909 raft_consensus.cc:357] T 6de9e445ad834b008a2f513fac78dba1 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:39.566030 3784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "28cf5da85c864698894ed4e1ee38cd86" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:31:39.569727 3909 raft_consensus.cc:383] T 6de9e445ad834b008a2f513fac78dba1 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:39.567356 3910 tablet_bootstrap.cc:492] T ea706d649de940bf8652264ed57a901f P ddc0ad67020f45edb3ba9c83cab687a4: No bootstrap required, opened a new log
I20250625 03:31:39.570055 3909 raft_consensus.cc:738] T 6de9e445ad834b008a2f513fac78dba1 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Initialized, Role: FOLLOWER
I20250625 03:31:39.570103 3784 raft_consensus.cc:2466] T 28cf5da85c864698894ed4e1ee38cd86 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddc0ad67020f45edb3ba9c83cab687a4 in term 0.
I20250625 03:31:39.570487 3910 ts_tablet_manager.cc:1397] T ea706d649de940bf8652264ed57a901f P ddc0ad67020f45edb3ba9c83cab687a4: Time spent bootstrapping tablet: real 0.056s user 0.014s sys 0.001s
I20250625 03:31:39.567258 3638 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "28cf5da85c864698894ed4e1ee38cd86" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:39.570786 3909 consensus_queue.cc:260] T 6de9e445ad834b008a2f513fac78dba1 P 3d5b9823dfcd41cb92bd195c811cbf39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
W20250625 03:31:39.571895 3754 leader_election.cc:343] T 39880aedaeca464f81d899dc222a35b9 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:39.572381 3754 leader_election.cc:304] T 39880aedaeca464f81d899dc222a35b9 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841018313ad649679de64e006582f4c5; no voters: 01873d289e0b4f9f9184b251369502a9, ddc0ad67020f45edb3ba9c83cab687a4
I20250625 03:31:39.573519 4200 raft_consensus.cc:2747] T 39880aedaeca464f81d899dc222a35b9 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:31:39.573179 3909 ts_tablet_manager.cc:1428] T 6de9e445ad834b008a2f513fac78dba1 P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent starting tablet: real 0.037s user 0.005s sys 0.002s
I20250625 03:31:39.568779 3905 ts_tablet_manager.cc:1428] T ea706d649de940bf8652264ed57a901f P 841018313ad649679de64e006582f4c5: Time spent starting tablet: real 0.021s user 0.004s sys 0.004s
W20250625 03:31:39.575222 3828 leader_election.cc:343] T 28cf5da85c864698894ed4e1ee38cd86 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:39.575912 3909 tablet_bootstrap.cc:492] T 049948eeceeb43c98ccda9e839b521a8 P 3d5b9823dfcd41cb92bd195c811cbf39: Bootstrap starting.
I20250625 03:31:39.586038 3914 consensus_queue.cc:1035] T 8ee7d6306b5146ed90a1b8392e062172 P 3d5b9823dfcd41cb92bd195c811cbf39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:31:39.576181 3905 tablet_bootstrap.cc:492] T e91e209dcfdb4fd0bebe666bbbe16b75 P 841018313ad649679de64e006582f4c5: Bootstrap starting.
I20250625 03:31:39.573136 3910 raft_consensus.cc:357] T ea706d649de940bf8652264ed57a901f P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:39.575973 3828 leader_election.cc:304] T 28cf5da85c864698894ed4e1ee38cd86 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841018313ad649679de64e006582f4c5, ddc0ad67020f45edb3ba9c83cab687a4; no voters: 01873d289e0b4f9f9184b251369502a9
I20250625 03:31:39.601263 3975 raft_consensus.cc:2802] T 28cf5da85c864698894ed4e1ee38cd86 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:31:39.601691 3975 raft_consensus.cc:491] T 28cf5da85c864698894ed4e1ee38cd86 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:31:39.602036 3975 raft_consensus.cc:3058] T 28cf5da85c864698894ed4e1ee38cd86 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:39.596084 3910 raft_consensus.cc:383] T ea706d649de940bf8652264ed57a901f P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:39.605672 3910 raft_consensus.cc:738] T ea706d649de940bf8652264ed57a901f P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Initialized, Role: FOLLOWER
I20250625 03:31:39.606392 3910 consensus_queue.cc:260] T ea706d649de940bf8652264ed57a901f P ddc0ad67020f45edb3ba9c83cab687a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:39.614001 3910 ts_tablet_manager.cc:1428] T ea706d649de940bf8652264ed57a901f P ddc0ad67020f45edb3ba9c83cab687a4: Time spent starting tablet: real 0.043s user 0.006s sys 0.000s
I20250625 03:31:39.616318 3910 tablet_bootstrap.cc:492] T 41d33fbc861a40338ae6da1732fb696b P ddc0ad67020f45edb3ba9c83cab687a4: Bootstrap starting.
I20250625 03:31:39.617250 3906 tablet_bootstrap.cc:654] T 4b38a4199d1d44988233b6d8604d1a96 P 01873d289e0b4f9f9184b251369502a9: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:39.618955 4200 raft_consensus.cc:491] T 162ddcc09f594ed7bcb752f842b6c97c P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:39.619639 4200 raft_consensus.cc:513] T 162ddcc09f594ed7bcb752f842b6c97c P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:39.625950 3713 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "162ddcc09f594ed7bcb752f842b6c97c" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" is_pre_election: true
I20250625 03:31:39.624878 4200 leader_election.cc:290] T 162ddcc09f594ed7bcb752f842b6c97c P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041), ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353)
I20250625 03:31:39.626152 3862 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "162ddcc09f594ed7bcb752f842b6c97c" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:39.626718 3713 raft_consensus.cc:2466] T 162ddcc09f594ed7bcb752f842b6c97c P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841018313ad649679de64e006582f4c5 in term 0.
W20250625 03:31:39.627928 3753 leader_election.cc:343] T 162ddcc09f594ed7bcb752f842b6c97c P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:39.601147 3909 tablet_bootstrap.cc:654] T 049948eeceeb43c98ccda9e839b521a8 P 3d5b9823dfcd41cb92bd195c811cbf39: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:39.628540 3754 leader_election.cc:304] T 162ddcc09f594ed7bcb752f842b6c97c P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, 841018313ad649679de64e006582f4c5; no voters: ddc0ad67020f45edb3ba9c83cab687a4
I20250625 03:31:39.630601 4200 raft_consensus.cc:2802] T 162ddcc09f594ed7bcb752f842b6c97c P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:31:39.631760 3905 tablet_bootstrap.cc:654] T e91e209dcfdb4fd0bebe666bbbe16b75 P 841018313ad649679de64e006582f4c5: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:39.626370 3975 raft_consensus.cc:513] T 28cf5da85c864698894ed4e1ee38cd86 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:39.640206 3975 leader_election.cc:290] T 28cf5da85c864698894ed4e1ee38cd86 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 election: Requested vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:31:39.642103 3909 tablet_bootstrap.cc:492] T 049948eeceeb43c98ccda9e839b521a8 P 3d5b9823dfcd41cb92bd195c811cbf39: No bootstrap required, opened a new log
I20250625 03:31:39.642633 3909 ts_tablet_manager.cc:1397] T 049948eeceeb43c98ccda9e839b521a8 P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent bootstrapping tablet: real 0.068s user 0.009s sys 0.001s
I20250625 03:31:39.643107 3905 tablet_bootstrap.cc:492] T e91e209dcfdb4fd0bebe666bbbe16b75 P 841018313ad649679de64e006582f4c5: No bootstrap required, opened a new log
I20250625 03:31:39.645051 3788 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "28cf5da85c864698894ed4e1ee38cd86" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5"
I20250625 03:31:39.645726 3788 raft_consensus.cc:3058] T 28cf5da85c864698894ed4e1ee38cd86 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:39.646584 3639 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "28cf5da85c864698894ed4e1ee38cd86" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9"
W20250625 03:31:39.648051 3828 leader_election.cc:343] T 28cf5da85c864698894ed4e1ee38cd86 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:39.631081 4200 raft_consensus.cc:491] T 162ddcc09f594ed7bcb752f842b6c97c P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:31:39.651665 4200 raft_consensus.cc:3058] T 162ddcc09f594ed7bcb752f842b6c97c P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:39.653345 3910 tablet_bootstrap.cc:654] T 41d33fbc861a40338ae6da1732fb696b P ddc0ad67020f45edb3ba9c83cab687a4: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:39.654539 3905 ts_tablet_manager.cc:1397] T e91e209dcfdb4fd0bebe666bbbe16b75 P 841018313ad649679de64e006582f4c5: Time spent bootstrapping tablet: real 0.079s user 0.010s sys 0.003s
I20250625 03:31:39.655766 3788 raft_consensus.cc:2466] T 28cf5da85c864698894ed4e1ee38cd86 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddc0ad67020f45edb3ba9c83cab687a4 in term 1.
I20250625 03:31:39.658340 3828 leader_election.cc:304] T 28cf5da85c864698894ed4e1ee38cd86 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841018313ad649679de64e006582f4c5, ddc0ad67020f45edb3ba9c83cab687a4; no voters: 01873d289e0b4f9f9184b251369502a9
I20250625 03:31:39.656889 3909 raft_consensus.cc:357] T 049948eeceeb43c98ccda9e839b521a8 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:39.659811 3909 raft_consensus.cc:383] T 049948eeceeb43c98ccda9e839b521a8 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:39.660169 3909 raft_consensus.cc:738] T 049948eeceeb43c98ccda9e839b521a8 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Initialized, Role: FOLLOWER
I20250625 03:31:39.660041 4200 raft_consensus.cc:513] T 162ddcc09f594ed7bcb752f842b6c97c P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:39.660471 3905 raft_consensus.cc:357] T e91e209dcfdb4fd0bebe666bbbe16b75 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:39.661296 3905 raft_consensus.cc:383] T e91e209dcfdb4fd0bebe666bbbe16b75 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:39.661630 3905 raft_consensus.cc:738] T e91e209dcfdb4fd0bebe666bbbe16b75 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841018313ad649679de64e006582f4c5, State: Initialized, Role: FOLLOWER
I20250625 03:31:39.661401 3909 consensus_queue.cc:260] T 049948eeceeb43c98ccda9e839b521a8 P 3d5b9823dfcd41cb92bd195c811cbf39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:39.662303 3905 consensus_queue.cc:260] T e91e209dcfdb4fd0bebe666bbbe16b75 P 841018313ad649679de64e006582f4c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:39.662797 3713 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "162ddcc09f594ed7bcb752f842b6c97c" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
I20250625 03:31:39.663411 3713 raft_consensus.cc:3058] T 162ddcc09f594ed7bcb752f842b6c97c P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:39.665172 3975 raft_consensus.cc:2802] T 28cf5da85c864698894ed4e1ee38cd86 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:31:39.665695 3975 raft_consensus.cc:695] T 28cf5da85c864698894ed4e1ee38cd86 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 LEADER]: Becoming Leader. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Running, Role: LEADER
I20250625 03:31:39.666499 3975 consensus_queue.cc:237] T 28cf5da85c864698894ed4e1ee38cd86 P ddc0ad67020f45edb3ba9c83cab687a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:39.668781 3909 ts_tablet_manager.cc:1428] T 049948eeceeb43c98ccda9e839b521a8 P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent starting tablet: real 0.026s user 0.008s sys 0.000s
I20250625 03:31:39.673197 3905 ts_tablet_manager.cc:1428] T e91e209dcfdb4fd0bebe666bbbe16b75 P 841018313ad649679de64e006582f4c5: Time spent starting tablet: real 0.018s user 0.006s sys 0.000s
I20250625 03:31:39.674508 3905 tablet_bootstrap.cc:492] T 41d33fbc861a40338ae6da1732fb696b P 841018313ad649679de64e006582f4c5: Bootstrap starting.
I20250625 03:31:39.670228 3909 tablet_bootstrap.cc:492] T d83c6c79a784452289ba414976adb9e0 P 3d5b9823dfcd41cb92bd195c811cbf39: Bootstrap starting.
I20250625 03:31:39.685927 3906 tablet_bootstrap.cc:492] T 4b38a4199d1d44988233b6d8604d1a96 P 01873d289e0b4f9f9184b251369502a9: No bootstrap required, opened a new log
I20250625 03:31:39.686479 3906 ts_tablet_manager.cc:1397] T 4b38a4199d1d44988233b6d8604d1a96 P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.123s user 0.010s sys 0.005s
I20250625 03:31:39.687605 3996 raft_consensus.cc:491] T 6a179f065ae046df819a9bd88194dae6 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:39.688262 3996 raft_consensus.cc:513] T 6a179f065ae046df819a9bd88194dae6 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:39.689059 3906 raft_consensus.cc:357] T 4b38a4199d1d44988233b6d8604d1a96 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:39.689769 3906 raft_consensus.cc:383] T 4b38a4199d1d44988233b6d8604d1a96 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:39.690222 3996 leader_election.cc:290] T 6a179f065ae046df819a9bd88194dae6 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041), 841018313ad649679de64e006582f4c5 (127.0.106.131:39467)
I20250625 03:31:39.690811 3905 tablet_bootstrap.cc:654] T 41d33fbc861a40338ae6da1732fb696b P 841018313ad649679de64e006582f4c5: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:39.693126 3712 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6a179f065ae046df819a9bd88194dae6" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" is_pre_election: true
I20250625 03:31:39.693857 3712 raft_consensus.cc:2466] T 6a179f065ae046df819a9bd88194dae6 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01873d289e0b4f9f9184b251369502a9 in term 0.
I20250625 03:31:39.693967 3786 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6a179f065ae046df819a9bd88194dae6" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:31:39.695376 3713 raft_consensus.cc:2466] T 162ddcc09f594ed7bcb752f842b6c97c P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841018313ad649679de64e006582f4c5 in term 1.
W20250625 03:31:39.695535 3605 leader_election.cc:343] T 6a179f065ae046df819a9bd88194dae6 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841018313ad649679de64e006582f4c5 (127.0.106.131:39467): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:39.697471 4200 leader_election.cc:290] T 162ddcc09f594ed7bcb752f842b6c97c P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 election: Requested vote from peers 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041), ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353)
I20250625 03:31:39.698561 3754 leader_election.cc:304] T 162ddcc09f594ed7bcb752f842b6c97c P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, 841018313ad649679de64e006582f4c5; no voters:
I20250625 03:31:39.700819 3863 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "162ddcc09f594ed7bcb752f842b6c97c" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4"
W20250625 03:31:39.702106 3753 leader_election.cc:343] T 162ddcc09f594ed7bcb752f842b6c97c P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:39.702350 3909 tablet_bootstrap.cc:654] T d83c6c79a784452289ba414976adb9e0 P 3d5b9823dfcd41cb92bd195c811cbf39: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:39.702870 3605 leader_election.cc:304] T 6a179f065ae046df819a9bd88194dae6 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9, 3d5b9823dfcd41cb92bd195c811cbf39; no voters: 841018313ad649679de64e006582f4c5
I20250625 03:31:39.704052 3996 raft_consensus.cc:2802] T 6a179f065ae046df819a9bd88194dae6 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:31:39.704459 3996 raft_consensus.cc:491] T 6a179f065ae046df819a9bd88194dae6 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:31:39.704794 3996 raft_consensus.cc:3058] T 6a179f065ae046df819a9bd88194dae6 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:39.690040 3906 raft_consensus.cc:738] T 4b38a4199d1d44988233b6d8604d1a96 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:39.705691 3906 consensus_queue.cc:260] T 4b38a4199d1d44988233b6d8604d1a96 P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:39.713047 3996 raft_consensus.cc:513] T 6a179f065ae046df819a9bd88194dae6 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:39.715057 3996 leader_election.cc:290] T 6a179f065ae046df819a9bd88194dae6 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 election: Requested vote from peers 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041), 841018313ad649679de64e006582f4c5 (127.0.106.131:39467)
I20250625 03:31:39.704818 4200 raft_consensus.cc:2802] T 162ddcc09f594ed7bcb752f842b6c97c P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:31:39.716572 3713 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6a179f065ae046df819a9bd88194dae6" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
I20250625 03:31:39.717233 3713 raft_consensus.cc:3058] T 6a179f065ae046df819a9bd88194dae6 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:39.717514 3906 ts_tablet_manager.cc:1428] T 4b38a4199d1d44988233b6d8604d1a96 P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.031s user 0.005s sys 0.000s
I20250625 03:31:39.718602 3906 tablet_bootstrap.cc:492] T c5a9463f96314a83b7955d80444b1c29 P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:39.721756 4200 raft_consensus.cc:695] T 162ddcc09f594ed7bcb752f842b6c97c P 841018313ad649679de64e006582f4c5 [term 1 LEADER]: Becoming Leader. State: Replica: 841018313ad649679de64e006582f4c5, State: Running, Role: LEADER
I20250625 03:31:39.722822 4200 consensus_queue.cc:237] T 162ddcc09f594ed7bcb752f842b6c97c P 841018313ad649679de64e006582f4c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:39.733566 3786 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6a179f065ae046df819a9bd88194dae6" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5"
W20250625 03:31:39.735734 3605 leader_election.cc:343] T 6a179f065ae046df819a9bd88194dae6 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 841018313ad649679de64e006582f4c5 (127.0.106.131:39467): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:39.742255 3909 tablet_bootstrap.cc:492] T d83c6c79a784452289ba414976adb9e0 P 3d5b9823dfcd41cb92bd195c811cbf39: No bootstrap required, opened a new log
I20250625 03:31:39.742832 3909 ts_tablet_manager.cc:1397] T d83c6c79a784452289ba414976adb9e0 P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent bootstrapping tablet: real 0.073s user 0.017s sys 0.000s
I20250625 03:31:39.742283 3713 raft_consensus.cc:2466] T 6a179f065ae046df819a9bd88194dae6 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01873d289e0b4f9f9184b251369502a9 in term 1.
I20250625 03:31:39.747231 3537 catalog_manager.cc:5582] T 28cf5da85c864698894ed4e1ee38cd86 P ddc0ad67020f45edb3ba9c83cab687a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132). New cstate: current_term: 1 leader_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:39.748670 3605 leader_election.cc:304] T 6a179f065ae046df819a9bd88194dae6 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9, 3d5b9823dfcd41cb92bd195c811cbf39; no voters: 841018313ad649679de64e006582f4c5
I20250625 03:31:39.749676 3910 tablet_bootstrap.cc:492] T 41d33fbc861a40338ae6da1732fb696b P ddc0ad67020f45edb3ba9c83cab687a4: No bootstrap required, opened a new log
I20250625 03:31:39.749943 4115 raft_consensus.cc:2802] T 6a179f065ae046df819a9bd88194dae6 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:31:39.750162 3910 ts_tablet_manager.cc:1397] T 41d33fbc861a40338ae6da1732fb696b P ddc0ad67020f45edb3ba9c83cab687a4: Time spent bootstrapping tablet: real 0.134s user 0.004s sys 0.010s
I20250625 03:31:39.754541 3910 raft_consensus.cc:357] T 41d33fbc861a40338ae6da1732fb696b P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:39.755231 3910 raft_consensus.cc:383] T 41d33fbc861a40338ae6da1732fb696b P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:39.755510 3910 raft_consensus.cc:738] T 41d33fbc861a40338ae6da1732fb696b P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Initialized, Role: FOLLOWER
I20250625 03:31:39.756259 3910 consensus_queue.cc:260] T 41d33fbc861a40338ae6da1732fb696b P ddc0ad67020f45edb3ba9c83cab687a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:39.756711 4115 raft_consensus.cc:695] T 6a179f065ae046df819a9bd88194dae6 P 01873d289e0b4f9f9184b251369502a9 [term 1 LEADER]: Becoming Leader. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Running, Role: LEADER
I20250625 03:31:39.747279 3909 raft_consensus.cc:357] T d83c6c79a784452289ba414976adb9e0 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:39.757649 4115 consensus_queue.cc:237] T 6a179f065ae046df819a9bd88194dae6 P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:39.758260 3909 raft_consensus.cc:383] T d83c6c79a784452289ba414976adb9e0 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:39.758580 3910 ts_tablet_manager.cc:1428] T 41d33fbc861a40338ae6da1732fb696b P ddc0ad67020f45edb3ba9c83cab687a4: Time spent starting tablet: real 0.008s user 0.003s sys 0.002s
I20250625 03:31:39.758900 3909 raft_consensus.cc:738] T d83c6c79a784452289ba414976adb9e0 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Initialized, Role: FOLLOWER
I20250625 03:31:39.759691 3910 tablet_bootstrap.cc:492] T 162ddcc09f594ed7bcb752f842b6c97c P ddc0ad67020f45edb3ba9c83cab687a4: Bootstrap starting.
I20250625 03:31:39.759986 3909 consensus_queue.cc:260] T d83c6c79a784452289ba414976adb9e0 P 3d5b9823dfcd41cb92bd195c811cbf39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:39.765734 3909 ts_tablet_manager.cc:1428] T d83c6c79a784452289ba414976adb9e0 P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent starting tablet: real 0.020s user 0.008s sys 0.000s
I20250625 03:31:39.757659 3536 catalog_manager.cc:5582] T 162ddcc09f594ed7bcb752f842b6c97c P 841018313ad649679de64e006582f4c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 841018313ad649679de64e006582f4c5 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "841018313ad649679de64e006582f4c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:39.771088 3910 tablet_bootstrap.cc:654] T 162ddcc09f594ed7bcb752f842b6c97c P ddc0ad67020f45edb3ba9c83cab687a4: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:39.780174 3996 raft_consensus.cc:491] T 5350a260b3364354b73176e6bdd77940 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:39.784094 3914 raft_consensus.cc:491] T d83c6c79a784452289ba414976adb9e0 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:39.784672 3914 raft_consensus.cc:513] T d83c6c79a784452289ba414976adb9e0 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:39.786480 3914 leader_election.cc:290] T d83c6c79a784452289ba414976adb9e0 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:31:39.788908 3638 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d83c6c79a784452289ba414976adb9e0" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:39.789510 3910 tablet_bootstrap.cc:492] T 162ddcc09f594ed7bcb752f842b6c97c P ddc0ad67020f45edb3ba9c83cab687a4: No bootstrap required, opened a new log
I20250625 03:31:39.789996 3910 ts_tablet_manager.cc:1397] T 162ddcc09f594ed7bcb752f842b6c97c P ddc0ad67020f45edb3ba9c83cab687a4: Time spent bootstrapping tablet: real 0.031s user 0.013s sys 0.000s
W20250625 03:31:39.792502 3680 leader_election.cc:343] T d83c6c79a784452289ba414976adb9e0 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:39.792991 3910 raft_consensus.cc:357] T 162ddcc09f594ed7bcb752f842b6c97c P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:39.792883 3863 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d83c6c79a784452289ba414976adb9e0" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:39.793715 3910 raft_consensus.cc:383] T 162ddcc09f594ed7bcb752f842b6c97c P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:39.794059 3910 raft_consensus.cc:738] T 162ddcc09f594ed7bcb752f842b6c97c P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Initialized, Role: FOLLOWER
I20250625 03:31:39.794699 3910 consensus_queue.cc:260] T 162ddcc09f594ed7bcb752f842b6c97c P ddc0ad67020f45edb3ba9c83cab687a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:39.797302 3910 ts_tablet_manager.cc:1428] T 162ddcc09f594ed7bcb752f842b6c97c P ddc0ad67020f45edb3ba9c83cab687a4: Time spent starting tablet: real 0.007s user 0.006s sys 0.001s
I20250625 03:31:39.804236 3909 tablet_bootstrap.cc:492] T aa64717b3f7d4af893e9908260f4520e P 3d5b9823dfcd41cb92bd195c811cbf39: Bootstrap starting.
W20250625 03:31:39.804260 3679 leader_election.cc:343] T d83c6c79a784452289ba414976adb9e0 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:39.805045 3679 leader_election.cc:304] T d83c6c79a784452289ba414976adb9e0 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39; no voters: 01873d289e0b4f9f9184b251369502a9, ddc0ad67020f45edb3ba9c83cab687a4
I20250625 03:31:39.806146 4182 raft_consensus.cc:2747] T d83c6c79a784452289ba414976adb9e0 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:31:39.807317 3638 raft_consensus.cc:3058] T 4b38a4199d1d44988233b6d8604d1a96 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:39.807103 3996 raft_consensus.cc:513] T 5350a260b3364354b73176e6bdd77940 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:39.809787 3863 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5350a260b3364354b73176e6bdd77940" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
W20250625 03:31:39.811581 3604 leader_election.cc:343] T 5350a260b3364354b73176e6bdd77940 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:39.813697 3996 leader_election.cc:290] T 5350a260b3364354b73176e6bdd77940 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:31:39.815227 3713 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5350a260b3364354b73176e6bdd77940" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" is_pre_election: true
I20250625 03:31:39.815943 3713 raft_consensus.cc:2466] T 5350a260b3364354b73176e6bdd77940 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01873d289e0b4f9f9184b251369502a9 in term 0.
I20250625 03:31:39.817159 3605 leader_election.cc:304] T 5350a260b3364354b73176e6bdd77940 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9, 3d5b9823dfcd41cb92bd195c811cbf39; no voters: ddc0ad67020f45edb3ba9c83cab687a4
I20250625 03:31:39.804553 3914 raft_consensus.cc:491] T c5a9463f96314a83b7955d80444b1c29 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:39.821204 3914 raft_consensus.cc:513] T c5a9463f96314a83b7955d80444b1c29 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:39.822729 3910 tablet_bootstrap.cc:492] T 39880aedaeca464f81d899dc222a35b9 P ddc0ad67020f45edb3ba9c83cab687a4: Bootstrap starting.
I20250625 03:31:39.815227 3906 tablet_bootstrap.cc:654] T c5a9463f96314a83b7955d80444b1c29 P 01873d289e0b4f9f9184b251369502a9: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:39.830087 3914 leader_election.cc:290] T c5a9463f96314a83b7955d80444b1c29 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 841018313ad649679de64e006582f4c5 (127.0.106.131:39467)
I20250625 03:31:39.834483 3914 raft_consensus.cc:491] T 049948eeceeb43c98ccda9e839b521a8 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:39.834619 4096 raft_consensus.cc:2802] T 5350a260b3364354b73176e6bdd77940 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:31:39.835142 4096 raft_consensus.cc:491] T 5350a260b3364354b73176e6bdd77940 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:31:39.835070 3914 raft_consensus.cc:513] T 049948eeceeb43c98ccda9e839b521a8 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:39.835666 4096 raft_consensus.cc:3058] T 5350a260b3364354b73176e6bdd77940 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:39.839596 3909 tablet_bootstrap.cc:654] T aa64717b3f7d4af893e9908260f4520e P 3d5b9823dfcd41cb92bd195c811cbf39: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:39.848058 3639 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c5a9463f96314a83b7955d80444b1c29" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:39.848359 3932 consensus_queue.cc:1035] T 4b38a4199d1d44988233b6d8604d1a96 P ddc0ad67020f45edb3ba9c83cab687a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:31:39.849258 3914 leader_election.cc:290] T 049948eeceeb43c98ccda9e839b521a8 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:31:39.849996 3788 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c5a9463f96314a83b7955d80444b1c29" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:31:39.850584 3639 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "049948eeceeb43c98ccda9e839b521a8" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:39.850721 3788 raft_consensus.cc:2466] T c5a9463f96314a83b7955d80444b1c29 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5b9823dfcd41cb92bd195c811cbf39 in term 0.
I20250625 03:31:39.850172 4096 raft_consensus.cc:513] T 5350a260b3364354b73176e6bdd77940 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:39.851352 3905 tablet_bootstrap.cc:492] T 41d33fbc861a40338ae6da1732fb696b P 841018313ad649679de64e006582f4c5: No bootstrap required, opened a new log
I20250625 03:31:39.852505 3863 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "049948eeceeb43c98ccda9e839b521a8" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:39.855188 3905 ts_tablet_manager.cc:1397] T 41d33fbc861a40338ae6da1732fb696b P 841018313ad649679de64e006582f4c5: Time spent bootstrapping tablet: real 0.181s user 0.059s sys 0.054s
I20250625 03:31:39.856108 3862 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5350a260b3364354b73176e6bdd77940" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4"
W20250625 03:31:39.857789 3604 leader_election.cc:343] T 5350a260b3364354b73176e6bdd77940 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:39.856710 4096 leader_election.cc:290] T 5350a260b3364354b73176e6bdd77940 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 election: Requested vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:31:39.859498 3905 raft_consensus.cc:357] T 41d33fbc861a40338ae6da1732fb696b P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:39.860481 3905 raft_consensus.cc:383] T 41d33fbc861a40338ae6da1732fb696b P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:39.860904 3905 raft_consensus.cc:738] T 41d33fbc861a40338ae6da1732fb696b P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841018313ad649679de64e006582f4c5, State: Initialized, Role: FOLLOWER
I20250625 03:31:39.861913 3905 consensus_queue.cc:260] T 41d33fbc861a40338ae6da1732fb696b P 841018313ad649679de64e006582f4c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:39.863575 3713 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5350a260b3364354b73176e6bdd77940" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
I20250625 03:31:39.864791 3713 raft_consensus.cc:3058] T 5350a260b3364354b73176e6bdd77940 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:39.866868 3905 ts_tablet_manager.cc:1428] T 41d33fbc861a40338ae6da1732fb696b P 841018313ad649679de64e006582f4c5: Time spent starting tablet: real 0.011s user 0.003s sys 0.003s
W20250625 03:31:39.862454 3679 leader_election.cc:343] T 049948eeceeb43c98ccda9e839b521a8 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:39.852854 3910 tablet_bootstrap.cc:654] T 39880aedaeca464f81d899dc222a35b9 P ddc0ad67020f45edb3ba9c83cab687a4: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:39.871100 3905 tablet_bootstrap.cc:492] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 841018313ad649679de64e006582f4c5: Bootstrap starting.
I20250625 03:31:39.875535 3713 raft_consensus.cc:2466] T 5350a260b3364354b73176e6bdd77940 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01873d289e0b4f9f9184b251369502a9 in term 1.
I20250625 03:31:39.879575 3905 tablet_bootstrap.cc:654] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 841018313ad649679de64e006582f4c5: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:39.847599 3537 catalog_manager.cc:5582] T 6a179f065ae046df819a9bd88194dae6 P 01873d289e0b4f9f9184b251369502a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 01873d289e0b4f9f9184b251369502a9 (127.0.106.129). New cstate: current_term: 1 leader_uuid: "01873d289e0b4f9f9184b251369502a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: UNKNOWN } } }
W20250625 03:31:39.851922 3680 leader_election.cc:343] T c5a9463f96314a83b7955d80444b1c29 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
W20250625 03:31:39.880973 3680 leader_election.cc:343] T 049948eeceeb43c98ccda9e839b521a8 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:39.881389 3680 leader_election.cc:304] T 049948eeceeb43c98ccda9e839b521a8 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39; no voters: 01873d289e0b4f9f9184b251369502a9, ddc0ad67020f45edb3ba9c83cab687a4
I20250625 03:31:39.885777 3906 tablet_bootstrap.cc:492] T c5a9463f96314a83b7955d80444b1c29 P 01873d289e0b4f9f9184b251369502a9: No bootstrap required, opened a new log
I20250625 03:31:39.886471 3906 ts_tablet_manager.cc:1397] T c5a9463f96314a83b7955d80444b1c29 P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.168s user 0.012s sys 0.008s
I20250625 03:31:39.886960 3914 raft_consensus.cc:2747] T 049948eeceeb43c98ccda9e839b521a8 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:31:39.888495 3605 leader_election.cc:304] T 5350a260b3364354b73176e6bdd77940 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9, 3d5b9823dfcd41cb92bd195c811cbf39; no voters: ddc0ad67020f45edb3ba9c83cab687a4
I20250625 03:31:39.889370 3906 raft_consensus.cc:357] T c5a9463f96314a83b7955d80444b1c29 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:39.890080 3906 raft_consensus.cc:383] T c5a9463f96314a83b7955d80444b1c29 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:39.890197 4096 raft_consensus.cc:2802] T 5350a260b3364354b73176e6bdd77940 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:31:39.891062 4096 raft_consensus.cc:695] T 5350a260b3364354b73176e6bdd77940 P 01873d289e0b4f9f9184b251369502a9 [term 1 LEADER]: Becoming Leader. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Running, Role: LEADER
I20250625 03:31:39.892138 4096 consensus_queue.cc:237] T 5350a260b3364354b73176e6bdd77940 P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:39.890364 3906 raft_consensus.cc:738] T c5a9463f96314a83b7955d80444b1c29 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:39.892690 3680 leader_election.cc:304] T c5a9463f96314a83b7955d80444b1c29 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, 841018313ad649679de64e006582f4c5; no voters: 01873d289e0b4f9f9184b251369502a9
I20250625 03:31:39.894407 3914 raft_consensus.cc:2802] T c5a9463f96314a83b7955d80444b1c29 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:31:39.894780 3914 raft_consensus.cc:491] T c5a9463f96314a83b7955d80444b1c29 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:31:39.895851 3909 tablet_bootstrap.cc:492] T aa64717b3f7d4af893e9908260f4520e P 3d5b9823dfcd41cb92bd195c811cbf39: No bootstrap required, opened a new log
I20250625 03:31:39.896071 3914 raft_consensus.cc:3058] T c5a9463f96314a83b7955d80444b1c29 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:39.896399 3909 ts_tablet_manager.cc:1397] T aa64717b3f7d4af893e9908260f4520e P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent bootstrapping tablet: real 0.093s user 0.014s sys 0.014s
I20250625 03:31:39.896593 3932 consensus_queue.cc:1035] T 4b38a4199d1d44988233b6d8604d1a96 P ddc0ad67020f45edb3ba9c83cab687a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:31:39.899029 3909 raft_consensus.cc:357] T aa64717b3f7d4af893e9908260f4520e P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:39.899718 3909 raft_consensus.cc:383] T aa64717b3f7d4af893e9908260f4520e P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:39.893680 3906 consensus_queue.cc:260] T c5a9463f96314a83b7955d80444b1c29 P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:39.899991 3909 raft_consensus.cc:738] T aa64717b3f7d4af893e9908260f4520e P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Initialized, Role: FOLLOWER
I20250625 03:31:39.902724 3909 consensus_queue.cc:260] T aa64717b3f7d4af893e9908260f4520e P 3d5b9823dfcd41cb92bd195c811cbf39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:39.907429 3906 ts_tablet_manager.cc:1428] T c5a9463f96314a83b7955d80444b1c29 P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.021s user 0.005s sys 0.001s
I20250625 03:31:39.908556 3906 tablet_bootstrap.cc:492] T 28cf5da85c864698894ed4e1ee38cd86 P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:39.905701 3914 raft_consensus.cc:513] T c5a9463f96314a83b7955d80444b1c29 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:39.913537 3638 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c5a9463f96314a83b7955d80444b1c29" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9"
I20250625 03:31:39.914181 3638 raft_consensus.cc:3058] T c5a9463f96314a83b7955d80444b1c29 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:39.916844 3914 leader_election.cc:290] T c5a9463f96314a83b7955d80444b1c29 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 election: Requested vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 841018313ad649679de64e006582f4c5 (127.0.106.131:39467)
I20250625 03:31:39.919734 3788 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c5a9463f96314a83b7955d80444b1c29" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5"
I20250625 03:31:39.920428 3788 raft_consensus.cc:3058] T c5a9463f96314a83b7955d80444b1c29 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:39.924201 3909 ts_tablet_manager.cc:1428] T aa64717b3f7d4af893e9908260f4520e P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent starting tablet: real 0.028s user 0.004s sys 0.003s
I20250625 03:31:39.925415 3906 tablet_bootstrap.cc:654] T 28cf5da85c864698894ed4e1ee38cd86 P 01873d289e0b4f9f9184b251369502a9: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:39.934473 3905 tablet_bootstrap.cc:492] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 841018313ad649679de64e006582f4c5: No bootstrap required, opened a new log
I20250625 03:31:39.934948 3905 ts_tablet_manager.cc:1397] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 841018313ad649679de64e006582f4c5: Time spent bootstrapping tablet: real 0.067s user 0.017s sys 0.009s
I20250625 03:31:39.937448 3905 raft_consensus.cc:357] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:39.938125 3905 raft_consensus.cc:383] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:39.925472 3909 tablet_bootstrap.cc:492] T 6afeedd3b768470f921526d58704c21d P 3d5b9823dfcd41cb92bd195c811cbf39: Bootstrap starting.
I20250625 03:31:39.938649 3788 raft_consensus.cc:2466] T c5a9463f96314a83b7955d80444b1c29 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5b9823dfcd41cb92bd195c811cbf39 in term 1.
I20250625 03:31:39.944653 3914 raft_consensus.cc:491] T 6de9e445ad834b008a2f513fac78dba1 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:39.949447 3914 raft_consensus.cc:513] T 6de9e445ad834b008a2f513fac78dba1 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:39.951373 3914 leader_election.cc:290] T 6de9e445ad834b008a2f513fac78dba1 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353)
I20250625 03:31:39.938400 3905 raft_consensus.cc:738] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841018313ad649679de64e006582f4c5, State: Initialized, Role: FOLLOWER
I20250625 03:31:39.952224 3905 consensus_queue.cc:260] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 841018313ad649679de64e006582f4c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:39.954164 3786 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6de9e445ad834b008a2f513fac78dba1" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:31:39.954556 3905 ts_tablet_manager.cc:1428] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 841018313ad649679de64e006582f4c5: Time spent starting tablet: real 0.019s user 0.007s sys 0.000s
I20250625 03:31:39.954767 3786 raft_consensus.cc:2466] T 6de9e445ad834b008a2f513fac78dba1 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5b9823dfcd41cb92bd195c811cbf39 in term 0.
I20250625 03:31:39.947219 3909 tablet_bootstrap.cc:654] T 6afeedd3b768470f921526d58704c21d P 3d5b9823dfcd41cb92bd195c811cbf39: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:39.956172 3906 tablet_bootstrap.cc:492] T 28cf5da85c864698894ed4e1ee38cd86 P 01873d289e0b4f9f9184b251369502a9: No bootstrap required, opened a new log
I20250625 03:31:39.956656 3680 leader_election.cc:304] T 6de9e445ad834b008a2f513fac78dba1 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, 841018313ad649679de64e006582f4c5; no voters:
I20250625 03:31:39.957934 3862 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6de9e445ad834b008a2f513fac78dba1" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:39.958217 4182 raft_consensus.cc:2802] T 6de9e445ad834b008a2f513fac78dba1 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:31:39.958602 4182 raft_consensus.cc:491] T 6de9e445ad834b008a2f513fac78dba1 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:31:39.958920 4182 raft_consensus.cc:3058] T 6de9e445ad834b008a2f513fac78dba1 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Advancing to term 1
W20250625 03:31:39.959345 3679 leader_election.cc:343] T 6de9e445ad834b008a2f513fac78dba1 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:39.960709 3905 tablet_bootstrap.cc:492] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 841018313ad649679de64e006582f4c5: Bootstrap starting.
I20250625 03:31:39.967147 3905 tablet_bootstrap.cc:654] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 841018313ad649679de64e006582f4c5: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:39.969573 3680 leader_election.cc:304] T c5a9463f96314a83b7955d80444b1c29 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, 841018313ad649679de64e006582f4c5; no voters:
I20250625 03:31:39.970443 3962 raft_consensus.cc:2802] T c5a9463f96314a83b7955d80444b1c29 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:31:39.970938 3962 raft_consensus.cc:695] T c5a9463f96314a83b7955d80444b1c29 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 LEADER]: Becoming Leader. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Running, Role: LEADER
I20250625 03:31:39.971786 3962 consensus_queue.cc:237] T c5a9463f96314a83b7955d80444b1c29 P 3d5b9823dfcd41cb92bd195c811cbf39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:39.972108 4182 raft_consensus.cc:513] T 6de9e445ad834b008a2f513fac78dba1 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:39.974109 4182 leader_election.cc:290] T 6de9e445ad834b008a2f513fac78dba1 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 election: Requested vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353)
I20250625 03:31:39.956665 3906 ts_tablet_manager.cc:1397] T 28cf5da85c864698894ed4e1ee38cd86 P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.048s user 0.008s sys 0.021s
I20250625 03:31:39.975739 3862 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6de9e445ad834b008a2f513fac78dba1" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4"
W20250625 03:31:39.977101 3679 leader_election.cc:343] T 6de9e445ad834b008a2f513fac78dba1 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:39.977183 3906 raft_consensus.cc:357] T 28cf5da85c864698894ed4e1ee38cd86 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:39.977942 3906 raft_consensus.cc:383] T 28cf5da85c864698894ed4e1ee38cd86 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:39.978243 3906 raft_consensus.cc:738] T 28cf5da85c864698894ed4e1ee38cd86 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:39.978868 3906 consensus_queue.cc:260] T 28cf5da85c864698894ed4e1ee38cd86 P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:39.981082 3906 ts_tablet_manager.cc:1428] T 28cf5da85c864698894ed4e1ee38cd86 P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20250625 03:31:39.982201 3906 tablet_bootstrap.cc:492] T ea706d649de940bf8652264ed57a901f P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:39.987298 3788 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6de9e445ad834b008a2f513fac78dba1" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5"
I20250625 03:31:39.987982 3788 raft_consensus.cc:3058] T 6de9e445ad834b008a2f513fac78dba1 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:39.994845 3788 raft_consensus.cc:2466] T 6de9e445ad834b008a2f513fac78dba1 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5b9823dfcd41cb92bd195c811cbf39 in term 1.
I20250625 03:31:39.947070 3638 raft_consensus.cc:2466] T c5a9463f96314a83b7955d80444b1c29 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5b9823dfcd41cb92bd195c811cbf39 in term 1.
I20250625 03:31:39.947530 3910 tablet_bootstrap.cc:492] T 39880aedaeca464f81d899dc222a35b9 P ddc0ad67020f45edb3ba9c83cab687a4: No bootstrap required, opened a new log
I20250625 03:31:39.998885 3910 ts_tablet_manager.cc:1397] T 39880aedaeca464f81d899dc222a35b9 P ddc0ad67020f45edb3ba9c83cab687a4: Time spent bootstrapping tablet: real 0.176s user 0.023s sys 0.023s
I20250625 03:31:40.001101 3906 tablet_bootstrap.cc:654] T ea706d649de940bf8652264ed57a901f P 01873d289e0b4f9f9184b251369502a9: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:40.001710 3910 raft_consensus.cc:357] T 39880aedaeca464f81d899dc222a35b9 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:40.002441 3910 raft_consensus.cc:383] T 39880aedaeca464f81d899dc222a35b9 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:40.002719 3910 raft_consensus.cc:738] T 39880aedaeca464f81d899dc222a35b9 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Initialized, Role: FOLLOWER
I20250625 03:31:40.004084 3910 consensus_queue.cc:260] T 39880aedaeca464f81d899dc222a35b9 P ddc0ad67020f45edb3ba9c83cab687a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:40.006424 3910 ts_tablet_manager.cc:1428] T 39880aedaeca464f81d899dc222a35b9 P ddc0ad67020f45edb3ba9c83cab687a4: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20250625 03:31:40.017155 3910 tablet_bootstrap.cc:492] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P ddc0ad67020f45edb3ba9c83cab687a4: Bootstrap starting.
I20250625 03:31:40.018967 3906 tablet_bootstrap.cc:492] T ea706d649de940bf8652264ed57a901f P 01873d289e0b4f9f9184b251369502a9: No bootstrap required, opened a new log
I20250625 03:31:40.020927 3906 ts_tablet_manager.cc:1397] T ea706d649de940bf8652264ed57a901f P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.039s user 0.011s sys 0.000s
I20250625 03:31:40.019560 3537 catalog_manager.cc:5582] T 5350a260b3364354b73176e6bdd77940 P 01873d289e0b4f9f9184b251369502a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 01873d289e0b4f9f9184b251369502a9 (127.0.106.129). New cstate: current_term: 1 leader_uuid: "01873d289e0b4f9f9184b251369502a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:40.024941 4200 raft_consensus.cc:491] T ea706d649de940bf8652264ed57a901f P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:40.025961 4200 raft_consensus.cc:513] T ea706d649de940bf8652264ed57a901f P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:40.026798 4079 raft_consensus.cc:491] T e91e209dcfdb4fd0bebe666bbbe16b75 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:40.026605 3906 raft_consensus.cc:357] T ea706d649de940bf8652264ed57a901f P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:40.027407 3906 raft_consensus.cc:383] T ea706d649de940bf8652264ed57a901f P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:40.027354 4079 raft_consensus.cc:513] T e91e209dcfdb4fd0bebe666bbbe16b75 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:40.027833 3906 raft_consensus.cc:738] T ea706d649de940bf8652264ed57a901f P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:40.028268 4200 leader_election.cc:290] T ea706d649de940bf8652264ed57a901f P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:31:40.029438 4079 leader_election.cc:290] T e91e209dcfdb4fd0bebe666bbbe16b75 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041), ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353)
I20250625 03:31:40.024780 3910 tablet_bootstrap.cc:654] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P ddc0ad67020f45edb3ba9c83cab687a4: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:40.030426 3638 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ea706d649de940bf8652264ed57a901f" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:40.032052 3863 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e91e209dcfdb4fd0bebe666bbbe16b75" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:40.031879 3906 consensus_queue.cc:260] T ea706d649de940bf8652264ed57a901f P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:40.025285 3909 tablet_bootstrap.cc:492] T 6afeedd3b768470f921526d58704c21d P 3d5b9823dfcd41cb92bd195c811cbf39: No bootstrap required, opened a new log
I20250625 03:31:40.033577 3909 ts_tablet_manager.cc:1397] T 6afeedd3b768470f921526d58704c21d P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent bootstrapping tablet: real 0.108s user 0.017s sys 0.012s
I20250625 03:31:40.033654 3906 ts_tablet_manager.cc:1428] T ea706d649de940bf8652264ed57a901f P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.012s user 0.005s sys 0.000s
I20250625 03:31:40.031991 3712 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e91e209dcfdb4fd0bebe666bbbe16b75" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" is_pre_election: true
I20250625 03:31:40.034806 3638 raft_consensus.cc:2466] T ea706d649de940bf8652264ed57a901f P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841018313ad649679de64e006582f4c5 in term 0.
I20250625 03:31:40.035564 3712 raft_consensus.cc:2466] T e91e209dcfdb4fd0bebe666bbbe16b75 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841018313ad649679de64e006582f4c5 in term 0.
I20250625 03:31:40.036881 3754 leader_election.cc:304] T e91e209dcfdb4fd0bebe666bbbe16b75 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, 841018313ad649679de64e006582f4c5; no voters:
I20250625 03:31:40.037745 3754 leader_election.cc:304] T ea706d649de940bf8652264ed57a901f P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9, 841018313ad649679de64e006582f4c5; no voters:
I20250625 03:31:40.038612 4200 raft_consensus.cc:2802] T e91e209dcfdb4fd0bebe666bbbe16b75 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:31:40.039003 4200 raft_consensus.cc:491] T e91e209dcfdb4fd0bebe666bbbe16b75 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:31:40.039381 4200 raft_consensus.cc:3058] T e91e209dcfdb4fd0bebe666bbbe16b75 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:40.034806 3906 tablet_bootstrap.cc:492] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:40.042270 4079 raft_consensus.cc:2802] T ea706d649de940bf8652264ed57a901f P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:31:40.042737 4079 raft_consensus.cc:491] T ea706d649de940bf8652264ed57a901f P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:31:40.043078 4079 raft_consensus.cc:3058] T ea706d649de940bf8652264ed57a901f P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:40.043766 3862 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ea706d649de940bf8652264ed57a901f" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:40.053018 3680 leader_election.cc:304] T 6de9e445ad834b008a2f513fac78dba1 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, 841018313ad649679de64e006582f4c5; no voters: ddc0ad67020f45edb3ba9c83cab687a4
I20250625 03:31:40.058595 3914 raft_consensus.cc:2802] T 6de9e445ad834b008a2f513fac78dba1 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:31:40.059338 3914 raft_consensus.cc:695] T 6de9e445ad834b008a2f513fac78dba1 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 LEADER]: Becoming Leader. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Running, Role: LEADER
I20250625 03:31:40.060453 3914 consensus_queue.cc:237] T 6de9e445ad834b008a2f513fac78dba1 P 3d5b9823dfcd41cb92bd195c811cbf39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:40.087039 3906 tablet_bootstrap.cc:654] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 01873d289e0b4f9f9184b251369502a9: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:40.111048 3909 raft_consensus.cc:357] T 6afeedd3b768470f921526d58704c21d P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:40.111845 3909 raft_consensus.cc:383] T 6afeedd3b768470f921526d58704c21d P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:40.112174 3909 raft_consensus.cc:738] T 6afeedd3b768470f921526d58704c21d P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Initialized, Role: FOLLOWER
I20250625 03:31:40.055629 3862 raft_consensus.cc:2466] T ea706d649de940bf8652264ed57a901f P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841018313ad649679de64e006582f4c5 in term 0.
I20250625 03:31:40.113201 3909 consensus_queue.cc:260] T 6afeedd3b768470f921526d58704c21d P 3d5b9823dfcd41cb92bd195c811cbf39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:40.119463 3905 tablet_bootstrap.cc:492] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 841018313ad649679de64e006582f4c5: No bootstrap required, opened a new log
I20250625 03:31:40.120038 3905 ts_tablet_manager.cc:1397] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 841018313ad649679de64e006582f4c5: Time spent bootstrapping tablet: real 0.160s user 0.012s sys 0.041s
I20250625 03:31:40.136220 3909 ts_tablet_manager.cc:1428] T 6afeedd3b768470f921526d58704c21d P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent starting tablet: real 0.102s user 0.008s sys 0.001s
I20250625 03:31:40.136507 3910 tablet_bootstrap.cc:492] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P ddc0ad67020f45edb3ba9c83cab687a4: No bootstrap required, opened a new log
I20250625 03:31:40.137082 3910 ts_tablet_manager.cc:1397] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P ddc0ad67020f45edb3ba9c83cab687a4: Time spent bootstrapping tablet: real 0.120s user 0.029s sys 0.024s
I20250625 03:31:40.145772 3905 raft_consensus.cc:357] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:40.146534 3905 raft_consensus.cc:383] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:40.146777 3905 raft_consensus.cc:738] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841018313ad649679de64e006582f4c5, State: Initialized, Role: FOLLOWER
I20250625 03:31:40.128283 3975 raft_consensus.cc:491] T 41d33fbc861a40338ae6da1732fb696b P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:40.150835 3975 raft_consensus.cc:513] T 41d33fbc861a40338ae6da1732fb696b P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:40.152824 3975 leader_election.cc:290] T 41d33fbc861a40338ae6da1732fb696b P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041), 841018313ad649679de64e006582f4c5 (127.0.106.131:39467)
I20250625 03:31:40.158051 3905 consensus_queue.cc:260] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 841018313ad649679de64e006582f4c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:40.159967 3905 ts_tablet_manager.cc:1428] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 841018313ad649679de64e006582f4c5: Time spent starting tablet: real 0.040s user 0.004s sys 0.000s
I20250625 03:31:40.161060 3905 tablet_bootstrap.cc:492] T 6a179f065ae046df819a9bd88194dae6 P 841018313ad649679de64e006582f4c5: Bootstrap starting.
I20250625 03:31:40.162875 4079 raft_consensus.cc:513] T ea706d649de940bf8652264ed57a901f P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:40.168254 3786 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "41d33fbc861a40338ae6da1732fb696b" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:31:40.169023 3786 raft_consensus.cc:2466] T 41d33fbc861a40338ae6da1732fb696b P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddc0ad67020f45edb3ba9c83cab687a4 in term 0.
I20250625 03:31:40.173161 3828 leader_election.cc:304] T 41d33fbc861a40338ae6da1732fb696b P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841018313ad649679de64e006582f4c5, ddc0ad67020f45edb3ba9c83cab687a4; no voters:
I20250625 03:31:40.173957 4110 consensus_queue.cc:1035] T 28cf5da85c864698894ed4e1ee38cd86 P ddc0ad67020f45edb3ba9c83cab687a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:31:40.175720 3932 raft_consensus.cc:2802] T 41d33fbc861a40338ae6da1732fb696b P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:31:40.176229 3932 raft_consensus.cc:491] T 41d33fbc861a40338ae6da1732fb696b P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:31:40.176597 3932 raft_consensus.cc:3058] T 41d33fbc861a40338ae6da1732fb696b P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:40.180083 3909 tablet_bootstrap.cc:492] T 7257f8e1d9b24e3a9650c5838fe1a8c5 P 3d5b9823dfcd41cb92bd195c811cbf39: Bootstrap starting.
I20250625 03:31:40.181087 3910 raft_consensus.cc:357] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:40.181794 3910 raft_consensus.cc:383] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:40.182058 3910 raft_consensus.cc:738] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Initialized, Role: FOLLOWER
I20250625 03:31:40.182780 3910 consensus_queue.cc:260] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P ddc0ad67020f45edb3ba9c83cab687a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:40.183255 3713 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "41d33fbc861a40338ae6da1732fb696b" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" is_pre_election: true
I20250625 03:31:40.183904 3713 raft_consensus.cc:2466] T 41d33fbc861a40338ae6da1732fb696b P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddc0ad67020f45edb3ba9c83cab687a4 in term 0.
I20250625 03:31:40.180163 4200 raft_consensus.cc:513] T e91e209dcfdb4fd0bebe666bbbe16b75 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:40.212157 4079 leader_election.cc:290] T ea706d649de940bf8652264ed57a901f P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 election: Requested vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:31:40.216221 4200 leader_election.cc:290] T e91e209dcfdb4fd0bebe666bbbe16b75 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 election: Requested vote from peers 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041), ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353)
W20250625 03:31:40.199760 3753 leader_election.cc:343] T e91e209dcfdb4fd0bebe666bbbe16b75 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353): Illegal state: must be running to vote when last-logged opid is not known
W20250625 03:31:40.220811 3753 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.132:37353, user_credentials={real_user=slave}} blocked reactor thread for 78341.3us
I20250625 03:31:40.220613 3536 catalog_manager.cc:5582] T c5a9463f96314a83b7955d80444b1c29 P 3d5b9823dfcd41cb92bd195c811cbf39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:40.222707 3910 ts_tablet_manager.cc:1428] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P ddc0ad67020f45edb3ba9c83cab687a4: Time spent starting tablet: real 0.085s user 0.008s sys 0.000s
I20250625 03:31:40.223827 3910 tablet_bootstrap.cc:492] T 049948eeceeb43c98ccda9e839b521a8 P ddc0ad67020f45edb3ba9c83cab687a4: Bootstrap starting.
I20250625 03:31:40.227689 3713 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e91e209dcfdb4fd0bebe666bbbe16b75" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
I20250625 03:31:40.233052 3713 raft_consensus.cc:3058] T e91e209dcfdb4fd0bebe666bbbe16b75 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:40.234715 4259 consensus_queue.cc:1035] T 162ddcc09f594ed7bcb752f842b6c97c P 841018313ad649679de64e006582f4c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:31:40.229272 4110 raft_consensus.cc:491] T 162ddcc09f594ed7bcb752f842b6c97c P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:40.235827 4110 raft_consensus.cc:513] T 162ddcc09f594ed7bcb752f842b6c97c P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:40.238055 4110 leader_election.cc:290] T 162ddcc09f594ed7bcb752f842b6c97c P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041), 841018313ad649679de64e006582f4c5 (127.0.106.131:39467)
I20250625 03:31:40.229370 4130 raft_consensus.cc:491] T 39880aedaeca464f81d899dc222a35b9 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:40.238960 4130 raft_consensus.cc:513] T 39880aedaeca464f81d899dc222a35b9 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:40.241060 4130 leader_election.cc:290] T 39880aedaeca464f81d899dc222a35b9 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:31:40.241925 3638 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ea706d649de940bf8652264ed57a901f" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9"
I20250625 03:31:40.242661 3638 raft_consensus.cc:3058] T ea706d649de940bf8652264ed57a901f P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:40.246774 3861 raft_consensus.cc:3058] T 162ddcc09f594ed7bcb752f842b6c97c P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:40.249953 3909 tablet_bootstrap.cc:654] T 7257f8e1d9b24e3a9650c5838fe1a8c5 P 3d5b9823dfcd41cb92bd195c811cbf39: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:40.255518 3859 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ea706d649de940bf8652264ed57a901f" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4"
I20250625 03:31:40.256254 3859 raft_consensus.cc:3058] T ea706d649de940bf8652264ed57a901f P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:40.258462 3905 tablet_bootstrap.cc:654] T 6a179f065ae046df819a9bd88194dae6 P 841018313ad649679de64e006582f4c5: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:40.260953 3715 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "162ddcc09f594ed7bcb752f842b6c97c" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" is_pre_election: true
I20250625 03:31:40.261456 3860 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e91e209dcfdb4fd0bebe666bbbe16b75" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4"
W20250625 03:31:40.264540 3753 leader_election.cc:343] T e91e209dcfdb4fd0bebe666bbbe16b75 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:40.268131 3909 tablet_bootstrap.cc:492] T 7257f8e1d9b24e3a9650c5838fe1a8c5 P 3d5b9823dfcd41cb92bd195c811cbf39: No bootstrap required, opened a new log
I20250625 03:31:40.268074 4115 consensus_queue.cc:1035] T 6a179f065ae046df819a9bd88194dae6 P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:31:40.268769 3909 ts_tablet_manager.cc:1397] T 7257f8e1d9b24e3a9650c5838fe1a8c5 P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent bootstrapping tablet: real 0.089s user 0.016s sys 0.000s
I20250625 03:31:40.271499 3909 raft_consensus.cc:357] T 7257f8e1d9b24e3a9650c5838fe1a8c5 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:40.272193 3909 raft_consensus.cc:383] T 7257f8e1d9b24e3a9650c5838fe1a8c5 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:40.272495 3909 raft_consensus.cc:738] T 7257f8e1d9b24e3a9650c5838fe1a8c5 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Initialized, Role: FOLLOWER
I20250625 03:31:40.272706 3784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "39880aedaeca464f81d899dc222a35b9" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:31:40.273020 3788 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "162ddcc09f594ed7bcb752f842b6c97c" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:31:40.273397 3784 raft_consensus.cc:2466] T 39880aedaeca464f81d899dc222a35b9 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddc0ad67020f45edb3ba9c83cab687a4 in term 0.
I20250625 03:31:40.273191 3909 consensus_queue.cc:260] T 7257f8e1d9b24e3a9650c5838fe1a8c5 P 3d5b9823dfcd41cb92bd195c811cbf39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:40.275378 3909 ts_tablet_manager.cc:1428] T 7257f8e1d9b24e3a9650c5838fe1a8c5 P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20250625 03:31:40.275455 3639 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "39880aedaeca464f81d899dc222a35b9" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:40.276412 3909 tablet_bootstrap.cc:492] T d657bcfa8eea4e7db43d4d2715857516 P 3d5b9823dfcd41cb92bd195c811cbf39: Bootstrap starting.
I20250625 03:31:40.276994 3914 raft_consensus.cc:491] T aa64717b3f7d4af893e9908260f4520e P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:40.277561 3914 raft_consensus.cc:513] T aa64717b3f7d4af893e9908260f4520e P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:40.279332 3914 leader_election.cc:290] T aa64717b3f7d4af893e9908260f4520e P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 841018313ad649679de64e006582f4c5 (127.0.106.131:39467)
I20250625 03:31:40.282459 3639 raft_consensus.cc:3058] T 28cf5da85c864698894ed4e1ee38cd86 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:40.283631 3859 raft_consensus.cc:2466] T ea706d649de940bf8652264ed57a901f P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841018313ad649679de64e006582f4c5 in term 1.
I20250625 03:31:40.286372 3909 tablet_bootstrap.cc:654] T d657bcfa8eea4e7db43d4d2715857516 P 3d5b9823dfcd41cb92bd195c811cbf39: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:40.289238 3906 tablet_bootstrap.cc:492] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 01873d289e0b4f9f9184b251369502a9: No bootstrap required, opened a new log
I20250625 03:31:40.290014 3906 ts_tablet_manager.cc:1397] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.255s user 0.003s sys 0.012s
I20250625 03:31:40.276921 3638 raft_consensus.cc:2466] T ea706d649de940bf8652264ed57a901f P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841018313ad649679de64e006582f4c5 in term 1.
I20250625 03:31:40.291571 3754 leader_election.cc:304] T ea706d649de940bf8652264ed57a901f P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9, 841018313ad649679de64e006582f4c5; no voters:
I20250625 03:31:40.292367 4176 raft_consensus.cc:2802] T ea706d649de940bf8652264ed57a901f P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Leader election won for term 1
W20250625 03:31:40.292901 3828 leader_election.cc:343] T 39880aedaeca464f81d899dc222a35b9 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:40.293998 3828 leader_election.cc:304] T 39880aedaeca464f81d899dc222a35b9 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841018313ad649679de64e006582f4c5, ddc0ad67020f45edb3ba9c83cab687a4; no voters: 01873d289e0b4f9f9184b251369502a9
I20250625 03:31:40.295481 4196 raft_consensus.cc:491] T 6afeedd3b768470f921526d58704c21d P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:40.296072 3640 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "aa64717b3f7d4af893e9908260f4520e" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:40.296223 4196 raft_consensus.cc:513] T 6afeedd3b768470f921526d58704c21d P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:40.297749 4130 raft_consensus.cc:2802] T 39880aedaeca464f81d899dc222a35b9 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:31:40.299376 4130 raft_consensus.cc:491] T 39880aedaeca464f81d899dc222a35b9 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:31:40.301266 4130 raft_consensus.cc:3058] T 39880aedaeca464f81d899dc222a35b9 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:40.298789 4196 leader_election.cc:290] T 6afeedd3b768470f921526d58704c21d P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:31:40.306370 3828 leader_election.cc:304] T 162ddcc09f594ed7bcb752f842b6c97c P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddc0ad67020f45edb3ba9c83cab687a4; no voters: 3d5b9823dfcd41cb92bd195c811cbf39, 841018313ad649679de64e006582f4c5
I20250625 03:31:40.309938 3975 raft_consensus.cc:2747] T 162ddcc09f594ed7bcb752f842b6c97c P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:31:40.316545 4274 raft_consensus.cc:491] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:40.317320 4274 raft_consensus.cc:513] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:40.318841 4176 raft_consensus.cc:695] T ea706d649de940bf8652264ed57a901f P 841018313ad649679de64e006582f4c5 [term 1 LEADER]: Becoming Leader. State: Replica: 841018313ad649679de64e006582f4c5, State: Running, Role: LEADER
I20250625 03:31:40.319870 4176 consensus_queue.cc:237] T ea706d649de940bf8652264ed57a901f P 841018313ad649679de64e006582f4c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:40.320749 3789 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "aa64717b3f7d4af893e9908260f4520e" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:31:40.323099 4115 raft_consensus.cc:491] T 28cf5da85c864698894ed4e1ee38cd86 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:40.323712 4115 raft_consensus.cc:513] T 28cf5da85c864698894ed4e1ee38cd86 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:40.326653 4115 leader_election.cc:290] T 28cf5da85c864698894ed4e1ee38cd86 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353)
W20250625 03:31:40.330116 3604 consensus_peers.cc:487] T 5350a260b3364354b73176e6bdd77940 P 01873d289e0b4f9f9184b251369502a9 -> Peer ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353): Couldn't send request to peer ddc0ad67020f45edb3ba9c83cab687a4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:40.335219 4130 raft_consensus.cc:513] T 39880aedaeca464f81d899dc222a35b9 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:40.337651 4130 leader_election.cc:290] T 39880aedaeca464f81d899dc222a35b9 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 election: Requested vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:31:40.340803 3862 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6afeedd3b768470f921526d58704c21d" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:40.341316 3789 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "39880aedaeca464f81d899dc222a35b9" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5"
I20250625 03:31:40.341920 3789 raft_consensus.cc:3058] T 39880aedaeca464f81d899dc222a35b9 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:40.251632 3932 raft_consensus.cc:513] T 41d33fbc861a40338ae6da1732fb696b P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:40.350135 3932 leader_election.cc:290] T 41d33fbc861a40338ae6da1732fb696b P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 election: Requested vote from peers 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041), 841018313ad649679de64e006582f4c5 (127.0.106.131:39467)
I20250625 03:31:40.350337 3789 raft_consensus.cc:2466] T 39880aedaeca464f81d899dc222a35b9 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddc0ad67020f45edb3ba9c83cab687a4 in term 1.
I20250625 03:31:40.352949 3906 raft_consensus.cc:357] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:40.355278 3638 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "39880aedaeca464f81d899dc222a35b9" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9"
I20250625 03:31:40.357213 3905 tablet_bootstrap.cc:492] T 6a179f065ae046df819a9bd88194dae6 P 841018313ad649679de64e006582f4c5: No bootstrap required, opened a new log
I20250625 03:31:40.357748 3905 ts_tablet_manager.cc:1397] T 6a179f065ae046df819a9bd88194dae6 P 841018313ad649679de64e006582f4c5: Time spent bootstrapping tablet: real 0.197s user 0.006s sys 0.005s
I20250625 03:31:40.360605 3905 raft_consensus.cc:357] T 6a179f065ae046df819a9bd88194dae6 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:40.361414 3905 raft_consensus.cc:383] T 6a179f065ae046df819a9bd88194dae6 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:40.365669 3905 raft_consensus.cc:738] T 6a179f065ae046df819a9bd88194dae6 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841018313ad649679de64e006582f4c5, State: Initialized, Role: FOLLOWER
I20250625 03:31:40.366288 3905 consensus_queue.cc:260] T 6a179f065ae046df819a9bd88194dae6 P 841018313ad649679de64e006582f4c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:40.367964 4130 consensus_queue.cc:1035] T 28cf5da85c864698894ed4e1ee38cd86 P ddc0ad67020f45edb3ba9c83cab687a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20250625 03:31:40.369827 3828 leader_election.cc:343] T 39880aedaeca464f81d899dc222a35b9 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:40.372404 3859 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "28cf5da85c864698894ed4e1ee38cd86" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
W20250625 03:31:40.332456 3680 leader_election.cc:343] T aa64717b3f7d4af893e9908260f4520e P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:40.373224 3909 tablet_bootstrap.cc:492] T d657bcfa8eea4e7db43d4d2715857516 P 3d5b9823dfcd41cb92bd195c811cbf39: No bootstrap required, opened a new log
I20250625 03:31:40.374392 3909 ts_tablet_manager.cc:1397] T d657bcfa8eea4e7db43d4d2715857516 P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent bootstrapping tablet: real 0.098s user 0.054s sys 0.033s
I20250625 03:31:40.374502 3905 ts_tablet_manager.cc:1428] T 6a179f065ae046df819a9bd88194dae6 P 841018313ad649679de64e006582f4c5: Time spent starting tablet: real 0.016s user 0.007s sys 0.000s
W20250625 03:31:40.377087 3679 leader_election.cc:343] T 6afeedd3b768470f921526d58704c21d P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:40.381095 3910 tablet_bootstrap.cc:654] T 049948eeceeb43c98ccda9e839b521a8 P ddc0ad67020f45edb3ba9c83cab687a4: Neither blocks nor log segments found. Creating new log.
W20250625 03:31:40.383602 4265 log.cc:927] Time spent T 28cf5da85c864698894ed4e1ee38cd86 P 841018313ad649679de64e006582f4c5: Append to log took a long time: real 0.069s user 0.001s sys 0.000s
I20250625 03:31:40.384514 3715 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "41d33fbc861a40338ae6da1732fb696b" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
I20250625 03:31:40.385295 3715 raft_consensus.cc:3058] T 41d33fbc861a40338ae6da1732fb696b P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:40.377135 3909 raft_consensus.cc:357] T d657bcfa8eea4e7db43d4d2715857516 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:40.388788 3909 raft_consensus.cc:383] T d657bcfa8eea4e7db43d4d2715857516 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:40.389036 3909 raft_consensus.cc:738] T d657bcfa8eea4e7db43d4d2715857516 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Initialized, Role: FOLLOWER
I20250625 03:31:40.391708 3638 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6afeedd3b768470f921526d58704c21d" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:40.392783 3789 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "41d33fbc861a40338ae6da1732fb696b" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5"
I20250625 03:31:40.393508 3789 raft_consensus.cc:3058] T 41d33fbc861a40338ae6da1732fb696b P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:40.397156 3909 consensus_queue.cc:260] T d657bcfa8eea4e7db43d4d2715857516 P 3d5b9823dfcd41cb92bd195c811cbf39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
W20250625 03:31:40.401769 3680 leader_election.cc:343] T 6afeedd3b768470f921526d58704c21d P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:40.402227 3680 leader_election.cc:304] T 6afeedd3b768470f921526d58704c21d P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39; no voters: 01873d289e0b4f9f9184b251369502a9, ddc0ad67020f45edb3ba9c83cab687a4
I20250625 03:31:40.402897 4182 raft_consensus.cc:2747] T 6afeedd3b768470f921526d58704c21d P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:31:40.400951 3537 catalog_manager.cc:5582] T ea706d649de940bf8652264ed57a901f P 841018313ad649679de64e006582f4c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 841018313ad649679de64e006582f4c5 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "841018313ad649679de64e006582f4c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: UNKNOWN } } }
W20250625 03:31:40.405190 3753 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.132:37353, user_credentials={real_user=slave}} blocked reactor thread for 84184.7us
I20250625 03:31:40.407625 3909 ts_tablet_manager.cc:1428] T d657bcfa8eea4e7db43d4d2715857516 P 3d5b9823dfcd41cb92bd195c811cbf39: Time spent starting tablet: real 0.033s user 0.006s sys 0.000s
I20250625 03:31:40.411604 3715 raft_consensus.cc:2466] T 41d33fbc861a40338ae6da1732fb696b P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddc0ad67020f45edb3ba9c83cab687a4 in term 1.
I20250625 03:31:40.411931 3638 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "db241b7e8b2a45f297e0bbd9ba86cdd8" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
W20250625 03:31:40.412442 3585 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20250625 03:31:40.419620 4079 consensus_queue.cc:1035] T 162ddcc09f594ed7bcb752f842b6c97c P 841018313ad649679de64e006582f4c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:31:40.425915 4274 leader_election.cc:290] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:31:40.355211 3906 raft_consensus.cc:383] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:40.426743 3906 raft_consensus.cc:738] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:40.427771 3906 consensus_queue.cc:260] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:40.424294 3828 leader_election.cc:304] T 39880aedaeca464f81d899dc222a35b9 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841018313ad649679de64e006582f4c5, ddc0ad67020f45edb3ba9c83cab687a4; no voters: 01873d289e0b4f9f9184b251369502a9
I20250625 03:31:40.429036 3638 raft_consensus.cc:2466] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841018313ad649679de64e006582f4c5 in term 0.
I20250625 03:31:40.424886 3905 tablet_bootstrap.cc:492] T d657bcfa8eea4e7db43d4d2715857516 P 841018313ad649679de64e006582f4c5: Bootstrap starting.
I20250625 03:31:40.430490 4130 raft_consensus.cc:2802] T 39880aedaeca464f81d899dc222a35b9 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:31:40.431031 4130 raft_consensus.cc:695] T 39880aedaeca464f81d899dc222a35b9 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 LEADER]: Becoming Leader. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Running, Role: LEADER
I20250625 03:31:40.431910 4130 consensus_queue.cc:237] T 39880aedaeca464f81d899dc222a35b9 P ddc0ad67020f45edb3ba9c83cab687a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:40.433619 3754 leader_election.cc:304] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9, 841018313ad649679de64e006582f4c5; no voters:
I20250625 03:31:40.435016 4079 raft_consensus.cc:2802] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:31:40.428546 3789 raft_consensus.cc:2466] T 41d33fbc861a40338ae6da1732fb696b P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddc0ad67020f45edb3ba9c83cab687a4 in term 1.
W20250625 03:31:40.423211 3605 consensus_peers.cc:487] T 6a179f065ae046df819a9bd88194dae6 P 01873d289e0b4f9f9184b251369502a9 -> Peer 841018313ad649679de64e006582f4c5 (127.0.106.131:39467): Couldn't send request to peer 841018313ad649679de64e006582f4c5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:40.435566 4079 raft_consensus.cc:491] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:31:40.438014 4079 raft_consensus.cc:3058] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:40.425295 3713 raft_consensus.cc:2466] T e91e209dcfdb4fd0bebe666bbbe16b75 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841018313ad649679de64e006582f4c5 in term 1.
I20250625 03:31:40.448450 3788 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "28cf5da85c864698894ed4e1ee38cd86" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:31:40.453043 3914 raft_consensus.cc:491] T d657bcfa8eea4e7db43d4d2715857516 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:40.453228 4261 raft_consensus.cc:491] T 7257f8e1d9b24e3a9650c5838fe1a8c5 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:40.453660 3914 raft_consensus.cc:513] T d657bcfa8eea4e7db43d4d2715857516 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:40.453567 4079 raft_consensus.cc:513] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:40.453855 4261 raft_consensus.cc:513] T 7257f8e1d9b24e3a9650c5838fe1a8c5 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:40.455510 3914 leader_election.cc:290] T d657bcfa8eea4e7db43d4d2715857516 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 841018313ad649679de64e006582f4c5 (127.0.106.131:39467)
I20250625 03:31:40.456353 3638 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "db241b7e8b2a45f297e0bbd9ba86cdd8" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9"
I20250625 03:31:40.457005 3638 raft_consensus.cc:3058] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:40.457365 4079 leader_election.cc:290] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 election: Requested vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:31:40.457808 3715 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "db241b7e8b2a45f297e0bbd9ba86cdd8" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
I20250625 03:31:40.458416 3715 raft_consensus.cc:3058] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:40.458712 4261 leader_election.cc:290] T 7257f8e1d9b24e3a9650c5838fe1a8c5 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353)
I20250625 03:31:40.456724 3754 leader_election.cc:304] T e91e209dcfdb4fd0bebe666bbbe16b75 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, 841018313ad649679de64e006582f4c5; no voters: ddc0ad67020f45edb3ba9c83cab687a4
I20250625 03:31:40.461043 3713 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "db241b7e8b2a45f297e0bbd9ba86cdd8" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" is_pre_election: true
W20250625 03:31:40.453373 3680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:37771, user_credentials={real_user=slave}} blocked reactor thread for 49538.4us
I20250625 03:31:40.467948 3638 raft_consensus.cc:2466] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841018313ad649679de64e006582f4c5 in term 1.
I20250625 03:31:40.469638 3754 leader_election.cc:304] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9, 841018313ad649679de64e006582f4c5; no voters:
I20250625 03:31:40.470795 4274 raft_consensus.cc:2802] T e91e209dcfdb4fd0bebe666bbbe16b75 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:31:40.471807 4272 raft_consensus.cc:2802] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:31:40.472644 4272 raft_consensus.cc:695] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 841018313ad649679de64e006582f4c5 [term 1 LEADER]: Becoming Leader. State: Replica: 841018313ad649679de64e006582f4c5, State: Running, Role: LEADER
I20250625 03:31:40.473975 4272 consensus_queue.cc:237] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 841018313ad649679de64e006582f4c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:40.474557 3537 catalog_manager.cc:5582] T 6de9e445ad834b008a2f513fac78dba1 P 3d5b9823dfcd41cb92bd195c811cbf39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:40.478725 3640 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d657bcfa8eea4e7db43d4d2715857516" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:40.486544 3828 leader_election.cc:304] T 41d33fbc861a40338ae6da1732fb696b P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, ddc0ad67020f45edb3ba9c83cab687a4; no voters:
I20250625 03:31:40.493800 3910 tablet_bootstrap.cc:492] T 049948eeceeb43c98ccda9e839b521a8 P ddc0ad67020f45edb3ba9c83cab687a4: No bootstrap required, opened a new log
I20250625 03:31:40.494374 3910 ts_tablet_manager.cc:1397] T 049948eeceeb43c98ccda9e839b521a8 P ddc0ad67020f45edb3ba9c83cab687a4: Time spent bootstrapping tablet: real 0.271s user 0.045s sys 0.028s
I20250625 03:31:40.494171 4274 raft_consensus.cc:695] T e91e209dcfdb4fd0bebe666bbbe16b75 P 841018313ad649679de64e006582f4c5 [term 1 LEADER]: Becoming Leader. State: Replica: 841018313ad649679de64e006582f4c5, State: Running, Role: LEADER
I20250625 03:31:40.495411 4274 consensus_queue.cc:237] T e91e209dcfdb4fd0bebe666bbbe16b75 P 841018313ad649679de64e006582f4c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:40.499099 3786 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d657bcfa8eea4e7db43d4d2715857516" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:31:40.506299 3605 leader_election.cc:304] T 28cf5da85c864698894ed4e1ee38cd86 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9; no voters: 841018313ad649679de64e006582f4c5, ddc0ad67020f45edb3ba9c83cab687a4
I20250625 03:31:40.508581 4285 raft_consensus.cc:2747] T 28cf5da85c864698894ed4e1ee38cd86 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250625 03:31:40.467988 3715 raft_consensus.cc:2466] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841018313ad649679de64e006582f4c5 in term 1.
I20250625 03:31:40.517905 3906 ts_tablet_manager.cc:1428] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.228s user 0.010s sys 0.000s
I20250625 03:31:40.519084 3906 tablet_bootstrap.cc:492] T 39880aedaeca464f81d899dc222a35b9 P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:40.520731 3905 tablet_bootstrap.cc:654] T d657bcfa8eea4e7db43d4d2715857516 P 841018313ad649679de64e006582f4c5: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:40.521878 4096 consensus_queue.cc:1035] T 5350a260b3364354b73176e6bdd77940 P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20250625 03:31:40.522135 3680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.131:39467, user_credentials={real_user=slave}} blocked reactor thread for 47877us
I20250625 03:31:40.528259 4268 raft_consensus.cc:491] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:40.528820 4268 raft_consensus.cc:513] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:40.529273 3861 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7257f8e1d9b24e3a9650c5838fe1a8c5" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:40.530867 4268 leader_election.cc:290] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:31:40.531399 4268 raft_consensus.cc:2802] T 41d33fbc861a40338ae6da1732fb696b P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:31:40.534552 4272 raft_consensus.cc:491] T 6a179f065ae046df819a9bd88194dae6 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:40.535105 4272 raft_consensus.cc:513] T 6a179f065ae046df819a9bd88194dae6 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:40.537129 4272 leader_election.cc:290] T 6a179f065ae046df819a9bd88194dae6 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:31:40.538838 3910 raft_consensus.cc:357] T 049948eeceeb43c98ccda9e839b521a8 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:40.539557 3910 raft_consensus.cc:383] T 049948eeceeb43c98ccda9e839b521a8 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:40.539814 3910 raft_consensus.cc:738] T 049948eeceeb43c98ccda9e839b521a8 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Initialized, Role: FOLLOWER
I20250625 03:31:40.540426 3910 consensus_queue.cc:260] T 049948eeceeb43c98ccda9e839b521a8 P ddc0ad67020f45edb3ba9c83cab687a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:40.540653 3786 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7257f8e1d9b24e3a9650c5838fe1a8c5" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:31:40.542160 3910 ts_tablet_manager.cc:1428] T 049948eeceeb43c98ccda9e839b521a8 P ddc0ad67020f45edb3ba9c83cab687a4: Time spent starting tablet: real 0.047s user 0.005s sys 0.000s
I20250625 03:31:40.536945 4268 raft_consensus.cc:695] T 41d33fbc861a40338ae6da1732fb696b P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 LEADER]: Becoming Leader. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Running, Role: LEADER
I20250625 03:31:40.545753 3638 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6a179f065ae046df819a9bd88194dae6" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:40.547629 3715 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6a179f065ae046df819a9bd88194dae6" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" is_pre_election: true
I20250625 03:31:40.549157 3754 leader_election.cc:304] T 6a179f065ae046df819a9bd88194dae6 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841018313ad649679de64e006582f4c5; no voters: 01873d289e0b4f9f9184b251369502a9, 3d5b9823dfcd41cb92bd195c811cbf39
I20250625 03:31:40.550243 4272 raft_consensus.cc:2747] T 6a179f065ae046df819a9bd88194dae6 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:31:40.550665 3910 tablet_bootstrap.cc:492] T 5350a260b3364354b73176e6bdd77940 P ddc0ad67020f45edb3ba9c83cab687a4: Bootstrap starting.
I20250625 03:31:40.557065 3910 tablet_bootstrap.cc:654] T 5350a260b3364354b73176e6bdd77940 P ddc0ad67020f45edb3ba9c83cab687a4: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:40.545208 4268 consensus_queue.cc:237] T 41d33fbc861a40338ae6da1732fb696b P ddc0ad67020f45edb3ba9c83cab687a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:40.569213 3537 catalog_manager.cc:5582] T e91e209dcfdb4fd0bebe666bbbe16b75 P 841018313ad649679de64e006582f4c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 841018313ad649679de64e006582f4c5 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "841018313ad649679de64e006582f4c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:40.571002 3910 tablet_bootstrap.cc:492] T 5350a260b3364354b73176e6bdd77940 P ddc0ad67020f45edb3ba9c83cab687a4: No bootstrap required, opened a new log
I20250625 03:31:40.571722 3910 ts_tablet_manager.cc:1397] T 5350a260b3364354b73176e6bdd77940 P ddc0ad67020f45edb3ba9c83cab687a4: Time spent bootstrapping tablet: real 0.029s user 0.012s sys 0.003s
I20250625 03:31:40.572711 4272 raft_consensus.cc:491] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:40.573400 4272 raft_consensus.cc:513] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:40.575286 3910 raft_consensus.cc:357] T 5350a260b3364354b73176e6bdd77940 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:40.576437 3910 raft_consensus.cc:383] T 5350a260b3364354b73176e6bdd77940 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:40.576794 3910 raft_consensus.cc:738] T 5350a260b3364354b73176e6bdd77940 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Initialized, Role: FOLLOWER
I20250625 03:31:40.577503 3638 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3ae65ab4d0d2480cb3e4d2d0dd5f5c14" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:40.577629 3910 consensus_queue.cc:260] T 5350a260b3364354b73176e6bdd77940 P ddc0ad67020f45edb3ba9c83cab687a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:40.579015 4272 leader_election.cc:290] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:31:40.580217 3859 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3ae65ab4d0d2480cb3e4d2d0dd5f5c14" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:40.525543 3906 tablet_bootstrap.cc:654] T 39880aedaeca464f81d899dc222a35b9 P 01873d289e0b4f9f9184b251369502a9: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:40.581112 3859 raft_consensus.cc:2466] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841018313ad649679de64e006582f4c5 in term 0.
W20250625 03:31:40.581630 3754 leader_election.cc:343] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:40.583489 3753 leader_election.cc:304] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841018313ad649679de64e006582f4c5, ddc0ad67020f45edb3ba9c83cab687a4; no voters: 01873d289e0b4f9f9184b251369502a9
W20250625 03:31:40.571585 3680 leader_election.cc:343] T aa64717b3f7d4af893e9908260f4520e P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841018313ad649679de64e006582f4c5 (127.0.106.131:39467): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:40.585117 3680 leader_election.cc:304] T aa64717b3f7d4af893e9908260f4520e P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39; no voters: 01873d289e0b4f9f9184b251369502a9, 841018313ad649679de64e006582f4c5
I20250625 03:31:40.586304 3914 raft_consensus.cc:2747] T aa64717b3f7d4af893e9908260f4520e P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:31:40.584614 4274 raft_consensus.cc:2802] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:31:40.587977 4274 raft_consensus.cc:491] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:31:40.588384 4274 raft_consensus.cc:3058] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:40.588601 3906 tablet_bootstrap.cc:492] T 39880aedaeca464f81d899dc222a35b9 P 01873d289e0b4f9f9184b251369502a9: No bootstrap required, opened a new log
W20250625 03:31:40.590613 3680 leader_election.cc:343] T d657bcfa8eea4e7db43d4d2715857516 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841018313ad649679de64e006582f4c5 (127.0.106.131:39467): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:40.590821 3906 ts_tablet_manager.cc:1397] T 39880aedaeca464f81d899dc222a35b9 P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.072s user 0.009s sys 0.002s
I20250625 03:31:40.593653 3906 raft_consensus.cc:357] T 39880aedaeca464f81d899dc222a35b9 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:40.594337 3906 raft_consensus.cc:383] T 39880aedaeca464f81d899dc222a35b9 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:40.594651 3906 raft_consensus.cc:738] T 39880aedaeca464f81d899dc222a35b9 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:40.572645 3537 catalog_manager.cc:5582] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 841018313ad649679de64e006582f4c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 841018313ad649679de64e006582f4c5 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "841018313ad649679de64e006582f4c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: HEALTHY } } }
I20250625 03:31:40.596218 3914 consensus_queue.cc:1035] T c5a9463f96314a83b7955d80444b1c29 P 3d5b9823dfcd41cb92bd195c811cbf39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:31:40.599788 3905 tablet_bootstrap.cc:492] T d657bcfa8eea4e7db43d4d2715857516 P 841018313ad649679de64e006582f4c5: No bootstrap required, opened a new log
I20250625 03:31:40.600313 3905 ts_tablet_manager.cc:1397] T d657bcfa8eea4e7db43d4d2715857516 P 841018313ad649679de64e006582f4c5: Time spent bootstrapping tablet: real 0.225s user 0.031s sys 0.011s
I20250625 03:31:40.603978 3636 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3ae65ab4d0d2480cb3e4d2d0dd5f5c14" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
W20250625 03:31:40.604357 3679 leader_election.cc:343] T 7257f8e1d9b24e3a9650c5838fe1a8c5 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353): Illegal state: must be running to vote when last-logged opid is not known
W20250625 03:31:40.605209 3679 consensus_peers.cc:487] T 6de9e445ad834b008a2f513fac78dba1 P 3d5b9823dfcd41cb92bd195c811cbf39 -> Peer ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353): Couldn't send request to peer ddc0ad67020f45edb3ba9c83cab687a4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:40.607723 3905 raft_consensus.cc:357] T d657bcfa8eea4e7db43d4d2715857516 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:40.608508 3905 raft_consensus.cc:383] T d657bcfa8eea4e7db43d4d2715857516 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:40.608768 3905 raft_consensus.cc:738] T d657bcfa8eea4e7db43d4d2715857516 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841018313ad649679de64e006582f4c5, State: Initialized, Role: FOLLOWER
I20250625 03:31:40.609493 3905 consensus_queue.cc:260] T d657bcfa8eea4e7db43d4d2715857516 P 841018313ad649679de64e006582f4c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:40.609848 3786 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3ae65ab4d0d2480cb3e4d2d0dd5f5c14" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
W20250625 03:31:40.611280 3828 leader_election.cc:343] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:40.614149 3910 ts_tablet_manager.cc:1428] T 5350a260b3364354b73176e6bdd77940 P ddc0ad67020f45edb3ba9c83cab687a4: Time spent starting tablet: real 0.042s user 0.006s sys 0.000s
I20250625 03:31:40.614678 3905 ts_tablet_manager.cc:1428] T d657bcfa8eea4e7db43d4d2715857516 P 841018313ad649679de64e006582f4c5: Time spent starting tablet: real 0.013s user 0.004s sys 0.002s
I20250625 03:31:40.615418 3910 tablet_bootstrap.cc:492] T e91e209dcfdb4fd0bebe666bbbe16b75 P ddc0ad67020f45edb3ba9c83cab687a4: Bootstrap starting.
I20250625 03:31:40.597959 3906 consensus_queue.cc:260] T 39880aedaeca464f81d899dc222a35b9 P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:40.615731 3905 tablet_bootstrap.cc:492] T aa64717b3f7d4af893e9908260f4520e P 841018313ad649679de64e006582f4c5: Bootstrap starting.
W20250625 03:31:40.623046 3680 leader_election.cc:343] T 7257f8e1d9b24e3a9650c5838fe1a8c5 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841018313ad649679de64e006582f4c5 (127.0.106.131:39467): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:40.622622 4274 raft_consensus.cc:513] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:40.625653 3786 raft_consensus.cc:2391] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddc0ad67020f45edb3ba9c83cab687a4 in current term 1: Already voted for candidate 841018313ad649679de64e006582f4c5 in this term.
I20250625 03:31:40.626299 4274 leader_election.cc:290] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 election: Requested vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:31:40.627185 3680 leader_election.cc:304] T 7257f8e1d9b24e3a9650c5838fe1a8c5 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39; no voters: 841018313ad649679de64e006582f4c5, ddc0ad67020f45edb3ba9c83cab687a4
I20250625 03:31:40.627421 3639 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3ae65ab4d0d2480cb3e4d2d0dd5f5c14" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9"
I20250625 03:31:40.629326 3862 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3ae65ab4d0d2480cb3e4d2d0dd5f5c14" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4"
I20250625 03:31:40.629870 3862 raft_consensus.cc:3058] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:40.622082 3910 tablet_bootstrap.cc:654] T e91e209dcfdb4fd0bebe666bbbe16b75 P ddc0ad67020f45edb3ba9c83cab687a4: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:40.617482 3906 ts_tablet_manager.cc:1428] T 39880aedaeca464f81d899dc222a35b9 P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.026s user 0.005s sys 0.000s
I20250625 03:31:40.633389 3906 tablet_bootstrap.cc:492] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:40.634330 3914 raft_consensus.cc:2747] T 7257f8e1d9b24e3a9650c5838fe1a8c5 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250625 03:31:40.636771 3754 leader_election.cc:343] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:40.638716 3828 leader_election.cc:304] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddc0ad67020f45edb3ba9c83cab687a4; no voters: 01873d289e0b4f9f9184b251369502a9, 841018313ad649679de64e006582f4c5
I20250625 03:31:40.639194 3906 tablet_bootstrap.cc:654] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 01873d289e0b4f9f9184b251369502a9: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:40.642284 3535 catalog_manager.cc:5582] T 39880aedaeca464f81d899dc222a35b9 P ddc0ad67020f45edb3ba9c83cab687a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132). New cstate: current_term: 1 leader_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:40.644383 3862 raft_consensus.cc:2466] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841018313ad649679de64e006582f4c5 in term 1.
I20250625 03:31:40.644930 3975 raft_consensus.cc:2747] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:31:40.648581 3753 leader_election.cc:304] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841018313ad649679de64e006582f4c5, ddc0ad67020f45edb3ba9c83cab687a4; no voters: 01873d289e0b4f9f9184b251369502a9
I20250625 03:31:40.652408 4272 raft_consensus.cc:2802] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Leader election won for term 1
W20250625 03:31:40.657513 3680 leader_election.cc:343] T d657bcfa8eea4e7db43d4d2715857516 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:40.658025 3680 leader_election.cc:304] T d657bcfa8eea4e7db43d4d2715857516 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39; no voters: 01873d289e0b4f9f9184b251369502a9, 841018313ad649679de64e006582f4c5
I20250625 03:31:40.658814 3914 raft_consensus.cc:2747] T d657bcfa8eea4e7db43d4d2715857516 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:31:40.659305 4261 consensus_queue.cc:1035] T c5a9463f96314a83b7955d80444b1c29 P 3d5b9823dfcd41cb92bd195c811cbf39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:31:40.664309 3910 tablet_bootstrap.cc:492] T e91e209dcfdb4fd0bebe666bbbe16b75 P ddc0ad67020f45edb3ba9c83cab687a4: No bootstrap required, opened a new log
I20250625 03:31:40.665082 3910 ts_tablet_manager.cc:1397] T e91e209dcfdb4fd0bebe666bbbe16b75 P ddc0ad67020f45edb3ba9c83cab687a4: Time spent bootstrapping tablet: real 0.050s user 0.012s sys 0.000s
I20250625 03:31:40.658888 4272 raft_consensus.cc:695] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 841018313ad649679de64e006582f4c5 [term 1 LEADER]: Becoming Leader. State: Replica: 841018313ad649679de64e006582f4c5, State: Running, Role: LEADER
I20250625 03:31:40.667975 4272 consensus_queue.cc:237] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 841018313ad649679de64e006582f4c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:40.668231 3910 raft_consensus.cc:357] T e91e209dcfdb4fd0bebe666bbbe16b75 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:40.669445 3910 raft_consensus.cc:383] T e91e209dcfdb4fd0bebe666bbbe16b75 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:40.670115 3910 raft_consensus.cc:738] T e91e209dcfdb4fd0bebe666bbbe16b75 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Initialized, Role: FOLLOWER
I20250625 03:31:40.671303 3910 consensus_queue.cc:260] T e91e209dcfdb4fd0bebe666bbbe16b75 P ddc0ad67020f45edb3ba9c83cab687a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:40.675124 3910 ts_tablet_manager.cc:1428] T e91e209dcfdb4fd0bebe666bbbe16b75 P ddc0ad67020f45edb3ba9c83cab687a4: Time spent starting tablet: real 0.010s user 0.005s sys 0.000s
I20250625 03:31:40.678382 3910 tablet_bootstrap.cc:492] T d83c6c79a784452289ba414976adb9e0 P ddc0ad67020f45edb3ba9c83cab687a4: Bootstrap starting.
I20250625 03:31:40.685477 3910 tablet_bootstrap.cc:654] T d83c6c79a784452289ba414976adb9e0 P ddc0ad67020f45edb3ba9c83cab687a4: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:40.675335 3905 tablet_bootstrap.cc:654] T aa64717b3f7d4af893e9908260f4520e P 841018313ad649679de64e006582f4c5: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:40.699692 3914 consensus_queue.cc:1035] T 6de9e445ad834b008a2f513fac78dba1 P 3d5b9823dfcd41cb92bd195c811cbf39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:31:40.702596 3910 tablet_bootstrap.cc:492] T d83c6c79a784452289ba414976adb9e0 P ddc0ad67020f45edb3ba9c83cab687a4: No bootstrap required, opened a new log
I20250625 03:31:40.705267 3910 ts_tablet_manager.cc:1397] T d83c6c79a784452289ba414976adb9e0 P ddc0ad67020f45edb3ba9c83cab687a4: Time spent bootstrapping tablet: real 0.027s user 0.011s sys 0.000s
I20250625 03:31:40.710377 3905 tablet_bootstrap.cc:492] T aa64717b3f7d4af893e9908260f4520e P 841018313ad649679de64e006582f4c5: No bootstrap required, opened a new log
I20250625 03:31:40.711102 3905 ts_tablet_manager.cc:1397] T aa64717b3f7d4af893e9908260f4520e P 841018313ad649679de64e006582f4c5: Time spent bootstrapping tablet: real 0.096s user 0.014s sys 0.003s
I20250625 03:31:40.709021 3910 raft_consensus.cc:357] T d83c6c79a784452289ba414976adb9e0 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:40.713464 3910 raft_consensus.cc:383] T d83c6c79a784452289ba414976adb9e0 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:40.714299 3910 raft_consensus.cc:738] T d83c6c79a784452289ba414976adb9e0 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Initialized, Role: FOLLOWER
I20250625 03:31:40.715412 3910 consensus_queue.cc:260] T d83c6c79a784452289ba414976adb9e0 P ddc0ad67020f45edb3ba9c83cab687a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:40.718660 3975 raft_consensus.cc:491] T 049948eeceeb43c98ccda9e839b521a8 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:40.718297 3534 catalog_manager.cc:5582] T 41d33fbc861a40338ae6da1732fb696b P ddc0ad67020f45edb3ba9c83cab687a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132). New cstate: current_term: 1 leader_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: HEALTHY } } }
I20250625 03:31:40.719329 3975 raft_consensus.cc:513] T 049948eeceeb43c98ccda9e839b521a8 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:40.723027 3975 leader_election.cc:290] T 049948eeceeb43c98ccda9e839b521a8 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:31:40.724081 3639 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "049948eeceeb43c98ccda9e839b521a8" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:40.725937 3910 ts_tablet_manager.cc:1428] T d83c6c79a784452289ba414976adb9e0 P ddc0ad67020f45edb3ba9c83cab687a4: Time spent starting tablet: real 0.019s user 0.006s sys 0.000s
I20250625 03:31:40.728363 3910 tablet_bootstrap.cc:492] T 6de9e445ad834b008a2f513fac78dba1 P ddc0ad67020f45edb3ba9c83cab687a4: Bootstrap starting.
W20250625 03:31:40.730348 3828 leader_election.cc:343] T 049948eeceeb43c98ccda9e839b521a8 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:40.726783 3712 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "049948eeceeb43c98ccda9e839b521a8" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" is_pre_election: true
I20250625 03:31:40.731138 3712 raft_consensus.cc:2466] T 049948eeceeb43c98ccda9e839b521a8 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddc0ad67020f45edb3ba9c83cab687a4 in term 0.
I20250625 03:31:40.732285 3828 leader_election.cc:304] T 049948eeceeb43c98ccda9e839b521a8 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, ddc0ad67020f45edb3ba9c83cab687a4; no voters: 01873d289e0b4f9f9184b251369502a9
I20250625 03:31:40.733155 3975 raft_consensus.cc:2802] T 049948eeceeb43c98ccda9e839b521a8 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:31:40.733500 3975 raft_consensus.cc:491] T 049948eeceeb43c98ccda9e839b521a8 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:31:40.733794 3975 raft_consensus.cc:3058] T 049948eeceeb43c98ccda9e839b521a8 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:40.737996 4262 raft_consensus.cc:491] T e91e209dcfdb4fd0bebe666bbbe16b75 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20250625 03:31:40.738194 3604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.132:37353, user_credentials={real_user=slave}} blocked reactor thread for 124698us
I20250625 03:31:40.738626 4262 raft_consensus.cc:513] T e91e209dcfdb4fd0bebe666bbbe16b75 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:40.740898 4262 leader_election.cc:290] T e91e209dcfdb4fd0bebe666bbbe16b75 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041), 841018313ad649679de64e006582f4c5 (127.0.106.131:39467)
I20250625 03:31:40.742600 3975 raft_consensus.cc:513] T 049948eeceeb43c98ccda9e839b521a8 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:40.743294 3712 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e91e209dcfdb4fd0bebe666bbbe16b75" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" is_pre_election: true
I20250625 03:31:40.744504 3785 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e91e209dcfdb4fd0bebe666bbbe16b75" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:31:40.744700 3975 leader_election.cc:290] T 049948eeceeb43c98ccda9e839b521a8 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 election: Requested vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:31:40.745832 3712 raft_consensus.cc:2391] T e91e209dcfdb4fd0bebe666bbbe16b75 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddc0ad67020f45edb3ba9c83cab687a4 in current term 1: Already voted for candidate 841018313ad649679de64e006582f4c5 in this term.
I20250625 03:31:40.747324 3639 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "049948eeceeb43c98ccda9e839b521a8" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9"
W20250625 03:31:40.748545 3828 leader_election.cc:343] T 049948eeceeb43c98ccda9e839b521a8 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:40.749615 3712 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "049948eeceeb43c98ccda9e839b521a8" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
I20250625 03:31:40.750205 3712 raft_consensus.cc:3058] T 049948eeceeb43c98ccda9e839b521a8 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:40.757007 3910 tablet_bootstrap.cc:654] T 6de9e445ad834b008a2f513fac78dba1 P ddc0ad67020f45edb3ba9c83cab687a4: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:40.758879 3828 leader_election.cc:304] T e91e209dcfdb4fd0bebe666bbbe16b75 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddc0ad67020f45edb3ba9c83cab687a4; no voters: 3d5b9823dfcd41cb92bd195c811cbf39, 841018313ad649679de64e006582f4c5
I20250625 03:31:40.759732 3975 raft_consensus.cc:3058] T e91e209dcfdb4fd0bebe666bbbe16b75 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:40.765101 3712 raft_consensus.cc:2466] T 049948eeceeb43c98ccda9e839b521a8 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddc0ad67020f45edb3ba9c83cab687a4 in term 1.
I20250625 03:31:40.765892 3906 tablet_bootstrap.cc:492] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 01873d289e0b4f9f9184b251369502a9: No bootstrap required, opened a new log
I20250625 03:31:40.766402 3906 ts_tablet_manager.cc:1397] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.133s user 0.021s sys 0.022s
I20250625 03:31:40.767050 3975 raft_consensus.cc:2747] T e91e209dcfdb4fd0bebe666bbbe16b75 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:31:40.766494 3828 leader_election.cc:304] T 049948eeceeb43c98ccda9e839b521a8 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, ddc0ad67020f45edb3ba9c83cab687a4; no voters: 01873d289e0b4f9f9184b251369502a9
I20250625 03:31:40.767993 3975 raft_consensus.cc:2802] T 049948eeceeb43c98ccda9e839b521a8 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:31:40.768452 3975 raft_consensus.cc:695] T 049948eeceeb43c98ccda9e839b521a8 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 LEADER]: Becoming Leader. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Running, Role: LEADER
I20250625 03:31:40.769182 3975 consensus_queue.cc:237] T 049948eeceeb43c98ccda9e839b521a8 P ddc0ad67020f45edb3ba9c83cab687a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:40.769757 3906 raft_consensus.cc:357] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:40.770459 3906 raft_consensus.cc:383] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:40.770753 3906 raft_consensus.cc:738] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:40.771780 3906 consensus_queue.cc:260] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:40.773278 3905 raft_consensus.cc:357] T aa64717b3f7d4af893e9908260f4520e P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:40.778753 3905 raft_consensus.cc:383] T aa64717b3f7d4af893e9908260f4520e P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:40.780436 3905 raft_consensus.cc:738] T aa64717b3f7d4af893e9908260f4520e P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841018313ad649679de64e006582f4c5, State: Initialized, Role: FOLLOWER
I20250625 03:31:40.782613 3905 consensus_queue.cc:260] T aa64717b3f7d4af893e9908260f4520e P 841018313ad649679de64e006582f4c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:40.806056 3906 ts_tablet_manager.cc:1428] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.039s user 0.007s sys 0.000s
I20250625 03:31:40.807191 3906 tablet_bootstrap.cc:492] T 049948eeceeb43c98ccda9e839b521a8 P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:40.808142 3862 raft_consensus.cc:3058] T 5350a260b3364354b73176e6bdd77940 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:40.809628 3905 ts_tablet_manager.cc:1428] T aa64717b3f7d4af893e9908260f4520e P 841018313ad649679de64e006582f4c5: Time spent starting tablet: real 0.098s user 0.007s sys 0.005s
I20250625 03:31:40.810678 3905 tablet_bootstrap.cc:492] T 7257f8e1d9b24e3a9650c5838fe1a8c5 P 841018313ad649679de64e006582f4c5: Bootstrap starting.
I20250625 03:31:40.819105 3906 tablet_bootstrap.cc:654] T 049948eeceeb43c98ccda9e839b521a8 P 01873d289e0b4f9f9184b251369502a9: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:40.815564 4274 consensus_queue.cc:1035] T ea706d649de940bf8652264ed57a901f P 841018313ad649679de64e006582f4c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20250625 03:31:40.834139 3537 catalog_manager.cc:5582] T 049948eeceeb43c98ccda9e839b521a8 P ddc0ad67020f45edb3ba9c83cab687a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132). New cstate: current_term: 1 leader_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:40.837625 3536 catalog_manager.cc:5582] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 841018313ad649679de64e006582f4c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 841018313ad649679de64e006582f4c5 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "841018313ad649679de64e006582f4c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:40.841445 3910 tablet_bootstrap.cc:492] T 6de9e445ad834b008a2f513fac78dba1 P ddc0ad67020f45edb3ba9c83cab687a4: No bootstrap required, opened a new log
I20250625 03:31:40.841989 3910 ts_tablet_manager.cc:1397] T 6de9e445ad834b008a2f513fac78dba1 P ddc0ad67020f45edb3ba9c83cab687a4: Time spent bootstrapping tablet: real 0.114s user 0.009s sys 0.016s
I20250625 03:31:40.844834 3905 tablet_bootstrap.cc:654] T 7257f8e1d9b24e3a9650c5838fe1a8c5 P 841018313ad649679de64e006582f4c5: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:40.848644 3906 tablet_bootstrap.cc:492] T 049948eeceeb43c98ccda9e839b521a8 P 01873d289e0b4f9f9184b251369502a9: No bootstrap required, opened a new log
I20250625 03:31:40.849107 3906 ts_tablet_manager.cc:1397] T 049948eeceeb43c98ccda9e839b521a8 P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.042s user 0.019s sys 0.000s
I20250625 03:31:40.853055 3906 raft_consensus.cc:357] T 049948eeceeb43c98ccda9e839b521a8 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:40.873672 3905 tablet_bootstrap.cc:492] T 7257f8e1d9b24e3a9650c5838fe1a8c5 P 841018313ad649679de64e006582f4c5: No bootstrap required, opened a new log
I20250625 03:31:40.879814 3906 raft_consensus.cc:383] T 049948eeceeb43c98ccda9e839b521a8 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:40.877064 4268 consensus_queue.cc:1035] T 39880aedaeca464f81d899dc222a35b9 P ddc0ad67020f45edb3ba9c83cab687a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:31:40.880187 3906 raft_consensus.cc:738] T 049948eeceeb43c98ccda9e839b521a8 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:40.880157 3905 ts_tablet_manager.cc:1397] T 7257f8e1d9b24e3a9650c5838fe1a8c5 P 841018313ad649679de64e006582f4c5: Time spent bootstrapping tablet: real 0.070s user 0.014s sys 0.001s
I20250625 03:31:40.881065 3906 consensus_queue.cc:260] T 049948eeceeb43c98ccda9e839b521a8 P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:40.883394 3906 ts_tablet_manager.cc:1428] T 049948eeceeb43c98ccda9e839b521a8 P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.034s user 0.010s sys 0.001s
I20250625 03:31:40.884392 3906 tablet_bootstrap.cc:492] T aa64717b3f7d4af893e9908260f4520e P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:40.877116 3910 raft_consensus.cc:357] T 6de9e445ad834b008a2f513fac78dba1 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:40.892719 3910 raft_consensus.cc:383] T 6de9e445ad834b008a2f513fac78dba1 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:40.893174 3910 raft_consensus.cc:738] T 6de9e445ad834b008a2f513fac78dba1 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Initialized, Role: FOLLOWER
I20250625 03:31:40.895714 3910 consensus_queue.cc:260] T 6de9e445ad834b008a2f513fac78dba1 P ddc0ad67020f45edb3ba9c83cab687a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:40.898037 3910 ts_tablet_manager.cc:1428] T 6de9e445ad834b008a2f513fac78dba1 P ddc0ad67020f45edb3ba9c83cab687a4: Time spent starting tablet: real 0.056s user 0.008s sys 0.001s
I20250625 03:31:40.899415 3910 tablet_bootstrap.cc:492] T 6afeedd3b768470f921526d58704c21d P ddc0ad67020f45edb3ba9c83cab687a4: Bootstrap starting.
I20250625 03:31:40.900907 3905 raft_consensus.cc:357] T 7257f8e1d9b24e3a9650c5838fe1a8c5 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:40.901705 3905 raft_consensus.cc:383] T 7257f8e1d9b24e3a9650c5838fe1a8c5 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:40.901973 3905 raft_consensus.cc:738] T 7257f8e1d9b24e3a9650c5838fe1a8c5 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841018313ad649679de64e006582f4c5, State: Initialized, Role: FOLLOWER
I20250625 03:31:40.902592 3905 consensus_queue.cc:260] T 7257f8e1d9b24e3a9650c5838fe1a8c5 P 841018313ad649679de64e006582f4c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:40.903297 4275 consensus_queue.cc:1035] T e91e209dcfdb4fd0bebe666bbbe16b75 P 841018313ad649679de64e006582f4c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:31:40.905875 3905 ts_tablet_manager.cc:1428] T 7257f8e1d9b24e3a9650c5838fe1a8c5 P 841018313ad649679de64e006582f4c5: Time spent starting tablet: real 0.025s user 0.006s sys 0.000s
I20250625 03:31:40.907897 3905 tablet_bootstrap.cc:492] T b6311a11ae9e44bea3a7340b8134679b P 841018313ad649679de64e006582f4c5: Bootstrap starting.
W20250625 03:31:40.914911 3753 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.132:37353, user_credentials={real_user=slave}} blocked reactor thread for 58760.8us
I20250625 03:31:40.918099 4275 consensus_queue.cc:1035] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 841018313ad649679de64e006582f4c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:31:40.925942 4258 consensus_queue.cc:1035] T ea706d649de940bf8652264ed57a901f P 841018313ad649679de64e006582f4c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:31:40.932164 4079 raft_consensus.cc:491] T 7257f8e1d9b24e3a9650c5838fe1a8c5 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:40.932837 4079 raft_consensus.cc:513] T 7257f8e1d9b24e3a9650c5838fe1a8c5 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:40.935145 4079 leader_election.cc:290] T 7257f8e1d9b24e3a9650c5838fe1a8c5 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041), ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353)
I20250625 03:31:40.937351 3785 raft_consensus.cc:3058] T 6a179f065ae046df819a9bd88194dae6 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:40.942993 3910 tablet_bootstrap.cc:654] T 6afeedd3b768470f921526d58704c21d P ddc0ad67020f45edb3ba9c83cab687a4: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:40.943787 3715 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7257f8e1d9b24e3a9650c5838fe1a8c5" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" is_pre_election: true
I20250625 03:31:40.956454 3715 raft_consensus.cc:2466] T 7257f8e1d9b24e3a9650c5838fe1a8c5 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841018313ad649679de64e006582f4c5 in term 0.
I20250625 03:31:40.958272 3754 leader_election.cc:304] T 7257f8e1d9b24e3a9650c5838fe1a8c5 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, 841018313ad649679de64e006582f4c5; no voters:
I20250625 03:31:40.959074 4291 raft_consensus.cc:491] T 39880aedaeca464f81d899dc222a35b9 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:40.964093 4291 raft_consensus.cc:513] T 39880aedaeca464f81d899dc222a35b9 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:40.962337 4172 raft_consensus.cc:491] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:40.975647 4172 raft_consensus.cc:513] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:40.970250 3910 tablet_bootstrap.cc:492] T 6afeedd3b768470f921526d58704c21d P ddc0ad67020f45edb3ba9c83cab687a4: No bootstrap required, opened a new log
I20250625 03:31:40.973403 4268 consensus_queue.cc:1035] T 41d33fbc861a40338ae6da1732fb696b P ddc0ad67020f45edb3ba9c83cab687a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:31:40.977178 3910 ts_tablet_manager.cc:1397] T 6afeedd3b768470f921526d58704c21d P ddc0ad67020f45edb3ba9c83cab687a4: Time spent bootstrapping tablet: real 0.078s user 0.010s sys 0.005s
I20250625 03:31:40.974812 4291 leader_election.cc:290] T 39880aedaeca464f81d899dc222a35b9 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353)
I20250625 03:31:40.968923 3861 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7257f8e1d9b24e3a9650c5838fe1a8c5" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:40.976171 3859 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "39880aedaeca464f81d899dc222a35b9" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:40.981854 4172 leader_election.cc:290] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353)
I20250625 03:31:40.982151 3859 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3ae65ab4d0d2480cb3e4d2d0dd5f5c14" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:40.981365 3910 raft_consensus.cc:357] T 6afeedd3b768470f921526d58704c21d P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:40.982977 3910 raft_consensus.cc:383] T 6afeedd3b768470f921526d58704c21d P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:40.983285 3910 raft_consensus.cc:738] T 6afeedd3b768470f921526d58704c21d P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Initialized, Role: FOLLOWER
I20250625 03:31:40.984314 3859 raft_consensus.cc:2391] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01873d289e0b4f9f9184b251369502a9 in current term 1: Already voted for candidate 841018313ad649679de64e006582f4c5 in this term.
I20250625 03:31:40.986012 4275 raft_consensus.cc:491] T d657bcfa8eea4e7db43d4d2715857516 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:40.983978 3910 consensus_queue.cc:260] T 6afeedd3b768470f921526d58704c21d P ddc0ad67020f45edb3ba9c83cab687a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:40.961733 4176 raft_consensus.cc:2802] T 7257f8e1d9b24e3a9650c5838fe1a8c5 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:31:40.987321 4176 raft_consensus.cc:491] T 7257f8e1d9b24e3a9650c5838fe1a8c5 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:31:40.986570 4275 raft_consensus.cc:513] T d657bcfa8eea4e7db43d4d2715857516 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:40.990408 3910 ts_tablet_manager.cc:1428] T 6afeedd3b768470f921526d58704c21d P ddc0ad67020f45edb3ba9c83cab687a4: Time spent starting tablet: real 0.013s user 0.002s sys 0.005s
I20250625 03:31:40.990537 3905 tablet_bootstrap.cc:654] T b6311a11ae9e44bea3a7340b8134679b P 841018313ad649679de64e006582f4c5: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:40.990747 3640 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d657bcfa8eea4e7db43d4d2715857516" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:40.991662 3910 tablet_bootstrap.cc:492] T b6311a11ae9e44bea3a7340b8134679b P ddc0ad67020f45edb3ba9c83cab687a4: Bootstrap starting.
W20250625 03:31:40.992587 3754 leader_election.cc:343] T d657bcfa8eea4e7db43d4d2715857516 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:40.994009 4275 leader_election.cc:290] T d657bcfa8eea4e7db43d4d2715857516 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:31:40.994666 3713 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d657bcfa8eea4e7db43d4d2715857516" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" is_pre_election: true
I20250625 03:31:40.995412 3713 raft_consensus.cc:2466] T d657bcfa8eea4e7db43d4d2715857516 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841018313ad649679de64e006582f4c5 in term 0.
I20250625 03:31:40.987715 4176 raft_consensus.cc:3058] T 7257f8e1d9b24e3a9650c5838fe1a8c5 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:40.996869 3754 leader_election.cc:304] T d657bcfa8eea4e7db43d4d2715857516 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, 841018313ad649679de64e006582f4c5; no voters: 01873d289e0b4f9f9184b251369502a9
I20250625 03:31:40.998062 4079 raft_consensus.cc:2802] T d657bcfa8eea4e7db43d4d2715857516 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:31:40.998522 4079 raft_consensus.cc:491] T d657bcfa8eea4e7db43d4d2715857516 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:31:40.998967 4079 raft_consensus.cc:3058] T d657bcfa8eea4e7db43d4d2715857516 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:40.965142 3906 tablet_bootstrap.cc:654] T aa64717b3f7d4af893e9908260f4520e P 01873d289e0b4f9f9184b251369502a9: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:41.002658 3910 tablet_bootstrap.cc:654] T b6311a11ae9e44bea3a7340b8134679b P ddc0ad67020f45edb3ba9c83cab687a4: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:41.021278 3640 raft_consensus.cc:3058] T 39880aedaeca464f81d899dc222a35b9 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:41.030902 3786 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "39880aedaeca464f81d899dc222a35b9" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:31:41.032891 3932 consensus_queue.cc:1035] T 39880aedaeca464f81d899dc222a35b9 P ddc0ad67020f45edb3ba9c83cab687a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:31:41.038439 3932 consensus_queue.cc:1035] T 41d33fbc861a40338ae6da1732fb696b P ddc0ad67020f45edb3ba9c83cab687a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:31:41.046761 3786 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3ae65ab4d0d2480cb3e4d2d0dd5f5c14" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:31:41.050631 3605 leader_election.cc:304] T 39880aedaeca464f81d899dc222a35b9 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9; no voters: 841018313ad649679de64e006582f4c5, ddc0ad67020f45edb3ba9c83cab687a4
I20250625 03:31:41.052162 3605 leader_election.cc:304] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9; no voters: 841018313ad649679de64e006582f4c5, ddc0ad67020f45edb3ba9c83cab687a4
I20250625 03:31:41.054255 4172 raft_consensus.cc:3058] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:41.060040 3906 tablet_bootstrap.cc:492] T aa64717b3f7d4af893e9908260f4520e P 01873d289e0b4f9f9184b251369502a9: No bootstrap required, opened a new log
I20250625 03:31:41.060611 3906 ts_tablet_manager.cc:1397] T aa64717b3f7d4af893e9908260f4520e P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.176s user 0.008s sys 0.003s
I20250625 03:31:41.062242 3910 tablet_bootstrap.cc:492] T b6311a11ae9e44bea3a7340b8134679b P ddc0ad67020f45edb3ba9c83cab687a4: No bootstrap required, opened a new log
I20250625 03:31:41.062727 3910 ts_tablet_manager.cc:1397] T b6311a11ae9e44bea3a7340b8134679b P ddc0ad67020f45edb3ba9c83cab687a4: Time spent bootstrapping tablet: real 0.071s user 0.008s sys 0.010s
I20250625 03:31:41.063226 3906 raft_consensus.cc:357] T aa64717b3f7d4af893e9908260f4520e P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:41.064886 3910 raft_consensus.cc:357] T b6311a11ae9e44bea3a7340b8134679b P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:41.065369 3859 raft_consensus.cc:3058] T 6de9e445ad834b008a2f513fac78dba1 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:41.065725 3910 raft_consensus.cc:383] T b6311a11ae9e44bea3a7340b8134679b P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:41.066083 3910 raft_consensus.cc:738] T b6311a11ae9e44bea3a7340b8134679b P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Initialized, Role: FOLLOWER
I20250625 03:31:41.066588 4176 raft_consensus.cc:513] T 7257f8e1d9b24e3a9650c5838fe1a8c5 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:41.066756 3910 consensus_queue.cc:260] T b6311a11ae9e44bea3a7340b8134679b P ddc0ad67020f45edb3ba9c83cab687a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:41.067677 4268 raft_consensus.cc:491] T d83c6c79a784452289ba414976adb9e0 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:41.068266 4268 raft_consensus.cc:513] T d83c6c79a784452289ba414976adb9e0 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:41.070184 4268 leader_election.cc:290] T d83c6c79a784452289ba414976adb9e0 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:31:41.077389 3636 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d83c6c79a784452289ba414976adb9e0" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:41.080853 3715 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d83c6c79a784452289ba414976adb9e0" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" is_pre_election: true
I20250625 03:31:41.081534 3715 raft_consensus.cc:2466] T d83c6c79a784452289ba414976adb9e0 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddc0ad67020f45edb3ba9c83cab687a4 in term 0.
W20250625 03:31:41.050602 3753 leader_election.cc:343] T 7257f8e1d9b24e3a9650c5838fe1a8c5 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:41.086787 4272 consensus_queue.cc:1035] T e91e209dcfdb4fd0bebe666bbbe16b75 P 841018313ad649679de64e006582f4c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:31:41.090481 4275 consensus_queue.cc:1035] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 841018313ad649679de64e006582f4c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:31:41.098580 3712 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7257f8e1d9b24e3a9650c5838fe1a8c5" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
I20250625 03:31:41.099339 3712 raft_consensus.cc:3058] T 7257f8e1d9b24e3a9650c5838fe1a8c5 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:41.104660 4115 raft_consensus.cc:2747] T 39880aedaeca464f81d899dc222a35b9 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:31:41.089880 4079 raft_consensus.cc:513] T d657bcfa8eea4e7db43d4d2715857516 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:41.098258 4176 leader_election.cc:290] T 7257f8e1d9b24e3a9650c5838fe1a8c5 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 election: Requested vote from peers 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041), ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353)
I20250625 03:31:41.063961 3906 raft_consensus.cc:383] T aa64717b3f7d4af893e9908260f4520e P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:41.109710 3906 raft_consensus.cc:738] T aa64717b3f7d4af893e9908260f4520e P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:41.111136 3906 consensus_queue.cc:260] T aa64717b3f7d4af893e9908260f4520e P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:41.112902 3640 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d657bcfa8eea4e7db43d4d2715857516" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9"
I20250625 03:31:41.113529 3906 ts_tablet_manager.cc:1428] T aa64717b3f7d4af893e9908260f4520e P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.053s user 0.006s sys 0.000s
I20250625 03:31:41.114168 3712 raft_consensus.cc:2466] T 7257f8e1d9b24e3a9650c5838fe1a8c5 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841018313ad649679de64e006582f4c5 in term 1.
W20250625 03:31:41.114768 3754 leader_election.cc:343] T d657bcfa8eea4e7db43d4d2715857516 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:41.116366 3828 leader_election.cc:304] T d83c6c79a784452289ba414976adb9e0 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, ddc0ad67020f45edb3ba9c83cab687a4; no voters:
I20250625 03:31:41.117111 4262 raft_consensus.cc:2802] T d83c6c79a784452289ba414976adb9e0 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:31:41.117491 4262 raft_consensus.cc:491] T d83c6c79a784452289ba414976adb9e0 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:31:41.117811 4262 raft_consensus.cc:3058] T d83c6c79a784452289ba414976adb9e0 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:41.118043 3713 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d657bcfa8eea4e7db43d4d2715857516" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
I20250625 03:31:41.118470 3754 leader_election.cc:304] T 7257f8e1d9b24e3a9650c5838fe1a8c5 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, 841018313ad649679de64e006582f4c5; no voters:
I20250625 03:31:41.118664 3713 raft_consensus.cc:3058] T d657bcfa8eea4e7db43d4d2715857516 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:41.119764 4275 raft_consensus.cc:2802] T 7257f8e1d9b24e3a9650c5838fe1a8c5 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:31:41.120286 4275 raft_consensus.cc:695] T 7257f8e1d9b24e3a9650c5838fe1a8c5 P 841018313ad649679de64e006582f4c5 [term 1 LEADER]: Becoming Leader. State: Replica: 841018313ad649679de64e006582f4c5, State: Running, Role: LEADER
I20250625 03:31:41.121160 4275 consensus_queue.cc:237] T 7257f8e1d9b24e3a9650c5838fe1a8c5 P 841018313ad649679de64e006582f4c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:41.129055 3713 raft_consensus.cc:2466] T d657bcfa8eea4e7db43d4d2715857516 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841018313ad649679de64e006582f4c5 in term 1.
I20250625 03:31:41.130746 3754 leader_election.cc:304] T d657bcfa8eea4e7db43d4d2715857516 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, 841018313ad649679de64e006582f4c5; no voters: 01873d289e0b4f9f9184b251369502a9
I20250625 03:31:41.132251 4258 raft_consensus.cc:2802] T d657bcfa8eea4e7db43d4d2715857516 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Leader election won for term 1
W20250625 03:31:41.132640 3828 leader_election.cc:343] T d83c6c79a784452289ba414976adb9e0 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:41.133095 4258 raft_consensus.cc:695] T d657bcfa8eea4e7db43d4d2715857516 P 841018313ad649679de64e006582f4c5 [term 1 LEADER]: Becoming Leader. State: Replica: 841018313ad649679de64e006582f4c5, State: Running, Role: LEADER
I20250625 03:31:41.134514 4262 raft_consensus.cc:513] T d83c6c79a784452289ba414976adb9e0 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:41.158130 4262 leader_election.cc:290] T d83c6c79a784452289ba414976adb9e0 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 election: Requested vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:31:41.134373 4258 consensus_queue.cc:237] T d657bcfa8eea4e7db43d4d2715857516 P 841018313ad649679de64e006582f4c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:41.160961 3910 ts_tablet_manager.cc:1428] T b6311a11ae9e44bea3a7340b8134679b P ddc0ad67020f45edb3ba9c83cab687a4: Time spent starting tablet: real 0.098s user 0.031s sys 0.049s
I20250625 03:31:41.161996 3910 tablet_bootstrap.cc:492] T 7257f8e1d9b24e3a9650c5838fe1a8c5 P ddc0ad67020f45edb3ba9c83cab687a4: Bootstrap starting.
I20250625 03:31:41.138978 3905 tablet_bootstrap.cc:492] T b6311a11ae9e44bea3a7340b8134679b P 841018313ad649679de64e006582f4c5: No bootstrap required, opened a new log
I20250625 03:31:41.163305 3905 ts_tablet_manager.cc:1397] T b6311a11ae9e44bea3a7340b8134679b P 841018313ad649679de64e006582f4c5: Time spent bootstrapping tablet: real 0.256s user 0.010s sys 0.004s
I20250625 03:31:41.165156 4262 raft_consensus.cc:491] T 6afeedd3b768470f921526d58704c21d P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:41.165877 3905 raft_consensus.cc:357] T b6311a11ae9e44bea3a7340b8134679b P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:41.166649 3905 raft_consensus.cc:383] T b6311a11ae9e44bea3a7340b8134679b P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:41.166918 3905 raft_consensus.cc:738] T b6311a11ae9e44bea3a7340b8134679b P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841018313ad649679de64e006582f4c5, State: Initialized, Role: FOLLOWER
I20250625 03:31:41.165786 4262 raft_consensus.cc:513] T 6afeedd3b768470f921526d58704c21d P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:41.167886 3910 tablet_bootstrap.cc:654] T 7257f8e1d9b24e3a9650c5838fe1a8c5 P ddc0ad67020f45edb3ba9c83cab687a4: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:41.136291 4079 leader_election.cc:290] T d657bcfa8eea4e7db43d4d2715857516 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 election: Requested vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:31:41.139595 4172 raft_consensus.cc:2747] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:31:41.144738 4176 raft_consensus.cc:491] T aa64717b3f7d4af893e9908260f4520e P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:41.170760 4176 raft_consensus.cc:513] T aa64717b3f7d4af893e9908260f4520e P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:41.174584 3638 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "aa64717b3f7d4af893e9908260f4520e" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:41.175452 3638 raft_consensus.cc:2466] T aa64717b3f7d4af893e9908260f4520e P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841018313ad649679de64e006582f4c5 in term 0.
I20250625 03:31:41.176370 4262 leader_election.cc:290] T 6afeedd3b768470f921526d58704c21d P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:31:41.177425 3754 leader_election.cc:304] T aa64717b3f7d4af893e9908260f4520e P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9, 841018313ad649679de64e006582f4c5; no voters:
I20250625 03:31:41.179518 4176 leader_election.cc:290] T aa64717b3f7d4af893e9908260f4520e P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:31:41.181197 4176 raft_consensus.cc:2802] T aa64717b3f7d4af893e9908260f4520e P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:31:41.181684 4176 raft_consensus.cc:491] T aa64717b3f7d4af893e9908260f4520e P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:31:41.182039 4176 raft_consensus.cc:3058] T aa64717b3f7d4af893e9908260f4520e P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:41.158813 3906 tablet_bootstrap.cc:492] T d657bcfa8eea4e7db43d4d2715857516 P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:41.187561 4079 consensus_queue.cc:1035] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 841018313ad649679de64e006582f4c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:31:41.193147 3639 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6afeedd3b768470f921526d58704c21d" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:41.196290 3715 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6afeedd3b768470f921526d58704c21d" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" is_pre_election: true
I20250625 03:31:41.197026 3715 raft_consensus.cc:2466] T 6afeedd3b768470f921526d58704c21d P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddc0ad67020f45edb3ba9c83cab687a4 in term 0.
I20250625 03:31:41.199137 3906 tablet_bootstrap.cc:654] T d657bcfa8eea4e7db43d4d2715857516 P 01873d289e0b4f9f9184b251369502a9: Neither blocks nor log segments found. Creating new log.
W20250625 03:31:41.134930 3753 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.132:37353, user_credentials={real_user=slave}} blocked reactor thread for 48279.9us
I20250625 03:31:41.188778 3910 tablet_bootstrap.cc:492] T 7257f8e1d9b24e3a9650c5838fe1a8c5 P ddc0ad67020f45edb3ba9c83cab687a4: No bootstrap required, opened a new log
I20250625 03:31:41.201030 3910 ts_tablet_manager.cc:1397] T 7257f8e1d9b24e3a9650c5838fe1a8c5 P ddc0ad67020f45edb3ba9c83cab687a4: Time spent bootstrapping tablet: real 0.039s user 0.009s sys 0.008s
I20250625 03:31:41.189148 3638 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d83c6c79a784452289ba414976adb9e0" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9"
I20250625 03:31:41.190622 3712 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d83c6c79a784452289ba414976adb9e0" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
I20250625 03:31:41.202675 3712 raft_consensus.cc:3058] T d83c6c79a784452289ba414976adb9e0 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:41.202030 3828 leader_election.cc:304] T 6afeedd3b768470f921526d58704c21d P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, ddc0ad67020f45edb3ba9c83cab687a4; no voters:
I20250625 03:31:41.204001 4262 raft_consensus.cc:2802] T 6afeedd3b768470f921526d58704c21d P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:31:41.204458 4262 raft_consensus.cc:491] T 6afeedd3b768470f921526d58704c21d P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:31:41.204861 4262 raft_consensus.cc:3058] T 6afeedd3b768470f921526d58704c21d P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:41.182626 3713 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "aa64717b3f7d4af893e9908260f4520e" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" is_pre_election: true
W20250625 03:31:41.206926 3828 leader_election.cc:343] T 6afeedd3b768470f921526d58704c21d P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:41.207298 3713 raft_consensus.cc:2466] T aa64717b3f7d4af893e9908260f4520e P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841018313ad649679de64e006582f4c5 in term 0.
I20250625 03:31:41.214082 3862 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7257f8e1d9b24e3a9650c5838fe1a8c5" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4"
I20250625 03:31:41.214406 3712 raft_consensus.cc:2466] T d83c6c79a784452289ba414976adb9e0 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddc0ad67020f45edb3ba9c83cab687a4 in term 1.
I20250625 03:31:41.208359 3910 raft_consensus.cc:357] T 7257f8e1d9b24e3a9650c5838fe1a8c5 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:41.216102 3910 raft_consensus.cc:383] T 7257f8e1d9b24e3a9650c5838fe1a8c5 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:41.216461 3910 raft_consensus.cc:738] T 7257f8e1d9b24e3a9650c5838fe1a8c5 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Initialized, Role: FOLLOWER
W20250625 03:31:41.207958 3828 leader_election.cc:343] T d83c6c79a784452289ba414976adb9e0 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:41.167577 3905 consensus_queue.cc:260] T b6311a11ae9e44bea3a7340b8134679b P 841018313ad649679de64e006582f4c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:41.217151 3910 consensus_queue.cc:260] T 7257f8e1d9b24e3a9650c5838fe1a8c5 P ddc0ad67020f45edb3ba9c83cab687a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:41.218691 3862 raft_consensus.cc:3058] T 7257f8e1d9b24e3a9650c5838fe1a8c5 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:41.219584 3910 ts_tablet_manager.cc:1428] T 7257f8e1d9b24e3a9650c5838fe1a8c5 P ddc0ad67020f45edb3ba9c83cab687a4: Time spent starting tablet: real 0.018s user 0.004s sys 0.000s
I20250625 03:31:41.220618 3910 tablet_bootstrap.cc:492] T 7c1dda599f144ecfab4c075ee4e28c16 P ddc0ad67020f45edb3ba9c83cab687a4: Bootstrap starting.
I20250625 03:31:41.227840 3905 ts_tablet_manager.cc:1428] T b6311a11ae9e44bea3a7340b8134679b P 841018313ad649679de64e006582f4c5: Time spent starting tablet: real 0.064s user 0.006s sys 0.000s
I20250625 03:31:41.243309 3905 tablet_bootstrap.cc:492] T 7c1dda599f144ecfab4c075ee4e28c16 P 841018313ad649679de64e006582f4c5: Bootstrap starting.
I20250625 03:31:41.228754 3910 tablet_bootstrap.cc:654] T 7c1dda599f144ecfab4c075ee4e28c16 P ddc0ad67020f45edb3ba9c83cab687a4: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:41.230245 3828 leader_election.cc:304] T d83c6c79a784452289ba414976adb9e0 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, ddc0ad67020f45edb3ba9c83cab687a4; no voters: 01873d289e0b4f9f9184b251369502a9
I20250625 03:31:41.231109 4176 raft_consensus.cc:513] T aa64717b3f7d4af893e9908260f4520e P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:41.249349 4316 raft_consensus.cc:2802] T d83c6c79a784452289ba414976adb9e0 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:31:41.249871 4316 raft_consensus.cc:695] T d83c6c79a784452289ba414976adb9e0 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 LEADER]: Becoming Leader. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Running, Role: LEADER
I20250625 03:31:41.250720 4316 consensus_queue.cc:237] T d83c6c79a784452289ba414976adb9e0 P ddc0ad67020f45edb3ba9c83cab687a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:41.251637 3638 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "aa64717b3f7d4af893e9908260f4520e" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9"
I20250625 03:31:41.252250 3638 raft_consensus.cc:3058] T aa64717b3f7d4af893e9908260f4520e P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:41.252866 3906 tablet_bootstrap.cc:492] T d657bcfa8eea4e7db43d4d2715857516 P 01873d289e0b4f9f9184b251369502a9: No bootstrap required, opened a new log
I20250625 03:31:41.253345 3906 ts_tablet_manager.cc:1397] T d657bcfa8eea4e7db43d4d2715857516 P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.097s user 0.009s sys 0.001s
I20250625 03:31:41.257815 3640 raft_consensus.cc:3058] T 049948eeceeb43c98ccda9e839b521a8 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:41.259229 3862 raft_consensus.cc:2466] T 7257f8e1d9b24e3a9650c5838fe1a8c5 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841018313ad649679de64e006582f4c5 in term 1.
I20250625 03:31:41.261413 4176 leader_election.cc:290] T aa64717b3f7d4af893e9908260f4520e P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 election: Requested vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:31:41.261658 3712 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "aa64717b3f7d4af893e9908260f4520e" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
I20250625 03:31:41.262275 3712 raft_consensus.cc:3058] T aa64717b3f7d4af893e9908260f4520e P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:41.263886 3905 tablet_bootstrap.cc:654] T 7c1dda599f144ecfab4c075ee4e28c16 P 841018313ad649679de64e006582f4c5: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:41.271121 3712 raft_consensus.cc:2466] T aa64717b3f7d4af893e9908260f4520e P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841018313ad649679de64e006582f4c5 in term 1.
I20250625 03:31:41.271482 3906 raft_consensus.cc:357] T d657bcfa8eea4e7db43d4d2715857516 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:41.272331 3906 raft_consensus.cc:383] T d657bcfa8eea4e7db43d4d2715857516 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:41.272614 3906 raft_consensus.cc:738] T d657bcfa8eea4e7db43d4d2715857516 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:41.272761 3638 raft_consensus.cc:2466] T aa64717b3f7d4af893e9908260f4520e P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841018313ad649679de64e006582f4c5 in term 1.
I20250625 03:31:41.273255 3906 consensus_queue.cc:260] T d657bcfa8eea4e7db43d4d2715857516 P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:41.274355 3754 leader_election.cc:304] T aa64717b3f7d4af893e9908260f4520e P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9, 841018313ad649679de64e006582f4c5; no voters:
I20250625 03:31:41.275425 4258 raft_consensus.cc:2802] T aa64717b3f7d4af893e9908260f4520e P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:31:41.275902 4258 raft_consensus.cc:695] T aa64717b3f7d4af893e9908260f4520e P 841018313ad649679de64e006582f4c5 [term 1 LEADER]: Becoming Leader. State: Replica: 841018313ad649679de64e006582f4c5, State: Running, Role: LEADER
I20250625 03:31:41.278098 4258 consensus_queue.cc:237] T aa64717b3f7d4af893e9908260f4520e P 841018313ad649679de64e006582f4c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:41.280809 4176 consensus_queue.cc:1035] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 841018313ad649679de64e006582f4c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:31:41.282946 3537 catalog_manager.cc:5582] T 7257f8e1d9b24e3a9650c5838fe1a8c5 P 841018313ad649679de64e006582f4c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 841018313ad649679de64e006582f4c5 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "841018313ad649679de64e006582f4c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:41.287783 3537 catalog_manager.cc:5582] T d657bcfa8eea4e7db43d4d2715857516 P 841018313ad649679de64e006582f4c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 841018313ad649679de64e006582f4c5 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "841018313ad649679de64e006582f4c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: HEALTHY } } }
I20250625 03:31:41.292318 3910 tablet_bootstrap.cc:492] T 7c1dda599f144ecfab4c075ee4e28c16 P ddc0ad67020f45edb3ba9c83cab687a4: No bootstrap required, opened a new log
I20250625 03:31:41.292917 3910 ts_tablet_manager.cc:1397] T 7c1dda599f144ecfab4c075ee4e28c16 P ddc0ad67020f45edb3ba9c83cab687a4: Time spent bootstrapping tablet: real 0.073s user 0.013s sys 0.000s
I20250625 03:31:41.296258 3910 raft_consensus.cc:357] T 7c1dda599f144ecfab4c075ee4e28c16 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:41.297333 3910 raft_consensus.cc:383] T 7c1dda599f144ecfab4c075ee4e28c16 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:41.297694 3910 raft_consensus.cc:738] T 7c1dda599f144ecfab4c075ee4e28c16 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Initialized, Role: FOLLOWER
I20250625 03:31:41.298396 3910 consensus_queue.cc:260] T 7c1dda599f144ecfab4c075ee4e28c16 P ddc0ad67020f45edb3ba9c83cab687a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:41.297894 4262 raft_consensus.cc:513] T 6afeedd3b768470f921526d58704c21d P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:41.303357 4262 leader_election.cc:290] T 6afeedd3b768470f921526d58704c21d P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 election: Requested vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:31:41.303380 3910 ts_tablet_manager.cc:1428] T 7c1dda599f144ecfab4c075ee4e28c16 P ddc0ad67020f45edb3ba9c83cab687a4: Time spent starting tablet: real 0.010s user 0.006s sys 0.000s
I20250625 03:31:41.314520 3638 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6afeedd3b768470f921526d58704c21d" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9"
I20250625 03:31:41.314664 3712 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6afeedd3b768470f921526d58704c21d" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
I20250625 03:31:41.315513 3712 raft_consensus.cc:3058] T 6afeedd3b768470f921526d58704c21d P 3d5b9823dfcd41cb92bd195c811cbf39 [term 0 FOLLOWER]: Advancing to term 1
W20250625 03:31:41.318667 3828 leader_election.cc:343] T 6afeedd3b768470f921526d58704c21d P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:41.331063 3712 raft_consensus.cc:2466] T 6afeedd3b768470f921526d58704c21d P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddc0ad67020f45edb3ba9c83cab687a4 in term 1.
I20250625 03:31:41.332084 4115 raft_consensus.cc:491] T 049948eeceeb43c98ccda9e839b521a8 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:41.332382 3828 leader_election.cc:304] T 6afeedd3b768470f921526d58704c21d P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, ddc0ad67020f45edb3ba9c83cab687a4; no voters: 01873d289e0b4f9f9184b251369502a9
I20250625 03:31:41.332646 4115 raft_consensus.cc:513] T 049948eeceeb43c98ccda9e839b521a8 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:41.339560 4316 raft_consensus.cc:2802] T 6afeedd3b768470f921526d58704c21d P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:31:41.340139 4316 raft_consensus.cc:695] T 6afeedd3b768470f921526d58704c21d P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 LEADER]: Becoming Leader. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Running, Role: LEADER
I20250625 03:31:41.340999 4316 consensus_queue.cc:237] T 6afeedd3b768470f921526d58704c21d P ddc0ad67020f45edb3ba9c83cab687a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:41.348649 4115 leader_election.cc:290] T 049948eeceeb43c98ccda9e839b521a8 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:31:41.350546 3715 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "049948eeceeb43c98ccda9e839b521a8" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" is_pre_election: true
I20250625 03:31:41.351574 3715 raft_consensus.cc:2466] T 049948eeceeb43c98ccda9e839b521a8 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01873d289e0b4f9f9184b251369502a9 in term 1.
I20250625 03:31:41.353348 3605 leader_election.cc:304] T 049948eeceeb43c98ccda9e839b521a8 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9, 3d5b9823dfcd41cb92bd195c811cbf39; no voters:
I20250625 03:31:41.356345 3906 ts_tablet_manager.cc:1428] T d657bcfa8eea4e7db43d4d2715857516 P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.103s user 0.008s sys 0.000s
I20250625 03:31:41.356926 4115 raft_consensus.cc:2802] T 049948eeceeb43c98ccda9e839b521a8 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250625 03:31:41.357384 4115 raft_consensus.cc:491] T 049948eeceeb43c98ccda9e839b521a8 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:31:41.357762 4115 raft_consensus.cc:3058] T 049948eeceeb43c98ccda9e839b521a8 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:41.360042 3906 tablet_bootstrap.cc:492] T b6311a11ae9e44bea3a7340b8134679b P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:41.363240 3861 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "049948eeceeb43c98ccda9e839b521a8" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:41.367017 3534 catalog_manager.cc:5582] T d83c6c79a784452289ba414976adb9e0 P ddc0ad67020f45edb3ba9c83cab687a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132). New cstate: current_term: 1 leader_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:41.370100 4268 consensus_queue.cc:1035] T 049948eeceeb43c98ccda9e839b521a8 P ddc0ad67020f45edb3ba9c83cab687a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:31:41.371711 4268 raft_consensus.cc:491] T b6311a11ae9e44bea3a7340b8134679b P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:41.372287 4268 raft_consensus.cc:513] T b6311a11ae9e44bea3a7340b8134679b P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:41.377202 4115 raft_consensus.cc:513] T 049948eeceeb43c98ccda9e839b521a8 P 01873d289e0b4f9f9184b251369502a9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:41.377657 4268 leader_election.cc:290] T b6311a11ae9e44bea3a7340b8134679b P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:31:41.379354 4115 leader_election.cc:290] T 049948eeceeb43c98ccda9e839b521a8 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 2 election: Requested vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:31:41.379978 3640 raft_consensus.cc:1238] T 049948eeceeb43c98ccda9e839b521a8 P 01873d289e0b4f9f9184b251369502a9 [term 2 FOLLOWER]: Rejecting Update request from peer ddc0ad67020f45edb3ba9c83cab687a4 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20250625 03:31:41.380877 3715 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "049948eeceeb43c98ccda9e839b521a8" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
I20250625 03:31:41.381503 3715 raft_consensus.cc:3058] T 049948eeceeb43c98ccda9e839b521a8 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:41.382819 3640 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b6311a11ae9e44bea3a7340b8134679b" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:41.384140 3861 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "049948eeceeb43c98ccda9e839b521a8" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4"
I20250625 03:31:41.387948 4316 consensus_queue.cc:1046] T 049948eeceeb43c98ccda9e839b521a8 P ddc0ad67020f45edb3ba9c83cab687a4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250625 03:31:41.388322 3828 leader_election.cc:343] T b6311a11ae9e44bea3a7340b8134679b P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:41.388837 4316 raft_consensus.cc:3053] T 049948eeceeb43c98ccda9e839b521a8 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:31:41.389457 4316 raft_consensus.cc:738] T 049948eeceeb43c98ccda9e839b521a8 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Running, Role: LEADER
I20250625 03:31:41.389869 3715 raft_consensus.cc:2466] T 049948eeceeb43c98ccda9e839b521a8 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01873d289e0b4f9f9184b251369502a9 in term 2.
I20250625 03:31:41.391031 3713 raft_consensus.cc:1238] T 049948eeceeb43c98ccda9e839b521a8 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Rejecting Update request from peer ddc0ad67020f45edb3ba9c83cab687a4 for earlier term 1. Current term is 2. Ops: []
I20250625 03:31:41.391299 3605 leader_election.cc:304] T 049948eeceeb43c98ccda9e839b521a8 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9, 3d5b9823dfcd41cb92bd195c811cbf39; no voters: ddc0ad67020f45edb3ba9c83cab687a4
I20250625 03:31:41.393887 4291 raft_consensus.cc:2802] T 049948eeceeb43c98ccda9e839b521a8 P 01873d289e0b4f9f9184b251369502a9 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:31:41.394423 4291 raft_consensus.cc:695] T 049948eeceeb43c98ccda9e839b521a8 P 01873d289e0b4f9f9184b251369502a9 [term 2 LEADER]: Becoming Leader. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Running, Role: LEADER
I20250625 03:31:41.395211 4291 consensus_queue.cc:237] T 049948eeceeb43c98ccda9e839b521a8 P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:41.395493 3785 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b6311a11ae9e44bea3a7340b8134679b" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:31:41.396189 3785 raft_consensus.cc:2466] T b6311a11ae9e44bea3a7340b8134679b P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddc0ad67020f45edb3ba9c83cab687a4 in term 0.
I20250625 03:31:41.399252 3828 leader_election.cc:304] T b6311a11ae9e44bea3a7340b8134679b P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841018313ad649679de64e006582f4c5, ddc0ad67020f45edb3ba9c83cab687a4; no voters: 01873d289e0b4f9f9184b251369502a9
I20250625 03:31:41.399986 4262 raft_consensus.cc:2802] T b6311a11ae9e44bea3a7340b8134679b P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:31:41.400388 4262 raft_consensus.cc:491] T b6311a11ae9e44bea3a7340b8134679b P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:31:41.400731 4262 raft_consensus.cc:3058] T b6311a11ae9e44bea3a7340b8134679b P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:41.396337 3906 tablet_bootstrap.cc:654] T b6311a11ae9e44bea3a7340b8134679b P 01873d289e0b4f9f9184b251369502a9: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:41.402220 3534 catalog_manager.cc:5582] T 6afeedd3b768470f921526d58704c21d P ddc0ad67020f45edb3ba9c83cab687a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132). New cstate: current_term: 1 leader_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:41.391551 3905 tablet_bootstrap.cc:492] T 7c1dda599f144ecfab4c075ee4e28c16 P 841018313ad649679de64e006582f4c5: No bootstrap required, opened a new log
I20250625 03:31:41.407759 3905 ts_tablet_manager.cc:1397] T 7c1dda599f144ecfab4c075ee4e28c16 P 841018313ad649679de64e006582f4c5: Time spent bootstrapping tablet: real 0.165s user 0.021s sys 0.008s
I20250625 03:31:41.415234 4262 raft_consensus.cc:513] T b6311a11ae9e44bea3a7340b8134679b P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:41.421576 3906 tablet_bootstrap.cc:492] T b6311a11ae9e44bea3a7340b8134679b P 01873d289e0b4f9f9184b251369502a9: No bootstrap required, opened a new log
I20250625 03:31:41.417625 3537 catalog_manager.cc:5582] T aa64717b3f7d4af893e9908260f4520e P 841018313ad649679de64e006582f4c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 841018313ad649679de64e006582f4c5 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "841018313ad649679de64e006582f4c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: HEALTHY } } }
I20250625 03:31:41.422222 3906 ts_tablet_manager.cc:1397] T b6311a11ae9e44bea3a7340b8134679b P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.065s user 0.010s sys 0.014s
I20250625 03:31:41.423131 3905 raft_consensus.cc:357] T 7c1dda599f144ecfab4c075ee4e28c16 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:41.390496 4316 consensus_queue.cc:260] T 049948eeceeb43c98ccda9e839b521a8 P ddc0ad67020f45edb3ba9c83cab687a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:41.424495 4268 consensus_queue.cc:1046] T 049948eeceeb43c98ccda9e839b521a8 P ddc0ad67020f45edb3ba9c83cab687a4 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:31:41.424729 3906 raft_consensus.cc:357] T b6311a11ae9e44bea3a7340b8134679b P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:41.425575 3906 raft_consensus.cc:383] T b6311a11ae9e44bea3a7340b8134679b P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:41.426100 3906 raft_consensus.cc:738] T b6311a11ae9e44bea3a7340b8134679b P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:41.426352 4316 raft_consensus.cc:3058] T 049948eeceeb43c98ccda9e839b521a8 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:41.426733 3906 consensus_queue.cc:260] T b6311a11ae9e44bea3a7340b8134679b P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:41.428493 3534 catalog_manager.cc:5582] T 049948eeceeb43c98ccda9e839b521a8 P 01873d289e0b4f9f9184b251369502a9 reported cstate change: term changed from 1 to 2, leader changed from ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132) to 01873d289e0b4f9f9184b251369502a9 (127.0.106.129). New cstate: current_term: 2 leader_uuid: "01873d289e0b4f9f9184b251369502a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:41.429410 3906 ts_tablet_manager.cc:1428] T b6311a11ae9e44bea3a7340b8134679b P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.007s user 0.005s sys 0.002s
I20250625 03:31:41.430485 3906 tablet_bootstrap.cc:492] T d83c6c79a784452289ba414976adb9e0 P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:41.423985 3905 raft_consensus.cc:383] T 7c1dda599f144ecfab4c075ee4e28c16 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:41.434259 3905 raft_consensus.cc:738] T 7c1dda599f144ecfab4c075ee4e28c16 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841018313ad649679de64e006582f4c5, State: Initialized, Role: FOLLOWER
I20250625 03:31:41.434933 3905 consensus_queue.cc:260] T 7c1dda599f144ecfab4c075ee4e28c16 P 841018313ad649679de64e006582f4c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:41.436936 3906 tablet_bootstrap.cc:654] T d83c6c79a784452289ba414976adb9e0 P 01873d289e0b4f9f9184b251369502a9: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:41.437359 3905 ts_tablet_manager.cc:1428] T 7c1dda599f144ecfab4c075ee4e28c16 P 841018313ad649679de64e006582f4c5: Time spent starting tablet: real 0.018s user 0.000s sys 0.005s
I20250625 03:31:41.438838 4262 leader_election.cc:290] T b6311a11ae9e44bea3a7340b8134679b P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 election: Requested vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:31:41.450057 3785 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b6311a11ae9e44bea3a7340b8134679b" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5"
I20250625 03:31:41.450824 3785 raft_consensus.cc:3058] T b6311a11ae9e44bea3a7340b8134679b P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:41.458671 3638 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b6311a11ae9e44bea3a7340b8134679b" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9"
I20250625 03:31:41.459312 3638 raft_consensus.cc:3058] T b6311a11ae9e44bea3a7340b8134679b P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:41.459664 3785 raft_consensus.cc:2466] T b6311a11ae9e44bea3a7340b8134679b P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddc0ad67020f45edb3ba9c83cab687a4 in term 1.
I20250625 03:31:41.460987 3828 leader_election.cc:304] T b6311a11ae9e44bea3a7340b8134679b P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841018313ad649679de64e006582f4c5, ddc0ad67020f45edb3ba9c83cab687a4; no voters:
I20250625 03:31:41.461537 4262 raft_consensus.cc:2802] T b6311a11ae9e44bea3a7340b8134679b P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:31:41.461977 4262 raft_consensus.cc:695] T b6311a11ae9e44bea3a7340b8134679b P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 LEADER]: Becoming Leader. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Running, Role: LEADER
I20250625 03:31:41.462744 4262 consensus_queue.cc:237] T b6311a11ae9e44bea3a7340b8134679b P ddc0ad67020f45edb3ba9c83cab687a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:41.466181 3638 raft_consensus.cc:2466] T b6311a11ae9e44bea3a7340b8134679b P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddc0ad67020f45edb3ba9c83cab687a4 in term 1.
I20250625 03:31:41.466181 3906 tablet_bootstrap.cc:492] T d83c6c79a784452289ba414976adb9e0 P 01873d289e0b4f9f9184b251369502a9: No bootstrap required, opened a new log
I20250625 03:31:41.468389 3906 ts_tablet_manager.cc:1397] T d83c6c79a784452289ba414976adb9e0 P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.038s user 0.013s sys 0.002s
I20250625 03:31:41.471879 3906 raft_consensus.cc:357] T d83c6c79a784452289ba414976adb9e0 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:41.473721 3906 raft_consensus.cc:383] T d83c6c79a784452289ba414976adb9e0 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:41.474048 3906 raft_consensus.cc:738] T d83c6c79a784452289ba414976adb9e0 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:41.474810 3906 consensus_queue.cc:260] T d83c6c79a784452289ba414976adb9e0 P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:41.477159 3906 ts_tablet_manager.cc:1428] T d83c6c79a784452289ba414976adb9e0 P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.008s user 0.004s sys 0.001s
I20250625 03:31:41.478498 3906 tablet_bootstrap.cc:492] T 6afeedd3b768470f921526d58704c21d P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:41.485381 3906 tablet_bootstrap.cc:654] T 6afeedd3b768470f921526d58704c21d P 01873d289e0b4f9f9184b251369502a9: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:41.509446 3906 tablet_bootstrap.cc:492] T 6afeedd3b768470f921526d58704c21d P 01873d289e0b4f9f9184b251369502a9: No bootstrap required, opened a new log
I20250625 03:31:41.509931 3906 ts_tablet_manager.cc:1397] T 6afeedd3b768470f921526d58704c21d P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.032s user 0.015s sys 0.012s
I20250625 03:31:41.513559 3906 raft_consensus.cc:357] T 6afeedd3b768470f921526d58704c21d P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:41.514923 3906 raft_consensus.cc:383] T 6afeedd3b768470f921526d58704c21d P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:41.514288 3534 catalog_manager.cc:5582] T b6311a11ae9e44bea3a7340b8134679b P ddc0ad67020f45edb3ba9c83cab687a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132). New cstate: current_term: 1 leader_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:41.515244 3906 raft_consensus.cc:738] T 6afeedd3b768470f921526d58704c21d P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:41.516405 3906 consensus_queue.cc:260] T 6afeedd3b768470f921526d58704c21d P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
W20250625 03:31:41.521140 3585 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20250625 03:31:41.519217 3906 ts_tablet_manager.cc:1428] T 6afeedd3b768470f921526d58704c21d P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.008s user 0.002s sys 0.002s
I20250625 03:31:41.523216 3906 tablet_bootstrap.cc:492] T 7c1dda599f144ecfab4c075ee4e28c16 P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:41.529824 3906 tablet_bootstrap.cc:654] T 7c1dda599f144ecfab4c075ee4e28c16 P 01873d289e0b4f9f9184b251369502a9: Neither blocks nor log segments found. Creating new log.
I20250625 03:31:41.536201 3906 tablet_bootstrap.cc:492] T 7c1dda599f144ecfab4c075ee4e28c16 P 01873d289e0b4f9f9184b251369502a9: No bootstrap required, opened a new log
I20250625 03:31:41.536549 3906 ts_tablet_manager.cc:1397] T 7c1dda599f144ecfab4c075ee4e28c16 P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.014s user 0.011s sys 0.000s
I20250625 03:31:41.538374 3906 raft_consensus.cc:357] T 7c1dda599f144ecfab4c075ee4e28c16 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:41.538851 3906 raft_consensus.cc:383] T 7c1dda599f144ecfab4c075ee4e28c16 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:31:41.539043 3906 raft_consensus.cc:738] T 7c1dda599f144ecfab4c075ee4e28c16 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:41.539530 3906 consensus_queue.cc:260] T 7c1dda599f144ecfab4c075ee4e28c16 P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:41.541147 3906 ts_tablet_manager.cc:1428] T 7c1dda599f144ecfab4c075ee4e28c16 P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20250625 03:31:41.550606 4172 raft_consensus.cc:491] T 6afeedd3b768470f921526d58704c21d P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:41.551107 4172 raft_consensus.cc:513] T 6afeedd3b768470f921526d58704c21d P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:41.553073 4172 leader_election.cc:290] T 6afeedd3b768470f921526d58704c21d P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:31:41.553323 3640 raft_consensus.cc:3058] T d657bcfa8eea4e7db43d4d2715857516 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:41.553736 3861 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6afeedd3b768470f921526d58704c21d" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:41.554632 3713 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6afeedd3b768470f921526d58704c21d" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" is_pre_election: true
I20250625 03:31:41.555403 3713 raft_consensus.cc:2391] T 6afeedd3b768470f921526d58704c21d P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01873d289e0b4f9f9184b251369502a9 in current term 1: Already voted for candidate ddc0ad67020f45edb3ba9c83cab687a4 in this term.
I20250625 03:31:41.556339 3605 leader_election.cc:304] T 6afeedd3b768470f921526d58704c21d P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9; no voters: 3d5b9823dfcd41cb92bd195c811cbf39, ddc0ad67020f45edb3ba9c83cab687a4
I20250625 03:31:41.557425 4172 raft_consensus.cc:3058] T 6afeedd3b768470f921526d58704c21d P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:41.563668 4275 consensus_queue.cc:1035] T d657bcfa8eea4e7db43d4d2715857516 P 841018313ad649679de64e006582f4c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:31:41.565553 4172 raft_consensus.cc:2747] T 6afeedd3b768470f921526d58704c21d P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:31:41.582479 4274 consensus_queue.cc:1035] T d657bcfa8eea4e7db43d4d2715857516 P 841018313ad649679de64e006582f4c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:31:41.613106 4275 consensus_queue.cc:1035] T 7257f8e1d9b24e3a9650c5838fe1a8c5 P 841018313ad649679de64e006582f4c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:31:41.626197 4275 consensus_queue.cc:1035] T 7257f8e1d9b24e3a9650c5838fe1a8c5 P 841018313ad649679de64e006582f4c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:31:41.668349 4272 raft_consensus.cc:491] T 7c1dda599f144ecfab4c075ee4e28c16 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:41.668792 4272 raft_consensus.cc:513] T 7c1dda599f144ecfab4c075ee4e28c16 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:41.671062 4272 leader_election.cc:290] T 7c1dda599f144ecfab4c075ee4e28c16 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:31:41.671401 3861 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7c1dda599f144ecfab4c075ee4e28c16" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:41.672127 3861 raft_consensus.cc:2466] T 7c1dda599f144ecfab4c075ee4e28c16 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841018313ad649679de64e006582f4c5 in term 0.
I20250625 03:31:41.672637 3638 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7c1dda599f144ecfab4c075ee4e28c16" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:41.673013 3753 leader_election.cc:304] T 7c1dda599f144ecfab4c075ee4e28c16 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841018313ad649679de64e006582f4c5, ddc0ad67020f45edb3ba9c83cab687a4; no voters:
I20250625 03:31:41.673219 3638 raft_consensus.cc:2466] T 7c1dda599f144ecfab4c075ee4e28c16 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841018313ad649679de64e006582f4c5 in term 0.
I20250625 03:31:41.673731 4272 raft_consensus.cc:2802] T 7c1dda599f144ecfab4c075ee4e28c16 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:31:41.674078 4272 raft_consensus.cc:491] T 7c1dda599f144ecfab4c075ee4e28c16 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:31:41.674360 4272 raft_consensus.cc:3058] T 7c1dda599f144ecfab4c075ee4e28c16 P 841018313ad649679de64e006582f4c5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:41.680194 4272 raft_consensus.cc:513] T 7c1dda599f144ecfab4c075ee4e28c16 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:41.681985 4272 leader_election.cc:290] T 7c1dda599f144ecfab4c075ee4e28c16 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 election: Requested vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:31:41.683084 3862 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7c1dda599f144ecfab4c075ee4e28c16" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4"
I20250625 03:31:41.683669 3862 raft_consensus.cc:3058] T 7c1dda599f144ecfab4c075ee4e28c16 P ddc0ad67020f45edb3ba9c83cab687a4 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:41.683797 3638 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7c1dda599f144ecfab4c075ee4e28c16" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9"
I20250625 03:31:41.684470 3638 raft_consensus.cc:3058] T 7c1dda599f144ecfab4c075ee4e28c16 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:41.690193 3862 raft_consensus.cc:2466] T 7c1dda599f144ecfab4c075ee4e28c16 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841018313ad649679de64e006582f4c5 in term 1.
I20250625 03:31:41.690490 3638 raft_consensus.cc:2466] T 7c1dda599f144ecfab4c075ee4e28c16 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841018313ad649679de64e006582f4c5 in term 1.
I20250625 03:31:41.691391 3753 leader_election.cc:304] T 7c1dda599f144ecfab4c075ee4e28c16 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841018313ad649679de64e006582f4c5, ddc0ad67020f45edb3ba9c83cab687a4; no voters:
I20250625 03:31:41.691994 4272 raft_consensus.cc:2802] T 7c1dda599f144ecfab4c075ee4e28c16 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:31:41.692492 4272 raft_consensus.cc:695] T 7c1dda599f144ecfab4c075ee4e28c16 P 841018313ad649679de64e006582f4c5 [term 1 LEADER]: Becoming Leader. State: Replica: 841018313ad649679de64e006582f4c5, State: Running, Role: LEADER
I20250625 03:31:41.693209 4272 consensus_queue.cc:237] T 7c1dda599f144ecfab4c075ee4e28c16 P 841018313ad649679de64e006582f4c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:41.704644 3537 catalog_manager.cc:5582] T 7c1dda599f144ecfab4c075ee4e28c16 P 841018313ad649679de64e006582f4c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 841018313ad649679de64e006582f4c5 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "841018313ad649679de64e006582f4c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:41.737514 4272 consensus_queue.cc:1035] T aa64717b3f7d4af893e9908260f4520e P 841018313ad649679de64e006582f4c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:31:41.738694 4115 raft_consensus.cc:491] T d83c6c79a784452289ba414976adb9e0 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:31:41.739228 4115 raft_consensus.cc:513] T d83c6c79a784452289ba414976adb9e0 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:41.741024 4115 leader_election.cc:290] T d83c6c79a784452289ba414976adb9e0 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:31:41.742033 3712 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d83c6c79a784452289ba414976adb9e0" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" is_pre_election: true
I20250625 03:31:41.742810 3712 raft_consensus.cc:2391] T d83c6c79a784452289ba414976adb9e0 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01873d289e0b4f9f9184b251369502a9 in current term 1: Already voted for candidate ddc0ad67020f45edb3ba9c83cab687a4 in this term.
I20250625 03:31:41.749946 4274 consensus_queue.cc:1035] T aa64717b3f7d4af893e9908260f4520e P 841018313ad649679de64e006582f4c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:31:41.757673 3862 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d83c6c79a784452289ba414976adb9e0" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:41.760972 3604 leader_election.cc:304] T d83c6c79a784452289ba414976adb9e0 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9; no voters: 3d5b9823dfcd41cb92bd195c811cbf39, ddc0ad67020f45edb3ba9c83cab687a4
I20250625 03:31:41.761689 3638 raft_consensus.cc:3058] T d83c6c79a784452289ba414976adb9e0 P 01873d289e0b4f9f9184b251369502a9 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:31:41.767905 4172 raft_consensus.cc:2747] T d83c6c79a784452289ba414976adb9e0 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:31:41.771174 4262 consensus_queue.cc:1035] T d83c6c79a784452289ba414976adb9e0 P ddc0ad67020f45edb3ba9c83cab687a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:31:41.786429 4268 consensus_queue.cc:1035] T d83c6c79a784452289ba414976adb9e0 P ddc0ad67020f45edb3ba9c83cab687a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:31:41.787544 3861 raft_consensus.cc:1273] T 049948eeceeb43c98ccda9e839b521a8 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Refusing update from remote peer 01873d289e0b4f9f9184b251369502a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20250625 03:31:41.788081 3861 pending_rounds.cc:85] T 049948eeceeb43c98ccda9e839b521a8 P ddc0ad67020f45edb3ba9c83cab687a4: Aborting all ops after (but not including) 0
I20250625 03:31:41.788384 3861 pending_rounds.cc:107] T 049948eeceeb43c98ccda9e839b521a8 P ddc0ad67020f45edb3ba9c83cab687a4: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20250625 03:31:41.788667 3861 raft_consensus.cc:2887] T 049948eeceeb43c98ccda9e839b521a8 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20250625 03:31:41.793231 4172 consensus_queue.cc:1035] T 049948eeceeb43c98ccda9e839b521a8 P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:31:41.804715 3715 raft_consensus.cc:1273] T 049948eeceeb43c98ccda9e839b521a8 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Refusing update from remote peer 01873d289e0b4f9f9184b251369502a9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20250625 03:31:41.806298 4291 consensus_queue.cc:1035] T 049948eeceeb43c98ccda9e839b521a8 P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:31:41.838440 4268 consensus_queue.cc:1035] T 6afeedd3b768470f921526d58704c21d P ddc0ad67020f45edb3ba9c83cab687a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:31:41.855118 4316 consensus_queue.cc:1035] T 6afeedd3b768470f921526d58704c21d P ddc0ad67020f45edb3ba9c83cab687a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:31:41.884176 4316 consensus_queue.cc:1035] T b6311a11ae9e44bea3a7340b8134679b P ddc0ad67020f45edb3ba9c83cab687a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:31:41.898728 3975 consensus_queue.cc:1035] T b6311a11ae9e44bea3a7340b8134679b P ddc0ad67020f45edb3ba9c83cab687a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:31:42.158269 4274 consensus_queue.cc:1035] T 7c1dda599f144ecfab4c075ee4e28c16 P 841018313ad649679de64e006582f4c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:31:42.169160 4275 consensus_queue.cc:1035] T 7c1dda599f144ecfab4c075ee4e28c16 P 841018313ad649679de64e006582f4c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:31:43.259508 426 tablet_server.cc:178] TabletServer@127.0.106.129:0 shutting down...
W20250625 03:31:43.267916 3680 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 5 similar messages]
W20250625 03:31:43.276481 3680 consensus_peers.cc:487] T 06f309640df64f97a4065b1420fea692 P 3d5b9823dfcd41cb92bd195c811cbf39 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:43.304414 426 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250625 03:31:43.305325 426 tablet_replica.cc:331] T 7c1dda599f144ecfab4c075ee4e28c16 P 01873d289e0b4f9f9184b251369502a9: stopping tablet replica
I20250625 03:31:43.306186 426 raft_consensus.cc:2241] T 7c1dda599f144ecfab4c075ee4e28c16 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:43.306769 426 raft_consensus.cc:2270] T 7c1dda599f144ecfab4c075ee4e28c16 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:43.308880 426 tablet_replica.cc:331] T d83c6c79a784452289ba414976adb9e0 P 01873d289e0b4f9f9184b251369502a9: stopping tablet replica
I20250625 03:31:43.309433 426 raft_consensus.cc:2241] T d83c6c79a784452289ba414976adb9e0 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:43.309839 426 raft_consensus.cc:2270] T d83c6c79a784452289ba414976adb9e0 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:43.311967 426 tablet_replica.cc:331] T b6311a11ae9e44bea3a7340b8134679b P 01873d289e0b4f9f9184b251369502a9: stopping tablet replica
I20250625 03:31:43.313139 426 raft_consensus.cc:2241] T b6311a11ae9e44bea3a7340b8134679b P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:43.313592 426 raft_consensus.cc:2270] T b6311a11ae9e44bea3a7340b8134679b P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:43.315219 426 tablet_replica.cc:331] T d657bcfa8eea4e7db43d4d2715857516 P 01873d289e0b4f9f9184b251369502a9: stopping tablet replica
I20250625 03:31:43.315800 426 raft_consensus.cc:2241] T d657bcfa8eea4e7db43d4d2715857516 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:43.316251 426 raft_consensus.cc:2270] T d657bcfa8eea4e7db43d4d2715857516 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:43.317904 426 tablet_replica.cc:331] T 39880aedaeca464f81d899dc222a35b9 P 01873d289e0b4f9f9184b251369502a9: stopping tablet replica
I20250625 03:31:43.318475 426 raft_consensus.cc:2241] T 39880aedaeca464f81d899dc222a35b9 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:43.318868 426 raft_consensus.cc:2270] T 39880aedaeca464f81d899dc222a35b9 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:43.320540 426 tablet_replica.cc:331] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 01873d289e0b4f9f9184b251369502a9: stopping tablet replica
I20250625 03:31:43.321117 426 raft_consensus.cc:2241] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:43.321465 426 raft_consensus.cc:2270] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:43.323051 426 tablet_replica.cc:331] T 28cf5da85c864698894ed4e1ee38cd86 P 01873d289e0b4f9f9184b251369502a9: stopping tablet replica
I20250625 03:31:43.323704 426 raft_consensus.cc:2241] T 28cf5da85c864698894ed4e1ee38cd86 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:43.324147 426 raft_consensus.cc:2270] T 28cf5da85c864698894ed4e1ee38cd86 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:43.326270 426 tablet_replica.cc:331] T c5a9463f96314a83b7955d80444b1c29 P 01873d289e0b4f9f9184b251369502a9: stopping tablet replica
I20250625 03:31:43.326817 426 raft_consensus.cc:2241] T c5a9463f96314a83b7955d80444b1c29 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:43.327157 426 raft_consensus.cc:2270] T c5a9463f96314a83b7955d80444b1c29 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:43.328887 426 tablet_replica.cc:331] T 4b38a4199d1d44988233b6d8604d1a96 P 01873d289e0b4f9f9184b251369502a9: stopping tablet replica
I20250625 03:31:43.329430 426 raft_consensus.cc:2241] T 4b38a4199d1d44988233b6d8604d1a96 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:43.329783 426 raft_consensus.cc:2270] T 4b38a4199d1d44988233b6d8604d1a96 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:43.331332 426 tablet_replica.cc:331] T 6a179f065ae046df819a9bd88194dae6 P 01873d289e0b4f9f9184b251369502a9: stopping tablet replica
I20250625 03:31:43.332046 426 raft_consensus.cc:2241] T 6a179f065ae046df819a9bd88194dae6 P 01873d289e0b4f9f9184b251369502a9 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:31:43.332906 426 raft_consensus.cc:2270] T 6a179f065ae046df819a9bd88194dae6 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:43.334893 426 tablet_replica.cc:331] T 5350a260b3364354b73176e6bdd77940 P 01873d289e0b4f9f9184b251369502a9: stopping tablet replica
I20250625 03:31:43.335517 426 raft_consensus.cc:2241] T 5350a260b3364354b73176e6bdd77940 P 01873d289e0b4f9f9184b251369502a9 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:31:43.336248 426 raft_consensus.cc:2270] T 5350a260b3364354b73176e6bdd77940 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:43.338308 426 tablet_replica.cc:331] T 049948eeceeb43c98ccda9e839b521a8 P 01873d289e0b4f9f9184b251369502a9: stopping tablet replica
I20250625 03:31:43.339012 426 raft_consensus.cc:2241] T 049948eeceeb43c98ccda9e839b521a8 P 01873d289e0b4f9f9184b251369502a9 [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:31:43.339684 426 raft_consensus.cc:2270] T 049948eeceeb43c98ccda9e839b521a8 P 01873d289e0b4f9f9184b251369502a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:43.342017 426 tablet_replica.cc:331] T 03c46dae805341fdb9ec29725fa182a2 P 01873d289e0b4f9f9184b251369502a9: stopping tablet replica
W20250625 03:31:43.342516 3828 consensus_peers.cc:487] T 03c46dae805341fdb9ec29725fa182a2 P ddc0ad67020f45edb3ba9c83cab687a4 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:43.342684 426 raft_consensus.cc:2241] T 03c46dae805341fdb9ec29725fa182a2 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:43.343243 426 raft_consensus.cc:2270] T 03c46dae805341fdb9ec29725fa182a2 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:43.345038 426 tablet_replica.cc:331] T ea706d649de940bf8652264ed57a901f P 01873d289e0b4f9f9184b251369502a9: stopping tablet replica
I20250625 03:31:43.345580 426 raft_consensus.cc:2241] T ea706d649de940bf8652264ed57a901f P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:43.345899 426 raft_consensus.cc:2270] T ea706d649de940bf8652264ed57a901f P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:43.347992 426 tablet_replica.cc:331] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 01873d289e0b4f9f9184b251369502a9: stopping tablet replica
I20250625 03:31:43.348812 426 raft_consensus.cc:2241] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:43.349260 426 raft_consensus.cc:2270] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:43.351307 426 tablet_replica.cc:331] T 8ee7d6306b5146ed90a1b8392e062172 P 01873d289e0b4f9f9184b251369502a9: stopping tablet replica
I20250625 03:31:43.352043 426 raft_consensus.cc:2241] T 8ee7d6306b5146ed90a1b8392e062172 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus shutting down.
W20250625 03:31:43.352171 3680 consensus_peers.cc:487] T 9d985eca3d6f497c86b94c53f16c8ae5 P 3d5b9823dfcd41cb92bd195c811cbf39 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:43.352553 426 raft_consensus.cc:2270] T 8ee7d6306b5146ed90a1b8392e062172 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:43.354390 426 tablet_replica.cc:331] T 3d5b503929b24663a1f868ffaec34157 P 01873d289e0b4f9f9184b251369502a9: stopping tablet replica
I20250625 03:31:43.354970 426 raft_consensus.cc:2241] T 3d5b503929b24663a1f868ffaec34157 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:43.355340 426 raft_consensus.cc:2270] T 3d5b503929b24663a1f868ffaec34157 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:43.357218 426 tablet_replica.cc:331] T 39da7c80318f4c408f8cdaf2229b0c96 P 01873d289e0b4f9f9184b251369502a9: stopping tablet replica
I20250625 03:31:43.357822 426 raft_consensus.cc:2241] T 39da7c80318f4c408f8cdaf2229b0c96 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:43.358249 426 raft_consensus.cc:2270] T 39da7c80318f4c408f8cdaf2229b0c96 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:43.360324 426 tablet_replica.cc:331] T 9d985eca3d6f497c86b94c53f16c8ae5 P 01873d289e0b4f9f9184b251369502a9: stopping tablet replica
I20250625 03:31:43.361027 426 raft_consensus.cc:2241] T 9d985eca3d6f497c86b94c53f16c8ae5 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:43.361385 426 raft_consensus.cc:2270] T 9d985eca3d6f497c86b94c53f16c8ae5 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:43.363301 426 tablet_replica.cc:331] T d08de4c2326d46bab26f42d8d483ebd0 P 01873d289e0b4f9f9184b251369502a9: stopping tablet replica
W20250625 03:31:43.363265 3828 consensus_peers.cc:487] T 485f3e9350e245a9939133866b354302 P ddc0ad67020f45edb3ba9c83cab687a4 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:43.364315 426 raft_consensus.cc:2241] T d08de4c2326d46bab26f42d8d483ebd0 P 01873d289e0b4f9f9184b251369502a9 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:31:43.365243 426 raft_consensus.cc:2270] T d08de4c2326d46bab26f42d8d483ebd0 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:43.367193 426 tablet_replica.cc:331] T e7d3871088394a3ba7a6d18baae1feba P 01873d289e0b4f9f9184b251369502a9: stopping tablet replica
I20250625 03:31:43.367733 426 raft_consensus.cc:2241] T e7d3871088394a3ba7a6d18baae1feba P 01873d289e0b4f9f9184b251369502a9 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:31:43.368429 426 raft_consensus.cc:2270] T e7d3871088394a3ba7a6d18baae1feba P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:43.370229 426 tablet_replica.cc:331] T b74d9f11c2bc4a7bb6431d6222d45175 P 01873d289e0b4f9f9184b251369502a9: stopping tablet replica
I20250625 03:31:43.370790 426 raft_consensus.cc:2241] T b74d9f11c2bc4a7bb6431d6222d45175 P 01873d289e0b4f9f9184b251369502a9 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:31:43.371555 426 raft_consensus.cc:2270] T b74d9f11c2bc4a7bb6431d6222d45175 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:43.373365 426 tablet_replica.cc:331] T 526951ad467a4708926096ed1162a722 P 01873d289e0b4f9f9184b251369502a9: stopping tablet replica
I20250625 03:31:43.373955 426 raft_consensus.cc:2241] T 526951ad467a4708926096ed1162a722 P 01873d289e0b4f9f9184b251369502a9 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:31:43.374629 426 raft_consensus.cc:2270] T 526951ad467a4708926096ed1162a722 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:43.376399 426 tablet_replica.cc:331] T 002d4371d5414440b756829fe3343d07 P 01873d289e0b4f9f9184b251369502a9: stopping tablet replica
I20250625 03:31:43.376871 426 raft_consensus.cc:2241] T 002d4371d5414440b756829fe3343d07 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:43.377221 426 raft_consensus.cc:2270] T 002d4371d5414440b756829fe3343d07 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:43.379361 426 tablet_replica.cc:331] T d00ad2472fd74bfc9065d9dc4808e0c1 P 01873d289e0b4f9f9184b251369502a9: stopping tablet replica
I20250625 03:31:43.380155 426 raft_consensus.cc:2241] T d00ad2472fd74bfc9065d9dc4808e0c1 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:43.380695 426 raft_consensus.cc:2270] T d00ad2472fd74bfc9065d9dc4808e0c1 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:43.382750 426 tablet_replica.cc:331] T 007d68495d594a73a5e2748f51e7c44c P 01873d289e0b4f9f9184b251369502a9: stopping tablet replica
I20250625 03:31:43.383266 426 raft_consensus.cc:2241] T 007d68495d594a73a5e2748f51e7c44c P 01873d289e0b4f9f9184b251369502a9 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:31:43.383939 426 raft_consensus.cc:2270] T 007d68495d594a73a5e2748f51e7c44c P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:43.385640 426 tablet_replica.cc:331] T 7a8ecc65ca1140beb905dd6368bfaa2a P 01873d289e0b4f9f9184b251369502a9: stopping tablet replica
I20250625 03:31:43.386140 426 raft_consensus.cc:2241] T 7a8ecc65ca1140beb905dd6368bfaa2a P 01873d289e0b4f9f9184b251369502a9 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:31:43.387060 426 raft_consensus.cc:2270] T 7a8ecc65ca1140beb905dd6368bfaa2a P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:43.389793 426 tablet_replica.cc:331] T 5dc5a179a27f462989b291e8133742da P 01873d289e0b4f9f9184b251369502a9: stopping tablet replica
I20250625 03:31:43.390563 426 raft_consensus.cc:2241] T 5dc5a179a27f462989b291e8133742da P 01873d289e0b4f9f9184b251369502a9 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:31:43.391400 426 raft_consensus.cc:2270] T 5dc5a179a27f462989b291e8133742da P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:43.393675 426 tablet_replica.cc:331] T 1e9c146f8cd743f7ac35dc61d9226d1d P 01873d289e0b4f9f9184b251369502a9: stopping tablet replica
I20250625 03:31:43.394428 426 raft_consensus.cc:2241] T 1e9c146f8cd743f7ac35dc61d9226d1d P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:43.395021 426 raft_consensus.cc:2270] T 1e9c146f8cd743f7ac35dc61d9226d1d P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:43.397531 426 tablet_replica.cc:331] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 01873d289e0b4f9f9184b251369502a9: stopping tablet replica
I20250625 03:31:43.398175 426 raft_consensus.cc:2241] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus shutting down.
W20250625 03:31:43.398558 3828 consensus_peers.cc:487] T 28cf5da85c864698894ed4e1ee38cd86 P ddc0ad67020f45edb3ba9c83cab687a4 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:43.398631 426 raft_consensus.cc:2270] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:43.400751 426 tablet_replica.cc:331] T 06f309640df64f97a4065b1420fea692 P 01873d289e0b4f9f9184b251369502a9: stopping tablet replica
I20250625 03:31:43.401333 426 raft_consensus.cc:2241] T 06f309640df64f97a4065b1420fea692 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:43.401736 426 raft_consensus.cc:2270] T 06f309640df64f97a4065b1420fea692 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:43.403508 426 tablet_replica.cc:331] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 01873d289e0b4f9f9184b251369502a9: stopping tablet replica
I20250625 03:31:43.403980 426 raft_consensus.cc:2241] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 01873d289e0b4f9f9184b251369502a9 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:31:43.404829 426 raft_consensus.cc:2270] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:43.406795 426 tablet_replica.cc:331] T 0cf94f40d3434a11b3bfec277069c8c5 P 01873d289e0b4f9f9184b251369502a9: stopping tablet replica
I20250625 03:31:43.407496 426 raft_consensus.cc:2241] T 0cf94f40d3434a11b3bfec277069c8c5 P 01873d289e0b4f9f9184b251369502a9 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:31:43.408227 426 raft_consensus.cc:2270] T 0cf94f40d3434a11b3bfec277069c8c5 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:43.410035 426 tablet_replica.cc:331] T a07d77259251401d957af853b296750a P 01873d289e0b4f9f9184b251369502a9: stopping tablet replica
I20250625 03:31:43.410559 426 raft_consensus.cc:2241] T a07d77259251401d957af853b296750a P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:43.410955 426 raft_consensus.cc:2270] T a07d77259251401d957af853b296750a P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:43.413054 426 tablet_replica.cc:331] T 6afeedd3b768470f921526d58704c21d P 01873d289e0b4f9f9184b251369502a9: stopping tablet replica
I20250625 03:31:43.413647 426 raft_consensus.cc:2241] T 6afeedd3b768470f921526d58704c21d P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:43.414074 426 raft_consensus.cc:2270] T 6afeedd3b768470f921526d58704c21d P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250625 03:31:43.414825 3828 consensus_peers.cc:487] T 1e9c146f8cd743f7ac35dc61d9226d1d P ddc0ad67020f45edb3ba9c83cab687a4 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:43.415833 426 tablet_replica.cc:331] T 036dfe9e6b844fc6964b3b5e371f8c95 P 01873d289e0b4f9f9184b251369502a9: stopping tablet replica
I20250625 03:31:43.416702 426 raft_consensus.cc:2241] T 036dfe9e6b844fc6964b3b5e371f8c95 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:43.417269 426 raft_consensus.cc:2270] T 036dfe9e6b844fc6964b3b5e371f8c95 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:43.419487 426 tablet_replica.cc:331] T 3ecdd525d6fd47deacf323decbc5c329 P 01873d289e0b4f9f9184b251369502a9: stopping tablet replica
I20250625 03:31:43.420135 426 raft_consensus.cc:2241] T 3ecdd525d6fd47deacf323decbc5c329 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:43.420495 426 raft_consensus.cc:2270] T 3ecdd525d6fd47deacf323decbc5c329 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:43.422287 426 tablet_replica.cc:331] T 485f3e9350e245a9939133866b354302 P 01873d289e0b4f9f9184b251369502a9: stopping tablet replica
I20250625 03:31:43.422796 426 raft_consensus.cc:2241] T 485f3e9350e245a9939133866b354302 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:43.423203 426 raft_consensus.cc:2270] T 485f3e9350e245a9939133866b354302 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:43.425186 426 tablet_replica.cc:331] T aa64717b3f7d4af893e9908260f4520e P 01873d289e0b4f9f9184b251369502a9: stopping tablet replica
I20250625 03:31:43.425804 426 raft_consensus.cc:2241] T aa64717b3f7d4af893e9908260f4520e P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:43.426295 426 raft_consensus.cc:2270] T aa64717b3f7d4af893e9908260f4520e P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:43.428238 426 tablet_replica.cc:331] T c592f2c5305141c487b73e0867d0f36b P 01873d289e0b4f9f9184b251369502a9: stopping tablet replica
I20250625 03:31:43.428962 426 raft_consensus.cc:2241] T c592f2c5305141c487b73e0867d0f36b P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:43.429347 426 raft_consensus.cc:2270] T c592f2c5305141c487b73e0867d0f36b P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:43.431671 426 tablet_replica.cc:331] T c0c8dfded31e4566b07bc439f6e58ef6 P 01873d289e0b4f9f9184b251369502a9: stopping tablet replica
I20250625 03:31:43.432194 426 raft_consensus.cc:2241] T c0c8dfded31e4566b07bc439f6e58ef6 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus shutting down.
W20250625 03:31:43.432427 3680 consensus_peers.cc:487] T c5a9463f96314a83b7955d80444b1c29 P 3d5b9823dfcd41cb92bd195c811cbf39 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:43.432716 426 raft_consensus.cc:2270] T c0c8dfded31e4566b07bc439f6e58ef6 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:43.434695 426 tablet_replica.cc:331] T f3a33aa1d146468c986f0b1ba7d5fb84 P 01873d289e0b4f9f9184b251369502a9: stopping tablet replica
I20250625 03:31:43.435215 426 raft_consensus.cc:2241] T f3a33aa1d146468c986f0b1ba7d5fb84 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:43.435606 426 raft_consensus.cc:2270] T f3a33aa1d146468c986f0b1ba7d5fb84 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:43.438057 426 tablet_replica.cc:331] T 49d4fb2581ed4ef998f6a113ea67c323 P 01873d289e0b4f9f9184b251369502a9: stopping tablet replica
I20250625 03:31:43.438714 426 raft_consensus.cc:2241] T 49d4fb2581ed4ef998f6a113ea67c323 P 01873d289e0b4f9f9184b251369502a9 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:31:43.439759 426 raft_consensus.cc:2270] T 49d4fb2581ed4ef998f6a113ea67c323 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250625 03:31:43.440954 3828 consensus_peers.cc:487] T 39880aedaeca464f81d899dc222a35b9 P ddc0ad67020f45edb3ba9c83cab687a4 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:43.442224 426 tablet_replica.cc:331] T e638ce3a86d242fcadb10cdf57f5960d P 01873d289e0b4f9f9184b251369502a9: stopping tablet replica
I20250625 03:31:43.442854 426 raft_consensus.cc:2241] T e638ce3a86d242fcadb10cdf57f5960d P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:31:43.443321 426 raft_consensus.cc:2270] T e638ce3a86d242fcadb10cdf57f5960d P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:31:43.445683 426 tablet_replica.cc:331] T 7e92fd94b9f24b1097e9a7373896cb26 P 01873d289e0b4f9f9184b251369502a9: stopping tablet replica
I20250625 03:31:43.446282 426 raft_consensus.cc:2241] T 7e92fd94b9f24b1097e9a7373896cb26 P 01873d289e0b4f9f9184b251369502a9 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:31:43.447160 426 raft_consensus.cc:2270] T 7e92fd94b9f24b1097e9a7373896cb26 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250625 03:31:43.450932 3680 consensus_peers.cc:487] T 8ee7d6306b5146ed90a1b8392e062172 P 3d5b9823dfcd41cb92bd195c811cbf39 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250625 03:31:43.466117 3680 consensus_peers.cc:487] T f3a33aa1d146468c986f0b1ba7d5fb84 P 3d5b9823dfcd41cb92bd195c811cbf39 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250625 03:31:43.501194 3754 consensus_peers.cc:487] T d657bcfa8eea4e7db43d4d2715857516 P 841018313ad649679de64e006582f4c5 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:43.512689 426 tablet_server.cc:195] TabletServer@127.0.106.129:0 shutdown complete.
W20250625 03:31:43.513804 3828 consensus_peers.cc:487] T b6311a11ae9e44bea3a7340b8134679b P ddc0ad67020f45edb3ba9c83cab687a4 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:37771: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250625 03:31:43.514362 3828 consensus_peers.cc:487] T 4b38a4199d1d44988233b6d8604d1a96 P ddc0ad67020f45edb3ba9c83cab687a4 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:37771: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250625 03:31:43.522783 3828 consensus_peers.cc:487] T d83c6c79a784452289ba414976adb9e0 P ddc0ad67020f45edb3ba9c83cab687a4 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:37771: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250625 03:31:43.556417 3754 consensus_peers.cc:487] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 841018313ad649679de64e006582f4c5 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:37771: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250625 03:31:43.561647 3828 consensus_peers.cc:487] T 036dfe9e6b844fc6964b3b5e371f8c95 P ddc0ad67020f45edb3ba9c83cab687a4 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:37771: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250625 03:31:43.564213 3754 consensus_peers.cc:487] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 841018313ad649679de64e006582f4c5 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:37771: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250625 03:31:43.572304 3828 consensus_peers.cc:487] T 6afeedd3b768470f921526d58704c21d P ddc0ad67020f45edb3ba9c83cab687a4 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:37771: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250625 03:31:43.585398 3680 consensus_peers.cc:487] T e638ce3a86d242fcadb10cdf57f5960d P 3d5b9823dfcd41cb92bd195c811cbf39 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:37771: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250625 03:31:43.585919 3754 consensus_peers.cc:487] T ea706d649de940bf8652264ed57a901f P 841018313ad649679de64e006582f4c5 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:37771: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:43.586177 426 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250625 03:31:43.594983 4364 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250625 03:31:43.598075 4365 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250625 03:31:43.600154 3680 consensus_peers.cc:487] T c592f2c5305141c487b73e0867d0f36b P 3d5b9823dfcd41cb92bd195c811cbf39 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:37771: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250625 03:31:43.605584 3754 consensus_peers.cc:487] T aa64717b3f7d4af893e9908260f4520e P 841018313ad649679de64e006582f4c5 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:37771: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250625 03:31:43.613180 3754 consensus_peers.cc:487] T 7c1dda599f144ecfab4c075ee4e28c16 P 841018313ad649679de64e006582f4c5 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:37771: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250625 03:31:43.616402 3680 consensus_peers.cc:487] T c0c8dfded31e4566b07bc439f6e58ef6 P 3d5b9823dfcd41cb92bd195c811cbf39 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:37771: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250625 03:31:43.617874 4367 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250625 03:31:43.619552 426 server_base.cc:1048] running on GCE node
I20250625 03:31:43.623332 426 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250625 03:31:43.623660 426 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250625 03:31:43.623999 426 hybrid_clock.cc:648] HybridClock initialized: now 1750822303623978 us; error 0 us; skew 500 ppm
W20250625 03:31:43.624363 3680 consensus_peers.cc:487] T d00ad2472fd74bfc9065d9dc4808e0c1 P 3d5b9823dfcd41cb92bd195c811cbf39 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:37771: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:43.625560 426 server_base.cc:848] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250625 03:31:43.634202 426 webserver.cc:469] Webserver started at http://127.0.106.129:34457/ using document root <none> and password file <none>
I20250625 03:31:43.634745 426 fs_manager.cc:362] Metadata directory not provided
I20250625 03:31:43.634943 426 fs_manager.cc:365] Using existing metadata directory in first data directory
I20250625 03:31:43.639221 426 fs_manager.cc:714] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
W20250625 03:31:43.643920 3754 consensus_peers.cc:487] T 39da7c80318f4c408f8cdaf2229b0c96 P 841018313ad649679de64e006582f4c5 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:37771: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:43.648236 4372 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250625 03:31:43.649067 426 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20250625 03:31:43.649384 426 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1750822166717217-426-0/minicluster-data/ts-0-root
uuid: "01873d289e0b4f9f9184b251369502a9"
format_stamp: "Formatted at 2025-06-25 03:31:32 on dist-test-slave-lj23"
I20250625 03:31:43.649818 426 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1750822166717217-426-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1750822166717217-426-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1750822166717217-426-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250625 03:31:43.664665 426 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250625 03:31:43.665935 426 kserver.cc:163] Server-wide thread pool size limit: 3276
W20250625 03:31:43.666999 3680 consensus_peers.cc:487] T 002d4371d5414440b756829fe3343d07 P 3d5b9823dfcd41cb92bd195c811cbf39 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:37771: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:43.668087 426 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
W20250625 03:31:43.673498 3680 consensus_peers.cc:487] T 3ecdd525d6fd47deacf323decbc5c329 P 3d5b9823dfcd41cb92bd195c811cbf39 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:37771: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:43.674284 4379 ts_tablet_manager.cc:542] Loading tablet metadata (0/45 complete)
W20250625 03:31:43.720202 3754 consensus_peers.cc:487] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 841018313ad649679de64e006582f4c5 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:37771: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250625 03:31:43.756467 3828 consensus_peers.cc:487] T 3d5b503929b24663a1f868ffaec34157 P ddc0ad67020f45edb3ba9c83cab687a4 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:37771: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250625 03:31:43.854583 3828 consensus_peers.cc:487] T a07d77259251401d957af853b296750a P ddc0ad67020f45edb3ba9c83cab687a4 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:37771: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:43.946502 426 ts_tablet_manager.cc:579] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20250625 03:31:43.946931 426 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.274s user 0.005s sys 0.004s
I20250625 03:31:43.947268 426 ts_tablet_manager.cc:594] Registering tablets (0/45 complete)
I20250625 03:31:43.954553 4379 tablet_bootstrap.cc:492] T c0c8dfded31e4566b07bc439f6e58ef6 P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:43.981150 4379 tablet_bootstrap.cc:492] T c0c8dfded31e4566b07bc439f6e58ef6 P 01873d289e0b4f9f9184b251369502a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:31:43.982090 4379 tablet_bootstrap.cc:492] T c0c8dfded31e4566b07bc439f6e58ef6 P 01873d289e0b4f9f9184b251369502a9: Bootstrap complete.
I20250625 03:31:43.982692 4379 ts_tablet_manager.cc:1397] T c0c8dfded31e4566b07bc439f6e58ef6 P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.028s user 0.012s sys 0.004s
I20250625 03:31:43.986095 4379 raft_consensus.cc:357] T c0c8dfded31e4566b07bc439f6e58ef6 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:43.986775 4379 raft_consensus.cc:738] T c0c8dfded31e4566b07bc439f6e58ef6 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:43.987413 4379 consensus_queue.cc:260] T c0c8dfded31e4566b07bc439f6e58ef6 P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:43.992643 4379 ts_tablet_manager.cc:1428] T c0c8dfded31e4566b07bc439f6e58ef6 P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.010s user 0.010s sys 0.000s
I20250625 03:31:43.994590 4379 tablet_bootstrap.cc:492] T 39880aedaeca464f81d899dc222a35b9 P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:44.011026 4379 tablet_bootstrap.cc:492] T 39880aedaeca464f81d899dc222a35b9 P 01873d289e0b4f9f9184b251369502a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:31:44.011936 4379 tablet_bootstrap.cc:492] T 39880aedaeca464f81d899dc222a35b9 P 01873d289e0b4f9f9184b251369502a9: Bootstrap complete.
I20250625 03:31:44.013631 4379 ts_tablet_manager.cc:1397] T 39880aedaeca464f81d899dc222a35b9 P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.019s user 0.016s sys 0.000s
I20250625 03:31:44.015847 4379 raft_consensus.cc:357] T 39880aedaeca464f81d899dc222a35b9 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:44.016520 4379 raft_consensus.cc:738] T 39880aedaeca464f81d899dc222a35b9 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:44.017136 4379 consensus_queue.cc:260] T 39880aedaeca464f81d899dc222a35b9 P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:44.019116 4379 ts_tablet_manager.cc:1428] T 39880aedaeca464f81d899dc222a35b9 P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20250625 03:31:44.040882 4379 tablet_bootstrap.cc:492] T e638ce3a86d242fcadb10cdf57f5960d P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:44.060506 4379 tablet_bootstrap.cc:492] T e638ce3a86d242fcadb10cdf57f5960d P 01873d289e0b4f9f9184b251369502a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:31:44.061700 4379 tablet_bootstrap.cc:492] T e638ce3a86d242fcadb10cdf57f5960d P 01873d289e0b4f9f9184b251369502a9: Bootstrap complete.
I20250625 03:31:44.062222 4379 ts_tablet_manager.cc:1397] T e638ce3a86d242fcadb10cdf57f5960d P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.032s user 0.011s sys 0.004s
I20250625 03:31:44.063958 4379 raft_consensus.cc:357] T e638ce3a86d242fcadb10cdf57f5960d P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:44.064514 4379 raft_consensus.cc:738] T e638ce3a86d242fcadb10cdf57f5960d P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:44.065091 4379 consensus_queue.cc:260] T e638ce3a86d242fcadb10cdf57f5960d P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:44.067018 4379 ts_tablet_manager.cc:1428] T e638ce3a86d242fcadb10cdf57f5960d P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20250625 03:31:44.067761 4379 tablet_bootstrap.cc:492] T 3d5b503929b24663a1f868ffaec34157 P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:44.079118 4379 tablet_bootstrap.cc:492] T 3d5b503929b24663a1f868ffaec34157 P 01873d289e0b4f9f9184b251369502a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:31:44.079885 4379 tablet_bootstrap.cc:492] T 3d5b503929b24663a1f868ffaec34157 P 01873d289e0b4f9f9184b251369502a9: Bootstrap complete.
I20250625 03:31:44.080417 4379 ts_tablet_manager.cc:1397] T 3d5b503929b24663a1f868ffaec34157 P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.013s user 0.012s sys 0.000s
I20250625 03:31:44.082155 4379 raft_consensus.cc:357] T 3d5b503929b24663a1f868ffaec34157 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:44.082653 4379 raft_consensus.cc:738] T 3d5b503929b24663a1f868ffaec34157 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:44.083164 4379 consensus_queue.cc:260] T 3d5b503929b24663a1f868ffaec34157 P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:44.084689 4379 ts_tablet_manager.cc:1428] T 3d5b503929b24663a1f868ffaec34157 P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20250625 03:31:44.085330 4379 tablet_bootstrap.cc:492] T 0cf94f40d3434a11b3bfec277069c8c5 P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:44.196054 4379 tablet_bootstrap.cc:492] T 0cf94f40d3434a11b3bfec277069c8c5 P 01873d289e0b4f9f9184b251369502a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:31:44.197041 4379 tablet_bootstrap.cc:492] T 0cf94f40d3434a11b3bfec277069c8c5 P 01873d289e0b4f9f9184b251369502a9: Bootstrap complete.
I20250625 03:31:44.197687 4379 ts_tablet_manager.cc:1397] T 0cf94f40d3434a11b3bfec277069c8c5 P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.113s user 0.051s sys 0.053s
I20250625 03:31:44.199975 4379 raft_consensus.cc:357] T 0cf94f40d3434a11b3bfec277069c8c5 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:44.200668 4379 raft_consensus.cc:738] T 0cf94f40d3434a11b3bfec277069c8c5 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:44.201356 4379 consensus_queue.cc:260] T 0cf94f40d3434a11b3bfec277069c8c5 P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:44.203817 4379 ts_tablet_manager.cc:1428] T 0cf94f40d3434a11b3bfec277069c8c5 P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.006s user 0.002s sys 0.004s
I20250625 03:31:44.204643 4379 tablet_bootstrap.cc:492] T 1e9c146f8cd743f7ac35dc61d9226d1d P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:44.245872 426 ts_tablet_manager.cc:610] Registered 45 tablets
I20250625 03:31:44.247365 426 ts_tablet_manager.cc:589] Time spent register tablets: real 0.300s user 0.263s sys 0.016s
I20250625 03:31:44.261312 4379 tablet_bootstrap.cc:492] T 1e9c146f8cd743f7ac35dc61d9226d1d P 01873d289e0b4f9f9184b251369502a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:31:44.262274 4379 tablet_bootstrap.cc:492] T 1e9c146f8cd743f7ac35dc61d9226d1d P 01873d289e0b4f9f9184b251369502a9: Bootstrap complete.
I20250625 03:31:44.264128 4379 ts_tablet_manager.cc:1397] T 1e9c146f8cd743f7ac35dc61d9226d1d P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.060s user 0.021s sys 0.017s
I20250625 03:31:44.266222 4379 raft_consensus.cc:357] T 1e9c146f8cd743f7ac35dc61d9226d1d P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:44.266808 4379 raft_consensus.cc:738] T 1e9c146f8cd743f7ac35dc61d9226d1d P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:44.267359 4379 consensus_queue.cc:260] T 1e9c146f8cd743f7ac35dc61d9226d1d P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:44.270064 4379 ts_tablet_manager.cc:1428] T 1e9c146f8cd743f7ac35dc61d9226d1d P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20250625 03:31:44.271240 4379 tablet_bootstrap.cc:492] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:44.285357 4379 tablet_bootstrap.cc:492] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 01873d289e0b4f9f9184b251369502a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:31:44.286329 4379 tablet_bootstrap.cc:492] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 01873d289e0b4f9f9184b251369502a9: Bootstrap complete.
I20250625 03:31:44.286998 4379 ts_tablet_manager.cc:1397] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.016s user 0.012s sys 0.000s
I20250625 03:31:44.288904 4379 raft_consensus.cc:357] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:44.289402 4379 raft_consensus.cc:738] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:44.290007 4379 consensus_queue.cc:260] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:44.291996 4379 ts_tablet_manager.cc:1428] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20250625 03:31:44.292706 4379 tablet_bootstrap.cc:492] T 9d985eca3d6f497c86b94c53f16c8ae5 P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:44.323441 4379 tablet_bootstrap.cc:492] T 9d985eca3d6f497c86b94c53f16c8ae5 P 01873d289e0b4f9f9184b251369502a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:31:44.324401 4379 tablet_bootstrap.cc:492] T 9d985eca3d6f497c86b94c53f16c8ae5 P 01873d289e0b4f9f9184b251369502a9: Bootstrap complete.
I20250625 03:31:44.324995 4379 ts_tablet_manager.cc:1397] T 9d985eca3d6f497c86b94c53f16c8ae5 P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.032s user 0.020s sys 0.005s
I20250625 03:31:44.327442 4379 raft_consensus.cc:357] T 9d985eca3d6f497c86b94c53f16c8ae5 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:44.328276 4379 raft_consensus.cc:738] T 9d985eca3d6f497c86b94c53f16c8ae5 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:44.329015 4379 consensus_queue.cc:260] T 9d985eca3d6f497c86b94c53f16c8ae5 P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:44.332270 4379 ts_tablet_manager.cc:1428] T 9d985eca3d6f497c86b94c53f16c8ae5 P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.007s user 0.005s sys 0.002s
I20250625 03:31:44.333078 4379 tablet_bootstrap.cc:492] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:44.346271 4379 tablet_bootstrap.cc:492] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 01873d289e0b4f9f9184b251369502a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:31:44.347222 4379 tablet_bootstrap.cc:492] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 01873d289e0b4f9f9184b251369502a9: Bootstrap complete.
I20250625 03:31:44.347909 4379 ts_tablet_manager.cc:1397] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.015s user 0.012s sys 0.000s
I20250625 03:31:44.350407 4379 raft_consensus.cc:357] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:44.351074 4379 raft_consensus.cc:738] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:44.351784 4379 consensus_queue.cc:260] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:44.354127 4379 ts_tablet_manager.cc:1428] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20250625 03:31:44.355005 4379 tablet_bootstrap.cc:492] T 03c46dae805341fdb9ec29725fa182a2 P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:44.359944 4272 raft_consensus.cc:491] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01873d289e0b4f9f9184b251369502a9)
I20250625 03:31:44.360857 4272 raft_consensus.cc:513] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:44.368471 3861 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2c4bb2d21b5242d387f6bc6ada60b4d5" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:44.383620 4392 raft_consensus.cc:491] T 7e92fd94b9f24b1097e9a7373896cb26 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01873d289e0b4f9f9184b251369502a9)
I20250625 03:31:44.384434 4392 raft_consensus.cc:513] T 7e92fd94b9f24b1097e9a7373896cb26 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:44.387018 4392 leader_election.cc:290] T 7e92fd94b9f24b1097e9a7373896cb26 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 841018313ad649679de64e006582f4c5 (127.0.106.131:39467)
W20250625 03:31:44.389398 3754 leader_election.cc:336] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Network error: Client connection negotiation failed: client connection to 127.0.106.129:37771: connect: Connection refused (error 111)
I20250625 03:31:44.390103 3754 leader_election.cc:304] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841018313ad649679de64e006582f4c5; no voters: 01873d289e0b4f9f9184b251369502a9, ddc0ad67020f45edb3ba9c83cab687a4
I20250625 03:31:44.391345 4271 raft_consensus.cc:2747] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250625 03:31:44.397035 4272 leader_election.cc:290] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:31:44.411257 4356 raft_consensus.cc:491] T 049948eeceeb43c98ccda9e839b521a8 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01873d289e0b4f9f9184b251369502a9)
I20250625 03:31:44.412235 4356 raft_consensus.cc:513] T 049948eeceeb43c98ccda9e839b521a8 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:44.413844 4355 raft_consensus.cc:491] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01873d289e0b4f9f9184b251369502a9)
I20250625 03:31:44.414640 4355 raft_consensus.cc:513] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:44.418107 4356 leader_election.cc:290] T 049948eeceeb43c98ccda9e839b521a8 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:31:44.417228 4355 leader_election.cc:290] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:31:44.435890 3785 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7e92fd94b9f24b1097e9a7373896cb26" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:31:44.443252 4379 tablet_bootstrap.cc:492] T 03c46dae805341fdb9ec29725fa182a2 P 01873d289e0b4f9f9184b251369502a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:31:44.444180 3785 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2c4bb2d21b5242d387f6bc6ada60b4d5" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:31:44.444617 4379 tablet_bootstrap.cc:492] T 03c46dae805341fdb9ec29725fa182a2 P 01873d289e0b4f9f9184b251369502a9: Bootstrap complete.
I20250625 03:31:44.445466 4379 ts_tablet_manager.cc:1397] T 03c46dae805341fdb9ec29725fa182a2 P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.091s user 0.034s sys 0.017s
W20250625 03:31:44.445174 3680 leader_election.cc:336] T 7e92fd94b9f24b1097e9a7373896cb26 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Network error: Client connection negotiation failed: client connection to 127.0.106.129:37771: connect: Connection refused (error 111)
I20250625 03:31:44.448612 3680 leader_election.cc:304] T 7e92fd94b9f24b1097e9a7373896cb26 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39; no voters: 01873d289e0b4f9f9184b251369502a9, 841018313ad649679de64e006582f4c5
I20250625 03:31:44.451449 4356 raft_consensus.cc:2747] T 7e92fd94b9f24b1097e9a7373896cb26 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250625 03:31:44.451459 4379 raft_consensus.cc:357] T 03c46dae805341fdb9ec29725fa182a2 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:44.452433 4379 raft_consensus.cc:738] T 03c46dae805341fdb9ec29725fa182a2 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:44.452663 3861 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "049948eeceeb43c98ccda9e839b521a8" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:44.453125 4379 consensus_queue.cc:260] T 03c46dae805341fdb9ec29725fa182a2 P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:44.445164 3785 raft_consensus.cc:2466] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddc0ad67020f45edb3ba9c83cab687a4 in term 1.
I20250625 03:31:44.455569 4379 ts_tablet_manager.cc:1428] T 03c46dae805341fdb9ec29725fa182a2 P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.010s user 0.005s sys 0.000s
I20250625 03:31:44.456423 4379 tablet_bootstrap.cc:492] T 4b38a4199d1d44988233b6d8604d1a96 P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
W20250625 03:31:44.463019 3680 leader_election.cc:336] T 049948eeceeb43c98ccda9e839b521a8 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Network error: Client connection negotiation failed: client connection to 127.0.106.129:37771: connect: Connection refused (error 111)
I20250625 03:31:44.463615 3680 leader_election.cc:304] T 049948eeceeb43c98ccda9e839b521a8 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39; no voters: 01873d289e0b4f9f9184b251369502a9, ddc0ad67020f45edb3ba9c83cab687a4
I20250625 03:31:44.464411 4356 raft_consensus.cc:2747] T 049948eeceeb43c98ccda9e839b521a8 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20250625 03:31:44.468705 3828 leader_election.cc:304] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841018313ad649679de64e006582f4c5, ddc0ad67020f45edb3ba9c83cab687a4; no voters:
I20250625 03:31:44.469801 4382 raft_consensus.cc:2802] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250625 03:31:44.470203 4382 raft_consensus.cc:491] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 01873d289e0b4f9f9184b251369502a9)
I20250625 03:31:44.470705 4382 raft_consensus.cc:3058] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:44.470760 4356 raft_consensus.cc:491] T 526951ad467a4708926096ed1162a722 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01873d289e0b4f9f9184b251369502a9)
I20250625 03:31:44.471560 4356 raft_consensus.cc:513] T 526951ad467a4708926096ed1162a722 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:44.474423 4356 leader_election.cc:290] T 526951ad467a4708926096ed1162a722 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
W20250625 03:31:44.470026 3828 leader_election.cc:336] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Network error: Client connection negotiation failed: client connection to 127.0.106.129:37771: connect: Connection refused (error 111)
I20250625 03:31:44.479313 4382 raft_consensus.cc:513] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
W20250625 03:31:44.480962 3680 leader_election.cc:336] T 526951ad467a4708926096ed1162a722 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Network error: Client connection negotiation failed: client connection to 127.0.106.129:37771: connect: Connection refused (error 111)
I20250625 03:31:44.481532 4382 leader_election.cc:290] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 2 election: Requested vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:31:44.483112 4382 raft_consensus.cc:491] T 049948eeceeb43c98ccda9e839b521a8 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01873d289e0b4f9f9184b251369502a9)
I20250625 03:31:44.483623 4382 raft_consensus.cc:513] T 049948eeceeb43c98ccda9e839b521a8 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:44.484647 3861 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "526951ad467a4708926096ed1162a722" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:44.485673 4382 leader_election.cc:290] T 049948eeceeb43c98ccda9e839b521a8 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:31:44.487221 3785 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2c4bb2d21b5242d387f6bc6ada60b4d5" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5"
I20250625 03:31:44.488124 3785 raft_consensus.cc:3058] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:44.490084 3679 leader_election.cc:304] T 526951ad467a4708926096ed1162a722 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39; no voters: 01873d289e0b4f9f9184b251369502a9, ddc0ad67020f45edb3ba9c83cab687a4
I20250625 03:31:44.490451 3715 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "049948eeceeb43c98ccda9e839b521a8" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" is_pre_election: true
I20250625 03:31:44.491070 3715 raft_consensus.cc:2466] T 049948eeceeb43c98ccda9e839b521a8 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddc0ad67020f45edb3ba9c83cab687a4 in term 2.
I20250625 03:31:44.491343 4356 raft_consensus.cc:2747] T 526951ad467a4708926096ed1162a722 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250625 03:31:44.496135 426 rpc_server.cc:307] RPC server started. Bound to: 127.0.106.129:37771
I20250625 03:31:44.496279 4454 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.106.129:37771 every 8 connection(s)
I20250625 03:31:44.496866 3785 raft_consensus.cc:2466] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddc0ad67020f45edb3ba9c83cab687a4 in term 2.
I20250625 03:31:44.488149 4379 tablet_bootstrap.cc:492] T 4b38a4199d1d44988233b6d8604d1a96 P 01873d289e0b4f9f9184b251369502a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:31:44.498512 4379 tablet_bootstrap.cc:492] T 4b38a4199d1d44988233b6d8604d1a96 P 01873d289e0b4f9f9184b251369502a9: Bootstrap complete.
I20250625 03:31:44.499189 4379 ts_tablet_manager.cc:1397] T 4b38a4199d1d44988233b6d8604d1a96 P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.043s user 0.014s sys 0.002s
I20250625 03:31:44.502631 4379 raft_consensus.cc:357] T 4b38a4199d1d44988233b6d8604d1a96 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:44.503551 4379 raft_consensus.cc:738] T 4b38a4199d1d44988233b6d8604d1a96 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:44.506657 3828 leader_election.cc:304] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841018313ad649679de64e006582f4c5, ddc0ad67020f45edb3ba9c83cab687a4; no voters:
I20250625 03:31:44.507479 4382 raft_consensus.cc:2802] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:31:44.507987 4382 raft_consensus.cc:695] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 LEADER]: Becoming Leader. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Running, Role: LEADER
I20250625 03:31:44.508842 4382 consensus_queue.cc:237] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P ddc0ad67020f45edb3ba9c83cab687a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:44.509414 3828 leader_election.cc:304] T 049948eeceeb43c98ccda9e839b521a8 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, ddc0ad67020f45edb3ba9c83cab687a4; no voters:
I20250625 03:31:44.510445 4355 raft_consensus.cc:2802] T 049948eeceeb43c98ccda9e839b521a8 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20250625 03:31:44.510819 4355 raft_consensus.cc:491] T 049948eeceeb43c98ccda9e839b521a8 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 01873d289e0b4f9f9184b251369502a9)
I20250625 03:31:44.511090 4356 raft_consensus.cc:491] T 6a179f065ae046df819a9bd88194dae6 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01873d289e0b4f9f9184b251369502a9)
I20250625 03:31:44.511226 4355 raft_consensus.cc:3058] T 049948eeceeb43c98ccda9e839b521a8 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:44.511711 4356 raft_consensus.cc:513] T 6a179f065ae046df819a9bd88194dae6 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:44.515928 4356 leader_election.cc:290] T 6a179f065ae046df819a9bd88194dae6 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 841018313ad649679de64e006582f4c5 (127.0.106.131:39467)
I20250625 03:31:44.523005 3785 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6a179f065ae046df819a9bd88194dae6" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:31:44.528162 4383 raft_consensus.cc:491] T 526951ad467a4708926096ed1162a722 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01873d289e0b4f9f9184b251369502a9)
I20250625 03:31:44.529138 4383 raft_consensus.cc:513] T 526951ad467a4708926096ed1162a722 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:44.531754 4383 leader_election.cc:290] T 526951ad467a4708926096ed1162a722 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:31:44.504544 4379 consensus_queue.cc:260] T 4b38a4199d1d44988233b6d8604d1a96 P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:44.534569 3715 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "526951ad467a4708926096ed1162a722" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" is_pre_election: true
I20250625 03:31:44.540431 3715 raft_consensus.cc:2466] T 526951ad467a4708926096ed1162a722 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddc0ad67020f45edb3ba9c83cab687a4 in term 1.
I20250625 03:31:44.541546 4356 raft_consensus.cc:491] T 5350a260b3364354b73176e6bdd77940 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01873d289e0b4f9f9184b251369502a9)
I20250625 03:31:44.542549 4392 raft_consensus.cc:491] T 5dc5a179a27f462989b291e8133742da P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01873d289e0b4f9f9184b251369502a9)
I20250625 03:31:44.544363 4356 raft_consensus.cc:513] T 5350a260b3364354b73176e6bdd77940 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:44.544836 4392 raft_consensus.cc:513] T 5dc5a179a27f462989b291e8133742da P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:44.547000 4381 raft_consensus.cc:491] T 7a8ecc65ca1140beb905dd6368bfaa2a P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01873d289e0b4f9f9184b251369502a9)
I20250625 03:31:44.543283 4355 raft_consensus.cc:513] T 049948eeceeb43c98ccda9e839b521a8 P ddc0ad67020f45edb3ba9c83cab687a4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:44.536495 4379 ts_tablet_manager.cc:1428] T 4b38a4199d1d44988233b6d8604d1a96 P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.037s user 0.007s sys 0.000s
I20250625 03:31:44.549540 4382 raft_consensus.cc:491] T 49d4fb2581ed4ef998f6a113ea67c323 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01873d289e0b4f9f9184b251369502a9)
I20250625 03:31:44.549118 3537 catalog_manager.cc:5582] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P ddc0ad67020f45edb3ba9c83cab687a4 reported cstate change: term changed from 1 to 2, leader changed from 01873d289e0b4f9f9184b251369502a9 (127.0.106.129) to ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132). New cstate: current_term: 2 leader_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:44.547546 4381 raft_consensus.cc:513] T 7a8ecc65ca1140beb905dd6368bfaa2a P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:44.550073 4382 raft_consensus.cc:513] T 49d4fb2581ed4ef998f6a113ea67c323 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:44.550552 4391 raft_consensus.cc:491] T 7e92fd94b9f24b1097e9a7373896cb26 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01873d289e0b4f9f9184b251369502a9)
I20250625 03:31:44.551070 4391 raft_consensus.cc:513] T 7e92fd94b9f24b1097e9a7373896cb26 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:44.541575 3828 leader_election.cc:304] T 526951ad467a4708926096ed1162a722 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, ddc0ad67020f45edb3ba9c83cab687a4; no voters:
I20250625 03:31:44.552053 4382 leader_election.cc:290] T 49d4fb2581ed4ef998f6a113ea67c323 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:31:44.547637 4392 leader_election.cc:290] T 5dc5a179a27f462989b291e8133742da P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:31:44.553472 4379 tablet_bootstrap.cc:492] T ea706d649de940bf8652264ed57a901f P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:44.552067 4381 leader_election.cc:290] T 7a8ecc65ca1140beb905dd6368bfaa2a P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:31:44.555392 4391 leader_election.cc:290] T 7e92fd94b9f24b1097e9a7373896cb26 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:31:44.554255 4382 raft_consensus.cc:2802] T 526951ad467a4708926096ed1162a722 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250625 03:31:44.556339 4382 raft_consensus.cc:491] T 526951ad467a4708926096ed1162a722 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 01873d289e0b4f9f9184b251369502a9)
I20250625 03:31:44.556864 4382 raft_consensus.cc:3058] T 526951ad467a4708926096ed1162a722 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:44.556661 3715 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7e92fd94b9f24b1097e9a7373896cb26" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" is_pre_election: true
I20250625 03:31:44.557834 3715 raft_consensus.cc:2466] T 7e92fd94b9f24b1097e9a7373896cb26 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841018313ad649679de64e006582f4c5 in term 1.
I20250625 03:31:44.560278 3754 leader_election.cc:304] T 7e92fd94b9f24b1097e9a7373896cb26 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, 841018313ad649679de64e006582f4c5; no voters:
I20250625 03:31:44.561115 4271 raft_consensus.cc:491] T 49d4fb2581ed4ef998f6a113ea67c323 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01873d289e0b4f9f9184b251369502a9)
I20250625 03:31:44.561306 4391 raft_consensus.cc:2802] T 7e92fd94b9f24b1097e9a7373896cb26 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250625 03:31:44.561738 4391 raft_consensus.cc:491] T 7e92fd94b9f24b1097e9a7373896cb26 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 01873d289e0b4f9f9184b251369502a9)
I20250625 03:31:44.561614 4271 raft_consensus.cc:513] T 49d4fb2581ed4ef998f6a113ea67c323 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:44.562109 4391 raft_consensus.cc:3058] T 7e92fd94b9f24b1097e9a7373896cb26 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:44.563720 4271 leader_election.cc:290] T 49d4fb2581ed4ef998f6a113ea67c323 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:31:44.565335 3861 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "49d4fb2581ed4ef998f6a113ea67c323" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:44.566011 3861 raft_consensus.cc:2466] T 49d4fb2581ed4ef998f6a113ea67c323 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841018313ad649679de64e006582f4c5 in term 1.
I20250625 03:31:44.566576 3785 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7a8ecc65ca1140beb905dd6368bfaa2a" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:31:44.566217 4356 leader_election.cc:290] T 5350a260b3364354b73176e6bdd77940 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:31:44.568583 4385 raft_consensus.cc:491] T 0cf94f40d3434a11b3bfec277069c8c5 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01873d289e0b4f9f9184b251369502a9)
I20250625 03:31:44.569217 4272 raft_consensus.cc:491] T b74d9f11c2bc4a7bb6431d6222d45175 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01873d289e0b4f9f9184b251369502a9)
I20250625 03:31:44.569113 4385 raft_consensus.cc:513] T 0cf94f40d3434a11b3bfec277069c8c5 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:44.569785 4272 raft_consensus.cc:513] T b74d9f11c2bc4a7bb6431d6222d45175 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:44.571281 4385 leader_election.cc:290] T 0cf94f40d3434a11b3bfec277069c8c5 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:31:44.571820 4272 leader_election.cc:290] T b74d9f11c2bc4a7bb6431d6222d45175 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:31:44.572149 4355 leader_election.cc:290] T 049948eeceeb43c98ccda9e839b521a8 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 3 election: Requested vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:31:44.572625 3715 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0cf94f40d3434a11b3bfec277069c8c5" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" is_pre_election: true
I20250625 03:31:44.572834 3753 leader_election.cc:304] T 49d4fb2581ed4ef998f6a113ea67c323 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841018313ad649679de64e006582f4c5, ddc0ad67020f45edb3ba9c83cab687a4; no voters:
I20250625 03:31:44.573385 3715 raft_consensus.cc:2466] T 0cf94f40d3434a11b3bfec277069c8c5 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841018313ad649679de64e006582f4c5 in term 1.
I20250625 03:31:44.573583 4272 raft_consensus.cc:2802] T 49d4fb2581ed4ef998f6a113ea67c323 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250625 03:31:44.574132 4272 raft_consensus.cc:491] T 49d4fb2581ed4ef998f6a113ea67c323 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 01873d289e0b4f9f9184b251369502a9)
I20250625 03:31:44.574486 4272 raft_consensus.cc:3058] T 49d4fb2581ed4ef998f6a113ea67c323 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:44.574596 3862 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b74d9f11c2bc4a7bb6431d6222d45175" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:44.577663 3754 leader_election.cc:304] T 0cf94f40d3434a11b3bfec277069c8c5 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, 841018313ad649679de64e006582f4c5; no voters:
I20250625 03:31:44.583168 4271 raft_consensus.cc:2802] T 0cf94f40d3434a11b3bfec277069c8c5 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250625 03:31:44.583621 4271 raft_consensus.cc:491] T 0cf94f40d3434a11b3bfec277069c8c5 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 01873d289e0b4f9f9184b251369502a9)
I20250625 03:31:44.583992 4271 raft_consensus.cc:3058] T 0cf94f40d3434a11b3bfec277069c8c5 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:44.587204 4381 raft_consensus.cc:491] T d08de4c2326d46bab26f42d8d483ebd0 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01873d289e0b4f9f9184b251369502a9)
I20250625 03:31:44.587795 4381 raft_consensus.cc:513] T d08de4c2326d46bab26f42d8d483ebd0 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:44.588187 4272 raft_consensus.cc:513] T 49d4fb2581ed4ef998f6a113ea67c323 P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:44.589772 4381 leader_election.cc:290] T d08de4c2326d46bab26f42d8d483ebd0 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:31:44.590256 4272 leader_election.cc:290] T 49d4fb2581ed4ef998f6a113ea67c323 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 2 election: Requested vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:31:44.598232 3715 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "049948eeceeb43c98ccda9e839b521a8" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
I20250625 03:31:44.598325 3785 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "49d4fb2581ed4ef998f6a113ea67c323" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:31:44.598866 3715 raft_consensus.cc:3058] T 049948eeceeb43c98ccda9e839b521a8 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:44.599426 3785 raft_consensus.cc:2391] T 49d4fb2581ed4ef998f6a113ea67c323 P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddc0ad67020f45edb3ba9c83cab687a4 in current term 2: Already voted for candidate 841018313ad649679de64e006582f4c5 in this term.
I20250625 03:31:44.602484 3861 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5dc5a179a27f462989b291e8133742da" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:44.606242 4462 raft_consensus.cc:491] T 007d68495d594a73a5e2748f51e7c44c P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01873d289e0b4f9f9184b251369502a9)
I20250625 03:31:44.606843 4462 raft_consensus.cc:513] T 007d68495d594a73a5e2748f51e7c44c P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:44.608556 3861 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "49d4fb2581ed4ef998f6a113ea67c323" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4"
I20250625 03:31:44.608950 4462 leader_election.cc:290] T 007d68495d594a73a5e2748f51e7c44c P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:31:44.609226 3861 raft_consensus.cc:3058] T 49d4fb2581ed4ef998f6a113ea67c323 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:44.609534 4455 heartbeater.cc:344] Connected to a master server at 127.0.106.190:40959
I20250625 03:31:44.609826 4379 tablet_bootstrap.cc:492] T ea706d649de940bf8652264ed57a901f P 01873d289e0b4f9f9184b251369502a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:31:44.610003 4455 heartbeater.cc:461] Registering TS with master...
I20250625 03:31:44.610791 4379 tablet_bootstrap.cc:492] T ea706d649de940bf8652264ed57a901f P 01873d289e0b4f9f9184b251369502a9: Bootstrap complete.
I20250625 03:31:44.610426 4382 raft_consensus.cc:513] T 526951ad467a4708926096ed1162a722 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:44.611028 4455 heartbeater.cc:507] Master 127.0.106.190:40959 requested a full tablet report, sending...
I20250625 03:31:44.611502 4379 ts_tablet_manager.cc:1397] T ea706d649de940bf8652264ed57a901f P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.058s user 0.014s sys 0.004s
I20250625 03:31:44.578989 4356 raft_consensus.cc:491] T 0cf94f40d3434a11b3bfec277069c8c5 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01873d289e0b4f9f9184b251369502a9)
I20250625 03:31:44.617901 3862 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5350a260b3364354b73176e6bdd77940" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:44.618818 3859 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d08de4c2326d46bab26f42d8d483ebd0" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:44.623556 3785 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "007d68495d594a73a5e2748f51e7c44c" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:31:44.633795 3861 raft_consensus.cc:2466] T 49d4fb2581ed4ef998f6a113ea67c323 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841018313ad649679de64e006582f4c5 in term 2.
I20250625 03:31:44.634891 3715 raft_consensus.cc:2466] T 049948eeceeb43c98ccda9e839b521a8 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddc0ad67020f45edb3ba9c83cab687a4 in term 3.
I20250625 03:31:44.611671 4271 raft_consensus.cc:513] T 0cf94f40d3434a11b3bfec277069c8c5 P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:44.617364 4385 raft_consensus.cc:491] T 6a179f065ae046df819a9bd88194dae6 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01873d289e0b4f9f9184b251369502a9)
I20250625 03:31:44.640973 3828 leader_election.cc:304] T 049948eeceeb43c98ccda9e839b521a8 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, ddc0ad67020f45edb3ba9c83cab687a4; no voters:
I20250625 03:31:44.638185 4355 raft_consensus.cc:491] T b74d9f11c2bc4a7bb6431d6222d45175 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01873d289e0b4f9f9184b251369502a9)
I20250625 03:31:44.638973 4391 raft_consensus.cc:513] T 7e92fd94b9f24b1097e9a7373896cb26 P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:44.646797 3753 leader_election.cc:304] T 49d4fb2581ed4ef998f6a113ea67c323 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841018313ad649679de64e006582f4c5, ddc0ad67020f45edb3ba9c83cab687a4; no voters:
I20250625 03:31:44.651087 3715 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "526951ad467a4708926096ed1162a722" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
I20250625 03:31:44.651854 3715 raft_consensus.cc:3058] T 526951ad467a4708926096ed1162a722 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:44.646028 4385 raft_consensus.cc:513] T 6a179f065ae046df819a9bd88194dae6 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:44.626335 4356 raft_consensus.cc:513] T 0cf94f40d3434a11b3bfec277069c8c5 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:44.664803 4272 raft_consensus.cc:2802] T 49d4fb2581ed4ef998f6a113ea67c323 P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:31:44.665351 4272 raft_consensus.cc:695] T 49d4fb2581ed4ef998f6a113ea67c323 P 841018313ad649679de64e006582f4c5 [term 2 LEADER]: Becoming Leader. State: Replica: 841018313ad649679de64e006582f4c5, State: Running, Role: LEADER
I20250625 03:31:44.667208 3715 raft_consensus.cc:2466] T 526951ad467a4708926096ed1162a722 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddc0ad67020f45edb3ba9c83cab687a4 in term 2.
I20250625 03:31:44.653867 4382 leader_election.cc:290] T 526951ad467a4708926096ed1162a722 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 2 election: Requested vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:31:44.670015 4385 leader_election.cc:290] T 6a179f065ae046df819a9bd88194dae6 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:31:44.669878 4379 raft_consensus.cc:357] T ea706d649de940bf8652264ed57a901f P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:44.670697 4379 raft_consensus.cc:738] T ea706d649de940bf8652264ed57a901f P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:44.671377 4379 consensus_queue.cc:260] T ea706d649de940bf8652264ed57a901f P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:44.654301 4355 raft_consensus.cc:513] T b74d9f11c2bc4a7bb6431d6222d45175 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:44.673672 4356 leader_election.cc:290] T 0cf94f40d3434a11b3bfec277069c8c5 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 841018313ad649679de64e006582f4c5 (127.0.106.131:39467)
I20250625 03:31:44.671861 4462 raft_consensus.cc:2802] T 049948eeceeb43c98ccda9e839b521a8 P ddc0ad67020f45edb3ba9c83cab687a4 [term 3 FOLLOWER]: Leader election won for term 3
I20250625 03:31:44.674656 4462 raft_consensus.cc:695] T 049948eeceeb43c98ccda9e839b521a8 P ddc0ad67020f45edb3ba9c83cab687a4 [term 3 LEADER]: Becoming Leader. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Running, Role: LEADER
I20250625 03:31:44.675594 4379 ts_tablet_manager.cc:1428] T ea706d649de940bf8652264ed57a901f P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.064s user 0.003s sys 0.006s
I20250625 03:31:44.677395 4379 tablet_bootstrap.cc:492] T 049948eeceeb43c98ccda9e839b521a8 P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:44.666078 4272 consensus_queue.cc:237] T 49d4fb2581ed4ef998f6a113ea67c323 P 841018313ad649679de64e006582f4c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:44.678082 4423 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5350a260b3364354b73176e6bdd77940" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:44.679356 4427 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6a179f065ae046df819a9bd88194dae6" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:44.679530 4422 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d08de4c2326d46bab26f42d8d483ebd0" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:44.675488 4462 consensus_queue.cc:237] T 049948eeceeb43c98ccda9e839b521a8 P ddc0ad67020f45edb3ba9c83cab687a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:44.676558 4271 leader_election.cc:290] T 0cf94f40d3434a11b3bfec277069c8c5 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 2 election: Requested vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:31:44.680771 3712 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0cf94f40d3434a11b3bfec277069c8c5" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
I20250625 03:31:44.680291 3715 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6a179f065ae046df819a9bd88194dae6" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" is_pre_election: true
I20250625 03:31:44.702436 3712 raft_consensus.cc:3058] T 0cf94f40d3434a11b3bfec277069c8c5 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:44.702490 3715 raft_consensus.cc:2466] T 6a179f065ae046df819a9bd88194dae6 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841018313ad649679de64e006582f4c5 in term 1.
I20250625 03:31:44.703922 3754 leader_election.cc:304] T 6a179f065ae046df819a9bd88194dae6 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, 841018313ad649679de64e006582f4c5; no voters:
I20250625 03:31:44.706490 4385 raft_consensus.cc:2802] T 6a179f065ae046df819a9bd88194dae6 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250625 03:31:44.707003 4385 raft_consensus.cc:491] T 6a179f065ae046df819a9bd88194dae6 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 01873d289e0b4f9f9184b251369502a9)
I20250625 03:31:44.707515 4385 raft_consensus.cc:3058] T 6a179f065ae046df819a9bd88194dae6 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:44.678105 4355 leader_election.cc:290] T b74d9f11c2bc4a7bb6431d6222d45175 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:31:44.713089 4391 leader_election.cc:290] T 7e92fd94b9f24b1097e9a7373896cb26 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 2 election: Requested vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:31:44.714756 3715 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7e92fd94b9f24b1097e9a7373896cb26" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
W20250625 03:31:44.714177 3828 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.131:39467, user_credentials={real_user=slave}} blocked reactor thread for 57655.4us
I20250625 03:31:44.715359 3715 raft_consensus.cc:3058] T 7e92fd94b9f24b1097e9a7373896cb26 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:44.718950 3828 leader_election.cc:304] T 526951ad467a4708926096ed1162a722 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, ddc0ad67020f45edb3ba9c83cab687a4; no voters:
I20250625 03:31:44.719061 3712 raft_consensus.cc:2466] T 0cf94f40d3434a11b3bfec277069c8c5 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841018313ad649679de64e006582f4c5 in term 2.
I20250625 03:31:44.724618 3785 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b74d9f11c2bc4a7bb6431d6222d45175" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:31:44.725348 3785 raft_consensus.cc:2466] T b74d9f11c2bc4a7bb6431d6222d45175 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddc0ad67020f45edb3ba9c83cab687a4 in term 1.
I20250625 03:31:44.724772 3754 leader_election.cc:304] T 0cf94f40d3434a11b3bfec277069c8c5 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, 841018313ad649679de64e006582f4c5; no voters:
I20250625 03:31:44.729225 4271 raft_consensus.cc:2802] T 0cf94f40d3434a11b3bfec277069c8c5 P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:31:44.730017 4271 raft_consensus.cc:695] T 0cf94f40d3434a11b3bfec277069c8c5 P 841018313ad649679de64e006582f4c5 [term 2 LEADER]: Becoming Leader. State: Replica: 841018313ad649679de64e006582f4c5, State: Running, Role: LEADER
I20250625 03:31:44.730078 4470 raft_consensus.cc:491] T 5dc5a179a27f462989b291e8133742da P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01873d289e0b4f9f9184b251369502a9)
I20250625 03:31:44.730466 4425 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7a8ecc65ca1140beb905dd6368bfaa2a" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:44.730693 4470 raft_consensus.cc:513] T 5dc5a179a27f462989b291e8133742da P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:44.731029 4271 consensus_queue.cc:237] T 0cf94f40d3434a11b3bfec277069c8c5 P 841018313ad649679de64e006582f4c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:44.731928 3715 raft_consensus.cc:2466] T 7e92fd94b9f24b1097e9a7373896cb26 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841018313ad649679de64e006582f4c5 in term 2.
I20250625 03:31:44.733155 3754 leader_election.cc:304] T 7e92fd94b9f24b1097e9a7373896cb26 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, 841018313ad649679de64e006582f4c5; no voters:
I20250625 03:31:44.733261 4382 raft_consensus.cc:491] T d08de4c2326d46bab26f42d8d483ebd0 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01873d289e0b4f9f9184b251369502a9)
I20250625 03:31:44.733755 4473 raft_consensus.cc:491] T e7d3871088394a3ba7a6d18baae1feba P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01873d289e0b4f9f9184b251369502a9)
I20250625 03:31:44.733006 4470 leader_election.cc:290] T 5dc5a179a27f462989b291e8133742da P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:31:44.733847 4382 raft_consensus.cc:513] T d08de4c2326d46bab26f42d8d483ebd0 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:44.734356 4473 raft_consensus.cc:513] T e7d3871088394a3ba7a6d18baae1feba P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:44.736143 4382 leader_election.cc:290] T d08de4c2326d46bab26f42d8d483ebd0 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:31:44.736460 4473 leader_election.cc:290] T e7d3871088394a3ba7a6d18baae1feba P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:31:44.721338 4391 raft_consensus.cc:491] T 007d68495d594a73a5e2748f51e7c44c P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01873d289e0b4f9f9184b251369502a9)
I20250625 03:31:44.735551 4471 raft_consensus.cc:2802] T 7e92fd94b9f24b1097e9a7373896cb26 P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:31:44.737510 4391 raft_consensus.cc:513] T 007d68495d594a73a5e2748f51e7c44c P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:44.738389 4471 raft_consensus.cc:695] T 7e92fd94b9f24b1097e9a7373896cb26 P 841018313ad649679de64e006582f4c5 [term 2 LEADER]: Becoming Leader. State: Replica: 841018313ad649679de64e006582f4c5, State: Running, Role: LEADER
I20250625 03:31:44.739576 4391 leader_election.cc:290] T 007d68495d594a73a5e2748f51e7c44c P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:31:44.739374 4471 consensus_queue.cc:237] T 7e92fd94b9f24b1097e9a7373896cb26 P 841018313ad649679de64e006582f4c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
W20250625 03:31:44.748735 3753 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.132:37353, user_credentials={real_user=slave}} blocked reactor thread for 102007us
I20250625 03:31:44.749114 3712 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d08de4c2326d46bab26f42d8d483ebd0" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" is_pre_election: true
I20250625 03:31:44.750717 3715 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5dc5a179a27f462989b291e8133742da" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" is_pre_election: true
I20250625 03:31:44.752002 4419 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "049948eeceeb43c98ccda9e839b521a8" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:44.753756 4422 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "526951ad467a4708926096ed1162a722" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:44.754271 4427 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "49d4fb2581ed4ef998f6a113ea67c323" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:44.755054 4417 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "526951ad467a4708926096ed1162a722" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9"
I20250625 03:31:44.755532 4418 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "007d68495d594a73a5e2748f51e7c44c" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:44.756424 4421 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5dc5a179a27f462989b291e8133742da" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:44.746053 4355 raft_consensus.cc:2802] T 526951ad467a4708926096ed1162a722 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:31:44.757130 4427 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b74d9f11c2bc4a7bb6431d6222d45175" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:44.758845 4425 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2c4bb2d21b5242d387f6bc6ada60b4d5" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9"
I20250625 03:31:44.762531 3785 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0cf94f40d3434a11b3bfec277069c8c5" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:31:44.765477 3786 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e7d3871088394a3ba7a6d18baae1feba" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:31:44.768051 4468 raft_consensus.cc:491] T e7d3871088394a3ba7a6d18baae1feba P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01873d289e0b4f9f9184b251369502a9)
I20250625 03:31:44.768607 4468 raft_consensus.cc:513] T e7d3871088394a3ba7a6d18baae1feba P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:44.769511 4420 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0cf94f40d3434a11b3bfec277069c8c5" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:44.769596 4423 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "049948eeceeb43c98ccda9e839b521a8" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9"
I20250625 03:31:44.770298 4420 raft_consensus.cc:2466] T 0cf94f40d3434a11b3bfec277069c8c5 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5b9823dfcd41cb92bd195c811cbf39 in term 1.
I20250625 03:31:44.770061 3862 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "007d68495d594a73a5e2748f51e7c44c" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:44.770669 4468 leader_election.cc:290] T e7d3871088394a3ba7a6d18baae1feba P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:31:44.771157 3862 raft_consensus.cc:2466] T 007d68495d594a73a5e2748f51e7c44c P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841018313ad649679de64e006582f4c5 in term 1.
W20250625 03:31:44.767308 3680 leader_election.cc:343] T 5350a260b3364354b73176e6bdd77940 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:44.771382 3786 raft_consensus.cc:2466] T e7d3871088394a3ba7a6d18baae1feba P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddc0ad67020f45edb3ba9c83cab687a4 in term 1.
I20250625 03:31:44.771723 3680 leader_election.cc:304] T 5350a260b3364354b73176e6bdd77940 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39; no voters: 01873d289e0b4f9f9184b251369502a9, ddc0ad67020f45edb3ba9c83cab687a4
I20250625 03:31:44.749904 3712 raft_consensus.cc:2466] T d08de4c2326d46bab26f42d8d483ebd0 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddc0ad67020f45edb3ba9c83cab687a4 in term 1.
W20250625 03:31:44.778105 3680 leader_election.cc:343] T 6a179f065ae046df819a9bd88194dae6 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:44.778055 3715 raft_consensus.cc:2466] T 5dc5a179a27f462989b291e8133742da P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddc0ad67020f45edb3ba9c83cab687a4 in term 1.
I20250625 03:31:44.778712 3680 leader_election.cc:304] T 6a179f065ae046df819a9bd88194dae6 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39; no voters: 01873d289e0b4f9f9184b251369502a9, 841018313ad649679de64e006582f4c5
I20250625 03:31:44.765018 4355 raft_consensus.cc:695] T 526951ad467a4708926096ed1162a722 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 LEADER]: Becoming Leader. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Running, Role: LEADER
W20250625 03:31:44.785876 3680 leader_election.cc:343] T d08de4c2326d46bab26f42d8d483ebd0 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:44.786252 3680 leader_election.cc:304] T d08de4c2326d46bab26f42d8d483ebd0 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39; no voters: 01873d289e0b4f9f9184b251369502a9, ddc0ad67020f45edb3ba9c83cab687a4
I20250625 03:31:44.787750 4357 raft_consensus.cc:2747] T 6a179f065ae046df819a9bd88194dae6 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250625 03:31:44.777333 4392 raft_consensus.cc:2747] T 5350a260b3364354b73176e6bdd77940 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250625 03:31:44.794379 3828 leader_election.cc:304] T b74d9f11c2bc4a7bb6431d6222d45175 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841018313ad649679de64e006582f4c5, ddc0ad67020f45edb3ba9c83cab687a4; no voters:
I20250625 03:31:44.799803 3828 leader_election.cc:304] T e7d3871088394a3ba7a6d18baae1feba P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841018313ad649679de64e006582f4c5, ddc0ad67020f45edb3ba9c83cab687a4; no voters:
I20250625 03:31:44.788180 4419 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d08de4c2326d46bab26f42d8d483ebd0" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
W20250625 03:31:44.810557 4466 log.cc:927] Time spent T 00000000000000000000000000000000 P 9fa95fcbf1e74bd8826a5f32008a0ffe: Append to log took a long time: real 0.064s user 0.000s sys 0.000s
I20250625 03:31:44.810880 4426 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5dc5a179a27f462989b291e8133742da" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:44.801627 4473 raft_consensus.cc:2802] T b74d9f11c2bc4a7bb6431d6222d45175 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250625 03:31:44.807906 4392 raft_consensus.cc:2747] T d08de4c2326d46bab26f42d8d483ebd0 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250625 03:31:44.807334 4382 raft_consensus.cc:2802] T e7d3871088394a3ba7a6d18baae1feba P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20250625 03:31:44.824434 3680 leader_election.cc:343] T 7a8ecc65ca1140beb905dd6368bfaa2a P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:44.825222 3680 leader_election.cc:304] T 7a8ecc65ca1140beb905dd6368bfaa2a P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39; no voters: 01873d289e0b4f9f9184b251369502a9, 841018313ad649679de64e006582f4c5
I20250625 03:31:44.827204 4355 consensus_queue.cc:237] T 526951ad467a4708926096ed1162a722 P ddc0ad67020f45edb3ba9c83cab687a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:44.822968 4425 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e7d3871088394a3ba7a6d18baae1feba" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:44.821935 4473 raft_consensus.cc:491] T b74d9f11c2bc4a7bb6431d6222d45175 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 01873d289e0b4f9f9184b251369502a9)
I20250625 03:31:44.836350 4473 raft_consensus.cc:3058] T b74d9f11c2bc4a7bb6431d6222d45175 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:44.828310 4381 raft_consensus.cc:2747] T 7a8ecc65ca1140beb905dd6368bfaa2a P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250625 03:31:44.842870 3680 leader_election.cc:304] T 0cf94f40d3434a11b3bfec277069c8c5 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9, 3d5b9823dfcd41cb92bd195c811cbf39; no voters:
W20250625 03:31:44.844432 3680 leader_election.cc:343] T 5dc5a179a27f462989b291e8133742da P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:44.845080 3680 leader_election.cc:304] T 5dc5a179a27f462989b291e8133742da P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39; no voters: 01873d289e0b4f9f9184b251369502a9, ddc0ad67020f45edb3ba9c83cab687a4
I20250625 03:31:44.847009 4385 raft_consensus.cc:513] T 6a179f065ae046df819a9bd88194dae6 P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:44.827342 4382 raft_consensus.cc:491] T e7d3871088394a3ba7a6d18baae1feba P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 01873d289e0b4f9f9184b251369502a9)
I20250625 03:31:44.849597 4382 raft_consensus.cc:3058] T e7d3871088394a3ba7a6d18baae1feba P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:44.844079 3536 catalog_manager.cc:5582] T 49d4fb2581ed4ef998f6a113ea67c323 P 841018313ad649679de64e006582f4c5 reported cstate change: term changed from 1 to 2, leader changed from 01873d289e0b4f9f9184b251369502a9 (127.0.106.129) to 841018313ad649679de64e006582f4c5 (127.0.106.131). New cstate: current_term: 2 leader_uuid: "841018313ad649679de64e006582f4c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:44.854190 4381 raft_consensus.cc:2762] T 0cf94f40d3434a11b3bfec277069c8c5 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20250625 03:31:44.874724 3828 leader_election.cc:304] T d08de4c2326d46bab26f42d8d483ebd0 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, ddc0ad67020f45edb3ba9c83cab687a4; no voters:
I20250625 03:31:44.866376 4356 raft_consensus.cc:2747] T 5dc5a179a27f462989b291e8133742da P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20250625 03:31:44.884443 3753 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.132:37353, user_credentials={real_user=slave}} blocked reactor thread for 120212us
I20250625 03:31:44.885705 4476 raft_consensus.cc:2802] T d08de4c2326d46bab26f42d8d483ebd0 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250625 03:31:44.884471 3828 leader_election.cc:304] T 5dc5a179a27f462989b291e8133742da P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, ddc0ad67020f45edb3ba9c83cab687a4; no voters:
I20250625 03:31:44.886168 4476 raft_consensus.cc:491] T d08de4c2326d46bab26f42d8d483ebd0 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 01873d289e0b4f9f9184b251369502a9)
I20250625 03:31:44.884667 4271 raft_consensus.cc:491] T 7a8ecc65ca1140beb905dd6368bfaa2a P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01873d289e0b4f9f9184b251369502a9)
I20250625 03:31:44.886590 4476 raft_consensus.cc:3058] T d08de4c2326d46bab26f42d8d483ebd0 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:44.887091 4385 leader_election.cc:290] T 6a179f065ae046df819a9bd88194dae6 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 2 election: Requested vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:31:44.886893 4271 raft_consensus.cc:513] T 7a8ecc65ca1140beb905dd6368bfaa2a P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
W20250625 03:31:44.887162 3828 leader_election.cc:343] T 049948eeceeb43c98ccda9e839b521a8 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:44.889309 4271 leader_election.cc:290] T 7a8ecc65ca1140beb905dd6368bfaa2a P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
W20250625 03:31:44.889562 3828 leader_election.cc:343] T 526951ad467a4708926096ed1162a722 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:44.889890 4469 raft_consensus.cc:2802] T 5dc5a179a27f462989b291e8133742da P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250625 03:31:44.890290 4469 raft_consensus.cc:491] T 5dc5a179a27f462989b291e8133742da P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 01873d289e0b4f9f9184b251369502a9)
W20250625 03:31:44.890461 3828 leader_election.cc:343] T 49d4fb2581ed4ef998f6a113ea67c323 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:44.890653 4469 raft_consensus.cc:3058] T 5dc5a179a27f462989b291e8133742da P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:44.872810 4470 raft_consensus.cc:491] T 5350a260b3364354b73176e6bdd77940 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01873d289e0b4f9f9184b251369502a9)
I20250625 03:31:44.890908 3828 leader_election.cc:304] T 49d4fb2581ed4ef998f6a113ea67c323 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddc0ad67020f45edb3ba9c83cab687a4; no voters: 01873d289e0b4f9f9184b251369502a9, 841018313ad649679de64e006582f4c5
I20250625 03:31:44.891283 4470 raft_consensus.cc:513] T 5350a260b3364354b73176e6bdd77940 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:44.880549 4423 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "49d4fb2581ed4ef998f6a113ea67c323" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
W20250625 03:31:44.892275 3828 leader_election.cc:343] T 526951ad467a4708926096ed1162a722 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:44.893301 3753 leader_election.cc:304] T 007d68495d594a73a5e2748f51e7c44c P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841018313ad649679de64e006582f4c5, ddc0ad67020f45edb3ba9c83cab687a4; no voters:
I20250625 03:31:44.900370 4418 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0cf94f40d3434a11b3bfec277069c8c5" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9"
I20250625 03:31:44.929977 4271 raft_consensus.cc:2802] T 007d68495d594a73a5e2748f51e7c44c P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250625 03:31:44.895852 4470 leader_election.cc:290] T 5350a260b3364354b73176e6bdd77940 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:31:44.930402 4271 raft_consensus.cc:491] T 007d68495d594a73a5e2748f51e7c44c P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 01873d289e0b4f9f9184b251369502a9)
W20250625 03:31:44.928452 3828 leader_election.cc:343] T 007d68495d594a73a5e2748f51e7c44c P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:44.935101 3828 leader_election.cc:304] T 007d68495d594a73a5e2748f51e7c44c P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddc0ad67020f45edb3ba9c83cab687a4; no voters: 01873d289e0b4f9f9184b251369502a9, 841018313ad649679de64e006582f4c5
I20250625 03:31:44.930835 4271 raft_consensus.cc:3058] T 007d68495d594a73a5e2748f51e7c44c P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:44.930783 4418 raft_consensus.cc:3058] T 0cf94f40d3434a11b3bfec277069c8c5 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:44.891846 4382 raft_consensus.cc:513] T e7d3871088394a3ba7a6d18baae1feba P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:44.944478 3534 ts_manager.cc:194] Re-registered known tserver with Master: 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:31:44.944907 4382 leader_election.cc:290] T e7d3871088394a3ba7a6d18baae1feba P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 2 election: Requested vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
W20250625 03:31:44.938820 3828 leader_election.cc:343] T 5dc5a179a27f462989b291e8133742da P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:44.893343 4383 raft_consensus.cc:2747] T 49d4fb2581ed4ef998f6a113ea67c323 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250625 03:31:44.900786 4421 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e7d3871088394a3ba7a6d18baae1feba" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:44.901340 4422 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6a179f065ae046df819a9bd88194dae6" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:44.903824 4419 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7a8ecc65ca1140beb905dd6368bfaa2a" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:44.898658 4417 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7e92fd94b9f24b1097e9a7373896cb26" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9"
I20250625 03:31:44.959769 4417 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "007d68495d594a73a5e2748f51e7c44c" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:44.960093 3859 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e7d3871088394a3ba7a6d18baae1feba" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:31:44.960994 3859 raft_consensus.cc:2391] T e7d3871088394a3ba7a6d18baae1feba P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841018313ad649679de64e006582f4c5 in current term 2: Already voted for candidate ddc0ad67020f45edb3ba9c83cab687a4 in this term.
W20250625 03:31:44.949877 3828 leader_election.cc:343] T b74d9f11c2bc4a7bb6431d6222d45175 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:44.892302 4420 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7e92fd94b9f24b1097e9a7373896cb26" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
W20250625 03:31:44.964610 3828 leader_election.cc:343] T 049948eeceeb43c98ccda9e839b521a8 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 3 election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
W20250625 03:31:44.965361 3828 leader_election.cc:343] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
W20250625 03:31:44.966069 3828 leader_election.cc:343] T d08de4c2326d46bab26f42d8d483ebd0 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
W20250625 03:31:44.966821 3828 leader_election.cc:343] T e7d3871088394a3ba7a6d18baae1feba P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:44.896330 4427 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "49d4fb2581ed4ef998f6a113ea67c323" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9"
I20250625 03:31:44.944762 4470 raft_consensus.cc:2747] T 007d68495d594a73a5e2748f51e7c44c P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20250625 03:31:44.952205 3754 leader_election.cc:343] T 49d4fb2581ed4ef998f6a113ea67c323 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:44.898499 4425 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b74d9f11c2bc4a7bb6431d6222d45175" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:44.898011 4426 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0cf94f40d3434a11b3bfec277069c8c5" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
I20250625 03:31:44.971089 4379 tablet_bootstrap.cc:492] T 049948eeceeb43c98ccda9e839b521a8 P 01873d289e0b4f9f9184b251369502a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:31:44.975309 3785 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e7d3871088394a3ba7a6d18baae1feba" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5"
I20250625 03:31:44.975958 3785 raft_consensus.cc:3058] T e7d3871088394a3ba7a6d18baae1feba P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:44.978837 4473 raft_consensus.cc:513] T b74d9f11c2bc4a7bb6431d6222d45175 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:44.983440 4271 raft_consensus.cc:513] T 007d68495d594a73a5e2748f51e7c44c P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:44.984423 3711 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5350a260b3364354b73176e6bdd77940" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" is_pre_election: true
I20250625 03:31:44.985209 3711 raft_consensus.cc:2466] T 5350a260b3364354b73176e6bdd77940 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddc0ad67020f45edb3ba9c83cab687a4 in term 1.
W20250625 03:31:44.985940 3754 leader_election.cc:343] T 7e92fd94b9f24b1097e9a7373896cb26 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:44.986601 3788 raft_consensus.cc:1273] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Refusing update from remote peer ddc0ad67020f45edb3ba9c83cab687a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20250625 03:31:44.986865 3754 leader_election.cc:343] T 007d68495d594a73a5e2748f51e7c44c P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:44.989391 4423 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6a179f065ae046df819a9bd88194dae6" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9"
I20250625 03:31:44.994133 4423 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e7d3871088394a3ba7a6d18baae1feba" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9"
I20250625 03:31:44.994307 4426 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5350a260b3364354b73176e6bdd77940" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9" is_pre_election: true
W20250625 03:31:45.001355 3754 leader_election.cc:343] T 7e92fd94b9f24b1097e9a7373896cb26 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:45.007208 4469 raft_consensus.cc:513] T 5dc5a179a27f462989b291e8133742da P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:45.023626 4476 raft_consensus.cc:513] T d08de4c2326d46bab26f42d8d483ebd0 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:45.011109 4473 leader_election.cc:290] T b74d9f11c2bc4a7bb6431d6222d45175 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 2 election: Requested vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:31:45.019028 4271 leader_election.cc:290] T 007d68495d594a73a5e2748f51e7c44c P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 2 election: Requested vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
W20250625 03:31:45.032574 3754 leader_election.cc:343] T 49d4fb2581ed4ef998f6a113ea67c323 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:45.032086 3785 raft_consensus.cc:2466] T e7d3871088394a3ba7a6d18baae1feba P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddc0ad67020f45edb3ba9c83cab687a4 in term 2.
W20250625 03:31:45.044108 3754 leader_election.cc:343] T 6a179f065ae046df819a9bd88194dae6 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
W20250625 03:31:45.045219 3754 leader_election.cc:343] T e7d3871088394a3ba7a6d18baae1feba P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:45.045747 3754 leader_election.cc:304] T e7d3871088394a3ba7a6d18baae1feba P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841018313ad649679de64e006582f4c5; no voters: 01873d289e0b4f9f9184b251369502a9, ddc0ad67020f45edb3ba9c83cab687a4
W20250625 03:31:45.047729 3754 leader_election.cc:343] T 6a179f065ae046df819a9bd88194dae6 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
W20250625 03:31:45.048532 3754 leader_election.cc:343] T 7a8ecc65ca1140beb905dd6368bfaa2a P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
W20250625 03:31:45.049086 3754 leader_election.cc:343] T b74d9f11c2bc4a7bb6431d6222d45175 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:45.049440 3754 leader_election.cc:304] T b74d9f11c2bc4a7bb6431d6222d45175 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841018313ad649679de64e006582f4c5; no voters: 01873d289e0b4f9f9184b251369502a9, ddc0ad67020f45edb3ba9c83cab687a4
I20250625 03:31:45.049466 3715 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6a179f065ae046df819a9bd88194dae6" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
I20250625 03:31:45.050439 3715 raft_consensus.cc:3058] T 6a179f065ae046df819a9bd88194dae6 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:45.052898 3862 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "007d68495d594a73a5e2748f51e7c44c" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4"
I20250625 03:31:45.053845 3862 raft_consensus.cc:3058] T 007d68495d594a73a5e2748f51e7c44c P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:45.029505 4476 leader_election.cc:290] T d08de4c2326d46bab26f42d8d483ebd0 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 2 election: Requested vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:31:45.062656 4379 tablet_bootstrap.cc:492] T 049948eeceeb43c98ccda9e839b521a8 P 01873d289e0b4f9f9184b251369502a9: Bootstrap complete.
I20250625 03:31:45.063475 4379 ts_tablet_manager.cc:1397] T 049948eeceeb43c98ccda9e839b521a8 P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.386s user 0.023s sys 0.004s
I20250625 03:31:45.065280 3862 raft_consensus.cc:2466] T 007d68495d594a73a5e2748f51e7c44c P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841018313ad649679de64e006582f4c5 in term 2.
I20250625 03:31:45.065889 3714 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7a8ecc65ca1140beb905dd6368bfaa2a" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" is_pre_election: true
I20250625 03:31:45.066640 3714 raft_consensus.cc:2466] T 7a8ecc65ca1140beb905dd6368bfaa2a P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841018313ad649679de64e006582f4c5 in term 1.
I20250625 03:31:45.066825 4478 raft_consensus.cc:2747] T e7d3871088394a3ba7a6d18baae1feba P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250625 03:31:45.070302 4385 raft_consensus.cc:2747] T b74d9f11c2bc4a7bb6431d6222d45175 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250625 03:31:45.036664 4423 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d08de4c2326d46bab26f42d8d483ebd0" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9"
I20250625 03:31:45.073464 4419 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "007d68495d594a73a5e2748f51e7c44c" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9"
I20250625 03:31:45.037192 4422 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b74d9f11c2bc4a7bb6431d6222d45175" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9"
I20250625 03:31:45.074783 4379 raft_consensus.cc:357] T 049948eeceeb43c98ccda9e839b521a8 P 01873d289e0b4f9f9184b251369502a9 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:45.075531 4379 raft_consensus.cc:738] T 049948eeceeb43c98ccda9e839b521a8 P 01873d289e0b4f9f9184b251369502a9 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:45.076217 4379 consensus_queue.cc:260] T 049948eeceeb43c98ccda9e839b521a8 P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:45.033370 4426 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5dc5a179a27f462989b291e8133742da" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9"
I20250625 03:31:45.078434 3753 leader_election.cc:304] T 007d68495d594a73a5e2748f51e7c44c P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841018313ad649679de64e006582f4c5, ddc0ad67020f45edb3ba9c83cab687a4; no voters:
I20250625 03:31:45.079376 4271 raft_consensus.cc:2802] T 007d68495d594a73a5e2748f51e7c44c P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:31:45.079860 4271 raft_consensus.cc:695] T 007d68495d594a73a5e2748f51e7c44c P 841018313ad649679de64e006582f4c5 [term 2 LEADER]: Becoming Leader. State: Replica: 841018313ad649679de64e006582f4c5, State: Running, Role: LEADER
I20250625 03:31:45.080963 4271 consensus_queue.cc:237] T 007d68495d594a73a5e2748f51e7c44c P 841018313ad649679de64e006582f4c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
W20250625 03:31:45.089236 3828 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:37771, user_credentials={real_user=slave}} blocked reactor thread for 44523.3us
W20250625 03:31:45.092543 3828 leader_election.cc:343] T e7d3871088394a3ba7a6d18baae1feba P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
W20250625 03:31:45.093169 3828 leader_election.cc:343] T 5350a260b3364354b73176e6bdd77940 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:45.096285 4379 ts_tablet_manager.cc:1428] T 049948eeceeb43c98ccda9e839b521a8 P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.032s user 0.008s sys 0.000s
I20250625 03:31:45.097349 4379 tablet_bootstrap.cc:492] T 007d68495d594a73a5e2748f51e7c44c P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:45.091491 3715 raft_consensus.cc:2466] T 6a179f065ae046df819a9bd88194dae6 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841018313ad649679de64e006582f4c5 in term 2.
I20250625 03:31:45.099738 3754 leader_election.cc:304] T 7a8ecc65ca1140beb905dd6368bfaa2a P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, 841018313ad649679de64e006582f4c5; no voters: 01873d289e0b4f9f9184b251369502a9
I20250625 03:31:45.095137 4469 leader_election.cc:290] T 5dc5a179a27f462989b291e8133742da P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 2 election: Requested vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:31:45.106658 4467 raft_consensus.cc:2802] T 7a8ecc65ca1140beb905dd6368bfaa2a P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250625 03:31:45.108623 4467 raft_consensus.cc:491] T 7a8ecc65ca1140beb905dd6368bfaa2a P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 01873d289e0b4f9f9184b251369502a9)
W20250625 03:31:45.117492 3828 consensus_peers.cc:487] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P ddc0ad67020f45edb3ba9c83cab687a4 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20250625 03:31:45.119874 3828 leader_election.cc:343] T d08de4c2326d46bab26f42d8d483ebd0 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
W20250625 03:31:45.120915 3828 leader_election.cc:343] T b74d9f11c2bc4a7bb6431d6222d45175 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
W20250625 03:31:45.121639 3828 leader_election.cc:343] T 5dc5a179a27f462989b291e8133742da P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:45.117295 4467 raft_consensus.cc:3058] T 7a8ecc65ca1140beb905dd6368bfaa2a P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:45.110174 4418 raft_consensus.cc:2466] T 0cf94f40d3434a11b3bfec277069c8c5 P 01873d289e0b4f9f9184b251369502a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841018313ad649679de64e006582f4c5 in term 2.
W20250625 03:31:45.162572 3754 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.130:42041, user_credentials={real_user=slave}} blocked reactor thread for 51945.4us
I20250625 03:31:45.164306 3754 leader_election.cc:304] T 6a179f065ae046df819a9bd88194dae6 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, 841018313ad649679de64e006582f4c5; no voters: 01873d289e0b4f9f9184b251369502a9
W20250625 03:31:45.168488 3754 leader_election.cc:343] T 007d68495d594a73a5e2748f51e7c44c P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:45.172230 4478 raft_consensus.cc:2802] T 6a179f065ae046df819a9bd88194dae6 P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:31:45.172819 4478 raft_consensus.cc:695] T 6a179f065ae046df819a9bd88194dae6 P 841018313ad649679de64e006582f4c5 [term 2 LEADER]: Becoming Leader. State: Replica: 841018313ad649679de64e006582f4c5, State: Running, Role: LEADER
I20250625 03:31:45.172891 3828 leader_election.cc:304] T 5350a260b3364354b73176e6bdd77940 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, ddc0ad67020f45edb3ba9c83cab687a4; no voters: 01873d289e0b4f9f9184b251369502a9
I20250625 03:31:45.173729 4478 consensus_queue.cc:237] T 6a179f065ae046df819a9bd88194dae6 P 841018313ad649679de64e006582f4c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:45.174299 4469 raft_consensus.cc:2802] T 5350a260b3364354b73176e6bdd77940 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250625 03:31:45.175041 4469 raft_consensus.cc:491] T 5350a260b3364354b73176e6bdd77940 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 01873d289e0b4f9f9184b251369502a9)
I20250625 03:31:45.175763 4469 raft_consensus.cc:3058] T 5350a260b3364354b73176e6bdd77940 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:45.181309 3785 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b74d9f11c2bc4a7bb6431d6222d45175" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5"
I20250625 03:31:45.181934 3785 raft_consensus.cc:3058] T b74d9f11c2bc4a7bb6431d6222d45175 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:45.188006 3713 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5dc5a179a27f462989b291e8133742da" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
I20250625 03:31:45.188648 3713 raft_consensus.cc:3058] T 5dc5a179a27f462989b291e8133742da P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:45.212932 3713 raft_consensus.cc:2466] T 5dc5a179a27f462989b291e8133742da P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddc0ad67020f45edb3ba9c83cab687a4 in term 2.
I20250625 03:31:45.214632 3828 leader_election.cc:304] T e7d3871088394a3ba7a6d18baae1feba P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841018313ad649679de64e006582f4c5, ddc0ad67020f45edb3ba9c83cab687a4; no voters: 01873d289e0b4f9f9184b251369502a9
I20250625 03:31:45.216662 4473 consensus_queue.cc:1035] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P ddc0ad67020f45edb3ba9c83cab687a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20250625 03:31:45.232209 4382 raft_consensus.cc:2802] T e7d3871088394a3ba7a6d18baae1feba P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:31:45.232728 4382 raft_consensus.cc:695] T e7d3871088394a3ba7a6d18baae1feba P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 LEADER]: Becoming Leader. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Running, Role: LEADER
I20250625 03:31:45.233584 4382 consensus_queue.cc:237] T e7d3871088394a3ba7a6d18baae1feba P ddc0ad67020f45edb3ba9c83cab687a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:45.238354 3828 leader_election.cc:304] T 5dc5a179a27f462989b291e8133742da P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, ddc0ad67020f45edb3ba9c83cab687a4; no voters: 01873d289e0b4f9f9184b251369502a9
I20250625 03:31:45.240285 4355 raft_consensus.cc:2802] T 5dc5a179a27f462989b291e8133742da P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:31:45.240777 4355 raft_consensus.cc:695] T 5dc5a179a27f462989b291e8133742da P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 LEADER]: Becoming Leader. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Running, Role: LEADER
I20250625 03:31:45.245920 4355 consensus_queue.cc:237] T 5dc5a179a27f462989b291e8133742da P ddc0ad67020f45edb3ba9c83cab687a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:45.252450 4469 raft_consensus.cc:513] T 5350a260b3364354b73176e6bdd77940 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:45.223721 4467 raft_consensus.cc:513] T 7a8ecc65ca1140beb905dd6368bfaa2a P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:45.255117 4469 leader_election.cc:290] T 5350a260b3364354b73176e6bdd77940 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 2 election: Requested vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:31:45.260587 4467 leader_election.cc:290] T 7a8ecc65ca1140beb905dd6368bfaa2a P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 2 election: Requested vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:31:45.220528 3534 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36580
I20250625 03:31:45.227046 3711 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d08de4c2326d46bab26f42d8d483ebd0" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
I20250625 03:31:45.262236 3862 raft_consensus.cc:1273] T 49d4fb2581ed4ef998f6a113ea67c323 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Refusing update from remote peer 841018313ad649679de64e006582f4c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:45.262552 3711 raft_consensus.cc:3058] T d08de4c2326d46bab26f42d8d483ebd0 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:45.265671 4493 consensus_queue.cc:1035] T 49d4fb2581ed4ef998f6a113ea67c323 P 841018313ad649679de64e006582f4c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20250625 03:31:45.268260 3754 consensus_peers.cc:487] T 49d4fb2581ed4ef998f6a113ea67c323 P 841018313ad649679de64e006582f4c5 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:45.268541 4418 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7a8ecc65ca1140beb905dd6368bfaa2a" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9"
W20250625 03:31:45.269124 3754 consensus_peers.cc:487] T 7e92fd94b9f24b1097e9a7373896cb26 P 841018313ad649679de64e006582f4c5 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:45.272344 3711 raft_consensus.cc:2466] T d08de4c2326d46bab26f42d8d483ebd0 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddc0ad67020f45edb3ba9c83cab687a4 in term 2.
I20250625 03:31:45.229219 3785 raft_consensus.cc:2466] T b74d9f11c2bc4a7bb6431d6222d45175 P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddc0ad67020f45edb3ba9c83cab687a4 in term 2.
W20250625 03:31:45.275720 3754 leader_election.cc:343] T 7a8ecc65ca1140beb905dd6368bfaa2a P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:45.208240 3537 catalog_manager.cc:5582] T 0cf94f40d3434a11b3bfec277069c8c5 P 841018313ad649679de64e006582f4c5 reported cstate change: term changed from 1 to 2, leader changed from 01873d289e0b4f9f9184b251369502a9 (127.0.106.129) to 841018313ad649679de64e006582f4c5 (127.0.106.131). New cstate: current_term: 2 leader_uuid: "841018313ad649679de64e006582f4c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: HEALTHY } } }
I20250625 03:31:45.281634 4455 heartbeater.cc:499] Master 127.0.106.190:40959 was elected leader, sending a full tablet report...
I20250625 03:31:45.282382 3713 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7a8ecc65ca1140beb905dd6368bfaa2a" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
I20250625 03:31:45.283658 3713 raft_consensus.cc:3058] T 7a8ecc65ca1140beb905dd6368bfaa2a P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:45.281538 3537 catalog_manager.cc:5582] T 007d68495d594a73a5e2748f51e7c44c P 841018313ad649679de64e006582f4c5 reported cstate change: term changed from 1 to 2, leader changed from 01873d289e0b4f9f9184b251369502a9 (127.0.106.129) to 841018313ad649679de64e006582f4c5 (127.0.106.131). New cstate: current_term: 2 leader_uuid: "841018313ad649679de64e006582f4c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:45.289597 4418 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5350a260b3364354b73176e6bdd77940" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01873d289e0b4f9f9184b251369502a9"
I20250625 03:31:45.288764 3537 catalog_manager.cc:5582] T 7e92fd94b9f24b1097e9a7373896cb26 P 841018313ad649679de64e006582f4c5 reported cstate change: term changed from 1 to 2, leader changed from 01873d289e0b4f9f9184b251369502a9 (127.0.106.129) to 841018313ad649679de64e006582f4c5 (127.0.106.131). New cstate: current_term: 2 leader_uuid: "841018313ad649679de64e006582f4c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: HEALTHY } } }
I20250625 03:31:45.297195 3711 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5350a260b3364354b73176e6bdd77940" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
I20250625 03:31:45.297812 3711 raft_consensus.cc:3058] T 5350a260b3364354b73176e6bdd77940 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:45.309463 3714 raft_consensus.cc:1273] T 0cf94f40d3434a11b3bfec277069c8c5 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Refusing update from remote peer 841018313ad649679de64e006582f4c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:45.318434 4385 consensus_queue.cc:1035] T 0cf94f40d3434a11b3bfec277069c8c5 P 841018313ad649679de64e006582f4c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:45.321756 3714 raft_consensus.cc:1273] T 7e92fd94b9f24b1097e9a7373896cb26 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Refusing update from remote peer 841018313ad649679de64e006582f4c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:45.326437 4418 raft_consensus.cc:1273] T 0cf94f40d3434a11b3bfec277069c8c5 P 01873d289e0b4f9f9184b251369502a9 [term 2 FOLLOWER]: Refusing update from remote peer 841018313ad649679de64e006582f4c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:45.327288 4385 consensus_queue.cc:1035] T 7e92fd94b9f24b1097e9a7373896cb26 P 841018313ad649679de64e006582f4c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:45.330299 4272 consensus_queue.cc:1035] T 0cf94f40d3434a11b3bfec277069c8c5 P 841018313ad649679de64e006582f4c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:45.335821 4379 tablet_bootstrap.cc:492] T 007d68495d594a73a5e2748f51e7c44c P 01873d289e0b4f9f9184b251369502a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:31:45.288525 3828 leader_election.cc:304] T d08de4c2326d46bab26f42d8d483ebd0 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, ddc0ad67020f45edb3ba9c83cab687a4; no voters: 01873d289e0b4f9f9184b251369502a9
W20250625 03:31:45.344427 3828 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.130:42041, user_credentials={real_user=slave}} blocked reactor thread for 55989.3us
I20250625 03:31:45.346489 4469 raft_consensus.cc:2802] T d08de4c2326d46bab26f42d8d483ebd0 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:31:45.347321 4469 raft_consensus.cc:695] T d08de4c2326d46bab26f42d8d483ebd0 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 LEADER]: Becoming Leader. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Running, Role: LEADER
I20250625 03:31:45.348551 4469 consensus_queue.cc:237] T d08de4c2326d46bab26f42d8d483ebd0 P ddc0ad67020f45edb3ba9c83cab687a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:45.337054 4379 tablet_bootstrap.cc:492] T 007d68495d594a73a5e2748f51e7c44c P 01873d289e0b4f9f9184b251369502a9: Bootstrap complete.
I20250625 03:31:45.352757 4379 ts_tablet_manager.cc:1397] T 007d68495d594a73a5e2748f51e7c44c P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.256s user 0.013s sys 0.006s
I20250625 03:31:45.303790 3713 raft_consensus.cc:2466] T 7a8ecc65ca1140beb905dd6368bfaa2a P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841018313ad649679de64e006582f4c5 in term 2.
I20250625 03:31:45.366036 3754 leader_election.cc:304] T 7a8ecc65ca1140beb905dd6368bfaa2a P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, 841018313ad649679de64e006582f4c5; no voters: 01873d289e0b4f9f9184b251369502a9
I20250625 03:31:45.366940 4385 raft_consensus.cc:2802] T 7a8ecc65ca1140beb905dd6368bfaa2a P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:31:45.367486 4385 raft_consensus.cc:695] T 7a8ecc65ca1140beb905dd6368bfaa2a P 841018313ad649679de64e006582f4c5 [term 2 LEADER]: Becoming Leader. State: Replica: 841018313ad649679de64e006582f4c5, State: Running, Role: LEADER
I20250625 03:31:45.368654 4385 consensus_queue.cc:237] T 7a8ecc65ca1140beb905dd6368bfaa2a P 841018313ad649679de64e006582f4c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:45.369899 4421 raft_consensus.cc:3058] T 049948eeceeb43c98ccda9e839b521a8 P 01873d289e0b4f9f9184b251369502a9 [term 2 FOLLOWER]: Advancing to term 3
W20250625 03:31:45.373469 3828 leader_election.cc:343] T 5350a260b3364354b73176e6bdd77940 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:31:45.363910 4379 raft_consensus.cc:357] T 007d68495d594a73a5e2748f51e7c44c P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
W20250625 03:31:45.381757 3828 consensus_peers.cc:487] T 526951ad467a4708926096ed1162a722 P ddc0ad67020f45edb3ba9c83cab687a4 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:45.382128 4379 raft_consensus.cc:738] T 007d68495d594a73a5e2748f51e7c44c P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:45.382910 4379 consensus_queue.cc:260] T 007d68495d594a73a5e2748f51e7c44c P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:45.389622 3828 leader_election.cc:304] T b74d9f11c2bc4a7bb6431d6222d45175 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841018313ad649679de64e006582f4c5, ddc0ad67020f45edb3ba9c83cab687a4; no voters: 01873d289e0b4f9f9184b251369502a9
I20250625 03:31:45.400190 4379 ts_tablet_manager.cc:1428] T 007d68495d594a73a5e2748f51e7c44c P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.047s user 0.007s sys 0.000s
I20250625 03:31:45.407162 3715 raft_consensus.cc:1273] T 526951ad467a4708926096ed1162a722 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Refusing update from remote peer ddc0ad67020f45edb3ba9c83cab687a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:45.411803 4379 tablet_bootstrap.cc:492] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:45.407258 4383 raft_consensus.cc:2802] T b74d9f11c2bc4a7bb6431d6222d45175 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:31:45.423041 3711 raft_consensus.cc:2466] T 5350a260b3364354b73176e6bdd77940 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddc0ad67020f45edb3ba9c83cab687a4 in term 2.
W20250625 03:31:45.446795 4497 log.cc:927] Time spent T e7d3871088394a3ba7a6d18baae1feba P ddc0ad67020f45edb3ba9c83cab687a4: Append to log took a long time: real 0.085s user 0.001s sys 0.000s
I20250625 03:31:45.439353 4383 raft_consensus.cc:695] T b74d9f11c2bc4a7bb6431d6222d45175 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 LEADER]: Becoming Leader. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Running, Role: LEADER
I20250625 03:31:45.483249 4383 consensus_queue.cc:237] T b74d9f11c2bc4a7bb6431d6222d45175 P ddc0ad67020f45edb3ba9c83cab687a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:45.489735 4421 raft_consensus.cc:1273] T 049948eeceeb43c98ccda9e839b521a8 P 01873d289e0b4f9f9184b251369502a9 [term 3 FOLLOWER]: Refusing update from remote peer ddc0ad67020f45edb3ba9c83cab687a4: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20250625 03:31:45.491681 3828 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.130:42041, user_credentials={real_user=slave}} blocked reactor thread for 85091.1us
W20250625 03:31:45.493309 4502 log.cc:927] Time spent T 0cf94f40d3434a11b3bfec277069c8c5 P 3d5b9823dfcd41cb92bd195c811cbf39: Append to log took a long time: real 0.057s user 0.000s sys 0.003s
I20250625 03:31:45.496127 3714 raft_consensus.cc:1273] T 049948eeceeb43c98ccda9e839b521a8 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 3 FOLLOWER]: Refusing update from remote peer ddc0ad67020f45edb3ba9c83cab687a4: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20250625 03:31:45.503173 3534 catalog_manager.cc:5582] T 6a179f065ae046df819a9bd88194dae6 P 841018313ad649679de64e006582f4c5 reported cstate change: term changed from 1 to 2, leader changed from 01873d289e0b4f9f9184b251369502a9 (127.0.106.129) to 841018313ad649679de64e006582f4c5 (127.0.106.131). New cstate: current_term: 2 leader_uuid: "841018313ad649679de64e006582f4c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: HEALTHY } } }
I20250625 03:31:45.504460 4470 consensus_queue.cc:1035] T 049948eeceeb43c98ccda9e839b521a8 P ddc0ad67020f45edb3ba9c83cab687a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:45.505167 3534 catalog_manager.cc:5582] T 7a8ecc65ca1140beb905dd6368bfaa2a P 841018313ad649679de64e006582f4c5 reported cstate change: term changed from 1 to 2, leader changed from 01873d289e0b4f9f9184b251369502a9 (127.0.106.129) to 841018313ad649679de64e006582f4c5 (127.0.106.131). New cstate: current_term: 2 leader_uuid: "841018313ad649679de64e006582f4c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:45.508992 3537 catalog_manager.cc:5582] T 049948eeceeb43c98ccda9e839b521a8 P ddc0ad67020f45edb3ba9c83cab687a4 reported cstate change: term changed from 2 to 3, leader changed from 01873d289e0b4f9f9184b251369502a9 (127.0.106.129) to ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132). New cstate: current_term: 3 leader_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:45.511188 3537 catalog_manager.cc:5582] T 526951ad467a4708926096ed1162a722 P ddc0ad67020f45edb3ba9c83cab687a4 reported cstate change: term changed from 1 to 2, leader changed from 01873d289e0b4f9f9184b251369502a9 (127.0.106.129) to ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132). New cstate: current_term: 2 leader_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:45.518514 3537 catalog_manager.cc:5582] T e7d3871088394a3ba7a6d18baae1feba P ddc0ad67020f45edb3ba9c83cab687a4 reported cstate change: term changed from 1 to 2, leader changed from 01873d289e0b4f9f9184b251369502a9 (127.0.106.129) to ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132). New cstate: current_term: 2 leader_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:45.519548 4470 consensus_queue.cc:1035] T 526951ad467a4708926096ed1162a722 P ddc0ad67020f45edb3ba9c83cab687a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20250625 03:31:45.520443 3828 leader_election.cc:304] T 5350a260b3364354b73176e6bdd77940 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, ddc0ad67020f45edb3ba9c83cab687a4; no voters: 01873d289e0b4f9f9184b251369502a9
I20250625 03:31:45.528674 4470 raft_consensus.cc:2802] T 5350a260b3364354b73176e6bdd77940 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:31:45.529261 4470 raft_consensus.cc:695] T 5350a260b3364354b73176e6bdd77940 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 LEADER]: Becoming Leader. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Running, Role: LEADER
I20250625 03:31:45.530114 4470 consensus_queue.cc:237] T 5350a260b3364354b73176e6bdd77940 P ddc0ad67020f45edb3ba9c83cab687a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:45.535295 4517 consensus_queue.cc:1035] T 049948eeceeb43c98ccda9e839b521a8 P ddc0ad67020f45edb3ba9c83cab687a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:45.542623 4379 tablet_bootstrap.cc:492] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 01873d289e0b4f9f9184b251369502a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:31:45.543673 4379 tablet_bootstrap.cc:492] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 01873d289e0b4f9f9184b251369502a9: Bootstrap complete.
I20250625 03:31:45.544370 4379 ts_tablet_manager.cc:1397] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.133s user 0.027s sys 0.009s
I20250625 03:31:45.546803 3862 raft_consensus.cc:1273] T 007d68495d594a73a5e2748f51e7c44c P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Refusing update from remote peer 841018313ad649679de64e006582f4c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:45.546804 4379 raft_consensus.cc:357] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:45.549621 4379 raft_consensus.cc:738] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:45.550446 4379 consensus_queue.cc:260] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:45.550609 4493 consensus_queue.cc:1035] T 007d68495d594a73a5e2748f51e7c44c P 841018313ad649679de64e006582f4c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:45.555142 4379 ts_tablet_manager.cc:1428] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.010s user 0.005s sys 0.001s
I20250625 03:31:45.556517 4379 tablet_bootstrap.cc:492] T 06f309640df64f97a4065b1420fea692 P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:45.557413 4421 raft_consensus.cc:3058] T 007d68495d594a73a5e2748f51e7c44c P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Advancing to term 2
W20250625 03:31:45.576243 3754 consensus_peers.cc:487] T 6a179f065ae046df819a9bd88194dae6 P 841018313ad649679de64e006582f4c5 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:45.589803 4379 tablet_bootstrap.cc:492] T 06f309640df64f97a4065b1420fea692 P 01873d289e0b4f9f9184b251369502a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:31:45.590771 4379 tablet_bootstrap.cc:492] T 06f309640df64f97a4065b1420fea692 P 01873d289e0b4f9f9184b251369502a9: Bootstrap complete.
I20250625 03:31:45.591435 4379 ts_tablet_manager.cc:1397] T 06f309640df64f97a4065b1420fea692 P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.035s user 0.018s sys 0.001s
I20250625 03:31:45.593644 4379 raft_consensus.cc:357] T 06f309640df64f97a4065b1420fea692 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:45.594313 4379 raft_consensus.cc:738] T 06f309640df64f97a4065b1420fea692 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:45.595114 4379 consensus_queue.cc:260] T 06f309640df64f97a4065b1420fea692 P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:45.597031 4379 ts_tablet_manager.cc:1428] T 06f309640df64f97a4065b1420fea692 P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.005s user 0.004s sys 0.004s
I20250625 03:31:45.597820 4379 tablet_bootstrap.cc:492] T 7a8ecc65ca1140beb905dd6368bfaa2a P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:45.607803 4421 raft_consensus.cc:1273] T 007d68495d594a73a5e2748f51e7c44c P 01873d289e0b4f9f9184b251369502a9 [term 2 FOLLOWER]: Refusing update from remote peer 841018313ad649679de64e006582f4c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:45.619006 4272 consensus_queue.cc:1035] T 007d68495d594a73a5e2748f51e7c44c P 841018313ad649679de64e006582f4c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:45.619424 4379 tablet_bootstrap.cc:492] T 7a8ecc65ca1140beb905dd6368bfaa2a P 01873d289e0b4f9f9184b251369502a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:31:45.637763 3536 catalog_manager.cc:5582] T d08de4c2326d46bab26f42d8d483ebd0 P ddc0ad67020f45edb3ba9c83cab687a4 reported cstate change: term changed from 1 to 2, leader changed from 01873d289e0b4f9f9184b251369502a9 (127.0.106.129) to ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132). New cstate: current_term: 2 leader_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:45.639878 3536 catalog_manager.cc:5582] T 5dc5a179a27f462989b291e8133742da P ddc0ad67020f45edb3ba9c83cab687a4 reported cstate change: term changed from 1 to 2, leader changed from 01873d289e0b4f9f9184b251369502a9 (127.0.106.129) to ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132). New cstate: current_term: 2 leader_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:45.642362 3536 catalog_manager.cc:5582] T 5350a260b3364354b73176e6bdd77940 P ddc0ad67020f45edb3ba9c83cab687a4 reported cstate change: term changed from 1 to 2, leader changed from 01873d289e0b4f9f9184b251369502a9 (127.0.106.129) to ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132). New cstate: current_term: 2 leader_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:45.641518 4379 tablet_bootstrap.cc:492] T 7a8ecc65ca1140beb905dd6368bfaa2a P 01873d289e0b4f9f9184b251369502a9: Bootstrap complete.
I20250625 03:31:45.643767 3714 raft_consensus.cc:1273] T 6a179f065ae046df819a9bd88194dae6 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Refusing update from remote peer 841018313ad649679de64e006582f4c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:45.644481 4379 ts_tablet_manager.cc:1397] T 7a8ecc65ca1140beb905dd6368bfaa2a P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.047s user 0.018s sys 0.004s
I20250625 03:31:45.646183 4272 consensus_queue.cc:1035] T 6a179f065ae046df819a9bd88194dae6 P 841018313ad649679de64e006582f4c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:45.646762 4379 raft_consensus.cc:357] T 7a8ecc65ca1140beb905dd6368bfaa2a P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:45.647428 4379 raft_consensus.cc:738] T 7a8ecc65ca1140beb905dd6368bfaa2a P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:45.648109 4379 consensus_queue.cc:260] T 7a8ecc65ca1140beb905dd6368bfaa2a P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:45.650091 4379 ts_tablet_manager.cc:1428] T 7a8ecc65ca1140beb905dd6368bfaa2a P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20250625 03:31:45.650921 4379 tablet_bootstrap.cc:492] T 5350a260b3364354b73176e6bdd77940 P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:45.643842 3536 catalog_manager.cc:5582] T b74d9f11c2bc4a7bb6431d6222d45175 P ddc0ad67020f45edb3ba9c83cab687a4 reported cstate change: term changed from 1 to 2, leader changed from 01873d289e0b4f9f9184b251369502a9 (127.0.106.129) to ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132). New cstate: current_term: 2 leader_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:45.673344 4379 tablet_bootstrap.cc:492] T 5350a260b3364354b73176e6bdd77940 P 01873d289e0b4f9f9184b251369502a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:31:45.674300 4379 tablet_bootstrap.cc:492] T 5350a260b3364354b73176e6bdd77940 P 01873d289e0b4f9f9184b251369502a9: Bootstrap complete.
I20250625 03:31:45.674930 4379 ts_tablet_manager.cc:1397] T 5350a260b3364354b73176e6bdd77940 P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.024s user 0.013s sys 0.000s
I20250625 03:31:45.677834 3785 raft_consensus.cc:1273] T e7d3871088394a3ba7a6d18baae1feba P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Refusing update from remote peer ddc0ad67020f45edb3ba9c83cab687a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:45.682204 4379 raft_consensus.cc:357] T 5350a260b3364354b73176e6bdd77940 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:45.683012 4379 raft_consensus.cc:738] T 5350a260b3364354b73176e6bdd77940 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:45.683655 4379 consensus_queue.cc:260] T 5350a260b3364354b73176e6bdd77940 P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:45.685523 4379 ts_tablet_manager.cc:1428] T 5350a260b3364354b73176e6bdd77940 P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.010s user 0.007s sys 0.000s
I20250625 03:31:45.686373 4379 tablet_bootstrap.cc:492] T 5dc5a179a27f462989b291e8133742da P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
W20250625 03:31:45.687155 3828 consensus_peers.cc:487] T 5dc5a179a27f462989b291e8133742da P ddc0ad67020f45edb3ba9c83cab687a4 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20250625 03:31:45.687853 3828 consensus_peers.cc:487] T e7d3871088394a3ba7a6d18baae1feba P ddc0ad67020f45edb3ba9c83cab687a4 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:45.690598 4470 consensus_queue.cc:1035] T e7d3871088394a3ba7a6d18baae1feba P ddc0ad67020f45edb3ba9c83cab687a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:45.711036 4379 tablet_bootstrap.cc:492] T 5dc5a179a27f462989b291e8133742da P 01873d289e0b4f9f9184b251369502a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:31:45.712327 4379 tablet_bootstrap.cc:492] T 5dc5a179a27f462989b291e8133742da P 01873d289e0b4f9f9184b251369502a9: Bootstrap complete.
I20250625 03:31:45.714325 4379 ts_tablet_manager.cc:1397] T 5dc5a179a27f462989b291e8133742da P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.028s user 0.018s sys 0.004s
I20250625 03:31:45.720674 4379 raft_consensus.cc:357] T 5dc5a179a27f462989b291e8133742da P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:45.721294 4379 raft_consensus.cc:738] T 5dc5a179a27f462989b291e8133742da P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:45.721928 4379 consensus_queue.cc:260] T 5dc5a179a27f462989b291e8133742da P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:45.724578 4379 ts_tablet_manager.cc:1428] T 5dc5a179a27f462989b291e8133742da P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.010s user 0.005s sys 0.000s
I20250625 03:31:45.726336 4379 tablet_bootstrap.cc:492] T 39da7c80318f4c408f8cdaf2229b0c96 P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:45.742682 4379 tablet_bootstrap.cc:492] T 39da7c80318f4c408f8cdaf2229b0c96 P 01873d289e0b4f9f9184b251369502a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:31:45.743453 4379 tablet_bootstrap.cc:492] T 39da7c80318f4c408f8cdaf2229b0c96 P 01873d289e0b4f9f9184b251369502a9: Bootstrap complete.
I20250625 03:31:45.744073 4379 ts_tablet_manager.cc:1397] T 39da7c80318f4c408f8cdaf2229b0c96 P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.018s user 0.013s sys 0.003s
I20250625 03:31:45.745960 4379 raft_consensus.cc:357] T 39da7c80318f4c408f8cdaf2229b0c96 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:45.746490 4379 raft_consensus.cc:738] T 39da7c80318f4c408f8cdaf2229b0c96 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:45.746976 4379 consensus_queue.cc:260] T 39da7c80318f4c408f8cdaf2229b0c96 P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:45.748934 4379 ts_tablet_manager.cc:1428] T 39da7c80318f4c408f8cdaf2229b0c96 P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20250625 03:31:45.749915 4379 tablet_bootstrap.cc:492] T c5a9463f96314a83b7955d80444b1c29 P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:45.765210 4379 tablet_bootstrap.cc:492] T c5a9463f96314a83b7955d80444b1c29 P 01873d289e0b4f9f9184b251369502a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:31:45.766043 4379 tablet_bootstrap.cc:492] T c5a9463f96314a83b7955d80444b1c29 P 01873d289e0b4f9f9184b251369502a9: Bootstrap complete.
I20250625 03:31:45.766602 4379 ts_tablet_manager.cc:1397] T c5a9463f96314a83b7955d80444b1c29 P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.017s user 0.010s sys 0.004s
I20250625 03:31:45.768406 4379 raft_consensus.cc:357] T c5a9463f96314a83b7955d80444b1c29 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:45.768888 4379 raft_consensus.cc:738] T c5a9463f96314a83b7955d80444b1c29 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:45.769390 4379 consensus_queue.cc:260] T c5a9463f96314a83b7955d80444b1c29 P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:45.771103 4379 ts_tablet_manager.cc:1428] T c5a9463f96314a83b7955d80444b1c29 P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20250625 03:31:45.771811 4379 tablet_bootstrap.cc:492] T 49d4fb2581ed4ef998f6a113ea67c323 P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:45.785110 4379 tablet_bootstrap.cc:492] T 49d4fb2581ed4ef998f6a113ea67c323 P 01873d289e0b4f9f9184b251369502a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:31:45.786389 4379 tablet_bootstrap.cc:492] T 49d4fb2581ed4ef998f6a113ea67c323 P 01873d289e0b4f9f9184b251369502a9: Bootstrap complete.
I20250625 03:31:45.786283 3714 raft_consensus.cc:1273] T 5dc5a179a27f462989b291e8133742da P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Refusing update from remote peer ddc0ad67020f45edb3ba9c83cab687a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:45.787145 4379 ts_tablet_manager.cc:1397] T 49d4fb2581ed4ef998f6a113ea67c323 P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.015s user 0.009s sys 0.004s
I20250625 03:31:45.787693 4514 consensus_queue.cc:1035] T 5dc5a179a27f462989b291e8133742da P ddc0ad67020f45edb3ba9c83cab687a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:45.789654 4379 raft_consensus.cc:357] T 49d4fb2581ed4ef998f6a113ea67c323 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:45.790294 4379 raft_consensus.cc:738] T 49d4fb2581ed4ef998f6a113ea67c323 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:45.790956 4379 consensus_queue.cc:260] T 49d4fb2581ed4ef998f6a113ea67c323 P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:45.793186 4379 ts_tablet_manager.cc:1428] T 49d4fb2581ed4ef998f6a113ea67c323 P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20250625 03:31:45.794010 4379 tablet_bootstrap.cc:492] T 036dfe9e6b844fc6964b3b5e371f8c95 P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
W20250625 03:31:45.803021 3828 consensus_peers.cc:487] T d08de4c2326d46bab26f42d8d483ebd0 P ddc0ad67020f45edb3ba9c83cab687a4 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:45.815001 4379 tablet_bootstrap.cc:492] T 036dfe9e6b844fc6964b3b5e371f8c95 P 01873d289e0b4f9f9184b251369502a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:31:45.815824 4379 tablet_bootstrap.cc:492] T 036dfe9e6b844fc6964b3b5e371f8c95 P 01873d289e0b4f9f9184b251369502a9: Bootstrap complete.
I20250625 03:31:45.816466 4379 ts_tablet_manager.cc:1397] T 036dfe9e6b844fc6964b3b5e371f8c95 P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.023s user 0.016s sys 0.004s
I20250625 03:31:45.820318 4379 raft_consensus.cc:357] T 036dfe9e6b844fc6964b3b5e371f8c95 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:45.821681 4379 raft_consensus.cc:738] T 036dfe9e6b844fc6964b3b5e371f8c95 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:45.822392 4379 consensus_queue.cc:260] T 036dfe9e6b844fc6964b3b5e371f8c95 P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:45.824445 4379 ts_tablet_manager.cc:1428] T 036dfe9e6b844fc6964b3b5e371f8c95 P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20250625 03:31:45.825191 4379 tablet_bootstrap.cc:492] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:45.845806 4379 tablet_bootstrap.cc:492] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 01873d289e0b4f9f9184b251369502a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:31:45.846673 4379 tablet_bootstrap.cc:492] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 01873d289e0b4f9f9184b251369502a9: Bootstrap complete.
I20250625 03:31:45.847203 4379 ts_tablet_manager.cc:1397] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.022s user 0.015s sys 0.004s
I20250625 03:31:45.849346 4379 raft_consensus.cc:357] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:45.849900 4379 raft_consensus.cc:738] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:45.850457 4379 consensus_queue.cc:260] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:45.852566 4379 ts_tablet_manager.cc:1428] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20250625 03:31:45.853717 4379 tablet_bootstrap.cc:492] T d83c6c79a784452289ba414976adb9e0 P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:45.870378 3710 raft_consensus.cc:1273] T d08de4c2326d46bab26f42d8d483ebd0 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Refusing update from remote peer ddc0ad67020f45edb3ba9c83cab687a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:45.872280 4511 consensus_queue.cc:1035] T d08de4c2326d46bab26f42d8d483ebd0 P ddc0ad67020f45edb3ba9c83cab687a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20250625 03:31:45.882114 3680 consensus_peers.cc:487] T 8ee7d6306b5146ed90a1b8392e062172 P 3d5b9823dfcd41cb92bd195c811cbf39 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20250625 03:31:45.884322 4379 tablet_bootstrap.cc:492] T d83c6c79a784452289ba414976adb9e0 P 01873d289e0b4f9f9184b251369502a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:31:45.885318 4379 tablet_bootstrap.cc:492] T d83c6c79a784452289ba414976adb9e0 P 01873d289e0b4f9f9184b251369502a9: Bootstrap complete.
I20250625 03:31:45.885999 4379 ts_tablet_manager.cc:1397] T d83c6c79a784452289ba414976adb9e0 P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.032s user 0.019s sys 0.008s
I20250625 03:31:45.888329 4379 raft_consensus.cc:357] T d83c6c79a784452289ba414976adb9e0 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:45.889017 4379 raft_consensus.cc:738] T d83c6c79a784452289ba414976adb9e0 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:45.889712 3785 raft_consensus.cc:1273] T b74d9f11c2bc4a7bb6431d6222d45175 P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Refusing update from remote peer ddc0ad67020f45edb3ba9c83cab687a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:45.889616 4379 consensus_queue.cc:260] T d83c6c79a784452289ba414976adb9e0 P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:45.894163 4511 consensus_queue.cc:1035] T b74d9f11c2bc4a7bb6431d6222d45175 P ddc0ad67020f45edb3ba9c83cab687a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:45.895824 4379 ts_tablet_manager.cc:1428] T d83c6c79a784452289ba414976adb9e0 P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.010s user 0.007s sys 0.001s
I20250625 03:31:45.896785 4379 tablet_bootstrap.cc:492] T a07d77259251401d957af853b296750a P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:45.902544 3710 raft_consensus.cc:1273] T 7a8ecc65ca1140beb905dd6368bfaa2a P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Refusing update from remote peer 841018313ad649679de64e006582f4c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:45.904937 4478 consensus_queue.cc:1035] T 7a8ecc65ca1140beb905dd6368bfaa2a P 841018313ad649679de64e006582f4c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:45.906348 4421 raft_consensus.cc:3058] T 7a8ecc65ca1140beb905dd6368bfaa2a P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:45.926534 4421 raft_consensus.cc:1273] T 7a8ecc65ca1140beb905dd6368bfaa2a P 01873d289e0b4f9f9184b251369502a9 [term 2 FOLLOWER]: Refusing update from remote peer 841018313ad649679de64e006582f4c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:45.928121 4272 consensus_queue.cc:1035] T 7a8ecc65ca1140beb905dd6368bfaa2a P 841018313ad649679de64e006582f4c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20250625 03:31:45.943979 3754 consensus_peers.cc:487] T aa64717b3f7d4af893e9908260f4520e P 841018313ad649679de64e006582f4c5 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20250625 03:31:45.945749 3680 consensus_peers.cc:487] T d00ad2472fd74bfc9065d9dc4808e0c1 P 3d5b9823dfcd41cb92bd195c811cbf39 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20250625 03:31:45.954044 3828 consensus_peers.cc:487] T 6afeedd3b768470f921526d58704c21d P ddc0ad67020f45edb3ba9c83cab687a4 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20250625 03:31:45.957708 4422 raft_consensus.cc:3058] T 5350a260b3364354b73176e6bdd77940 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Advancing to term 2
W20250625 03:31:45.977949 3828 consensus_peers.cc:487] T b6311a11ae9e44bea3a7340b8134679b P ddc0ad67020f45edb3ba9c83cab687a4 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20250625 03:31:45.982124 4379 tablet_bootstrap.cc:492] T a07d77259251401d957af853b296750a P 01873d289e0b4f9f9184b251369502a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:31:45.988972 4379 tablet_bootstrap.cc:492] T a07d77259251401d957af853b296750a P 01873d289e0b4f9f9184b251369502a9: Bootstrap complete.
I20250625 03:31:45.989710 4379 ts_tablet_manager.cc:1397] T a07d77259251401d957af853b296750a P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.093s user 0.037s sys 0.046s
I20250625 03:31:45.993490 4379 raft_consensus.cc:357] T a07d77259251401d957af853b296750a P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:45.995540 3715 raft_consensus.cc:1273] T 5350a260b3364354b73176e6bdd77940 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Refusing update from remote peer ddc0ad67020f45edb3ba9c83cab687a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:45.995849 4379 raft_consensus.cc:738] T a07d77259251401d957af853b296750a P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:45.995491 4421 raft_consensus.cc:3058] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:45.996897 4462 consensus_queue.cc:1035] T 5350a260b3364354b73176e6bdd77940 P ddc0ad67020f45edb3ba9c83cab687a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:46.011662 4379 consensus_queue.cc:260] T a07d77259251401d957af853b296750a P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:46.014683 4379 ts_tablet_manager.cc:1428] T a07d77259251401d957af853b296750a P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.025s user 0.007s sys 0.000s
W20250625 03:31:46.016985 3828 consensus_peers.cc:487] T b74d9f11c2bc4a7bb6431d6222d45175 P ddc0ad67020f45edb3ba9c83cab687a4 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:31:46.018002 4379 tablet_bootstrap.cc:492] T f3a33aa1d146468c986f0b1ba7d5fb84 P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
W20250625 03:31:46.024798 3680 consensus_peers.cc:487] T f3a33aa1d146468c986f0b1ba7d5fb84 P 3d5b9823dfcd41cb92bd195c811cbf39 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20250625 03:31:45.985728 4422 raft_consensus.cc:1273] T 5350a260b3364354b73176e6bdd77940 P 01873d289e0b4f9f9184b251369502a9 [term 2 FOLLOWER]: Refusing update from remote peer ddc0ad67020f45edb3ba9c83cab687a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20250625 03:31:46.026259 3828 consensus_peers.cc:487] T 485f3e9350e245a9939133866b354302 P ddc0ad67020f45edb3ba9c83cab687a4 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20250625 03:31:46.029125 4462 consensus_queue.cc:1035] T 5350a260b3364354b73176e6bdd77940 P ddc0ad67020f45edb3ba9c83cab687a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20250625 03:31:46.066150 3828 consensus_peers.cc:487] T 28cf5da85c864698894ed4e1ee38cd86 P ddc0ad67020f45edb3ba9c83cab687a4 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20250625 03:31:46.100701 4379 tablet_bootstrap.cc:492] T f3a33aa1d146468c986f0b1ba7d5fb84 P 01873d289e0b4f9f9184b251369502a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:31:46.101765 4379 tablet_bootstrap.cc:492] T f3a33aa1d146468c986f0b1ba7d5fb84 P 01873d289e0b4f9f9184b251369502a9: Bootstrap complete.
I20250625 03:31:46.102468 4379 ts_tablet_manager.cc:1397] T f3a33aa1d146468c986f0b1ba7d5fb84 P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.085s user 0.057s sys 0.023s
W20250625 03:31:46.111964 3754 consensus_peers.cc:487] T 7c1dda599f144ecfab4c075ee4e28c16 P 841018313ad649679de64e006582f4c5 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20250625 03:31:46.112757 3754 consensus_peers.cc:487] T d657bcfa8eea4e7db43d4d2715857516 P 841018313ad649679de64e006582f4c5 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20250625 03:31:46.110846 4379 raft_consensus.cc:357] T f3a33aa1d146468c986f0b1ba7d5fb84 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:46.118654 4379 raft_consensus.cc:738] T f3a33aa1d146468c986f0b1ba7d5fb84 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:46.119424 4379 consensus_queue.cc:260] T f3a33aa1d146468c986f0b1ba7d5fb84 P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:46.124944 4379 ts_tablet_manager.cc:1428] T f3a33aa1d146468c986f0b1ba7d5fb84 P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.022s user 0.011s sys 0.001s
I20250625 03:31:46.125752 4379 tablet_bootstrap.cc:492] T d00ad2472fd74bfc9065d9dc4808e0c1 P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:46.146869 4379 tablet_bootstrap.cc:492] T d00ad2472fd74bfc9065d9dc4808e0c1 P 01873d289e0b4f9f9184b251369502a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:31:46.147884 4379 tablet_bootstrap.cc:492] T d00ad2472fd74bfc9065d9dc4808e0c1 P 01873d289e0b4f9f9184b251369502a9: Bootstrap complete.
I20250625 03:31:46.148545 4379 ts_tablet_manager.cc:1397] T d00ad2472fd74bfc9065d9dc4808e0c1 P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.023s user 0.015s sys 0.000s
I20250625 03:31:46.150930 4379 raft_consensus.cc:357] T d00ad2472fd74bfc9065d9dc4808e0c1 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:46.151616 4379 raft_consensus.cc:738] T d00ad2472fd74bfc9065d9dc4808e0c1 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:46.152287 4379 consensus_queue.cc:260] T d00ad2472fd74bfc9065d9dc4808e0c1 P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:46.154078 4379 ts_tablet_manager.cc:1428] T d00ad2472fd74bfc9065d9dc4808e0c1 P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20250625 03:31:46.154852 4379 tablet_bootstrap.cc:492] T e7d3871088394a3ba7a6d18baae1feba P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
W20250625 03:31:46.166314 3680 consensus_peers.cc:487] T 3ecdd525d6fd47deacf323decbc5c329 P 3d5b9823dfcd41cb92bd195c811cbf39 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20250625 03:31:46.172546 4379 tablet_bootstrap.cc:492] T e7d3871088394a3ba7a6d18baae1feba P 01873d289e0b4f9f9184b251369502a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:31:46.173578 4379 tablet_bootstrap.cc:492] T e7d3871088394a3ba7a6d18baae1feba P 01873d289e0b4f9f9184b251369502a9: Bootstrap complete.
I20250625 03:31:46.174278 4379 ts_tablet_manager.cc:1397] T e7d3871088394a3ba7a6d18baae1feba P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.020s user 0.014s sys 0.003s
I20250625 03:31:46.176815 4379 raft_consensus.cc:357] T e7d3871088394a3ba7a6d18baae1feba P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:46.177369 4379 raft_consensus.cc:738] T e7d3871088394a3ba7a6d18baae1feba P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:46.177881 4379 consensus_queue.cc:260] T e7d3871088394a3ba7a6d18baae1feba P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:46.179384 4421 raft_consensus.cc:3058] T 5dc5a179a27f462989b291e8133742da P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:46.179988 4379 ts_tablet_manager.cc:1428] T e7d3871088394a3ba7a6d18baae1feba P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20250625 03:31:46.182881 4379 tablet_bootstrap.cc:492] T 7c1dda599f144ecfab4c075ee4e28c16 P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
W20250625 03:31:46.196404 3680 consensus_peers.cc:487] T 002d4371d5414440b756829fe3343d07 P 3d5b9823dfcd41cb92bd195c811cbf39 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20250625 03:31:46.201557 4379 tablet_bootstrap.cc:492] T 7c1dda599f144ecfab4c075ee4e28c16 P 01873d289e0b4f9f9184b251369502a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:31:46.202512 4379 tablet_bootstrap.cc:492] T 7c1dda599f144ecfab4c075ee4e28c16 P 01873d289e0b4f9f9184b251369502a9: Bootstrap complete.
I20250625 03:31:46.203193 4379 ts_tablet_manager.cc:1397] T 7c1dda599f144ecfab4c075ee4e28c16 P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.021s user 0.016s sys 0.000s
I20250625 03:31:46.205549 4379 raft_consensus.cc:357] T 7c1dda599f144ecfab4c075ee4e28c16 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:46.206254 4379 raft_consensus.cc:738] T 7c1dda599f144ecfab4c075ee4e28c16 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:46.206902 4379 consensus_queue.cc:260] T 7c1dda599f144ecfab4c075ee4e28c16 P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:46.209108 4379 ts_tablet_manager.cc:1428] T 7c1dda599f144ecfab4c075ee4e28c16 P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20250625 03:31:46.209913 4379 tablet_bootstrap.cc:492] T d657bcfa8eea4e7db43d4d2715857516 P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
W20250625 03:31:46.217550 3680 consensus_peers.cc:487] T c592f2c5305141c487b73e0867d0f36b P 3d5b9823dfcd41cb92bd195c811cbf39 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20250625 03:31:46.228734 4379 tablet_bootstrap.cc:492] T d657bcfa8eea4e7db43d4d2715857516 P 01873d289e0b4f9f9184b251369502a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:31:46.229816 4379 tablet_bootstrap.cc:492] T d657bcfa8eea4e7db43d4d2715857516 P 01873d289e0b4f9f9184b251369502a9: Bootstrap complete.
I20250625 03:31:46.230424 4379 ts_tablet_manager.cc:1397] T d657bcfa8eea4e7db43d4d2715857516 P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.021s user 0.014s sys 0.003s
I20250625 03:31:46.232288 4379 raft_consensus.cc:357] T d657bcfa8eea4e7db43d4d2715857516 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:46.232877 4379 raft_consensus.cc:738] T d657bcfa8eea4e7db43d4d2715857516 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:46.233431 4379 consensus_queue.cc:260] T d657bcfa8eea4e7db43d4d2715857516 P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:46.235569 4379 ts_tablet_manager.cc:1428] T d657bcfa8eea4e7db43d4d2715857516 P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20250625 03:31:46.236596 4379 tablet_bootstrap.cc:492] T 485f3e9350e245a9939133866b354302 P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:46.249800 4379 tablet_bootstrap.cc:492] T 485f3e9350e245a9939133866b354302 P 01873d289e0b4f9f9184b251369502a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:31:46.250743 4379 tablet_bootstrap.cc:492] T 485f3e9350e245a9939133866b354302 P 01873d289e0b4f9f9184b251369502a9: Bootstrap complete.
I20250625 03:31:46.251469 4379 ts_tablet_manager.cc:1397] T 485f3e9350e245a9939133866b354302 P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.015s user 0.011s sys 0.000s
I20250625 03:31:46.252040 4421 raft_consensus.cc:3058] T 49d4fb2581ed4ef998f6a113ea67c323 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:46.253242 4379 raft_consensus.cc:357] T 485f3e9350e245a9939133866b354302 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:46.253841 4379 raft_consensus.cc:738] T 485f3e9350e245a9939133866b354302 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:46.254518 4379 consensus_queue.cc:260] T 485f3e9350e245a9939133866b354302 P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:46.256539 4379 ts_tablet_manager.cc:1428] T 485f3e9350e245a9939133866b354302 P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.005s user 0.008s sys 0.000s
I20250625 03:31:46.257491 4379 tablet_bootstrap.cc:492] T b74d9f11c2bc4a7bb6431d6222d45175 P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:46.277521 4379 tablet_bootstrap.cc:492] T b74d9f11c2bc4a7bb6431d6222d45175 P 01873d289e0b4f9f9184b251369502a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:31:46.278446 4379 tablet_bootstrap.cc:492] T b74d9f11c2bc4a7bb6431d6222d45175 P 01873d289e0b4f9f9184b251369502a9: Bootstrap complete.
I20250625 03:31:46.279223 4379 ts_tablet_manager.cc:1397] T b74d9f11c2bc4a7bb6431d6222d45175 P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.022s user 0.011s sys 0.007s
I20250625 03:31:46.281199 4379 raft_consensus.cc:357] T b74d9f11c2bc4a7bb6431d6222d45175 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:46.281797 4379 raft_consensus.cc:738] T b74d9f11c2bc4a7bb6431d6222d45175 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:46.282624 4379 consensus_queue.cc:260] T b74d9f11c2bc4a7bb6431d6222d45175 P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:46.284958 4379 ts_tablet_manager.cc:1428] T b74d9f11c2bc4a7bb6431d6222d45175 P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20250625 03:31:46.285841 4379 tablet_bootstrap.cc:492] T 002d4371d5414440b756829fe3343d07 P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:46.299889 4379 tablet_bootstrap.cc:492] T 002d4371d5414440b756829fe3343d07 P 01873d289e0b4f9f9184b251369502a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:31:46.300853 4379 tablet_bootstrap.cc:492] T 002d4371d5414440b756829fe3343d07 P 01873d289e0b4f9f9184b251369502a9: Bootstrap complete.
I20250625 03:31:46.301539 4379 ts_tablet_manager.cc:1397] T 002d4371d5414440b756829fe3343d07 P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.016s user 0.013s sys 0.000s
I20250625 03:31:46.303964 4379 raft_consensus.cc:357] T 002d4371d5414440b756829fe3343d07 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:46.304495 4379 raft_consensus.cc:738] T 002d4371d5414440b756829fe3343d07 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:46.304991 4379 consensus_queue.cc:260] T 002d4371d5414440b756829fe3343d07 P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:46.306484 4379 ts_tablet_manager.cc:1428] T 002d4371d5414440b756829fe3343d07 P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20250625 03:31:46.307538 4379 tablet_bootstrap.cc:492] T 6a179f065ae046df819a9bd88194dae6 P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:46.319125 4379 tablet_bootstrap.cc:492] T 6a179f065ae046df819a9bd88194dae6 P 01873d289e0b4f9f9184b251369502a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:31:46.319895 4379 tablet_bootstrap.cc:492] T 6a179f065ae046df819a9bd88194dae6 P 01873d289e0b4f9f9184b251369502a9: Bootstrap complete.
I20250625 03:31:46.320501 4379 ts_tablet_manager.cc:1397] T 6a179f065ae046df819a9bd88194dae6 P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.013s user 0.009s sys 0.003s
I20250625 03:31:46.322181 4379 raft_consensus.cc:357] T 6a179f065ae046df819a9bd88194dae6 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:46.322770 4379 raft_consensus.cc:738] T 6a179f065ae046df819a9bd88194dae6 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:46.323354 4379 consensus_queue.cc:260] T 6a179f065ae046df819a9bd88194dae6 P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:46.325073 4379 ts_tablet_manager.cc:1428] T 6a179f065ae046df819a9bd88194dae6 P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20250625 03:31:46.326014 4379 tablet_bootstrap.cc:492] T 28cf5da85c864698894ed4e1ee38cd86 P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:46.336620 4379 tablet_bootstrap.cc:492] T 28cf5da85c864698894ed4e1ee38cd86 P 01873d289e0b4f9f9184b251369502a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:31:46.337404 4379 tablet_bootstrap.cc:492] T 28cf5da85c864698894ed4e1ee38cd86 P 01873d289e0b4f9f9184b251369502a9: Bootstrap complete.
I20250625 03:31:46.337976 4379 ts_tablet_manager.cc:1397] T 28cf5da85c864698894ed4e1ee38cd86 P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.004s
I20250625 03:31:46.339592 4379 raft_consensus.cc:357] T 28cf5da85c864698894ed4e1ee38cd86 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:46.340126 4379 raft_consensus.cc:738] T 28cf5da85c864698894ed4e1ee38cd86 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:46.340644 4379 consensus_queue.cc:260] T 28cf5da85c864698894ed4e1ee38cd86 P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:46.342423 4379 ts_tablet_manager.cc:1428] T 28cf5da85c864698894ed4e1ee38cd86 P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20250625 03:31:46.343298 4379 tablet_bootstrap.cc:492] T b6311a11ae9e44bea3a7340b8134679b P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:46.355264 4379 tablet_bootstrap.cc:492] T b6311a11ae9e44bea3a7340b8134679b P 01873d289e0b4f9f9184b251369502a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:31:46.356230 4379 tablet_bootstrap.cc:492] T b6311a11ae9e44bea3a7340b8134679b P 01873d289e0b4f9f9184b251369502a9: Bootstrap complete.
I20250625 03:31:46.356879 4379 ts_tablet_manager.cc:1397] T b6311a11ae9e44bea3a7340b8134679b P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.014s user 0.012s sys 0.000s
I20250625 03:31:46.358891 4379 raft_consensus.cc:357] T b6311a11ae9e44bea3a7340b8134679b P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:46.359526 4379 raft_consensus.cc:738] T b6311a11ae9e44bea3a7340b8134679b P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:46.360131 4379 consensus_queue.cc:260] T b6311a11ae9e44bea3a7340b8134679b P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:46.362391 4379 ts_tablet_manager.cc:1428] T b6311a11ae9e44bea3a7340b8134679b P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20250625 03:31:46.363859 4379 tablet_bootstrap.cc:492] T 8ee7d6306b5146ed90a1b8392e062172 P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:46.375950 4379 tablet_bootstrap.cc:492] T 8ee7d6306b5146ed90a1b8392e062172 P 01873d289e0b4f9f9184b251369502a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:31:46.376718 4379 tablet_bootstrap.cc:492] T 8ee7d6306b5146ed90a1b8392e062172 P 01873d289e0b4f9f9184b251369502a9: Bootstrap complete.
I20250625 03:31:46.377372 4379 ts_tablet_manager.cc:1397] T 8ee7d6306b5146ed90a1b8392e062172 P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.014s user 0.012s sys 0.000s
I20250625 03:31:46.378993 4379 raft_consensus.cc:357] T 8ee7d6306b5146ed90a1b8392e062172 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:46.379639 4379 raft_consensus.cc:738] T 8ee7d6306b5146ed90a1b8392e062172 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:46.380151 4379 consensus_queue.cc:260] T 8ee7d6306b5146ed90a1b8392e062172 P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:46.381820 4379 ts_tablet_manager.cc:1428] T 8ee7d6306b5146ed90a1b8392e062172 P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20250625 03:31:46.382939 4379 tablet_bootstrap.cc:492] T aa64717b3f7d4af893e9908260f4520e P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:46.396440 4379 tablet_bootstrap.cc:492] T aa64717b3f7d4af893e9908260f4520e P 01873d289e0b4f9f9184b251369502a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:31:46.397364 4379 tablet_bootstrap.cc:492] T aa64717b3f7d4af893e9908260f4520e P 01873d289e0b4f9f9184b251369502a9: Bootstrap complete.
I20250625 03:31:46.398013 4379 ts_tablet_manager.cc:1397] T aa64717b3f7d4af893e9908260f4520e P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.015s user 0.012s sys 0.000s
I20250625 03:31:46.399701 4379 raft_consensus.cc:357] T aa64717b3f7d4af893e9908260f4520e P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:46.400249 4379 raft_consensus.cc:738] T aa64717b3f7d4af893e9908260f4520e P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:46.400738 4379 consensus_queue.cc:260] T aa64717b3f7d4af893e9908260f4520e P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:46.402232 4379 ts_tablet_manager.cc:1428] T aa64717b3f7d4af893e9908260f4520e P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20250625 03:31:46.403754 4379 tablet_bootstrap.cc:492] T 3ecdd525d6fd47deacf323decbc5c329 P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:46.416785 4379 tablet_bootstrap.cc:492] T 3ecdd525d6fd47deacf323decbc5c329 P 01873d289e0b4f9f9184b251369502a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:31:46.417778 4379 tablet_bootstrap.cc:492] T 3ecdd525d6fd47deacf323decbc5c329 P 01873d289e0b4f9f9184b251369502a9: Bootstrap complete.
I20250625 03:31:46.418438 4379 ts_tablet_manager.cc:1397] T 3ecdd525d6fd47deacf323decbc5c329 P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.015s user 0.009s sys 0.003s
I20250625 03:31:46.420673 4379 raft_consensus.cc:357] T 3ecdd525d6fd47deacf323decbc5c329 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:46.421382 4379 raft_consensus.cc:738] T 3ecdd525d6fd47deacf323decbc5c329 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:46.422029 4379 consensus_queue.cc:260] T 3ecdd525d6fd47deacf323decbc5c329 P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:46.424507 4379 ts_tablet_manager.cc:1428] T 3ecdd525d6fd47deacf323decbc5c329 P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20250625 03:31:46.425513 4379 tablet_bootstrap.cc:492] T c592f2c5305141c487b73e0867d0f36b P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:46.442137 4379 tablet_bootstrap.cc:492] T c592f2c5305141c487b73e0867d0f36b P 01873d289e0b4f9f9184b251369502a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:31:46.442902 4379 tablet_bootstrap.cc:492] T c592f2c5305141c487b73e0867d0f36b P 01873d289e0b4f9f9184b251369502a9: Bootstrap complete.
I20250625 03:31:46.443414 4379 ts_tablet_manager.cc:1397] T c592f2c5305141c487b73e0867d0f36b P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.018s user 0.009s sys 0.004s
I20250625 03:31:46.445261 4379 raft_consensus.cc:357] T c592f2c5305141c487b73e0867d0f36b P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:46.445812 4379 raft_consensus.cc:738] T c592f2c5305141c487b73e0867d0f36b P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:46.446517 4421 raft_consensus.cc:3058] T 6a179f065ae046df819a9bd88194dae6 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:46.446395 4379 consensus_queue.cc:260] T c592f2c5305141c487b73e0867d0f36b P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:46.448637 4379 ts_tablet_manager.cc:1428] T c592f2c5305141c487b73e0867d0f36b P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.005s user 0.008s sys 0.000s
I20250625 03:31:46.450176 4379 tablet_bootstrap.cc:492] T 7e92fd94b9f24b1097e9a7373896cb26 P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:46.474924 4379 tablet_bootstrap.cc:492] T 7e92fd94b9f24b1097e9a7373896cb26 P 01873d289e0b4f9f9184b251369502a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:31:46.475831 4379 tablet_bootstrap.cc:492] T 7e92fd94b9f24b1097e9a7373896cb26 P 01873d289e0b4f9f9184b251369502a9: Bootstrap complete.
I20250625 03:31:46.476445 4379 ts_tablet_manager.cc:1397] T 7e92fd94b9f24b1097e9a7373896cb26 P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.026s user 0.015s sys 0.000s
I20250625 03:31:46.479326 4379 raft_consensus.cc:357] T 7e92fd94b9f24b1097e9a7373896cb26 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:46.480046 4379 raft_consensus.cc:738] T 7e92fd94b9f24b1097e9a7373896cb26 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:46.480706 4379 consensus_queue.cc:260] T 7e92fd94b9f24b1097e9a7373896cb26 P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:46.482594 4379 ts_tablet_manager.cc:1428] T 7e92fd94b9f24b1097e9a7373896cb26 P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20250625 03:31:46.483407 4379 tablet_bootstrap.cc:492] T d08de4c2326d46bab26f42d8d483ebd0 P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:46.512334 4379 tablet_bootstrap.cc:492] T d08de4c2326d46bab26f42d8d483ebd0 P 01873d289e0b4f9f9184b251369502a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:31:46.513067 4379 tablet_bootstrap.cc:492] T d08de4c2326d46bab26f42d8d483ebd0 P 01873d289e0b4f9f9184b251369502a9: Bootstrap complete.
I20250625 03:31:46.513629 4379 ts_tablet_manager.cc:1397] T d08de4c2326d46bab26f42d8d483ebd0 P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.030s user 0.020s sys 0.008s
I20250625 03:31:46.515321 4379 raft_consensus.cc:357] T d08de4c2326d46bab26f42d8d483ebd0 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:46.515806 4379 raft_consensus.cc:738] T d08de4c2326d46bab26f42d8d483ebd0 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:46.516480 4379 consensus_queue.cc:260] T d08de4c2326d46bab26f42d8d483ebd0 P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:46.518128 4379 ts_tablet_manager.cc:1428] T d08de4c2326d46bab26f42d8d483ebd0 P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20250625 03:31:46.518735 4379 tablet_bootstrap.cc:492] T 526951ad467a4708926096ed1162a722 P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:46.536942 4379 tablet_bootstrap.cc:492] T 526951ad467a4708926096ed1162a722 P 01873d289e0b4f9f9184b251369502a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:31:46.537914 4379 tablet_bootstrap.cc:492] T 526951ad467a4708926096ed1162a722 P 01873d289e0b4f9f9184b251369502a9: Bootstrap complete.
I20250625 03:31:46.538587 4379 ts_tablet_manager.cc:1397] T 526951ad467a4708926096ed1162a722 P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.020s user 0.012s sys 0.000s
I20250625 03:31:46.540849 4379 raft_consensus.cc:357] T 526951ad467a4708926096ed1162a722 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:46.541577 4379 raft_consensus.cc:738] T 526951ad467a4708926096ed1162a722 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:46.542232 4379 consensus_queue.cc:260] T 526951ad467a4708926096ed1162a722 P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:46.543912 4379 ts_tablet_manager.cc:1428] T 526951ad467a4708926096ed1162a722 P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20250625 03:31:46.544953 4379 tablet_bootstrap.cc:492] T 6afeedd3b768470f921526d58704c21d P 01873d289e0b4f9f9184b251369502a9: Bootstrap starting.
I20250625 03:31:46.563212 4379 tablet_bootstrap.cc:492] T 6afeedd3b768470f921526d58704c21d P 01873d289e0b4f9f9184b251369502a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 03:31:46.564060 4379 tablet_bootstrap.cc:492] T 6afeedd3b768470f921526d58704c21d P 01873d289e0b4f9f9184b251369502a9: Bootstrap complete.
I20250625 03:31:46.564584 4379 ts_tablet_manager.cc:1397] T 6afeedd3b768470f921526d58704c21d P 01873d289e0b4f9f9184b251369502a9: Time spent bootstrapping tablet: real 0.020s user 0.014s sys 0.004s
I20250625 03:31:46.566162 4379 raft_consensus.cc:357] T 6afeedd3b768470f921526d58704c21d P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:46.566680 4379 raft_consensus.cc:738] T 6afeedd3b768470f921526d58704c21d P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Initialized, Role: FOLLOWER
I20250625 03:31:46.567193 4379 consensus_queue.cc:260] T 6afeedd3b768470f921526d58704c21d P 01873d289e0b4f9f9184b251369502a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:46.568876 4379 ts_tablet_manager.cc:1428] T 6afeedd3b768470f921526d58704c21d P 01873d289e0b4f9f9184b251369502a9: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20250625 03:31:46.613083 4421 raft_consensus.cc:3058] T e7d3871088394a3ba7a6d18baae1feba P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:46.614720 4422 raft_consensus.cc:3058] T b74d9f11c2bc4a7bb6431d6222d45175 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:46.773658 4421 raft_consensus.cc:3058] T 7e92fd94b9f24b1097e9a7373896cb26 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:46.893430 4421 raft_consensus.cc:3058] T d08de4c2326d46bab26f42d8d483ebd0 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:46.963547 4422 raft_consensus.cc:3058] T 526951ad467a4708926096ed1162a722 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Advancing to term 2
W20250625 03:31:52.385864 3569 debug-util.cc:398] Leaking SignalData structure 0x7b080005b9a0 after lost signal to thread 429
W20250625 03:31:52.386878 3569 debug-util.cc:398] Leaking SignalData structure 0x7b08001900c0 after lost signal to thread 3572
W20250625 03:31:52.388052 3569 debug-util.cc:398] Leaking SignalData structure 0x7b08000c6ac0 after lost signal to thread 3739
W20250625 03:31:52.389077 3569 debug-util.cc:398] Leaking SignalData structure 0x7b080033c860 after lost signal to thread 3813
W20250625 03:31:52.390004 3569 debug-util.cc:398] Leaking SignalData structure 0x7b08002f0de0 after lost signal to thread 3887
W20250625 03:31:52.391132 3569 debug-util.cc:398] Leaking SignalData structure 0x7b08001767e0 after lost signal to thread 4454
I20250625 03:31:54.586483 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:31:54.665328 3789 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "007d68495d594a73a5e2748f51e7c44c"
dest_uuid: "841018313ad649679de64e006582f4c5"
mode: GRACEFUL
new_leader_uuid: "01873d289e0b4f9f9184b251369502a9"
from {username='slave'} at 127.0.0.1:60686
I20250625 03:31:54.666344 3789 raft_consensus.cc:604] T 007d68495d594a73a5e2748f51e7c44c P 841018313ad649679de64e006582f4c5 [term 2 LEADER]: Received request to transfer leadership to TS 01873d289e0b4f9f9184b251369502a9
I20250625 03:31:54.668936 3789 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "2e956665b7e4411f86cf77259093c8aa"
dest_uuid: "841018313ad649679de64e006582f4c5"
mode: GRACEFUL
new_leader_uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
from {username='slave'} at 127.0.0.1:60686
I20250625 03:31:54.669436 3789 raft_consensus.cc:604] T 2e956665b7e4411f86cf77259093c8aa P 841018313ad649679de64e006582f4c5 [term 1 LEADER]: Received request to transfer leadership to TS 3d5b9823dfcd41cb92bd195c811cbf39
I20250625 03:31:54.672510 3789 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "49d4fb2581ed4ef998f6a113ea67c323"
dest_uuid: "841018313ad649679de64e006582f4c5"
mode: GRACEFUL
new_leader_uuid: "01873d289e0b4f9f9184b251369502a9"
from {username='slave'} at 127.0.0.1:60686
I20250625 03:31:54.672953 3789 raft_consensus.cc:604] T 49d4fb2581ed4ef998f6a113ea67c323 P 841018313ad649679de64e006582f4c5 [term 2 LEADER]: Received request to transfer leadership to TS 01873d289e0b4f9f9184b251369502a9
I20250625 03:31:54.675114 3789 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "559ad5ac1bd14e8c8da7a2e7419cfcc6"
dest_uuid: "841018313ad649679de64e006582f4c5"
mode: GRACEFUL
new_leader_uuid: "01873d289e0b4f9f9184b251369502a9"
from {username='slave'} at 127.0.0.1:60686
I20250625 03:31:54.675537 3789 raft_consensus.cc:604] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 841018313ad649679de64e006582f4c5 [term 1 LEADER]: Received request to transfer leadership to TS 01873d289e0b4f9f9184b251369502a9
I20250625 03:31:54.689343 3861 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "5e59ae16ec1a4c69aac820531e504206"
dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4"
mode: GRACEFUL
new_leader_uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
from {username='slave'} at 127.0.0.1:36556
I20250625 03:31:54.689839 3861 raft_consensus.cc:604] T 5e59ae16ec1a4c69aac820531e504206 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 LEADER]: Received request to transfer leadership to TS 3d5b9823dfcd41cb92bd195c811cbf39
I20250625 03:31:54.692114 3789 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "eeca5a85dddf4d1884917690e01ff81d"
dest_uuid: "841018313ad649679de64e006582f4c5"
mode: GRACEFUL
new_leader_uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
from {username='slave'} at 127.0.0.1:60686
I20250625 03:31:54.692569 3789 raft_consensus.cc:604] T eeca5a85dddf4d1884917690e01ff81d P 841018313ad649679de64e006582f4c5 [term 1 LEADER]: Received request to transfer leadership to TS 3d5b9823dfcd41cb92bd195c811cbf39
I20250625 03:31:54.694171 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20250625 03:31:54.695977 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:31:54.697042 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:31:54.779565 4615 raft_consensus.cc:991] T 007d68495d594a73a5e2748f51e7c44c P 841018313ad649679de64e006582f4c5: : Instructing follower 01873d289e0b4f9f9184b251369502a9 to start an election
I20250625 03:31:54.780426 4615 raft_consensus.cc:1079] T 007d68495d594a73a5e2748f51e7c44c P 841018313ad649679de64e006582f4c5 [term 2 LEADER]: Signalling peer 01873d289e0b4f9f9184b251369502a9 to start an election
I20250625 03:31:54.782497 4420 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "007d68495d594a73a5e2748f51e7c44c"
dest_uuid: "01873d289e0b4f9f9184b251369502a9"
from {username='slave'} at 127.0.0.1:45168
I20250625 03:31:54.782970 4600 raft_consensus.cc:991] T 49d4fb2581ed4ef998f6a113ea67c323 P 841018313ad649679de64e006582f4c5: : Instructing follower 01873d289e0b4f9f9184b251369502a9 to start an election
I20250625 03:31:54.783129 4420 raft_consensus.cc:491] T 007d68495d594a73a5e2748f51e7c44c P 01873d289e0b4f9f9184b251369502a9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:31:54.783638 4600 raft_consensus.cc:1079] T 49d4fb2581ed4ef998f6a113ea67c323 P 841018313ad649679de64e006582f4c5 [term 2 LEADER]: Signalling peer 01873d289e0b4f9f9184b251369502a9 to start an election
I20250625 03:31:54.783730 4420 raft_consensus.cc:3058] T 007d68495d594a73a5e2748f51e7c44c P 01873d289e0b4f9f9184b251369502a9 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:54.786023 4426 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "49d4fb2581ed4ef998f6a113ea67c323"
dest_uuid: "01873d289e0b4f9f9184b251369502a9"
from {username='slave'} at 127.0.0.1:45168
I20250625 03:31:54.786603 4426 raft_consensus.cc:491] T 49d4fb2581ed4ef998f6a113ea67c323 P 01873d289e0b4f9f9184b251369502a9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:31:54.786978 4426 raft_consensus.cc:3058] T 49d4fb2581ed4ef998f6a113ea67c323 P 01873d289e0b4f9f9184b251369502a9 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:54.795563 4420 raft_consensus.cc:513] T 007d68495d594a73a5e2748f51e7c44c P 01873d289e0b4f9f9184b251369502a9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:54.795369 4426 raft_consensus.cc:513] T 49d4fb2581ed4ef998f6a113ea67c323 P 01873d289e0b4f9f9184b251369502a9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:54.798290 4420 leader_election.cc:290] T 007d68495d594a73a5e2748f51e7c44c P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 3 election: Requested vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353)
I20250625 03:31:54.803511 4426 leader_election.cc:290] T 49d4fb2581ed4ef998f6a113ea67c323 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 3 election: Requested vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353)
I20250625 03:31:54.819566 4621 raft_consensus.cc:991] T 2e956665b7e4411f86cf77259093c8aa P 841018313ad649679de64e006582f4c5: : Instructing follower 3d5b9823dfcd41cb92bd195c811cbf39 to start an election
I20250625 03:31:54.820101 4615 raft_consensus.cc:1079] T 2e956665b7e4411f86cf77259093c8aa P 841018313ad649679de64e006582f4c5 [term 1 LEADER]: Signalling peer 3d5b9823dfcd41cb92bd195c811cbf39 to start an election
I20250625 03:31:54.820188 3785 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "49d4fb2581ed4ef998f6a113ea67c323" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "841018313ad649679de64e006582f4c5"
I20250625 03:31:54.821128 3785 raft_consensus.cc:3053] T 49d4fb2581ed4ef998f6a113ea67c323 P 841018313ad649679de64e006582f4c5 [term 2 LEADER]: Stepping down as leader of term 2
I20250625 03:31:54.821499 3789 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "007d68495d594a73a5e2748f51e7c44c" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "841018313ad649679de64e006582f4c5"
I20250625 03:31:54.822918 3710 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "2e956665b7e4411f86cf77259093c8aa"
dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
from {username='slave'} at 127.0.0.1:49134
I20250625 03:31:54.821506 3785 raft_consensus.cc:738] T 49d4fb2581ed4ef998f6a113ea67c323 P 841018313ad649679de64e006582f4c5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 841018313ad649679de64e006582f4c5, State: Running, Role: LEADER
I20250625 03:31:54.823340 3789 raft_consensus.cc:3053] T 007d68495d594a73a5e2748f51e7c44c P 841018313ad649679de64e006582f4c5 [term 2 LEADER]: Stepping down as leader of term 2
I20250625 03:31:54.823611 3710 raft_consensus.cc:491] T 2e956665b7e4411f86cf77259093c8aa P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:31:54.825346 3789 raft_consensus.cc:738] T 007d68495d594a73a5e2748f51e7c44c P 841018313ad649679de64e006582f4c5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 841018313ad649679de64e006582f4c5, State: Running, Role: LEADER
I20250625 03:31:54.825680 3710 raft_consensus.cc:3058] T 2e956665b7e4411f86cf77259093c8aa P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:54.824110 3785 consensus_queue.cc:260] T 49d4fb2581ed4ef998f6a113ea67c323 P 841018313ad649679de64e006582f4c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:54.826450 3789 consensus_queue.cc:260] T 007d68495d594a73a5e2748f51e7c44c P 841018313ad649679de64e006582f4c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:54.827592 3785 raft_consensus.cc:3058] T 49d4fb2581ed4ef998f6a113ea67c323 P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:54.828085 3789 raft_consensus.cc:3058] T 007d68495d594a73a5e2748f51e7c44c P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:54.834918 3863 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "49d4fb2581ed4ef998f6a113ea67c323" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4"
I20250625 03:31:54.835611 3863 raft_consensus.cc:3058] T 49d4fb2581ed4ef998f6a113ea67c323 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:54.839639 3710 raft_consensus.cc:513] T 2e956665b7e4411f86cf77259093c8aa P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:54.841640 3789 raft_consensus.cc:2466] T 007d68495d594a73a5e2748f51e7c44c P 841018313ad649679de64e006582f4c5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01873d289e0b4f9f9184b251369502a9 in term 3.
I20250625 03:31:54.843327 4375 leader_election.cc:304] T 007d68495d594a73a5e2748f51e7c44c P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9, 841018313ad649679de64e006582f4c5; no voters:
I20250625 03:31:54.843881 3861 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "007d68495d594a73a5e2748f51e7c44c" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4"
I20250625 03:31:54.844521 3861 raft_consensus.cc:3058] T 007d68495d594a73a5e2748f51e7c44c P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:54.847065 3863 raft_consensus.cc:2466] T 49d4fb2581ed4ef998f6a113ea67c323 P ddc0ad67020f45edb3ba9c83cab687a4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01873d289e0b4f9f9184b251369502a9 in term 3.
I20250625 03:31:54.848875 4374 leader_election.cc:304] T 49d4fb2581ed4ef998f6a113ea67c323 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9, ddc0ad67020f45edb3ba9c83cab687a4; no voters:
I20250625 03:31:54.853106 3861 raft_consensus.cc:2466] T 007d68495d594a73a5e2748f51e7c44c P ddc0ad67020f45edb3ba9c83cab687a4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01873d289e0b4f9f9184b251369502a9 in term 3.
I20250625 03:31:54.857362 3785 raft_consensus.cc:2466] T 49d4fb2581ed4ef998f6a113ea67c323 P 841018313ad649679de64e006582f4c5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01873d289e0b4f9f9184b251369502a9 in term 3.
I20250625 03:31:54.862246 3710 leader_election.cc:290] T 2e956665b7e4411f86cf77259093c8aa P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 2 election: Requested vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353)
I20250625 03:31:54.863977 3863 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2e956665b7e4411f86cf77259093c8aa" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4"
I20250625 03:31:54.864872 3863 raft_consensus.cc:3058] T 2e956665b7e4411f86cf77259093c8aa P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:54.865298 3789 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2e956665b7e4411f86cf77259093c8aa" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "841018313ad649679de64e006582f4c5"
I20250625 03:31:54.865795 4624 raft_consensus.cc:2802] T 007d68495d594a73a5e2748f51e7c44c P 01873d289e0b4f9f9184b251369502a9 [term 3 FOLLOWER]: Leader election won for term 3
I20250625 03:31:54.868327 4625 raft_consensus.cc:2802] T 49d4fb2581ed4ef998f6a113ea67c323 P 01873d289e0b4f9f9184b251369502a9 [term 3 FOLLOWER]: Leader election won for term 3
I20250625 03:31:54.872743 4624 raft_consensus.cc:695] T 007d68495d594a73a5e2748f51e7c44c P 01873d289e0b4f9f9184b251369502a9 [term 3 LEADER]: Becoming Leader. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Running, Role: LEADER
I20250625 03:31:54.865898 3789 raft_consensus.cc:3053] T 2e956665b7e4411f86cf77259093c8aa P 841018313ad649679de64e006582f4c5 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:31:54.874428 3789 raft_consensus.cc:738] T 2e956665b7e4411f86cf77259093c8aa P 841018313ad649679de64e006582f4c5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 841018313ad649679de64e006582f4c5, State: Running, Role: LEADER
I20250625 03:31:54.874008 4624 consensus_queue.cc:237] T 007d68495d594a73a5e2748f51e7c44c P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:54.875346 3789 consensus_queue.cc:260] T 2e956665b7e4411f86cf77259093c8aa P 841018313ad649679de64e006582f4c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:54.879351 3789 raft_consensus.cc:3058] T 2e956665b7e4411f86cf77259093c8aa P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:54.879779 3863 raft_consensus.cc:2466] T 2e956665b7e4411f86cf77259093c8aa P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5b9823dfcd41cb92bd195c811cbf39 in term 2.
I20250625 03:31:54.880952 4625 raft_consensus.cc:695] T 49d4fb2581ed4ef998f6a113ea67c323 P 01873d289e0b4f9f9184b251369502a9 [term 3 LEADER]: Becoming Leader. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Running, Role: LEADER
I20250625 03:31:54.881171 3679 leader_election.cc:304] T 2e956665b7e4411f86cf77259093c8aa P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, ddc0ad67020f45edb3ba9c83cab687a4; no voters:
I20250625 03:31:54.881557 3861 raft_consensus.cc:1238] T 2e956665b7e4411f86cf77259093c8aa P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Rejecting Update request from peer 841018313ad649679de64e006582f4c5 for earlier term 1. Current term is 2. Ops: []
I20250625 03:31:54.882212 4602 raft_consensus.cc:2802] T 2e956665b7e4411f86cf77259093c8aa P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:31:54.882788 4602 raft_consensus.cc:695] T 2e956665b7e4411f86cf77259093c8aa P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 LEADER]: Becoming Leader. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Running, Role: LEADER
I20250625 03:31:54.882104 4625 consensus_queue.cc:237] T 49d4fb2581ed4ef998f6a113ea67c323 P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:54.883667 4602 consensus_queue.cc:237] T 2e956665b7e4411f86cf77259093c8aa P 3d5b9823dfcd41cb92bd195c811cbf39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:54.891438 3789 raft_consensus.cc:2466] T 2e956665b7e4411f86cf77259093c8aa P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5b9823dfcd41cb92bd195c811cbf39 in term 2.
I20250625 03:31:54.907898 3536 catalog_manager.cc:5582] T 007d68495d594a73a5e2748f51e7c44c P 01873d289e0b4f9f9184b251369502a9 reported cstate change: term changed from 2 to 3, leader changed from 841018313ad649679de64e006582f4c5 (127.0.106.131) to 01873d289e0b4f9f9184b251369502a9 (127.0.106.129). New cstate: current_term: 3 leader_uuid: "01873d289e0b4f9f9184b251369502a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: HEALTHY } } }
I20250625 03:31:54.907557 3534 catalog_manager.cc:5582] T 2e956665b7e4411f86cf77259093c8aa P 3d5b9823dfcd41cb92bd195c811cbf39 reported cstate change: term changed from 1 to 2, leader changed from 841018313ad649679de64e006582f4c5 (127.0.106.131) to 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130). New cstate: current_term: 2 leader_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:54.910247 3536 catalog_manager.cc:5582] T 49d4fb2581ed4ef998f6a113ea67c323 P 01873d289e0b4f9f9184b251369502a9 reported cstate change: term changed from 2 to 3, leader changed from 841018313ad649679de64e006582f4c5 (127.0.106.131) to 01873d289e0b4f9f9184b251369502a9 (127.0.106.129). New cstate: current_term: 3 leader_uuid: "01873d289e0b4f9f9184b251369502a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: HEALTHY } } }
I20250625 03:31:54.947928 4612 raft_consensus.cc:991] T 5e59ae16ec1a4c69aac820531e504206 P ddc0ad67020f45edb3ba9c83cab687a4: : Instructing follower 3d5b9823dfcd41cb92bd195c811cbf39 to start an election
I20250625 03:31:54.948554 4588 raft_consensus.cc:1079] T 5e59ae16ec1a4c69aac820531e504206 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 LEADER]: Signalling peer 3d5b9823dfcd41cb92bd195c811cbf39 to start an election
I20250625 03:31:54.950232 3711 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "5e59ae16ec1a4c69aac820531e504206"
dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
from {username='slave'} at 127.0.0.1:49138
I20250625 03:31:54.950745 3711 raft_consensus.cc:491] T 5e59ae16ec1a4c69aac820531e504206 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:31:54.951102 3711 raft_consensus.cc:3058] T 5e59ae16ec1a4c69aac820531e504206 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:54.964668 3711 raft_consensus.cc:513] T 5e59ae16ec1a4c69aac820531e504206 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:54.970796 3711 leader_election.cc:290] T 5e59ae16ec1a4c69aac820531e504206 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 2 election: Requested vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353)
I20250625 03:31:54.971338 3789 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5e59ae16ec1a4c69aac820531e504206" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "841018313ad649679de64e006582f4c5"
I20250625 03:31:54.971968 3789 raft_consensus.cc:3058] T 5e59ae16ec1a4c69aac820531e504206 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:54.972488 3861 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5e59ae16ec1a4c69aac820531e504206" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4"
I20250625 03:31:54.973153 3861 raft_consensus.cc:3053] T 5e59ae16ec1a4c69aac820531e504206 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:31:54.973459 3861 raft_consensus.cc:738] T 5e59ae16ec1a4c69aac820531e504206 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Running, Role: LEADER
I20250625 03:31:54.974496 3861 consensus_queue.cc:260] T 5e59ae16ec1a4c69aac820531e504206 P ddc0ad67020f45edb3ba9c83cab687a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:54.975855 3861 raft_consensus.cc:3058] T 5e59ae16ec1a4c69aac820531e504206 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:54.979120 3789 raft_consensus.cc:2466] T 5e59ae16ec1a4c69aac820531e504206 P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5b9823dfcd41cb92bd195c811cbf39 in term 2.
I20250625 03:31:54.980433 3680 leader_election.cc:304] T 5e59ae16ec1a4c69aac820531e504206 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, 841018313ad649679de64e006582f4c5; no voters:
I20250625 03:31:54.981063 4602 raft_consensus.cc:2802] T 5e59ae16ec1a4c69aac820531e504206 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:31:54.981463 4602 raft_consensus.cc:695] T 5e59ae16ec1a4c69aac820531e504206 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 LEADER]: Becoming Leader. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Running, Role: LEADER
I20250625 03:31:54.982245 4602 consensus_queue.cc:237] T 5e59ae16ec1a4c69aac820531e504206 P 3d5b9823dfcd41cb92bd195c811cbf39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:54.987455 3861 raft_consensus.cc:2466] T 5e59ae16ec1a4c69aac820531e504206 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5b9823dfcd41cb92bd195c811cbf39 in term 2.
I20250625 03:31:54.996090 3536 catalog_manager.cc:5582] T 5e59ae16ec1a4c69aac820531e504206 P 3d5b9823dfcd41cb92bd195c811cbf39 reported cstate change: term changed from 1 to 2, leader changed from ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132) to 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130). New cstate: current_term: 2 leader_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:55.028144 4615 raft_consensus.cc:991] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 841018313ad649679de64e006582f4c5: : Instructing follower 01873d289e0b4f9f9184b251369502a9 to start an election
I20250625 03:31:55.028650 4615 raft_consensus.cc:1079] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 841018313ad649679de64e006582f4c5 [term 1 LEADER]: Signalling peer 01873d289e0b4f9f9184b251369502a9 to start an election
I20250625 03:31:55.030040 4426 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "559ad5ac1bd14e8c8da7a2e7419cfcc6"
dest_uuid: "01873d289e0b4f9f9184b251369502a9"
from {username='slave'} at 127.0.0.1:45168
I20250625 03:31:55.030706 4426 raft_consensus.cc:491] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:31:55.039323 4426 raft_consensus.cc:3058] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:55.054149 4426 raft_consensus.cc:513] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 01873d289e0b4f9f9184b251369502a9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:55.055517 4615 raft_consensus.cc:991] T eeca5a85dddf4d1884917690e01ff81d P 841018313ad649679de64e006582f4c5: : Instructing follower 3d5b9823dfcd41cb92bd195c811cbf39 to start an election
I20250625 03:31:55.056062 4615 raft_consensus.cc:1079] T eeca5a85dddf4d1884917690e01ff81d P 841018313ad649679de64e006582f4c5 [term 1 LEADER]: Signalling peer 3d5b9823dfcd41cb92bd195c811cbf39 to start an election
I20250625 03:31:55.058883 3785 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "559ad5ac1bd14e8c8da7a2e7419cfcc6" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "841018313ad649679de64e006582f4c5"
I20250625 03:31:55.059456 3785 raft_consensus.cc:3053] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 841018313ad649679de64e006582f4c5 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:31:55.059504 3711 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "eeca5a85dddf4d1884917690e01ff81d"
dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
from {username='slave'} at 127.0.0.1:49134
I20250625 03:31:55.059785 3785 raft_consensus.cc:738] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 841018313ad649679de64e006582f4c5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 841018313ad649679de64e006582f4c5, State: Running, Role: LEADER
I20250625 03:31:55.060232 3711 raft_consensus.cc:491] T eeca5a85dddf4d1884917690e01ff81d P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:31:55.060631 3711 raft_consensus.cc:3058] T eeca5a85dddf4d1884917690e01ff81d P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:55.060638 3785 consensus_queue.cc:260] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 841018313ad649679de64e006582f4c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:55.062700 3785 raft_consensus.cc:3058] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:55.070394 4426 leader_election.cc:290] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 2 election: Requested vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353)
I20250625 03:31:55.071547 3861 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "559ad5ac1bd14e8c8da7a2e7419cfcc6" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4"
I20250625 03:31:55.072248 3861 raft_consensus.cc:3058] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:55.075312 3711 raft_consensus.cc:513] T eeca5a85dddf4d1884917690e01ff81d P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:55.082161 3789 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "eeca5a85dddf4d1884917690e01ff81d" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "841018313ad649679de64e006582f4c5"
I20250625 03:31:55.082756 3789 raft_consensus.cc:3053] T eeca5a85dddf4d1884917690e01ff81d P 841018313ad649679de64e006582f4c5 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:31:55.083128 3789 raft_consensus.cc:738] T eeca5a85dddf4d1884917690e01ff81d P 841018313ad649679de64e006582f4c5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 841018313ad649679de64e006582f4c5, State: Running, Role: LEADER
I20250625 03:31:55.085306 3863 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "eeca5a85dddf4d1884917690e01ff81d" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4"
I20250625 03:31:55.085544 3711 leader_election.cc:290] T eeca5a85dddf4d1884917690e01ff81d P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 2 election: Requested vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353)
I20250625 03:31:55.085906 3863 raft_consensus.cc:3058] T eeca5a85dddf4d1884917690e01ff81d P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:55.084446 3789 consensus_queue.cc:260] T eeca5a85dddf4d1884917690e01ff81d P 841018313ad649679de64e006582f4c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:55.079182 3785 raft_consensus.cc:2466] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01873d289e0b4f9f9184b251369502a9 in term 2.
I20250625 03:31:55.088547 3789 raft_consensus.cc:3058] T eeca5a85dddf4d1884917690e01ff81d P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:55.088860 4375 leader_election.cc:304] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9, 841018313ad649679de64e006582f4c5; no voters:
I20250625 03:31:55.089941 4625 raft_consensus.cc:2802] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 01873d289e0b4f9f9184b251369502a9 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:31:55.090499 4625 raft_consensus.cc:695] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 01873d289e0b4f9f9184b251369502a9 [term 2 LEADER]: Becoming Leader. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Running, Role: LEADER
I20250625 03:31:55.091434 4625 consensus_queue.cc:237] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:55.095295 3789 raft_consensus.cc:2466] T eeca5a85dddf4d1884917690e01ff81d P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5b9823dfcd41cb92bd195c811cbf39 in term 2.
I20250625 03:31:55.096500 3680 leader_election.cc:304] T eeca5a85dddf4d1884917690e01ff81d P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, 841018313ad649679de64e006582f4c5; no voters:
I20250625 03:31:55.079039 3861 raft_consensus.cc:2466] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01873d289e0b4f9f9184b251369502a9 in term 2.
I20250625 03:31:55.099479 4619 raft_consensus.cc:2802] T eeca5a85dddf4d1884917690e01ff81d P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:31:55.099961 4619 raft_consensus.cc:695] T eeca5a85dddf4d1884917690e01ff81d P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 LEADER]: Becoming Leader. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Running, Role: LEADER
I20250625 03:31:55.103296 4619 consensus_queue.cc:237] T eeca5a85dddf4d1884917690e01ff81d P 3d5b9823dfcd41cb92bd195c811cbf39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:55.100277 3863 raft_consensus.cc:2466] T eeca5a85dddf4d1884917690e01ff81d P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5b9823dfcd41cb92bd195c811cbf39 in term 2.
I20250625 03:31:55.117642 3536 catalog_manager.cc:5582] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 01873d289e0b4f9f9184b251369502a9 reported cstate change: term changed from 1 to 2, leader changed from 841018313ad649679de64e006582f4c5 (127.0.106.131) to 01873d289e0b4f9f9184b251369502a9 (127.0.106.129). New cstate: current_term: 2 leader_uuid: "01873d289e0b4f9f9184b251369502a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: HEALTHY } } }
I20250625 03:31:55.123580 3534 catalog_manager.cc:5582] T eeca5a85dddf4d1884917690e01ff81d P 3d5b9823dfcd41cb92bd195c811cbf39 reported cstate change: term changed from 1 to 2, leader changed from 841018313ad649679de64e006582f4c5 (127.0.106.131) to 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130). New cstate: current_term: 2 leader_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:55.302877 3863 raft_consensus.cc:1273] T 49d4fb2581ed4ef998f6a113ea67c323 P ddc0ad67020f45edb3ba9c83cab687a4 [term 3 FOLLOWER]: Refusing update from remote peer 01873d289e0b4f9f9184b251369502a9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250625 03:31:55.304790 4625 consensus_queue.cc:1035] T 49d4fb2581ed4ef998f6a113ea67c323 P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20250625 03:31:55.323369 3863 raft_consensus.cc:1273] T 007d68495d594a73a5e2748f51e7c44c P ddc0ad67020f45edb3ba9c83cab687a4 [term 3 FOLLOWER]: Refusing update from remote peer 01873d289e0b4f9f9184b251369502a9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250625 03:31:55.326795 4626 consensus_queue.cc:1035] T 007d68495d594a73a5e2748f51e7c44c P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20250625 03:31:55.359447 3789 raft_consensus.cc:1273] T 007d68495d594a73a5e2748f51e7c44c P 841018313ad649679de64e006582f4c5 [term 3 FOLLOWER]: Refusing update from remote peer 01873d289e0b4f9f9184b251369502a9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250625 03:31:55.361930 4627 consensus_queue.cc:1035] T 007d68495d594a73a5e2748f51e7c44c P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20250625 03:31:55.362782 3789 raft_consensus.cc:1273] T 49d4fb2581ed4ef998f6a113ea67c323 P 841018313ad649679de64e006582f4c5 [term 3 FOLLOWER]: Refusing update from remote peer 01873d289e0b4f9f9184b251369502a9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250625 03:31:55.364499 4627 consensus_queue.cc:1035] T 49d4fb2581ed4ef998f6a113ea67c323 P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:31:55.369884 3862 raft_consensus.cc:1273] T 2e956665b7e4411f86cf77259093c8aa P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Refusing update from remote peer 3d5b9823dfcd41cb92bd195c811cbf39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:55.376451 4602 consensus_queue.cc:1035] T 2e956665b7e4411f86cf77259093c8aa P 3d5b9823dfcd41cb92bd195c811cbf39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:55.382627 3786 raft_consensus.cc:1273] T 2e956665b7e4411f86cf77259093c8aa P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Refusing update from remote peer 3d5b9823dfcd41cb92bd195c811cbf39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:55.388602 4602 consensus_queue.cc:1035] T 2e956665b7e4411f86cf77259093c8aa P 3d5b9823dfcd41cb92bd195c811cbf39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20250625 03:31:55.475014 3858 raft_consensus.cc:1273] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Refusing update from remote peer 01873d289e0b4f9f9184b251369502a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:55.476289 3785 raft_consensus.cc:1273] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Refusing update from remote peer 01873d289e0b4f9f9184b251369502a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:55.476289 4627 consensus_queue.cc:1035] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:55.477663 4624 consensus_queue.cc:1035] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:55.553346 3863 raft_consensus.cc:1273] T 5e59ae16ec1a4c69aac820531e504206 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Refusing update from remote peer 3d5b9823dfcd41cb92bd195c811cbf39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:55.554855 4592 consensus_queue.cc:1035] T 5e59ae16ec1a4c69aac820531e504206 P 3d5b9823dfcd41cb92bd195c811cbf39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20250625 03:31:55.567641 3785 raft_consensus.cc:1273] T 5e59ae16ec1a4c69aac820531e504206 P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Refusing update from remote peer 3d5b9823dfcd41cb92bd195c811cbf39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:55.569195 4592 consensus_queue.cc:1035] T 5e59ae16ec1a4c69aac820531e504206 P 3d5b9823dfcd41cb92bd195c811cbf39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:55.669517 3863 raft_consensus.cc:1273] T eeca5a85dddf4d1884917690e01ff81d P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Refusing update from remote peer 3d5b9823dfcd41cb92bd195c811cbf39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:55.670591 4592 consensus_queue.cc:1035] T eeca5a85dddf4d1884917690e01ff81d P 3d5b9823dfcd41cb92bd195c811cbf39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:55.689628 3785 raft_consensus.cc:1273] T eeca5a85dddf4d1884917690e01ff81d P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Refusing update from remote peer 3d5b9823dfcd41cb92bd195c811cbf39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:55.691615 4619 consensus_queue.cc:1035] T eeca5a85dddf4d1884917690e01ff81d P 3d5b9823dfcd41cb92bd195c811cbf39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:55.766786 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:31:55.830271 3789 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "3ae65ab4d0d2480cb3e4d2d0dd5f5c14"
dest_uuid: "841018313ad649679de64e006582f4c5"
mode: GRACEFUL
new_leader_uuid: "01873d289e0b4f9f9184b251369502a9"
from {username='slave'} at 127.0.0.1:60686
I20250625 03:31:55.830775 3789 raft_consensus.cc:604] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 841018313ad649679de64e006582f4c5 [term 1 LEADER]: Received request to transfer leadership to TS 01873d289e0b4f9f9184b251369502a9
I20250625 03:31:55.843806 3711 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "6de9e445ad834b008a2f513fac78dba1"
dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
mode: GRACEFUL
new_leader_uuid: "841018313ad649679de64e006582f4c5"
from {username='slave'} at 127.0.0.1:42980
I20250625 03:31:55.844453 3711 raft_consensus.cc:604] T 6de9e445ad834b008a2f513fac78dba1 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 LEADER]: Received request to transfer leadership to TS 841018313ad649679de64e006582f4c5
I20250625 03:31:55.845479 4619 raft_consensus.cc:991] T 6de9e445ad834b008a2f513fac78dba1 P 3d5b9823dfcd41cb92bd195c811cbf39: : Instructing follower 841018313ad649679de64e006582f4c5 to start an election
I20250625 03:31:55.845966 4592 raft_consensus.cc:1079] T 6de9e445ad834b008a2f513fac78dba1 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 LEADER]: Signalling peer 841018313ad649679de64e006582f4c5 to start an election
I20250625 03:31:55.847410 3789 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "7e92fd94b9f24b1097e9a7373896cb26"
dest_uuid: "841018313ad649679de64e006582f4c5"
mode: GRACEFUL
new_leader_uuid: "01873d289e0b4f9f9184b251369502a9"
from {username='slave'} at 127.0.0.1:60686
I20250625 03:31:55.847589 3785 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "6de9e445ad834b008a2f513fac78dba1"
dest_uuid: "841018313ad649679de64e006582f4c5"
from {username='slave'} at 127.0.0.1:40292
I20250625 03:31:55.847999 3789 raft_consensus.cc:604] T 7e92fd94b9f24b1097e9a7373896cb26 P 841018313ad649679de64e006582f4c5 [term 2 LEADER]: Received request to transfer leadership to TS 01873d289e0b4f9f9184b251369502a9
I20250625 03:31:55.848132 3785 raft_consensus.cc:491] T 6de9e445ad834b008a2f513fac78dba1 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:31:55.848592 3785 raft_consensus.cc:3058] T 6de9e445ad834b008a2f513fac78dba1 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:55.850363 3858 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "b1ece928b2e2452191ee263cf19ec4f8"
dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4"
mode: GRACEFUL
new_leader_uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
from {username='slave'} at 127.0.0.1:36556
I20250625 03:31:55.850919 3858 raft_consensus.cc:604] T b1ece928b2e2452191ee263cf19ec4f8 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 LEADER]: Received request to transfer leadership to TS 3d5b9823dfcd41cb92bd195c811cbf39
I20250625 03:31:55.853507 3710 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "f3a33aa1d146468c986f0b1ba7d5fb84"
dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
mode: GRACEFUL
new_leader_uuid: "01873d289e0b4f9f9184b251369502a9"
from {username='slave'} at 127.0.0.1:42980
I20250625 03:31:55.854043 3710 raft_consensus.cc:604] T f3a33aa1d146468c986f0b1ba7d5fb84 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 LEADER]: Received request to transfer leadership to TS 01873d289e0b4f9f9184b251369502a9
I20250625 03:31:55.855412 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20250625 03:31:55.856228 3785 raft_consensus.cc:513] T 6de9e445ad834b008a2f513fac78dba1 P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:55.857259 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:31:55.858795 3785 leader_election.cc:290] T 6de9e445ad834b008a2f513fac78dba1 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 2 election: Requested vote from peers 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041), ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353)
I20250625 03:31:55.859477 3710 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6de9e445ad834b008a2f513fac78dba1" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
I20250625 03:31:55.859831 3858 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6de9e445ad834b008a2f513fac78dba1" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4"
I20250625 03:31:55.860155 3710 raft_consensus.cc:3053] T 6de9e445ad834b008a2f513fac78dba1 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:31:55.860427 3858 raft_consensus.cc:3058] T 6de9e445ad834b008a2f513fac78dba1 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:55.860455 3710 raft_consensus.cc:738] T 6de9e445ad834b008a2f513fac78dba1 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Running, Role: LEADER
I20250625 03:31:55.861323 3710 consensus_queue.cc:260] T 6de9e445ad834b008a2f513fac78dba1 P 3d5b9823dfcd41cb92bd195c811cbf39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:55.862432 3710 raft_consensus.cc:3058] T 6de9e445ad834b008a2f513fac78dba1 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:55.867591 3858 raft_consensus.cc:2466] T 6de9e445ad834b008a2f513fac78dba1 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841018313ad649679de64e006582f4c5 in term 2.
I20250625 03:31:55.868906 3753 leader_election.cc:304] T 6de9e445ad834b008a2f513fac78dba1 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841018313ad649679de64e006582f4c5, ddc0ad67020f45edb3ba9c83cab687a4; no voters:
I20250625 03:31:55.870085 4659 raft_consensus.cc:2802] T 6de9e445ad834b008a2f513fac78dba1 P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:31:55.870476 4659 raft_consensus.cc:695] T 6de9e445ad834b008a2f513fac78dba1 P 841018313ad649679de64e006582f4c5 [term 2 LEADER]: Becoming Leader. State: Replica: 841018313ad649679de64e006582f4c5, State: Running, Role: LEADER
I20250625 03:31:55.871623 4659 consensus_queue.cc:237] T 6de9e445ad834b008a2f513fac78dba1 P 841018313ad649679de64e006582f4c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:55.875706 3710 raft_consensus.cc:2466] T 6de9e445ad834b008a2f513fac78dba1 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841018313ad649679de64e006582f4c5 in term 2.
I20250625 03:31:55.858316 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:31:55.883831 3536 catalog_manager.cc:5582] T 6de9e445ad834b008a2f513fac78dba1 P 841018313ad649679de64e006582f4c5 reported cstate change: term changed from 1 to 2, leader changed from 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130) to 841018313ad649679de64e006582f4c5 (127.0.106.131). New cstate: current_term: 2 leader_uuid: "841018313ad649679de64e006582f4c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:55.978296 4604 raft_consensus.cc:991] T b1ece928b2e2452191ee263cf19ec4f8 P ddc0ad67020f45edb3ba9c83cab687a4: : Instructing follower 3d5b9823dfcd41cb92bd195c811cbf39 to start an election
I20250625 03:31:55.978788 4588 raft_consensus.cc:1079] T b1ece928b2e2452191ee263cf19ec4f8 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 LEADER]: Signalling peer 3d5b9823dfcd41cb92bd195c811cbf39 to start an election
I20250625 03:31:55.980309 3710 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "b1ece928b2e2452191ee263cf19ec4f8"
dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
from {username='slave'} at 127.0.0.1:49138
I20250625 03:31:55.980921 3710 raft_consensus.cc:491] T b1ece928b2e2452191ee263cf19ec4f8 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:31:55.982331 3710 raft_consensus.cc:3058] T b1ece928b2e2452191ee263cf19ec4f8 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:55.989771 3710 raft_consensus.cc:513] T b1ece928b2e2452191ee263cf19ec4f8 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:55.991911 3710 leader_election.cc:290] T b1ece928b2e2452191ee263cf19ec4f8 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 2 election: Requested vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353)
I20250625 03:31:55.992666 3858 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b1ece928b2e2452191ee263cf19ec4f8" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4"
I20250625 03:31:55.993016 3785 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b1ece928b2e2452191ee263cf19ec4f8" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "841018313ad649679de64e006582f4c5"
I20250625 03:31:55.993369 3858 raft_consensus.cc:3053] T b1ece928b2e2452191ee263cf19ec4f8 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:31:55.993562 3785 raft_consensus.cc:3058] T b1ece928b2e2452191ee263cf19ec4f8 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:55.993760 3858 raft_consensus.cc:738] T b1ece928b2e2452191ee263cf19ec4f8 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Running, Role: LEADER
I20250625 03:31:55.994592 3858 consensus_queue.cc:260] T b1ece928b2e2452191ee263cf19ec4f8 P ddc0ad67020f45edb3ba9c83cab687a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:55.995877 3858 raft_consensus.cc:3058] T b1ece928b2e2452191ee263cf19ec4f8 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:56.000558 3785 raft_consensus.cc:2466] T b1ece928b2e2452191ee263cf19ec4f8 P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5b9823dfcd41cb92bd195c811cbf39 in term 2.
I20250625 03:31:56.001755 3680 leader_election.cc:304] T b1ece928b2e2452191ee263cf19ec4f8 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, 841018313ad649679de64e006582f4c5; no voters:
I20250625 03:31:56.002578 4619 raft_consensus.cc:2802] T b1ece928b2e2452191ee263cf19ec4f8 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:31:56.003021 4619 raft_consensus.cc:695] T b1ece928b2e2452191ee263cf19ec4f8 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 LEADER]: Becoming Leader. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Running, Role: LEADER
I20250625 03:31:56.003033 3858 raft_consensus.cc:2466] T b1ece928b2e2452191ee263cf19ec4f8 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5b9823dfcd41cb92bd195c811cbf39 in term 2.
I20250625 03:31:56.004420 4619 consensus_queue.cc:237] T b1ece928b2e2452191ee263cf19ec4f8 P 3d5b9823dfcd41cb92bd195c811cbf39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:56.015172 3536 catalog_manager.cc:5582] T b1ece928b2e2452191ee263cf19ec4f8 P 3d5b9823dfcd41cb92bd195c811cbf39 reported cstate change: term changed from 1 to 2, leader changed from ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132) to 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130). New cstate: current_term: 2 leader_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:56.089824 4659 raft_consensus.cc:991] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 841018313ad649679de64e006582f4c5: : Instructing follower 01873d289e0b4f9f9184b251369502a9 to start an election
I20250625 03:31:56.090230 4660 raft_consensus.cc:1079] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 841018313ad649679de64e006582f4c5 [term 1 LEADER]: Signalling peer 01873d289e0b4f9f9184b251369502a9 to start an election
I20250625 03:31:56.091569 4422 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "3ae65ab4d0d2480cb3e4d2d0dd5f5c14"
dest_uuid: "01873d289e0b4f9f9184b251369502a9"
from {username='slave'} at 127.0.0.1:45168
I20250625 03:31:56.092103 4422 raft_consensus.cc:491] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:31:56.092409 4422 raft_consensus.cc:3058] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:56.097318 4422 raft_consensus.cc:513] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 01873d289e0b4f9f9184b251369502a9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:56.098907 4422 leader_election.cc:290] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 2 election: Requested vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353)
I20250625 03:31:56.099715 3785 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3ae65ab4d0d2480cb3e4d2d0dd5f5c14" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "841018313ad649679de64e006582f4c5"
I20250625 03:31:56.100175 3863 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3ae65ab4d0d2480cb3e4d2d0dd5f5c14" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4"
I20250625 03:31:56.100330 3785 raft_consensus.cc:3053] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 841018313ad649679de64e006582f4c5 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:31:56.100732 3785 raft_consensus.cc:738] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 841018313ad649679de64e006582f4c5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 841018313ad649679de64e006582f4c5, State: Running, Role: LEADER
I20250625 03:31:56.100760 3863 raft_consensus.cc:3058] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:56.101320 3785 consensus_queue.cc:260] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 841018313ad649679de64e006582f4c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:56.102254 3785 raft_consensus.cc:3058] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:56.107865 3863 raft_consensus.cc:2466] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01873d289e0b4f9f9184b251369502a9 in term 2.
I20250625 03:31:56.108418 3785 raft_consensus.cc:2466] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01873d289e0b4f9f9184b251369502a9 in term 2.
I20250625 03:31:56.109339 4374 leader_election.cc:304] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9, ddc0ad67020f45edb3ba9c83cab687a4; no voters:
I20250625 03:31:56.110152 4625 raft_consensus.cc:2802] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 01873d289e0b4f9f9184b251369502a9 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:31:56.110602 4625 raft_consensus.cc:695] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 01873d289e0b4f9f9184b251369502a9 [term 2 LEADER]: Becoming Leader. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Running, Role: LEADER
I20250625 03:31:56.111359 4625 consensus_queue.cc:237] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:56.119592 3536 catalog_manager.cc:5582] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 01873d289e0b4f9f9184b251369502a9 reported cstate change: term changed from 1 to 2, leader changed from 841018313ad649679de64e006582f4c5 (127.0.106.131) to 01873d289e0b4f9f9184b251369502a9 (127.0.106.129). New cstate: current_term: 2 leader_uuid: "01873d289e0b4f9f9184b251369502a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: HEALTHY } } }
I20250625 03:31:56.221767 4660 raft_consensus.cc:991] T 7e92fd94b9f24b1097e9a7373896cb26 P 841018313ad649679de64e006582f4c5: : Instructing follower 01873d289e0b4f9f9184b251369502a9 to start an election
I20250625 03:31:56.222158 4659 raft_consensus.cc:1079] T 7e92fd94b9f24b1097e9a7373896cb26 P 841018313ad649679de64e006582f4c5 [term 2 LEADER]: Signalling peer 01873d289e0b4f9f9184b251369502a9 to start an election
I20250625 03:31:56.223489 4426 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "7e92fd94b9f24b1097e9a7373896cb26"
dest_uuid: "01873d289e0b4f9f9184b251369502a9"
from {username='slave'} at 127.0.0.1:45168
I20250625 03:31:56.223982 4426 raft_consensus.cc:491] T 7e92fd94b9f24b1097e9a7373896cb26 P 01873d289e0b4f9f9184b251369502a9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:31:56.224355 4426 raft_consensus.cc:3058] T 7e92fd94b9f24b1097e9a7373896cb26 P 01873d289e0b4f9f9184b251369502a9 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:56.229354 4426 raft_consensus.cc:513] T 7e92fd94b9f24b1097e9a7373896cb26 P 01873d289e0b4f9f9184b251369502a9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:56.231035 4426 leader_election.cc:290] T 7e92fd94b9f24b1097e9a7373896cb26 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 3 election: Requested vote from peers 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041), 841018313ad649679de64e006582f4c5 (127.0.106.131:39467)
I20250625 03:31:56.233474 3785 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7e92fd94b9f24b1097e9a7373896cb26" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "841018313ad649679de64e006582f4c5"
I20250625 03:31:56.234141 3785 raft_consensus.cc:3053] T 7e92fd94b9f24b1097e9a7373896cb26 P 841018313ad649679de64e006582f4c5 [term 2 LEADER]: Stepping down as leader of term 2
I20250625 03:31:56.234509 3785 raft_consensus.cc:738] T 7e92fd94b9f24b1097e9a7373896cb26 P 841018313ad649679de64e006582f4c5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 841018313ad649679de64e006582f4c5, State: Running, Role: LEADER
I20250625 03:31:56.235488 4602 raft_consensus.cc:991] T f3a33aa1d146468c986f0b1ba7d5fb84 P 3d5b9823dfcd41cb92bd195c811cbf39: : Instructing follower 01873d289e0b4f9f9184b251369502a9 to start an election
I20250625 03:31:56.235390 3785 consensus_queue.cc:260] T 7e92fd94b9f24b1097e9a7373896cb26 P 841018313ad649679de64e006582f4c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:56.235963 4602 raft_consensus.cc:1079] T f3a33aa1d146468c986f0b1ba7d5fb84 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 LEADER]: Signalling peer 01873d289e0b4f9f9184b251369502a9 to start an election
I20250625 03:31:56.236959 3785 raft_consensus.cc:3058] T 7e92fd94b9f24b1097e9a7373896cb26 P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:56.237811 4426 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "f3a33aa1d146468c986f0b1ba7d5fb84"
dest_uuid: "01873d289e0b4f9f9184b251369502a9"
from {username='slave'} at 127.0.0.1:45172
I20250625 03:31:56.238396 4426 raft_consensus.cc:491] T f3a33aa1d146468c986f0b1ba7d5fb84 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:31:56.238719 4426 raft_consensus.cc:3058] T f3a33aa1d146468c986f0b1ba7d5fb84 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:56.241573 3711 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7e92fd94b9f24b1097e9a7373896cb26" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
I20250625 03:31:56.242206 3711 raft_consensus.cc:3058] T 7e92fd94b9f24b1097e9a7373896cb26 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:56.243952 3785 raft_consensus.cc:2466] T 7e92fd94b9f24b1097e9a7373896cb26 P 841018313ad649679de64e006582f4c5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01873d289e0b4f9f9184b251369502a9 in term 3.
I20250625 03:31:56.245193 4375 leader_election.cc:304] T 7e92fd94b9f24b1097e9a7373896cb26 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9, 841018313ad649679de64e006582f4c5; no voters:
I20250625 03:31:56.246034 4625 raft_consensus.cc:2802] T 7e92fd94b9f24b1097e9a7373896cb26 P 01873d289e0b4f9f9184b251369502a9 [term 3 FOLLOWER]: Leader election won for term 3
I20250625 03:31:56.245863 4426 raft_consensus.cc:513] T f3a33aa1d146468c986f0b1ba7d5fb84 P 01873d289e0b4f9f9184b251369502a9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:56.246555 4625 raft_consensus.cc:695] T 7e92fd94b9f24b1097e9a7373896cb26 P 01873d289e0b4f9f9184b251369502a9 [term 3 LEADER]: Becoming Leader. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Running, Role: LEADER
I20250625 03:31:56.248342 4426 leader_election.cc:290] T f3a33aa1d146468c986f0b1ba7d5fb84 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 2 election: Requested vote from peers 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041), ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353)
I20250625 03:31:56.248660 3711 raft_consensus.cc:2466] T 7e92fd94b9f24b1097e9a7373896cb26 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01873d289e0b4f9f9184b251369502a9 in term 3.
I20250625 03:31:56.249078 3710 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f3a33aa1d146468c986f0b1ba7d5fb84" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
I20250625 03:31:56.249722 3710 raft_consensus.cc:3053] T f3a33aa1d146468c986f0b1ba7d5fb84 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:31:56.249991 3710 raft_consensus.cc:738] T f3a33aa1d146468c986f0b1ba7d5fb84 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Running, Role: LEADER
I20250625 03:31:56.247462 4625 consensus_queue.cc:237] T 7e92fd94b9f24b1097e9a7373896cb26 P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:56.250593 3710 consensus_queue.cc:260] T f3a33aa1d146468c986f0b1ba7d5fb84 P 3d5b9823dfcd41cb92bd195c811cbf39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:56.251227 3863 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f3a33aa1d146468c986f0b1ba7d5fb84" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4"
I20250625 03:31:56.251816 3710 raft_consensus.cc:3058] T f3a33aa1d146468c986f0b1ba7d5fb84 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:56.251852 3863 raft_consensus.cc:3058] T f3a33aa1d146468c986f0b1ba7d5fb84 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:56.259393 3863 raft_consensus.cc:2466] T f3a33aa1d146468c986f0b1ba7d5fb84 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01873d289e0b4f9f9184b251369502a9 in term 2.
I20250625 03:31:56.260206 3710 raft_consensus.cc:2466] T f3a33aa1d146468c986f0b1ba7d5fb84 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01873d289e0b4f9f9184b251369502a9 in term 2.
I20250625 03:31:56.260658 4374 leader_election.cc:304] T f3a33aa1d146468c986f0b1ba7d5fb84 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9, ddc0ad67020f45edb3ba9c83cab687a4; no voters:
I20250625 03:31:56.261615 4625 raft_consensus.cc:2802] T f3a33aa1d146468c986f0b1ba7d5fb84 P 01873d289e0b4f9f9184b251369502a9 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:31:56.262112 4625 raft_consensus.cc:695] T f3a33aa1d146468c986f0b1ba7d5fb84 P 01873d289e0b4f9f9184b251369502a9 [term 2 LEADER]: Becoming Leader. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Running, Role: LEADER
I20250625 03:31:56.262918 4625 consensus_queue.cc:237] T f3a33aa1d146468c986f0b1ba7d5fb84 P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:56.265333 3536 catalog_manager.cc:5582] T 7e92fd94b9f24b1097e9a7373896cb26 P 01873d289e0b4f9f9184b251369502a9 reported cstate change: term changed from 2 to 3, leader changed from 841018313ad649679de64e006582f4c5 (127.0.106.131) to 01873d289e0b4f9f9184b251369502a9 (127.0.106.129). New cstate: current_term: 3 leader_uuid: "01873d289e0b4f9f9184b251369502a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:56.286227 3536 catalog_manager.cc:5582] T f3a33aa1d146468c986f0b1ba7d5fb84 P 01873d289e0b4f9f9184b251369502a9 reported cstate change: term changed from 1 to 2, leader changed from 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130) to 01873d289e0b4f9f9184b251369502a9 (127.0.106.129). New cstate: current_term: 2 leader_uuid: "01873d289e0b4f9f9184b251369502a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: HEALTHY } } }
I20250625 03:31:56.431192 3710 raft_consensus.cc:1273] T 6de9e445ad834b008a2f513fac78dba1 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Refusing update from remote peer 841018313ad649679de64e006582f4c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:56.432278 4659 consensus_queue.cc:1035] T 6de9e445ad834b008a2f513fac78dba1 P 841018313ad649679de64e006582f4c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:56.442103 3863 raft_consensus.cc:1273] T 6de9e445ad834b008a2f513fac78dba1 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Refusing update from remote peer 841018313ad649679de64e006582f4c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:56.445086 4660 consensus_queue.cc:1035] T 6de9e445ad834b008a2f513fac78dba1 P 841018313ad649679de64e006582f4c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20250625 03:31:56.546705 3785 raft_consensus.cc:1273] T b1ece928b2e2452191ee263cf19ec4f8 P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Refusing update from remote peer 3d5b9823dfcd41cb92bd195c811cbf39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:56.547819 4592 consensus_queue.cc:1035] T b1ece928b2e2452191ee263cf19ec4f8 P 3d5b9823dfcd41cb92bd195c811cbf39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:56.559847 3863 raft_consensus.cc:1273] T b1ece928b2e2452191ee263cf19ec4f8 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Refusing update from remote peer 3d5b9823dfcd41cb92bd195c811cbf39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:56.561846 4619 consensus_queue.cc:1035] T b1ece928b2e2452191ee263cf19ec4f8 P 3d5b9823dfcd41cb92bd195c811cbf39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:56.598384 3863 raft_consensus.cc:1273] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Refusing update from remote peer 01873d289e0b4f9f9184b251369502a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:56.599493 4625 consensus_queue.cc:1035] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:56.615217 3789 raft_consensus.cc:1273] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Refusing update from remote peer 01873d289e0b4f9f9184b251369502a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:56.616636 4624 consensus_queue.cc:1035] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:56.743991 3711 raft_consensus.cc:1273] T f3a33aa1d146468c986f0b1ba7d5fb84 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Refusing update from remote peer 01873d289e0b4f9f9184b251369502a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:56.745169 4624 consensus_queue.cc:1035] T f3a33aa1d146468c986f0b1ba7d5fb84 P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:56.756235 3858 raft_consensus.cc:1273] T f3a33aa1d146468c986f0b1ba7d5fb84 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Refusing update from remote peer 01873d289e0b4f9f9184b251369502a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:56.757759 4624 consensus_queue.cc:1035] T f3a33aa1d146468c986f0b1ba7d5fb84 P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:56.758209 3785 raft_consensus.cc:1273] T 7e92fd94b9f24b1097e9a7373896cb26 P 841018313ad649679de64e006582f4c5 [term 3 FOLLOWER]: Refusing update from remote peer 01873d289e0b4f9f9184b251369502a9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250625 03:31:56.761312 4685 consensus_queue.cc:1035] T 7e92fd94b9f24b1097e9a7373896cb26 P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20250625 03:31:56.782838 3711 raft_consensus.cc:1273] T 7e92fd94b9f24b1097e9a7373896cb26 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 3 FOLLOWER]: Refusing update from remote peer 01873d289e0b4f9f9184b251369502a9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250625 03:31:56.788321 4624 consensus_queue.cc:1035] T 7e92fd94b9f24b1097e9a7373896cb26 P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:31:56.931085 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:31:56.972069 3858 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "39880aedaeca464f81d899dc222a35b9"
dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4"
mode: GRACEFUL
new_leader_uuid: "01873d289e0b4f9f9184b251369502a9"
from {username='slave'} at 127.0.0.1:36556
I20250625 03:31:56.972642 3858 raft_consensus.cc:604] T 39880aedaeca464f81d899dc222a35b9 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 LEADER]: Received request to transfer leadership to TS 01873d289e0b4f9f9184b251369502a9
I20250625 03:31:56.974900 3858 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "41d33fbc861a40338ae6da1732fb696b"
dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4"
mode: GRACEFUL
new_leader_uuid: "841018313ad649679de64e006582f4c5"
from {username='slave'} at 127.0.0.1:36556
I20250625 03:31:56.975368 3858 raft_consensus.cc:604] T 41d33fbc861a40338ae6da1732fb696b P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 LEADER]: Received request to transfer leadership to TS 841018313ad649679de64e006582f4c5
I20250625 03:31:56.977667 3789 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "6fc84ca2087c4ded91412fb32117af48"
dest_uuid: "841018313ad649679de64e006582f4c5"
mode: GRACEFUL
new_leader_uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
from {username='slave'} at 127.0.0.1:60686
I20250625 03:31:56.978224 3789 raft_consensus.cc:604] T 6fc84ca2087c4ded91412fb32117af48 P 841018313ad649679de64e006582f4c5 [term 1 LEADER]: Received request to transfer leadership to TS 3d5b9823dfcd41cb92bd195c811cbf39
I20250625 03:31:56.980429 3858 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "b74d9f11c2bc4a7bb6431d6222d45175"
dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4"
mode: GRACEFUL
new_leader_uuid: "01873d289e0b4f9f9184b251369502a9"
from {username='slave'} at 127.0.0.1:36556
I20250625 03:31:56.981063 3858 raft_consensus.cc:604] T b74d9f11c2bc4a7bb6431d6222d45175 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 LEADER]: Received request to transfer leadership to TS 01873d289e0b4f9f9184b251369502a9
I20250625 03:31:56.983491 3711 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "c5a9463f96314a83b7955d80444b1c29"
dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
mode: GRACEFUL
new_leader_uuid: "01873d289e0b4f9f9184b251369502a9"
from {username='slave'} at 127.0.0.1:42980
I20250625 03:31:56.984375 3711 raft_consensus.cc:604] T c5a9463f96314a83b7955d80444b1c29 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 LEADER]: Received request to transfer leadership to TS 01873d289e0b4f9f9184b251369502a9
I20250625 03:31:56.985839 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20250625 03:31:56.988375 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:31:56.989004 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:31:57.005468 4676 raft_consensus.cc:991] T 6fc84ca2087c4ded91412fb32117af48 P 841018313ad649679de64e006582f4c5: : Instructing follower 3d5b9823dfcd41cb92bd195c811cbf39 to start an election
I20250625 03:31:57.005978 4659 raft_consensus.cc:1079] T 6fc84ca2087c4ded91412fb32117af48 P 841018313ad649679de64e006582f4c5 [term 1 LEADER]: Signalling peer 3d5b9823dfcd41cb92bd195c811cbf39 to start an election
I20250625 03:31:57.007546 3710 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "6fc84ca2087c4ded91412fb32117af48"
dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
from {username='slave'} at 127.0.0.1:49134
I20250625 03:31:57.008102 3710 raft_consensus.cc:491] T 6fc84ca2087c4ded91412fb32117af48 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:31:57.008474 3710 raft_consensus.cc:3058] T 6fc84ca2087c4ded91412fb32117af48 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:57.015319 3710 raft_consensus.cc:513] T 6fc84ca2087c4ded91412fb32117af48 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:57.019270 3710 leader_election.cc:290] T 6fc84ca2087c4ded91412fb32117af48 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 2 election: Requested vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353)
I20250625 03:31:57.019935 3789 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6fc84ca2087c4ded91412fb32117af48" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "841018313ad649679de64e006582f4c5"
I20250625 03:31:57.020586 3789 raft_consensus.cc:3053] T 6fc84ca2087c4ded91412fb32117af48 P 841018313ad649679de64e006582f4c5 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:31:57.020573 3863 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6fc84ca2087c4ded91412fb32117af48" candidate_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4"
I20250625 03:31:57.021054 3789 raft_consensus.cc:738] T 6fc84ca2087c4ded91412fb32117af48 P 841018313ad649679de64e006582f4c5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 841018313ad649679de64e006582f4c5, State: Running, Role: LEADER
I20250625 03:31:57.021258 3863 raft_consensus.cc:3058] T 6fc84ca2087c4ded91412fb32117af48 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:57.021744 3789 consensus_queue.cc:260] T 6fc84ca2087c4ded91412fb32117af48 P 841018313ad649679de64e006582f4c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:57.022518 3789 raft_consensus.cc:3058] T 6fc84ca2087c4ded91412fb32117af48 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:57.027525 3789 raft_consensus.cc:2466] T 6fc84ca2087c4ded91412fb32117af48 P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5b9823dfcd41cb92bd195c811cbf39 in term 2.
I20250625 03:31:57.027894 3863 raft_consensus.cc:2466] T 6fc84ca2087c4ded91412fb32117af48 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5b9823dfcd41cb92bd195c811cbf39 in term 2.
I20250625 03:31:57.028787 3680 leader_election.cc:304] T 6fc84ca2087c4ded91412fb32117af48 P 3d5b9823dfcd41cb92bd195c811cbf39 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, 841018313ad649679de64e006582f4c5; no voters:
I20250625 03:31:57.029634 4592 raft_consensus.cc:2802] T 6fc84ca2087c4ded91412fb32117af48 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:31:57.036767 4592 raft_consensus.cc:695] T 6fc84ca2087c4ded91412fb32117af48 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 LEADER]: Becoming Leader. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Running, Role: LEADER
I20250625 03:31:57.038745 4602 raft_consensus.cc:991] T c5a9463f96314a83b7955d80444b1c29 P 3d5b9823dfcd41cb92bd195c811cbf39: : Instructing follower 01873d289e0b4f9f9184b251369502a9 to start an election
I20250625 03:31:57.039352 4602 raft_consensus.cc:1079] T c5a9463f96314a83b7955d80444b1c29 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 LEADER]: Signalling peer 01873d289e0b4f9f9184b251369502a9 to start an election
I20250625 03:31:57.040632 4422 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "c5a9463f96314a83b7955d80444b1c29"
dest_uuid: "01873d289e0b4f9f9184b251369502a9"
from {username='slave'} at 127.0.0.1:45172
I20250625 03:31:57.041260 4422 raft_consensus.cc:491] T c5a9463f96314a83b7955d80444b1c29 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:31:57.037544 4592 consensus_queue.cc:237] T 6fc84ca2087c4ded91412fb32117af48 P 3d5b9823dfcd41cb92bd195c811cbf39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:57.041605 4422 raft_consensus.cc:3058] T c5a9463f96314a83b7955d80444b1c29 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:57.047847 4422 raft_consensus.cc:513] T c5a9463f96314a83b7955d80444b1c29 P 01873d289e0b4f9f9184b251369502a9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:57.054563 4422 leader_election.cc:290] T c5a9463f96314a83b7955d80444b1c29 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 2 election: Requested vote from peers 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041), 841018313ad649679de64e006582f4c5 (127.0.106.131:39467)
I20250625 03:31:57.054811 3536 catalog_manager.cc:5582] T 6fc84ca2087c4ded91412fb32117af48 P 3d5b9823dfcd41cb92bd195c811cbf39 reported cstate change: term changed from 1 to 2, leader changed from 841018313ad649679de64e006582f4c5 (127.0.106.131) to 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130). New cstate: current_term: 2 leader_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:57.056205 3710 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c5a9463f96314a83b7955d80444b1c29" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
I20250625 03:31:57.056840 3710 raft_consensus.cc:3053] T c5a9463f96314a83b7955d80444b1c29 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:31:57.057137 3710 raft_consensus.cc:738] T c5a9463f96314a83b7955d80444b1c29 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Running, Role: LEADER
I20250625 03:31:57.057746 3789 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c5a9463f96314a83b7955d80444b1c29" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "841018313ad649679de64e006582f4c5"
I20250625 03:31:57.058307 3789 raft_consensus.cc:3058] T c5a9463f96314a83b7955d80444b1c29 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:57.058550 3710 consensus_queue.cc:260] T c5a9463f96314a83b7955d80444b1c29 P 3d5b9823dfcd41cb92bd195c811cbf39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:57.059813 3710 raft_consensus.cc:3058] T c5a9463f96314a83b7955d80444b1c29 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:57.066329 3789 raft_consensus.cc:2466] T c5a9463f96314a83b7955d80444b1c29 P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01873d289e0b4f9f9184b251369502a9 in term 2.
I20250625 03:31:57.066839 3710 raft_consensus.cc:2466] T c5a9463f96314a83b7955d80444b1c29 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01873d289e0b4f9f9184b251369502a9 in term 2.
I20250625 03:31:57.067952 4375 leader_election.cc:304] T c5a9463f96314a83b7955d80444b1c29 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9, 841018313ad649679de64e006582f4c5; no voters:
I20250625 03:31:57.068760 4625 raft_consensus.cc:2802] T c5a9463f96314a83b7955d80444b1c29 P 01873d289e0b4f9f9184b251369502a9 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:31:57.069244 4625 raft_consensus.cc:695] T c5a9463f96314a83b7955d80444b1c29 P 01873d289e0b4f9f9184b251369502a9 [term 2 LEADER]: Becoming Leader. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Running, Role: LEADER
I20250625 03:31:57.070138 4625 consensus_queue.cc:237] T c5a9463f96314a83b7955d80444b1c29 P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:57.083952 3534 catalog_manager.cc:5582] T c5a9463f96314a83b7955d80444b1c29 P 01873d289e0b4f9f9184b251369502a9 reported cstate change: term changed from 1 to 2, leader changed from 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130) to 01873d289e0b4f9f9184b251369502a9 (127.0.106.129). New cstate: current_term: 2 leader_uuid: "01873d289e0b4f9f9184b251369502a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:57.156858 4690 raft_consensus.cc:991] T b74d9f11c2bc4a7bb6431d6222d45175 P ddc0ad67020f45edb3ba9c83cab687a4: : Instructing follower 01873d289e0b4f9f9184b251369502a9 to start an election
I20250625 03:31:57.157634 4588 raft_consensus.cc:1079] T b74d9f11c2bc4a7bb6431d6222d45175 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 LEADER]: Signalling peer 01873d289e0b4f9f9184b251369502a9 to start an election
I20250625 03:31:57.159085 4422 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "b74d9f11c2bc4a7bb6431d6222d45175"
dest_uuid: "01873d289e0b4f9f9184b251369502a9"
from {username='slave'} at 127.0.0.1:45156
I20250625 03:31:57.160492 4422 raft_consensus.cc:491] T b74d9f11c2bc4a7bb6431d6222d45175 P 01873d289e0b4f9f9184b251369502a9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:31:57.160764 4422 raft_consensus.cc:3058] T b74d9f11c2bc4a7bb6431d6222d45175 P 01873d289e0b4f9f9184b251369502a9 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:57.165635 4422 raft_consensus.cc:513] T b74d9f11c2bc4a7bb6431d6222d45175 P 01873d289e0b4f9f9184b251369502a9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:57.167021 4422 leader_election.cc:290] T b74d9f11c2bc4a7bb6431d6222d45175 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 3 election: Requested vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353)
I20250625 03:31:57.167970 3785 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b74d9f11c2bc4a7bb6431d6222d45175" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "841018313ad649679de64e006582f4c5"
I20250625 03:31:57.168042 3863 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b74d9f11c2bc4a7bb6431d6222d45175" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4"
I20250625 03:31:57.168690 3785 raft_consensus.cc:3058] T b74d9f11c2bc4a7bb6431d6222d45175 P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:57.168763 3863 raft_consensus.cc:3053] T b74d9f11c2bc4a7bb6431d6222d45175 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 LEADER]: Stepping down as leader of term 2
I20250625 03:31:57.169186 3863 raft_consensus.cc:738] T b74d9f11c2bc4a7bb6431d6222d45175 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Running, Role: LEADER
I20250625 03:31:57.169857 3863 consensus_queue.cc:260] T b74d9f11c2bc4a7bb6431d6222d45175 P ddc0ad67020f45edb3ba9c83cab687a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:57.170842 3863 raft_consensus.cc:3058] T b74d9f11c2bc4a7bb6431d6222d45175 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:57.176267 3785 raft_consensus.cc:2466] T b74d9f11c2bc4a7bb6431d6222d45175 P 841018313ad649679de64e006582f4c5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01873d289e0b4f9f9184b251369502a9 in term 3.
I20250625 03:31:57.177229 4375 leader_election.cc:304] T b74d9f11c2bc4a7bb6431d6222d45175 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9, 841018313ad649679de64e006582f4c5; no voters:
I20250625 03:31:57.177956 4685 raft_consensus.cc:2802] T b74d9f11c2bc4a7bb6431d6222d45175 P 01873d289e0b4f9f9184b251369502a9 [term 3 FOLLOWER]: Leader election won for term 3
I20250625 03:31:57.178576 4685 raft_consensus.cc:695] T b74d9f11c2bc4a7bb6431d6222d45175 P 01873d289e0b4f9f9184b251369502a9 [term 3 LEADER]: Becoming Leader. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Running, Role: LEADER
I20250625 03:31:57.179754 3863 raft_consensus.cc:2466] T b74d9f11c2bc4a7bb6431d6222d45175 P ddc0ad67020f45edb3ba9c83cab687a4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01873d289e0b4f9f9184b251369502a9 in term 3.
I20250625 03:31:57.179580 4685 consensus_queue.cc:237] T b74d9f11c2bc4a7bb6431d6222d45175 P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:57.184747 4690 raft_consensus.cc:991] T 41d33fbc861a40338ae6da1732fb696b P ddc0ad67020f45edb3ba9c83cab687a4: : Instructing follower 841018313ad649679de64e006582f4c5 to start an election
I20250625 03:31:57.185351 4588 raft_consensus.cc:1079] T 41d33fbc861a40338ae6da1732fb696b P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 LEADER]: Signalling peer 841018313ad649679de64e006582f4c5 to start an election
I20250625 03:31:57.187971 3785 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "41d33fbc861a40338ae6da1732fb696b"
dest_uuid: "841018313ad649679de64e006582f4c5"
from {username='slave'} at 127.0.0.1:40276
I20250625 03:31:57.188860 3785 raft_consensus.cc:491] T 41d33fbc861a40338ae6da1732fb696b P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:31:57.189551 3785 raft_consensus.cc:3058] T 41d33fbc861a40338ae6da1732fb696b P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:57.198238 3785 raft_consensus.cc:513] T 41d33fbc861a40338ae6da1732fb696b P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:57.200965 3711 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "41d33fbc861a40338ae6da1732fb696b" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
I20250625 03:31:57.200701 3534 catalog_manager.cc:5582] T b74d9f11c2bc4a7bb6431d6222d45175 P 01873d289e0b4f9f9184b251369502a9 reported cstate change: term changed from 2 to 3, leader changed from ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132) to 01873d289e0b4f9f9184b251369502a9 (127.0.106.129). New cstate: current_term: 3 leader_uuid: "01873d289e0b4f9f9184b251369502a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: HEALTHY } } }
I20250625 03:31:57.201548 3711 raft_consensus.cc:3058] T 41d33fbc861a40338ae6da1732fb696b P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:57.209575 3711 raft_consensus.cc:2466] T 41d33fbc861a40338ae6da1732fb696b P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841018313ad649679de64e006582f4c5 in term 2.
I20250625 03:31:57.210745 3754 leader_election.cc:304] T 41d33fbc861a40338ae6da1732fb696b P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5b9823dfcd41cb92bd195c811cbf39, 841018313ad649679de64e006582f4c5; no voters:
I20250625 03:31:57.211750 4693 raft_consensus.cc:2802] T 41d33fbc861a40338ae6da1732fb696b P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:31:57.212285 4693 raft_consensus.cc:695] T 41d33fbc861a40338ae6da1732fb696b P 841018313ad649679de64e006582f4c5 [term 2 LEADER]: Becoming Leader. State: Replica: 841018313ad649679de64e006582f4c5, State: Running, Role: LEADER
I20250625 03:31:57.213434 3863 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "41d33fbc861a40338ae6da1732fb696b" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4"
I20250625 03:31:57.213577 3785 leader_election.cc:290] T 41d33fbc861a40338ae6da1732fb696b P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 2 election: Requested vote from peers 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041), ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353)
I20250625 03:31:57.213243 4693 consensus_queue.cc:237] T 41d33fbc861a40338ae6da1732fb696b P 841018313ad649679de64e006582f4c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:57.214064 3863 raft_consensus.cc:3053] T 41d33fbc861a40338ae6da1732fb696b P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:31:57.214412 3863 raft_consensus.cc:738] T 41d33fbc861a40338ae6da1732fb696b P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Running, Role: LEADER
I20250625 03:31:57.215327 3863 consensus_queue.cc:260] T 41d33fbc861a40338ae6da1732fb696b P ddc0ad67020f45edb3ba9c83cab687a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:57.216562 3863 raft_consensus.cc:3058] T 41d33fbc861a40338ae6da1732fb696b P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:57.222138 3863 raft_consensus.cc:2466] T 41d33fbc861a40338ae6da1732fb696b P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841018313ad649679de64e006582f4c5 in term 2.
I20250625 03:31:57.225078 3534 catalog_manager.cc:5582] T 41d33fbc861a40338ae6da1732fb696b P 841018313ad649679de64e006582f4c5 reported cstate change: term changed from 1 to 2, leader changed from ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132) to 841018313ad649679de64e006582f4c5 (127.0.106.131). New cstate: current_term: 2 leader_uuid: "841018313ad649679de64e006582f4c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:57.471334 3710 raft_consensus.cc:1273] T c5a9463f96314a83b7955d80444b1c29 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Refusing update from remote peer 01873d289e0b4f9f9184b251369502a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:57.472918 4625 consensus_queue.cc:1035] T c5a9463f96314a83b7955d80444b1c29 P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:57.484444 3785 raft_consensus.cc:1273] T c5a9463f96314a83b7955d80444b1c29 P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Refusing update from remote peer 01873d289e0b4f9f9184b251369502a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:57.486030 4625 consensus_queue.cc:1035] T c5a9463f96314a83b7955d80444b1c29 P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:57.574714 4690 raft_consensus.cc:991] T 39880aedaeca464f81d899dc222a35b9 P ddc0ad67020f45edb3ba9c83cab687a4: : Instructing follower 01873d289e0b4f9f9184b251369502a9 to start an election
I20250625 03:31:57.575139 4612 raft_consensus.cc:1079] T 39880aedaeca464f81d899dc222a35b9 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 LEADER]: Signalling peer 01873d289e0b4f9f9184b251369502a9 to start an election
I20250625 03:31:57.576520 4426 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "39880aedaeca464f81d899dc222a35b9"
dest_uuid: "01873d289e0b4f9f9184b251369502a9"
from {username='slave'} at 127.0.0.1:45156
I20250625 03:31:57.576952 4426 raft_consensus.cc:491] T 39880aedaeca464f81d899dc222a35b9 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:31:57.577327 4426 raft_consensus.cc:3058] T 39880aedaeca464f81d899dc222a35b9 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:57.582814 4426 raft_consensus.cc:513] T 39880aedaeca464f81d899dc222a35b9 P 01873d289e0b4f9f9184b251369502a9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:57.585237 3785 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "39880aedaeca464f81d899dc222a35b9" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "841018313ad649679de64e006582f4c5"
I20250625 03:31:57.585268 4426 leader_election.cc:290] T 39880aedaeca464f81d899dc222a35b9 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 2 election: Requested vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353)
I20250625 03:31:57.585472 3858 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "39880aedaeca464f81d899dc222a35b9" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4"
I20250625 03:31:57.586108 3785 raft_consensus.cc:3058] T 39880aedaeca464f81d899dc222a35b9 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:57.586290 3858 raft_consensus.cc:3053] T 39880aedaeca464f81d899dc222a35b9 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:31:57.586824 3858 raft_consensus.cc:738] T 39880aedaeca464f81d899dc222a35b9 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Running, Role: LEADER
I20250625 03:31:57.587673 3858 consensus_queue.cc:260] T 39880aedaeca464f81d899dc222a35b9 P ddc0ad67020f45edb3ba9c83cab687a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:57.588954 3858 raft_consensus.cc:3058] T 39880aedaeca464f81d899dc222a35b9 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:57.594863 3785 raft_consensus.cc:2466] T 39880aedaeca464f81d899dc222a35b9 P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01873d289e0b4f9f9184b251369502a9 in term 2.
I20250625 03:31:57.596124 3858 raft_consensus.cc:2466] T 39880aedaeca464f81d899dc222a35b9 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01873d289e0b4f9f9184b251369502a9 in term 2.
I20250625 03:31:57.596139 4375 leader_election.cc:304] T 39880aedaeca464f81d899dc222a35b9 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9, 841018313ad649679de64e006582f4c5; no voters:
I20250625 03:31:57.597151 4625 raft_consensus.cc:2802] T 39880aedaeca464f81d899dc222a35b9 P 01873d289e0b4f9f9184b251369502a9 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:31:57.597664 4625 raft_consensus.cc:695] T 39880aedaeca464f81d899dc222a35b9 P 01873d289e0b4f9f9184b251369502a9 [term 2 LEADER]: Becoming Leader. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Running, Role: LEADER
I20250625 03:31:57.598565 4625 consensus_queue.cc:237] T 39880aedaeca464f81d899dc222a35b9 P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:31:57.611294 3536 catalog_manager.cc:5582] T 39880aedaeca464f81d899dc222a35b9 P 01873d289e0b4f9f9184b251369502a9 reported cstate change: term changed from 1 to 2, leader changed from ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132) to 01873d289e0b4f9f9184b251369502a9 (127.0.106.129). New cstate: current_term: 2 leader_uuid: "01873d289e0b4f9f9184b251369502a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: HEALTHY } } }
I20250625 03:31:57.629580 3785 raft_consensus.cc:1273] T 6fc84ca2087c4ded91412fb32117af48 P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Refusing update from remote peer 3d5b9823dfcd41cb92bd195c811cbf39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:57.631589 4592 consensus_queue.cc:1035] T 6fc84ca2087c4ded91412fb32117af48 P 3d5b9823dfcd41cb92bd195c811cbf39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:57.632789 3858 raft_consensus.cc:1273] T 6fc84ca2087c4ded91412fb32117af48 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Refusing update from remote peer 3d5b9823dfcd41cb92bd195c811cbf39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:57.634126 4592 consensus_queue.cc:1035] T 6fc84ca2087c4ded91412fb32117af48 P 3d5b9823dfcd41cb92bd195c811cbf39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:57.675603 3710 raft_consensus.cc:1273] T 41d33fbc861a40338ae6da1732fb696b P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Refusing update from remote peer 841018313ad649679de64e006582f4c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:57.676833 4676 consensus_queue.cc:1035] T 41d33fbc861a40338ae6da1732fb696b P 841018313ad649679de64e006582f4c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:57.685912 3858 raft_consensus.cc:1273] T 41d33fbc861a40338ae6da1732fb696b P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Refusing update from remote peer 841018313ad649679de64e006582f4c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:57.687459 4676 consensus_queue.cc:1035] T 41d33fbc861a40338ae6da1732fb696b P 841018313ad649679de64e006582f4c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:57.724550 3785 raft_consensus.cc:1273] T b74d9f11c2bc4a7bb6431d6222d45175 P 841018313ad649679de64e006582f4c5 [term 3 FOLLOWER]: Refusing update from remote peer 01873d289e0b4f9f9184b251369502a9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250625 03:31:57.726187 4625 consensus_queue.cc:1035] T b74d9f11c2bc4a7bb6431d6222d45175 P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:31:57.738801 3858 raft_consensus.cc:1273] T b74d9f11c2bc4a7bb6431d6222d45175 P ddc0ad67020f45edb3ba9c83cab687a4 [term 3 FOLLOWER]: Refusing update from remote peer 01873d289e0b4f9f9184b251369502a9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250625 03:31:57.741369 4685 consensus_queue.cc:1035] T b74d9f11c2bc4a7bb6431d6222d45175 P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:31:58.016719 3858 raft_consensus.cc:1273] T 39880aedaeca464f81d899dc222a35b9 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Refusing update from remote peer 01873d289e0b4f9f9184b251369502a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:58.017907 4685 consensus_queue.cc:1035] T 39880aedaeca464f81d899dc222a35b9 P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:58.026813 3785 raft_consensus.cc:1273] T 39880aedaeca464f81d899dc222a35b9 P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Refusing update from remote peer 01873d289e0b4f9f9184b251369502a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:58.028638 4625 consensus_queue.cc:1035] T 39880aedaeca464f81d899dc222a35b9 P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:31:58.036547 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:31:58.079988 3858 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "526951ad467a4708926096ed1162a722"
dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4"
mode: GRACEFUL
new_leader_uuid: "01873d289e0b4f9f9184b251369502a9"
from {username='slave'} at 127.0.0.1:36556
I20250625 03:31:58.080648 3858 raft_consensus.cc:604] T 526951ad467a4708926096ed1162a722 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 LEADER]: Received request to transfer leadership to TS 01873d289e0b4f9f9184b251369502a9
I20250625 03:31:58.083056 3863 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "6afeedd3b768470f921526d58704c21d"
dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4"
mode: GRACEFUL
new_leader_uuid: "01873d289e0b4f9f9184b251369502a9"
from {username='slave'} at 127.0.0.1:36556
I20250625 03:31:58.083679 3863 raft_consensus.cc:604] T 6afeedd3b768470f921526d58704c21d P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 LEADER]: Received request to transfer leadership to TS 01873d289e0b4f9f9184b251369502a9
I20250625 03:31:58.086349 3710 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "8ee7d6306b5146ed90a1b8392e062172"
dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
mode: GRACEFUL
new_leader_uuid: "01873d289e0b4f9f9184b251369502a9"
from {username='slave'} at 127.0.0.1:42980
I20250625 03:31:58.086827 3710 raft_consensus.cc:604] T 8ee7d6306b5146ed90a1b8392e062172 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 LEADER]: Received request to transfer leadership to TS 01873d289e0b4f9f9184b251369502a9
I20250625 03:31:58.088898 3858 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "d08de4c2326d46bab26f42d8d483ebd0"
dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4"
mode: GRACEFUL
new_leader_uuid: "01873d289e0b4f9f9184b251369502a9"
from {username='slave'} at 127.0.0.1:36556
I20250625 03:31:58.089403 3858 raft_consensus.cc:604] T d08de4c2326d46bab26f42d8d483ebd0 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 LEADER]: Received request to transfer leadership to TS 01873d289e0b4f9f9184b251369502a9
I20250625 03:31:58.091382 3785 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "d657bcfa8eea4e7db43d4d2715857516"
dest_uuid: "841018313ad649679de64e006582f4c5"
mode: GRACEFUL
new_leader_uuid: "01873d289e0b4f9f9184b251369502a9"
from {username='slave'} at 127.0.0.1:60686
I20250625 03:31:58.091851 3785 raft_consensus.cc:604] T d657bcfa8eea4e7db43d4d2715857516 P 841018313ad649679de64e006582f4c5 [term 1 LEADER]: Received request to transfer leadership to TS 01873d289e0b4f9f9184b251369502a9
I20250625 03:31:58.092805 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20250625 03:31:58.093880 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:31:58.094405 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:31:58.109817 4676 raft_consensus.cc:991] T d657bcfa8eea4e7db43d4d2715857516 P 841018313ad649679de64e006582f4c5: : Instructing follower 01873d289e0b4f9f9184b251369502a9 to start an election
I20250625 03:31:58.110363 4676 raft_consensus.cc:1079] T d657bcfa8eea4e7db43d4d2715857516 P 841018313ad649679de64e006582f4c5 [term 1 LEADER]: Signalling peer 01873d289e0b4f9f9184b251369502a9 to start an election
I20250625 03:31:58.112569 4422 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "d657bcfa8eea4e7db43d4d2715857516"
dest_uuid: "01873d289e0b4f9f9184b251369502a9"
from {username='slave'} at 127.0.0.1:45168
I20250625 03:31:58.113059 4422 raft_consensus.cc:491] T d657bcfa8eea4e7db43d4d2715857516 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:31:58.113310 4422 raft_consensus.cc:3058] T d657bcfa8eea4e7db43d4d2715857516 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:58.157960 4422 raft_consensus.cc:513] T d657bcfa8eea4e7db43d4d2715857516 P 01873d289e0b4f9f9184b251369502a9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:58.226491 4612 raft_consensus.cc:991] T 6afeedd3b768470f921526d58704c21d P ddc0ad67020f45edb3ba9c83cab687a4: : Instructing follower 01873d289e0b4f9f9184b251369502a9 to start an election
W20250625 03:31:58.226640 4374 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.132:37353, user_credentials={real_user=slave}} blocked reactor thread for 51552.2us
I20250625 03:31:58.227878 4717 raft_consensus.cc:1079] T 6afeedd3b768470f921526d58704c21d P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 LEADER]: Signalling peer 01873d289e0b4f9f9184b251369502a9 to start an election
I20250625 03:31:58.228355 4422 leader_election.cc:290] T d657bcfa8eea4e7db43d4d2715857516 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 2 election: Requested vote from peers 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041), 841018313ad649679de64e006582f4c5 (127.0.106.131:39467)
I20250625 03:31:58.229377 3710 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d657bcfa8eea4e7db43d4d2715857516" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
I20250625 03:31:58.229948 3710 raft_consensus.cc:3058] T d657bcfa8eea4e7db43d4d2715857516 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:58.231294 3789 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d657bcfa8eea4e7db43d4d2715857516" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "841018313ad649679de64e006582f4c5"
I20250625 03:31:58.231848 3789 raft_consensus.cc:3053] T d657bcfa8eea4e7db43d4d2715857516 P 841018313ad649679de64e006582f4c5 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:31:58.232172 3789 raft_consensus.cc:738] T d657bcfa8eea4e7db43d4d2715857516 P 841018313ad649679de64e006582f4c5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 841018313ad649679de64e006582f4c5, State: Running, Role: LEADER
I20250625 03:31:58.232867 3789 consensus_queue.cc:260] T d657bcfa8eea4e7db43d4d2715857516 P 841018313ad649679de64e006582f4c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:58.233883 3789 raft_consensus.cc:3058] T d657bcfa8eea4e7db43d4d2715857516 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:58.241802 3710 raft_consensus.cc:2466] T d657bcfa8eea4e7db43d4d2715857516 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01873d289e0b4f9f9184b251369502a9 in term 2.
W20250625 03:31:58.247793 3828 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:37771, user_credentials={real_user=slave}} blocked reactor thread for 122474us
I20250625 03:31:58.253881 3789 raft_consensus.cc:2466] T d657bcfa8eea4e7db43d4d2715857516 P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01873d289e0b4f9f9184b251369502a9 in term 2.
I20250625 03:31:58.255882 4375 leader_election.cc:304] T d657bcfa8eea4e7db43d4d2715857516 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9, 3d5b9823dfcd41cb92bd195c811cbf39; no voters:
I20250625 03:31:58.256698 4625 raft_consensus.cc:2802] T d657bcfa8eea4e7db43d4d2715857516 P 01873d289e0b4f9f9184b251369502a9 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:31:58.257194 4625 raft_consensus.cc:695] T d657bcfa8eea4e7db43d4d2715857516 P 01873d289e0b4f9f9184b251369502a9 [term 2 LEADER]: Becoming Leader. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Running, Role: LEADER
I20250625 03:31:58.258045 4625 consensus_queue.cc:237] T d657bcfa8eea4e7db43d4d2715857516 P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:31:58.270206 4426 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "6afeedd3b768470f921526d58704c21d"
dest_uuid: "01873d289e0b4f9f9184b251369502a9"
from {username='slave'} at 127.0.0.1:45156
I20250625 03:31:58.270862 4426 raft_consensus.cc:491] T 6afeedd3b768470f921526d58704c21d P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:31:58.271162 4426 raft_consensus.cc:3058] T 6afeedd3b768470f921526d58704c21d P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:58.278498 4426 raft_consensus.cc:513] T 6afeedd3b768470f921526d58704c21d P 01873d289e0b4f9f9184b251369502a9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:58.282184 3863 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6afeedd3b768470f921526d58704c21d" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4"
I20250625 03:31:58.282773 3863 raft_consensus.cc:3053] T 6afeedd3b768470f921526d58704c21d P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:31:58.283077 3863 raft_consensus.cc:738] T 6afeedd3b768470f921526d58704c21d P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Running, Role: LEADER
I20250625 03:31:58.285437 3863 consensus_queue.cc:260] T 6afeedd3b768470f921526d58704c21d P ddc0ad67020f45edb3ba9c83cab687a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:58.286652 3863 raft_consensus.cc:3058] T 6afeedd3b768470f921526d58704c21d P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:58.294441 3534 catalog_manager.cc:5582] T d657bcfa8eea4e7db43d4d2715857516 P 01873d289e0b4f9f9184b251369502a9 reported cstate change: term changed from 1 to 2, leader changed from 841018313ad649679de64e006582f4c5 (127.0.106.131) to 01873d289e0b4f9f9184b251369502a9 (127.0.106.129). New cstate: current_term: 2 leader_uuid: "01873d289e0b4f9f9184b251369502a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:58.295938 3863 raft_consensus.cc:2466] T 6afeedd3b768470f921526d58704c21d P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01873d289e0b4f9f9184b251369502a9 in term 2.
I20250625 03:31:58.297808 4374 leader_election.cc:304] T 6afeedd3b768470f921526d58704c21d P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9, ddc0ad67020f45edb3ba9c83cab687a4; no voters:
I20250625 03:31:58.299208 4625 raft_consensus.cc:2802] T 6afeedd3b768470f921526d58704c21d P 01873d289e0b4f9f9184b251369502a9 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:31:58.299870 4625 raft_consensus.cc:695] T 6afeedd3b768470f921526d58704c21d P 01873d289e0b4f9f9184b251369502a9 [term 2 LEADER]: Becoming Leader. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Running, Role: LEADER
I20250625 03:31:58.301041 4625 consensus_queue.cc:237] T 6afeedd3b768470f921526d58704c21d P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:58.306860 4426 leader_election.cc:290] T 6afeedd3b768470f921526d58704c21d P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 2 election: Requested vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:31:58.308478 3710 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6afeedd3b768470f921526d58704c21d" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
I20250625 03:31:58.309216 3710 raft_consensus.cc:3058] T 6afeedd3b768470f921526d58704c21d P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:58.320099 4612 raft_consensus.cc:991] T d08de4c2326d46bab26f42d8d483ebd0 P ddc0ad67020f45edb3ba9c83cab687a4: : Instructing follower 01873d289e0b4f9f9184b251369502a9 to start an election
I20250625 03:31:58.320603 4612 raft_consensus.cc:1079] T d08de4c2326d46bab26f42d8d483ebd0 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 LEADER]: Signalling peer 01873d289e0b4f9f9184b251369502a9 to start an election
I20250625 03:31:58.325311 4422 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "d08de4c2326d46bab26f42d8d483ebd0"
dest_uuid: "01873d289e0b4f9f9184b251369502a9"
from {username='slave'} at 127.0.0.1:45156
I20250625 03:31:58.325984 4422 raft_consensus.cc:491] T d08de4c2326d46bab26f42d8d483ebd0 P 01873d289e0b4f9f9184b251369502a9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:31:58.326440 4422 raft_consensus.cc:3058] T d08de4c2326d46bab26f42d8d483ebd0 P 01873d289e0b4f9f9184b251369502a9 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:58.330925 3710 raft_consensus.cc:2466] T 6afeedd3b768470f921526d58704c21d P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01873d289e0b4f9f9184b251369502a9 in term 2.
I20250625 03:31:58.338135 4422 raft_consensus.cc:513] T d08de4c2326d46bab26f42d8d483ebd0 P 01873d289e0b4f9f9184b251369502a9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:58.342767 3863 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d08de4c2326d46bab26f42d8d483ebd0" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4"
I20250625 03:31:58.343394 3863 raft_consensus.cc:3053] T d08de4c2326d46bab26f42d8d483ebd0 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 LEADER]: Stepping down as leader of term 2
I20250625 03:31:58.343698 3863 raft_consensus.cc:738] T d08de4c2326d46bab26f42d8d483ebd0 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Running, Role: LEADER
I20250625 03:31:58.344228 3710 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d08de4c2326d46bab26f42d8d483ebd0" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
I20250625 03:31:58.344502 3863 consensus_queue.cc:260] T d08de4c2326d46bab26f42d8d483ebd0 P ddc0ad67020f45edb3ba9c83cab687a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:58.344986 3710 raft_consensus.cc:3058] T d08de4c2326d46bab26f42d8d483ebd0 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:58.345624 3863 raft_consensus.cc:3058] T d08de4c2326d46bab26f42d8d483ebd0 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:58.353061 4422 leader_election.cc:290] T d08de4c2326d46bab26f42d8d483ebd0 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 3 election: Requested vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:31:58.354049 3863 raft_consensus.cc:2466] T d08de4c2326d46bab26f42d8d483ebd0 P ddc0ad67020f45edb3ba9c83cab687a4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01873d289e0b4f9f9184b251369502a9 in term 3.
I20250625 03:31:58.355701 3710 raft_consensus.cc:2466] T d08de4c2326d46bab26f42d8d483ebd0 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01873d289e0b4f9f9184b251369502a9 in term 3.
I20250625 03:31:58.357357 4374 leader_election.cc:304] T d08de4c2326d46bab26f42d8d483ebd0 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9, ddc0ad67020f45edb3ba9c83cab687a4; no voters:
I20250625 03:31:58.358487 4625 raft_consensus.cc:2802] T d08de4c2326d46bab26f42d8d483ebd0 P 01873d289e0b4f9f9184b251369502a9 [term 3 FOLLOWER]: Leader election won for term 3
I20250625 03:31:58.358943 4625 raft_consensus.cc:695] T d08de4c2326d46bab26f42d8d483ebd0 P 01873d289e0b4f9f9184b251369502a9 [term 3 LEADER]: Becoming Leader. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Running, Role: LEADER
I20250625 03:31:58.359724 4625 consensus_queue.cc:237] T d08de4c2326d46bab26f42d8d483ebd0 P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:58.390009 3534 catalog_manager.cc:5582] T 6afeedd3b768470f921526d58704c21d P 01873d289e0b4f9f9184b251369502a9 reported cstate change: term changed from 1 to 2, leader changed from ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132) to 01873d289e0b4f9f9184b251369502a9 (127.0.106.129). New cstate: current_term: 2 leader_uuid: "01873d289e0b4f9f9184b251369502a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:58.391324 3534 catalog_manager.cc:5582] T d08de4c2326d46bab26f42d8d483ebd0 P 01873d289e0b4f9f9184b251369502a9 reported cstate change: term changed from 2 to 3, leader changed from ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132) to 01873d289e0b4f9f9184b251369502a9 (127.0.106.129). New cstate: current_term: 3 leader_uuid: "01873d289e0b4f9f9184b251369502a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:58.463199 4612 raft_consensus.cc:991] T 526951ad467a4708926096ed1162a722 P ddc0ad67020f45edb3ba9c83cab687a4: : Instructing follower 01873d289e0b4f9f9184b251369502a9 to start an election
I20250625 03:31:58.463680 4612 raft_consensus.cc:1079] T 526951ad467a4708926096ed1162a722 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 LEADER]: Signalling peer 01873d289e0b4f9f9184b251369502a9 to start an election
I20250625 03:31:58.466390 4422 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "526951ad467a4708926096ed1162a722"
dest_uuid: "01873d289e0b4f9f9184b251369502a9"
from {username='slave'} at 127.0.0.1:45156
I20250625 03:31:58.466985 4422 raft_consensus.cc:491] T 526951ad467a4708926096ed1162a722 P 01873d289e0b4f9f9184b251369502a9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:31:58.467346 4422 raft_consensus.cc:3058] T 526951ad467a4708926096ed1162a722 P 01873d289e0b4f9f9184b251369502a9 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:58.475025 4422 raft_consensus.cc:513] T 526951ad467a4708926096ed1162a722 P 01873d289e0b4f9f9184b251369502a9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:58.483763 3858 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "526951ad467a4708926096ed1162a722" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4"
I20250625 03:31:58.484503 3858 raft_consensus.cc:3053] T 526951ad467a4708926096ed1162a722 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 LEADER]: Stepping down as leader of term 2
I20250625 03:31:58.484853 3858 raft_consensus.cc:738] T 526951ad467a4708926096ed1162a722 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ddc0ad67020f45edb3ba9c83cab687a4, State: Running, Role: LEADER
I20250625 03:31:58.485703 3858 consensus_queue.cc:260] T 526951ad467a4708926096ed1162a722 P ddc0ad67020f45edb3ba9c83cab687a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:58.486945 3858 raft_consensus.cc:3058] T 526951ad467a4708926096ed1162a722 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:58.497490 3711 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "526951ad467a4708926096ed1162a722" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
I20250625 03:31:58.498123 3711 raft_consensus.cc:3058] T 526951ad467a4708926096ed1162a722 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:58.504926 3711 raft_consensus.cc:2466] T 526951ad467a4708926096ed1162a722 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01873d289e0b4f9f9184b251369502a9 in term 3.
I20250625 03:31:58.496522 4422 leader_election.cc:290] T 526951ad467a4708926096ed1162a722 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 3 election: Requested vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:31:58.507206 4375 leader_election.cc:304] T 526951ad467a4708926096ed1162a722 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9, 3d5b9823dfcd41cb92bd195c811cbf39; no voters:
I20250625 03:31:58.507985 4624 raft_consensus.cc:2802] T 526951ad467a4708926096ed1162a722 P 01873d289e0b4f9f9184b251369502a9 [term 3 FOLLOWER]: Leader election won for term 3
I20250625 03:31:58.495858 3858 raft_consensus.cc:2466] T 526951ad467a4708926096ed1162a722 P ddc0ad67020f45edb3ba9c83cab687a4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01873d289e0b4f9f9184b251369502a9 in term 3.
I20250625 03:31:58.508544 4624 raft_consensus.cc:695] T 526951ad467a4708926096ed1162a722 P 01873d289e0b4f9f9184b251369502a9 [term 3 LEADER]: Becoming Leader. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Running, Role: LEADER
I20250625 03:31:58.509506 4624 consensus_queue.cc:237] T 526951ad467a4708926096ed1162a722 P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:58.522418 3534 catalog_manager.cc:5582] T 526951ad467a4708926096ed1162a722 P 01873d289e0b4f9f9184b251369502a9 reported cstate change: term changed from 2 to 3, leader changed from ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132) to 01873d289e0b4f9f9184b251369502a9 (127.0.106.129). New cstate: current_term: 3 leader_uuid: "01873d289e0b4f9f9184b251369502a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: UNKNOWN } } }
W20250625 03:31:58.662292 4375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.131:39467, user_credentials={real_user=slave}} blocked reactor thread for 48244.4us
I20250625 03:31:58.674715 4592 raft_consensus.cc:991] T 8ee7d6306b5146ed90a1b8392e062172 P 3d5b9823dfcd41cb92bd195c811cbf39: : Instructing follower 01873d289e0b4f9f9184b251369502a9 to start an election
I20250625 03:31:58.677825 4592 raft_consensus.cc:1079] T 8ee7d6306b5146ed90a1b8392e062172 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 LEADER]: Signalling peer 01873d289e0b4f9f9184b251369502a9 to start an election
I20250625 03:31:58.682277 3789 raft_consensus.cc:1273] T d657bcfa8eea4e7db43d4d2715857516 P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Refusing update from remote peer 01873d289e0b4f9f9184b251369502a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:58.689692 4420 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "8ee7d6306b5146ed90a1b8392e062172"
dest_uuid: "01873d289e0b4f9f9184b251369502a9"
from {username='slave'} at 127.0.0.1:45172
I20250625 03:31:58.690518 4420 raft_consensus.cc:491] T 8ee7d6306b5146ed90a1b8392e062172 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:31:58.690974 4420 raft_consensus.cc:3058] T 8ee7d6306b5146ed90a1b8392e062172 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:58.710548 4625 consensus_queue.cc:1035] T d657bcfa8eea4e7db43d4d2715857516 P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20250625 03:31:58.734941 4420 raft_consensus.cc:513] T 8ee7d6306b5146ed90a1b8392e062172 P 01873d289e0b4f9f9184b251369502a9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:58.741449 4420 leader_election.cc:290] T 8ee7d6306b5146ed90a1b8392e062172 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 2 election: Requested vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:31:58.742208 3863 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8ee7d6306b5146ed90a1b8392e062172" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4"
I20250625 03:31:58.743247 3863 raft_consensus.cc:3058] T 8ee7d6306b5146ed90a1b8392e062172 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:58.743440 3710 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8ee7d6306b5146ed90a1b8392e062172" candidate_uuid: "01873d289e0b4f9f9184b251369502a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
I20250625 03:31:58.744189 3710 raft_consensus.cc:3053] T 8ee7d6306b5146ed90a1b8392e062172 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:31:58.744519 3710 raft_consensus.cc:738] T 8ee7d6306b5146ed90a1b8392e062172 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Running, Role: LEADER
I20250625 03:31:58.750401 3710 consensus_queue.cc:260] T 8ee7d6306b5146ed90a1b8392e062172 P 3d5b9823dfcd41cb92bd195c811cbf39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:58.771080 3710 raft_consensus.cc:3058] T 8ee7d6306b5146ed90a1b8392e062172 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:31:58.892818 3710 raft_consensus.cc:2466] T 8ee7d6306b5146ed90a1b8392e062172 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01873d289e0b4f9f9184b251369502a9 in term 2.
I20250625 03:31:58.914026 3711 raft_consensus.cc:1273] T d657bcfa8eea4e7db43d4d2715857516 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Refusing update from remote peer 01873d289e0b4f9f9184b251369502a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:58.919442 3863 raft_consensus.cc:2466] T 8ee7d6306b5146ed90a1b8392e062172 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01873d289e0b4f9f9184b251369502a9 in term 2.
I20250625 03:31:59.002310 4374 leader_election.cc:304] T 8ee7d6306b5146ed90a1b8392e062172 P 01873d289e0b4f9f9184b251369502a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01873d289e0b4f9f9184b251369502a9, ddc0ad67020f45edb3ba9c83cab687a4; no voters:
I20250625 03:31:59.041735 4729 raft_consensus.cc:2802] T 8ee7d6306b5146ed90a1b8392e062172 P 01873d289e0b4f9f9184b251369502a9 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:31:59.055320 3710 raft_consensus.cc:1273] T 6afeedd3b768470f921526d58704c21d P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Refusing update from remote peer 01873d289e0b4f9f9184b251369502a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:59.052999 4729 raft_consensus.cc:695] T 8ee7d6306b5146ed90a1b8392e062172 P 01873d289e0b4f9f9184b251369502a9 [term 2 LEADER]: Becoming Leader. State: Replica: 01873d289e0b4f9f9184b251369502a9, State: Running, Role: LEADER
I20250625 03:31:59.058312 3710 raft_consensus.cc:1273] T d08de4c2326d46bab26f42d8d483ebd0 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 3 FOLLOWER]: Refusing update from remote peer 01873d289e0b4f9f9184b251369502a9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250625 03:31:59.058562 4729 consensus_queue.cc:237] T 8ee7d6306b5146ed90a1b8392e062172 P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:31:59.126925 4737 consensus_queue.cc:1035] T 6afeedd3b768470f921526d58704c21d P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20250625 03:31:59.139046 3828 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.131:39467, user_credentials={real_user=slave}} blocked reactor thread for 59772.5us
I20250625 03:31:59.175583 4731 consensus_queue.cc:1035] T d657bcfa8eea4e7db43d4d2715857516 P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.099s
I20250625 03:31:59.179616 3860 raft_consensus.cc:1273] T 6afeedd3b768470f921526d58704c21d P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Refusing update from remote peer 01873d289e0b4f9f9184b251369502a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:59.190239 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:31:59.248792 4624 consensus_queue.cc:1035] T 6afeedd3b768470f921526d58704c21d P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20250625 03:31:59.260757 4730 consensus_queue.cc:1035] T d08de4c2326d46bab26f42d8d483ebd0 P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20250625 03:31:59.262876 3859 raft_consensus.cc:1273] T d08de4c2326d46bab26f42d8d483ebd0 P ddc0ad67020f45edb3ba9c83cab687a4 [term 3 FOLLOWER]: Refusing update from remote peer 01873d289e0b4f9f9184b251369502a9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250625 03:31:59.266942 3860 raft_consensus.cc:1273] T 526951ad467a4708926096ed1162a722 P ddc0ad67020f45edb3ba9c83cab687a4 [term 3 FOLLOWER]: Refusing update from remote peer 01873d289e0b4f9f9184b251369502a9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250625 03:31:59.290870 3711 raft_consensus.cc:1273] T 526951ad467a4708926096ed1162a722 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 3 FOLLOWER]: Refusing update from remote peer 01873d289e0b4f9f9184b251369502a9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250625 03:31:59.293813 4731 consensus_queue.cc:1035] T d08de4c2326d46bab26f42d8d483ebd0 P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20250625 03:31:59.294253 4745 consensus_queue.cc:1035] T 526951ad467a4708926096ed1162a722 P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20250625 03:31:59.327103 3679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.132:37353, user_credentials={real_user=slave}} blocked reactor thread for 263458us
W20250625 03:31:59.368444 3680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:37771, user_credentials={real_user=slave}} blocked reactor thread for 57021.5us
I20250625 03:31:59.384542 3534 catalog_manager.cc:5582] T 8ee7d6306b5146ed90a1b8392e062172 P 01873d289e0b4f9f9184b251369502a9 reported cstate change: term changed from 1 to 2, leader changed from 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130) to 01873d289e0b4f9f9184b251369502a9 (127.0.106.129). New cstate: current_term: 2 leader_uuid: "01873d289e0b4f9f9184b251369502a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: UNKNOWN } } }
I20250625 03:31:59.419730 4746 consensus_queue.cc:1035] T 526951ad467a4708926096ed1162a722 P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.102s
I20250625 03:31:59.435309 3714 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "2e956665b7e4411f86cf77259093c8aa"
dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
mode: GRACEFUL
new_leader_uuid: "841018313ad649679de64e006582f4c5"
from {username='slave'} at 127.0.0.1:42980
I20250625 03:31:59.435961 3714 raft_consensus.cc:604] T 2e956665b7e4411f86cf77259093c8aa P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 LEADER]: Received request to transfer leadership to TS 841018313ad649679de64e006582f4c5
I20250625 03:31:59.440064 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 1
I20250625 03:31:59.442250 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:31:59.443544 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:31:59.687757 3858 raft_consensus.cc:1273] T 8ee7d6306b5146ed90a1b8392e062172 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Refusing update from remote peer 01873d289e0b4f9f9184b251369502a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:31:59.691077 4746 consensus_queue.cc:1035] T 8ee7d6306b5146ed90a1b8392e062172 P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20250625 03:31:59.820924 4766 raft_consensus.cc:991] T 2e956665b7e4411f86cf77259093c8aa P 3d5b9823dfcd41cb92bd195c811cbf39: : Instructing follower 841018313ad649679de64e006582f4c5 to start an election
I20250625 03:31:59.821424 4766 raft_consensus.cc:1079] T 2e956665b7e4411f86cf77259093c8aa P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 LEADER]: Signalling peer 841018313ad649679de64e006582f4c5 to start an election
I20250625 03:31:59.824134 3783 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "2e956665b7e4411f86cf77259093c8aa"
dest_uuid: "841018313ad649679de64e006582f4c5"
from {username='slave'} at 127.0.0.1:40292
I20250625 03:31:59.824721 3783 raft_consensus.cc:491] T 2e956665b7e4411f86cf77259093c8aa P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:31:59.825106 3783 raft_consensus.cc:3058] T 2e956665b7e4411f86cf77259093c8aa P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:31:59.832509 3783 raft_consensus.cc:513] T 2e956665b7e4411f86cf77259093c8aa P 841018313ad649679de64e006582f4c5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:31:59.834699 3783 leader_election.cc:290] T 2e956665b7e4411f86cf77259093c8aa P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 3 election: Requested vote from peers 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041), ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353)
W20250625 03:31:59.871909 3884 debug-util.cc:398] Leaking SignalData structure 0x7b0800369de0 after lost signal to thread 429
W20250625 03:31:59.873426 3884 debug-util.cc:398] Leaking SignalData structure 0x7b08001d1520 after lost signal to thread 3572
W20250625 03:31:59.874912 3884 debug-util.cc:398] Leaking SignalData structure 0x7b08001f5ac0 after lost signal to thread 3739
W20250625 03:31:59.969413 3884 debug-util.cc:398] Leaking SignalData structure 0x7b08002904c0 after lost signal to thread 3813
W20250625 03:31:59.970901 3884 debug-util.cc:398] Leaking SignalData structure 0x7b08000b0f40 after lost signal to thread 3887
W20250625 03:31:59.972396 3884 debug-util.cc:398] Leaking SignalData structure 0x7b080024ff40 after lost signal to thread 4454
I20250625 03:32:00.040341 3854 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2e956665b7e4411f86cf77259093c8aa" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4"
I20250625 03:32:00.048349 3854 raft_consensus.cc:3058] T 2e956665b7e4411f86cf77259093c8aa P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Advancing to term 3
W20250625 03:32:00.056288 3680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.131:39467, user_credentials={real_user=slave}} blocked reactor thread for 48186.1us
I20250625 03:32:00.069770 3854 raft_consensus.cc:2466] T 2e956665b7e4411f86cf77259093c8aa P ddc0ad67020f45edb3ba9c83cab687a4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841018313ad649679de64e006582f4c5 in term 3.
I20250625 03:32:00.090860 3860 raft_consensus.cc:1238] T 2e956665b7e4411f86cf77259093c8aa P ddc0ad67020f45edb3ba9c83cab687a4 [term 3 FOLLOWER]: Rejecting Update request from peer 3d5b9823dfcd41cb92bd195c811cbf39 for earlier term 2. Current term is 3. Ops: []
I20250625 03:32:00.093581 4766 consensus_queue.cc:1046] T 2e956665b7e4411f86cf77259093c8aa P 3d5b9823dfcd41cb92bd195c811cbf39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:32:00.094424 4766 raft_consensus.cc:3053] T 2e956665b7e4411f86cf77259093c8aa P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 LEADER]: Stepping down as leader of term 2
I20250625 03:32:00.094708 4766 raft_consensus.cc:738] T 2e956665b7e4411f86cf77259093c8aa P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3d5b9823dfcd41cb92bd195c811cbf39, State: Running, Role: LEADER
I20250625 03:32:00.095374 4766 consensus_queue.cc:260] T 2e956665b7e4411f86cf77259093c8aa P 3d5b9823dfcd41cb92bd195c811cbf39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:32:00.096431 4766 raft_consensus.cc:3058] T 2e956665b7e4411f86cf77259093c8aa P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:32:00.097401 3753 leader_election.cc:304] T 2e956665b7e4411f86cf77259093c8aa P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841018313ad649679de64e006582f4c5, ddc0ad67020f45edb3ba9c83cab687a4; no voters:
I20250625 03:32:00.098951 4771 raft_consensus.cc:2802] T 2e956665b7e4411f86cf77259093c8aa P 841018313ad649679de64e006582f4c5 [term 3 FOLLOWER]: Leader election won for term 3
I20250625 03:32:00.099428 4771 raft_consensus.cc:695] T 2e956665b7e4411f86cf77259093c8aa P 841018313ad649679de64e006582f4c5 [term 3 LEADER]: Becoming Leader. State: Replica: 841018313ad649679de64e006582f4c5, State: Running, Role: LEADER
I20250625 03:32:00.100363 4771 consensus_queue.cc:237] T 2e956665b7e4411f86cf77259093c8aa P 841018313ad649679de64e006582f4c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
W20250625 03:32:00.108203 3754 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.130:42041, user_credentials={real_user=slave}} blocked reactor thread for 71914.8us
I20250625 03:32:00.116809 3712 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2e956665b7e4411f86cf77259093c8aa" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3d5b9823dfcd41cb92bd195c811cbf39"
I20250625 03:32:00.167730 3711 raft_consensus.cc:1273] T 8ee7d6306b5146ed90a1b8392e062172 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Refusing update from remote peer 01873d289e0b4f9f9184b251369502a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:32:00.170382 3534 catalog_manager.cc:5582] T 2e956665b7e4411f86cf77259093c8aa P 841018313ad649679de64e006582f4c5 reported cstate change: term changed from 2 to 3, leader changed from 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130) to 841018313ad649679de64e006582f4c5 (127.0.106.131). New cstate: current_term: 3 leader_uuid: "841018313ad649679de64e006582f4c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } health_report { overall_health: UNKNOWN } } }
I20250625 03:32:00.176548 3712 raft_consensus.cc:2466] T 2e956665b7e4411f86cf77259093c8aa P 3d5b9823dfcd41cb92bd195c811cbf39 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841018313ad649679de64e006582f4c5 in term 3.
I20250625 03:32:00.249375 4745 consensus_queue.cc:1035] T 8ee7d6306b5146ed90a1b8392e062172 P 01873d289e0b4f9f9184b251369502a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20250625 03:32:00.290508 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/master/auto_leader_rebalancer-test.cc:471: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 1
I20250625 03:32:00.424023 426 tablet_server.cc:178] TabletServer@127.0.106.129:37771 shutting down...
W20250625 03:32:00.450728 3754 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 81 similar messages]
W20250625 03:32:00.481534 3754 consensus_peers.cc:487] T ea706d649de940bf8652264ed57a901f P 841018313ad649679de64e006582f4c5 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250625 03:32:00.484927 3828 consensus_peers.cc:487] T 036dfe9e6b844fc6964b3b5e371f8c95 P ddc0ad67020f45edb3ba9c83cab687a4 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250625 03:32:00.486016 3680 consensus_peers.cc:487] T 9d985eca3d6f497c86b94c53f16c8ae5 P 3d5b9823dfcd41cb92bd195c811cbf39 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250625 03:32:00.487586 3754 consensus_peers.cc:487] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 841018313ad649679de64e006582f4c5 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:32:00.512616 426 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250625 03:32:00.513752 426 tablet_replica.cc:331] stopping tablet replica
I20250625 03:32:00.514865 426 raft_consensus.cc:2241] T 7e92fd94b9f24b1097e9a7373896cb26 P 01873d289e0b4f9f9184b251369502a9 [term 3 LEADER]: Raft consensus shutting down.
I20250625 03:32:00.515781 426 raft_consensus.cc:2270] T 7e92fd94b9f24b1097e9a7373896cb26 P 01873d289e0b4f9f9184b251369502a9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:00.518141 426 tablet_replica.cc:331] stopping tablet replica
I20250625 03:32:00.519073 426 raft_consensus.cc:2241] T c592f2c5305141c487b73e0867d0f36b P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:00.519483 426 raft_consensus.cc:2270] T c592f2c5305141c487b73e0867d0f36b P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:00.521764 426 tablet_replica.cc:331] stopping tablet replica
I20250625 03:32:00.522414 426 raft_consensus.cc:2241] T aa64717b3f7d4af893e9908260f4520e P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:00.522913 426 raft_consensus.cc:2270] T aa64717b3f7d4af893e9908260f4520e P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:00.526070 426 tablet_replica.cc:331] stopping tablet replica
I20250625 03:32:00.526852 426 raft_consensus.cc:2241] T 8ee7d6306b5146ed90a1b8392e062172 P 01873d289e0b4f9f9184b251369502a9 [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:32:00.527865 426 raft_consensus.cc:2270] T 8ee7d6306b5146ed90a1b8392e062172 P 01873d289e0b4f9f9184b251369502a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:00.532212 426 tablet_replica.cc:331] stopping tablet replica
I20250625 03:32:00.533864 426 raft_consensus.cc:2241] T b6311a11ae9e44bea3a7340b8134679b P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:00.534641 426 raft_consensus.cc:2270] T b6311a11ae9e44bea3a7340b8134679b P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:00.537479 426 tablet_replica.cc:331] stopping tablet replica
I20250625 03:32:00.538663 426 raft_consensus.cc:2241] T 28cf5da85c864698894ed4e1ee38cd86 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:00.539194 426 raft_consensus.cc:2270] T 28cf5da85c864698894ed4e1ee38cd86 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:00.540452 3861 raft_consensus.cc:1273] T 2e956665b7e4411f86cf77259093c8aa P ddc0ad67020f45edb3ba9c83cab687a4 [term 3 FOLLOWER]: Refusing update from remote peer 841018313ad649679de64e006582f4c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250625 03:32:00.542090 426 tablet_replica.cc:331] stopping tablet replica
I20250625 03:32:00.542258 4743 consensus_queue.cc:1035] T 2e956665b7e4411f86cf77259093c8aa P 841018313ad649679de64e006582f4c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20250625 03:32:00.544624 426 raft_consensus.cc:2241] T 526951ad467a4708926096ed1162a722 P 01873d289e0b4f9f9184b251369502a9 [term 3 LEADER]: Raft consensus shutting down.
I20250625 03:32:00.545744 426 raft_consensus.cc:2270] T 526951ad467a4708926096ed1162a722 P 01873d289e0b4f9f9184b251369502a9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:00.548884 426 tablet_replica.cc:331] stopping tablet replica
I20250625 03:32:00.549852 426 raft_consensus.cc:2241] T b74d9f11c2bc4a7bb6431d6222d45175 P 01873d289e0b4f9f9184b251369502a9 [term 3 LEADER]: Raft consensus shutting down.
I20250625 03:32:00.550982 426 raft_consensus.cc:2270] T b74d9f11c2bc4a7bb6431d6222d45175 P 01873d289e0b4f9f9184b251369502a9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:00.554041 426 tablet_replica.cc:331] stopping tablet replica
I20250625 03:32:00.556067 426 raft_consensus.cc:2241] T 485f3e9350e245a9939133866b354302 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:00.557276 426 raft_consensus.cc:2270] T 485f3e9350e245a9939133866b354302 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:00.560464 426 tablet_replica.cc:331] stopping tablet replica
I20250625 03:32:00.561466 426 raft_consensus.cc:2241] T d657bcfa8eea4e7db43d4d2715857516 P 01873d289e0b4f9f9184b251369502a9 [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:32:00.563596 426 raft_consensus.cc:2270] T d657bcfa8eea4e7db43d4d2715857516 P 01873d289e0b4f9f9184b251369502a9 [term 2 FOLLOWER]: Raft consensus is shut down!
W20250625 03:32:00.566478 3828 consensus_peers.cc:487] T b6311a11ae9e44bea3a7340b8134679b P ddc0ad67020f45edb3ba9c83cab687a4 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:32:00.567145 426 tablet_replica.cc:331] stopping tablet replica
I20250625 03:32:00.568432 426 raft_consensus.cc:2241] T 7c1dda599f144ecfab4c075ee4e28c16 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:00.569064 426 raft_consensus.cc:2270] T 7c1dda599f144ecfab4c075ee4e28c16 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250625 03:32:00.569681 3828 consensus_peers.cc:487] T 28cf5da85c864698894ed4e1ee38cd86 P ddc0ad67020f45edb3ba9c83cab687a4 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250625 03:32:00.573336 3828 consensus_peers.cc:487] T 5dc5a179a27f462989b291e8133742da P ddc0ad67020f45edb3ba9c83cab687a4 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250625 03:32:00.574832 3828 consensus_peers.cc:487] T 049948eeceeb43c98ccda9e839b521a8 P ddc0ad67020f45edb3ba9c83cab687a4 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:32:00.572450 426 tablet_replica.cc:331] stopping tablet replica
I20250625 03:32:00.576949 426 raft_consensus.cc:2241] T d08de4c2326d46bab26f42d8d483ebd0 P 01873d289e0b4f9f9184b251369502a9 [term 3 LEADER]: Raft consensus shutting down.
I20250625 03:32:00.577957 426 raft_consensus.cc:2270] T d08de4c2326d46bab26f42d8d483ebd0 P 01873d289e0b4f9f9184b251369502a9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:00.580955 426 tablet_replica.cc:331] stopping tablet replica
I20250625 03:32:00.581925 426 raft_consensus.cc:2241] T e7d3871088394a3ba7a6d18baae1feba P 01873d289e0b4f9f9184b251369502a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:00.582578 426 raft_consensus.cc:2270] T e7d3871088394a3ba7a6d18baae1feba P 01873d289e0b4f9f9184b251369502a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:00.586594 426 tablet_replica.cc:331] stopping tablet replica
I20250625 03:32:00.587584 426 raft_consensus.cc:2241] T 002d4371d5414440b756829fe3343d07 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:00.588140 426 raft_consensus.cc:2270] T 002d4371d5414440b756829fe3343d07 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:00.591478 426 tablet_replica.cc:331] stopping tablet replica
I20250625 03:32:00.594565 426 raft_consensus.cc:2241] T d00ad2472fd74bfc9065d9dc4808e0c1 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:00.595242 426 raft_consensus.cc:2270] T d00ad2472fd74bfc9065d9dc4808e0c1 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250625 03:32:00.598348 3828 consensus_peers.cc:487] T 485f3e9350e245a9939133866b354302 P ddc0ad67020f45edb3ba9c83cab687a4 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250625 03:32:00.602960 3828 consensus_peers.cc:487] T 03c46dae805341fdb9ec29725fa182a2 P ddc0ad67020f45edb3ba9c83cab687a4 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:32:00.609664 426 tablet_replica.cc:331] stopping tablet replica
W20250625 03:32:00.618027 3680 consensus_peers.cc:487] T 3ecdd525d6fd47deacf323decbc5c329 P 3d5b9823dfcd41cb92bd195c811cbf39 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:32:00.610714 426 raft_consensus.cc:2241] T d83c6c79a784452289ba414976adb9e0 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:00.619216 426 raft_consensus.cc:2270] T d83c6c79a784452289ba414976adb9e0 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:00.623632 426 tablet_replica.cc:331] stopping tablet replica
I20250625 03:32:00.624655 426 raft_consensus.cc:2241] T 6afeedd3b768470f921526d58704c21d P 01873d289e0b4f9f9184b251369502a9 [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:32:00.625690 426 raft_consensus.cc:2270] T 6afeedd3b768470f921526d58704c21d P 01873d289e0b4f9f9184b251369502a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:00.628782 426 tablet_replica.cc:331] stopping tablet replica
I20250625 03:32:00.629710 426 raft_consensus.cc:2241] T 3ecdd525d6fd47deacf323decbc5c329 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:00.631285 426 raft_consensus.cc:2270] T 3ecdd525d6fd47deacf323decbc5c329 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:00.634918 426 tablet_replica.cc:331] stopping tablet replica
I20250625 03:32:00.635983 426 raft_consensus.cc:2241] T 036dfe9e6b844fc6964b3b5e371f8c95 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:00.643158 3714 raft_consensus.cc:1273] T 2e956665b7e4411f86cf77259093c8aa P 3d5b9823dfcd41cb92bd195c811cbf39 [term 3 FOLLOWER]: Refusing update from remote peer 841018313ad649679de64e006582f4c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250625 03:32:00.645421 426 raft_consensus.cc:2270] T 036dfe9e6b844fc6964b3b5e371f8c95 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:00.646804 4770 consensus_queue.cc:1035] T 2e956665b7e4411f86cf77259093c8aa P 841018313ad649679de64e006582f4c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20250625 03:32:00.648819 426 tablet_replica.cc:331] stopping tablet replica
I20250625 03:32:00.652889 426 raft_consensus.cc:2241] T 49d4fb2581ed4ef998f6a113ea67c323 P 01873d289e0b4f9f9184b251369502a9 [term 3 LEADER]: Raft consensus shutting down.
I20250625 03:32:00.653893 426 raft_consensus.cc:2270] T 49d4fb2581ed4ef998f6a113ea67c323 P 01873d289e0b4f9f9184b251369502a9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:00.656692 426 tablet_replica.cc:331] stopping tablet replica
W20250625 03:32:00.657078 3754 consensus_peers.cc:487] T 6a179f065ae046df819a9bd88194dae6 P 841018313ad649679de64e006582f4c5 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:32:00.666565 426 raft_consensus.cc:2241] T c5a9463f96314a83b7955d80444b1c29 P 01873d289e0b4f9f9184b251369502a9 [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:32:00.668056 426 raft_consensus.cc:2270] T c5a9463f96314a83b7955d80444b1c29 P 01873d289e0b4f9f9184b251369502a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:00.671494 426 tablet_replica.cc:331] stopping tablet replica
I20250625 03:32:00.672400 426 raft_consensus.cc:2241] T 39da7c80318f4c408f8cdaf2229b0c96 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:00.673141 426 raft_consensus.cc:2270] T 39da7c80318f4c408f8cdaf2229b0c96 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:00.676287 426 tablet_replica.cc:331] stopping tablet replica
I20250625 03:32:00.677147 426 raft_consensus.cc:2241] T 7a8ecc65ca1140beb905dd6368bfaa2a P 01873d289e0b4f9f9184b251369502a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:00.677834 426 raft_consensus.cc:2270] T 7a8ecc65ca1140beb905dd6368bfaa2a P 01873d289e0b4f9f9184b251369502a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:00.681171 426 tablet_replica.cc:331] stopping tablet replica
I20250625 03:32:00.682085 426 raft_consensus.cc:2241] T 1e9c146f8cd743f7ac35dc61d9226d1d P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:00.682667 426 raft_consensus.cc:2270] T 1e9c146f8cd743f7ac35dc61d9226d1d P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:00.685798 426 tablet_replica.cc:331] stopping tablet replica
I20250625 03:32:00.686717 426 raft_consensus.cc:2241] T 5dc5a179a27f462989b291e8133742da P 01873d289e0b4f9f9184b251369502a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:00.687373 426 raft_consensus.cc:2270] T 5dc5a179a27f462989b291e8133742da P 01873d289e0b4f9f9184b251369502a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:00.690640 426 tablet_replica.cc:331] stopping tablet replica
I20250625 03:32:00.691555 426 raft_consensus.cc:2241] T 5350a260b3364354b73176e6bdd77940 P 01873d289e0b4f9f9184b251369502a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:00.692262 426 raft_consensus.cc:2270] T 5350a260b3364354b73176e6bdd77940 P 01873d289e0b4f9f9184b251369502a9 [term 2 FOLLOWER]: Raft consensus is shut down!
W20250625 03:32:00.658964 3828 consensus_peers.cc:487] T 4b38a4199d1d44988233b6d8604d1a96 P ddc0ad67020f45edb3ba9c83cab687a4 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:32:00.701210 426 tablet_replica.cc:331] stopping tablet replica
I20250625 03:32:00.702265 426 raft_consensus.cc:2241] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 01873d289e0b4f9f9184b251369502a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:00.702929 426 raft_consensus.cc:2270] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 01873d289e0b4f9f9184b251369502a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:00.705988 426 tablet_replica.cc:331] stopping tablet replica
W20250625 03:32:00.711354 3754 consensus_peers.cc:487] T 7a8ecc65ca1140beb905dd6368bfaa2a P 841018313ad649679de64e006582f4c5 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:32:00.706846 426 raft_consensus.cc:2241] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 01873d289e0b4f9f9184b251369502a9 [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:32:00.713016 426 raft_consensus.cc:2270] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 01873d289e0b4f9f9184b251369502a9 [term 2 FOLLOWER]: Raft consensus is shut down!
W20250625 03:32:00.712494 3828 consensus_peers.cc:487] T 1e9c146f8cd743f7ac35dc61d9226d1d P ddc0ad67020f45edb3ba9c83cab687a4 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250625 03:32:00.714844 3828 consensus_peers.cc:487] T e7d3871088394a3ba7a6d18baae1feba P ddc0ad67020f45edb3ba9c83cab687a4 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:32:00.716315 426 tablet_replica.cc:331] stopping tablet replica
I20250625 03:32:00.717355 426 raft_consensus.cc:2241] T 06f309640df64f97a4065b1420fea692 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:00.718020 426 raft_consensus.cc:2270] T 06f309640df64f97a4065b1420fea692 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250625 03:32:00.723330 3828 consensus_peers.cc:487] T 3d5b503929b24663a1f868ffaec34157 P ddc0ad67020f45edb3ba9c83cab687a4 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250625 03:32:00.724036 3828 consensus_peers.cc:487] T a07d77259251401d957af853b296750a P ddc0ad67020f45edb3ba9c83cab687a4 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250625 03:32:00.724853 3828 consensus_peers.cc:487] T d83c6c79a784452289ba414976adb9e0 P ddc0ad67020f45edb3ba9c83cab687a4 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250625 03:32:00.725416 3828 consensus_peers.cc:487] T 5350a260b3364354b73176e6bdd77940 P ddc0ad67020f45edb3ba9c83cab687a4 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:32:00.733544 426 tablet_replica.cc:331] stopping tablet replica
I20250625 03:32:00.734421 426 raft_consensus.cc:2241] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:00.735097 426 raft_consensus.cc:2270] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250625 03:32:00.735888 3828 consensus_peers.cc:487] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P ddc0ad67020f45edb3ba9c83cab687a4 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:32:00.737821 426 tablet_replica.cc:331] stopping tablet replica
I20250625 03:32:00.738673 426 raft_consensus.cc:2241] T 03c46dae805341fdb9ec29725fa182a2 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:00.739094 426 raft_consensus.cc:2270] T 03c46dae805341fdb9ec29725fa182a2 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:00.741499 426 tablet_replica.cc:331] stopping tablet replica
I20250625 03:32:00.742074 426 raft_consensus.cc:2241] T 049948eeceeb43c98ccda9e839b521a8 P 01873d289e0b4f9f9184b251369502a9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:00.742579 426 raft_consensus.cc:2270] T 049948eeceeb43c98ccda9e839b521a8 P 01873d289e0b4f9f9184b251369502a9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:00.745527 426 tablet_replica.cc:331] stopping tablet replica
I20250625 03:32:00.746430 426 raft_consensus.cc:2241] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 01873d289e0b4f9f9184b251369502a9 [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:32:00.747720 426 raft_consensus.cc:2270] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 01873d289e0b4f9f9184b251369502a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:00.750146 426 tablet_replica.cc:331] stopping tablet replica
I20250625 03:32:00.750803 426 raft_consensus.cc:2241] T ea706d649de940bf8652264ed57a901f P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:00.751241 426 raft_consensus.cc:2270] T ea706d649de940bf8652264ed57a901f P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:00.753932 426 tablet_replica.cc:331] stopping tablet replica
I20250625 03:32:00.754489 426 raft_consensus.cc:2241] T 6a179f065ae046df819a9bd88194dae6 P 01873d289e0b4f9f9184b251369502a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:00.754954 426 raft_consensus.cc:2270] T 6a179f065ae046df819a9bd88194dae6 P 01873d289e0b4f9f9184b251369502a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:00.757157 426 tablet_replica.cc:331] stopping tablet replica
I20250625 03:32:00.757688 426 raft_consensus.cc:2241] T 4b38a4199d1d44988233b6d8604d1a96 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:00.758078 426 raft_consensus.cc:2270] T 4b38a4199d1d44988233b6d8604d1a96 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:00.760315 426 tablet_replica.cc:331] stopping tablet replica
I20250625 03:32:00.760857 426 raft_consensus.cc:2241] T 007d68495d594a73a5e2748f51e7c44c P 01873d289e0b4f9f9184b251369502a9 [term 3 LEADER]: Raft consensus shutting down.
I20250625 03:32:00.761682 426 raft_consensus.cc:2270] T 007d68495d594a73a5e2748f51e7c44c P 01873d289e0b4f9f9184b251369502a9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:00.763859 426 tablet_replica.cc:331] stopping tablet replica
I20250625 03:32:00.764423 426 raft_consensus.cc:2241] T 9d985eca3d6f497c86b94c53f16c8ae5 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:00.764880 426 raft_consensus.cc:2270] T 9d985eca3d6f497c86b94c53f16c8ae5 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250625 03:32:00.767674 3754 consensus_peers.cc:487] T 7c1dda599f144ecfab4c075ee4e28c16 P 841018313ad649679de64e006582f4c5 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:32:00.767987 426 tablet_replica.cc:331] stopping tablet replica
I20250625 03:32:00.768805 426 raft_consensus.cc:2241] T a07d77259251401d957af853b296750a P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:00.769313 426 raft_consensus.cc:2270] T a07d77259251401d957af853b296750a P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:00.773285 426 tablet_replica.cc:331] stopping tablet replica
I20250625 03:32:00.774024 426 raft_consensus.cc:2241] T 0cf94f40d3434a11b3bfec277069c8c5 P 01873d289e0b4f9f9184b251369502a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:00.774585 426 raft_consensus.cc:2270] T 0cf94f40d3434a11b3bfec277069c8c5 P 01873d289e0b4f9f9184b251369502a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:00.777281 426 tablet_replica.cc:331] stopping tablet replica
I20250625 03:32:00.777792 426 raft_consensus.cc:2241] T f3a33aa1d146468c986f0b1ba7d5fb84 P 01873d289e0b4f9f9184b251369502a9 [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:32:00.778561 426 raft_consensus.cc:2270] T f3a33aa1d146468c986f0b1ba7d5fb84 P 01873d289e0b4f9f9184b251369502a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:00.780812 426 tablet_replica.cc:331] stopping tablet replica
W20250625 03:32:00.780915 3569 debug-util.cc:398] Leaking SignalData structure 0x7b080031dce0 after lost signal to thread 429
I20250625 03:32:00.781656 426 raft_consensus.cc:2241] T c0c8dfded31e4566b07bc439f6e58ef6 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus shutting down.
W20250625 03:32:00.782075 3569 debug-util.cc:398] Leaking SignalData structure 0x7b0800176e40 after lost signal to thread 3572
I20250625 03:32:00.782215 426 raft_consensus.cc:2270] T c0c8dfded31e4566b07bc439f6e58ef6 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250625 03:32:00.783576 3569 debug-util.cc:398] Leaking SignalData structure 0x7b08001b3760 after lost signal to thread 3739
W20250625 03:32:00.784565 3680 consensus_peers.cc:487] T 002d4371d5414440b756829fe3343d07 P 3d5b9823dfcd41cb92bd195c811cbf39 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250625 03:32:00.784873 3569 debug-util.cc:398] Leaking SignalData structure 0x7b080005bb20 after lost signal to thread 3813
I20250625 03:32:00.785144 426 tablet_replica.cc:331] stopping tablet replica
I20250625 03:32:00.785754 426 raft_consensus.cc:2241] T 3d5b503929b24663a1f868ffaec34157 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus shutting down.
W20250625 03:32:00.786147 3569 debug-util.cc:398] Leaking SignalData structure 0x7b08002b0620 after lost signal to thread 3887
I20250625 03:32:00.786164 426 raft_consensus.cc:2270] T 3d5b503929b24663a1f868ffaec34157 P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250625 03:32:00.787513 3569 debug-util.cc:398] Leaking SignalData structure 0x7b08002193e0 after lost signal to thread 4454
I20250625 03:32:00.788751 426 tablet_replica.cc:331] stopping tablet replica
I20250625 03:32:00.789397 426 raft_consensus.cc:2241] T e638ce3a86d242fcadb10cdf57f5960d P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:00.789835 426 raft_consensus.cc:2270] T e638ce3a86d242fcadb10cdf57f5960d P 01873d289e0b4f9f9184b251369502a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:00.792338 426 tablet_replica.cc:331] stopping tablet replica
I20250625 03:32:00.792829 426 raft_consensus.cc:2241] T 39880aedaeca464f81d899dc222a35b9 P 01873d289e0b4f9f9184b251369502a9 [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:32:00.793624 426 raft_consensus.cc:2270] T 39880aedaeca464f81d899dc222a35b9 P 01873d289e0b4f9f9184b251369502a9 [term 2 FOLLOWER]: Raft consensus is shut down!
W20250625 03:32:00.811216 3754 consensus_peers.cc:487] T aa64717b3f7d4af893e9908260f4520e P 841018313ad649679de64e006582f4c5 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250625 03:32:00.832367 3680 consensus_peers.cc:487] T e638ce3a86d242fcadb10cdf57f5960d P 3d5b9823dfcd41cb92bd195c811cbf39 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250625 03:32:00.851001 3680 consensus_peers.cc:487] T c0c8dfded31e4566b07bc439f6e58ef6 P 3d5b9823dfcd41cb92bd195c811cbf39 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250625 03:32:00.862329 3680 consensus_peers.cc:487] T 06f309640df64f97a4065b1420fea692 P 3d5b9823dfcd41cb92bd195c811cbf39 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:32:00.891891 426 tablet_server.cc:195] TabletServer@127.0.106.129:37771 shutdown complete.
W20250625 03:32:00.895818 3754 consensus_peers.cc:487] T 39da7c80318f4c408f8cdaf2229b0c96 P 841018313ad649679de64e006582f4c5 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:37771: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250625 03:32:00.942492 3680 consensus_peers.cc:487] T c592f2c5305141c487b73e0867d0f36b P 3d5b9823dfcd41cb92bd195c811cbf39 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:37771: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250625 03:32:00.945854 3680 consensus_peers.cc:487] T d00ad2472fd74bfc9065d9dc4808e0c1 P 3d5b9823dfcd41cb92bd195c811cbf39 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:37771: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250625 03:32:00.947589 3754 consensus_peers.cc:487] T 0cf94f40d3434a11b3bfec277069c8c5 P 841018313ad649679de64e006582f4c5 -> Peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Couldn't send request to peer 01873d289e0b4f9f9184b251369502a9. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:37771: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250625 03:32:01.080452 426 tablet_server.cc:178] TabletServer@127.0.106.130:0 shutting down...
W20250625 03:32:01.097994 3754 consensus_peers.cc:487] T 7257f8e1d9b24e3a9650c5838fe1a8c5 P 841018313ad649679de64e006582f4c5 -> Peer 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041): Couldn't send request to peer 3d5b9823dfcd41cb92bd195c811cbf39. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250625 03:32:01.116860 3754 consensus_peers.cc:487] T 0cf94f40d3434a11b3bfec277069c8c5 P 841018313ad649679de64e006582f4c5 -> Peer 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041): Couldn't send request to peer 3d5b9823dfcd41cb92bd195c811cbf39. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250625 03:32:01.134467 3828 consensus_peers.cc:487] T 03c46dae805341fdb9ec29725fa182a2 P ddc0ad67020f45edb3ba9c83cab687a4 -> Peer 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041): Couldn't send request to peer 3d5b9823dfcd41cb92bd195c811cbf39. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250625 03:32:01.144685 3754 consensus_peers.cc:487] T 39da7c80318f4c408f8cdaf2229b0c96 P 841018313ad649679de64e006582f4c5 -> Peer 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041): Couldn't send request to peer 3d5b9823dfcd41cb92bd195c811cbf39. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250625 03:32:01.163080 3754 consensus_peers.cc:487] T e91e209dcfdb4fd0bebe666bbbe16b75 P 841018313ad649679de64e006582f4c5 -> Peer 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041): Couldn't send request to peer 3d5b9823dfcd41cb92bd195c811cbf39. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:32:01.188215 426 ts_tablet_manager.cc:1500] Shutting down tablet manager...
W20250625 03:32:01.189628 3828 consensus_peers.cc:487] T 049948eeceeb43c98ccda9e839b521a8 P ddc0ad67020f45edb3ba9c83cab687a4 -> Peer 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041): Couldn't send request to peer 3d5b9823dfcd41cb92bd195c811cbf39. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:32:01.192281 426 tablet_replica.cc:331] T 7257f8e1d9b24e3a9650c5838fe1a8c5 P 3d5b9823dfcd41cb92bd195c811cbf39: stopping tablet replica
I20250625 03:32:01.193392 426 raft_consensus.cc:2241] T 7257f8e1d9b24e3a9650c5838fe1a8c5 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:01.193985 426 raft_consensus.cc:2270] T 7257f8e1d9b24e3a9650c5838fe1a8c5 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:01.198895 426 tablet_replica.cc:331] T d83c6c79a784452289ba414976adb9e0 P 3d5b9823dfcd41cb92bd195c811cbf39: stopping tablet replica
I20250625 03:32:01.201190 426 raft_consensus.cc:2241] T d83c6c79a784452289ba414976adb9e0 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:01.201766 426 raft_consensus.cc:2270] T d83c6c79a784452289ba414976adb9e0 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:01.204545 426 tablet_replica.cc:331] T 6de9e445ad834b008a2f513fac78dba1 P 3d5b9823dfcd41cb92bd195c811cbf39: stopping tablet replica
I20250625 03:32:01.205345 426 raft_consensus.cc:2241] T 6de9e445ad834b008a2f513fac78dba1 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:01.205893 426 raft_consensus.cc:2270] T 6de9e445ad834b008a2f513fac78dba1 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Raft consensus is shut down!
W20250625 03:32:01.212698 3754 consensus_peers.cc:487] T aa64717b3f7d4af893e9908260f4520e P 841018313ad649679de64e006582f4c5 -> Peer 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041): Couldn't send request to peer 3d5b9823dfcd41cb92bd195c811cbf39. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:32:01.217692 426 tablet_replica.cc:331] T c5a9463f96314a83b7955d80444b1c29 P 3d5b9823dfcd41cb92bd195c811cbf39: stopping tablet replica
I20250625 03:32:01.218883 426 raft_consensus.cc:2241] T c5a9463f96314a83b7955d80444b1c29 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:01.219545 426 raft_consensus.cc:2270] T c5a9463f96314a83b7955d80444b1c29 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:01.222961 426 tablet_replica.cc:331] T 41d33fbc861a40338ae6da1732fb696b P 3d5b9823dfcd41cb92bd195c811cbf39: stopping tablet replica
I20250625 03:32:01.223767 426 raft_consensus.cc:2241] T 41d33fbc861a40338ae6da1732fb696b P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:01.224463 426 raft_consensus.cc:2270] T 41d33fbc861a40338ae6da1732fb696b P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:01.227702 426 tablet_replica.cc:331] T d657bcfa8eea4e7db43d4d2715857516 P 3d5b9823dfcd41cb92bd195c811cbf39: stopping tablet replica
I20250625 03:32:01.228608 426 raft_consensus.cc:2241] T d657bcfa8eea4e7db43d4d2715857516 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:01.229182 426 raft_consensus.cc:2270] T d657bcfa8eea4e7db43d4d2715857516 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:01.232031 426 tablet_replica.cc:331] T 162ddcc09f594ed7bcb752f842b6c97c P 3d5b9823dfcd41cb92bd195c811cbf39: stopping tablet replica
I20250625 03:32:01.233069 426 raft_consensus.cc:2241] T 162ddcc09f594ed7bcb752f842b6c97c P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:01.233697 426 raft_consensus.cc:2270] T 162ddcc09f594ed7bcb752f842b6c97c P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:01.236761 426 tablet_replica.cc:331] T 8ee7d6306b5146ed90a1b8392e062172 P 3d5b9823dfcd41cb92bd195c811cbf39: stopping tablet replica
I20250625 03:32:01.237709 426 raft_consensus.cc:2241] T 8ee7d6306b5146ed90a1b8392e062172 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:01.238319 426 raft_consensus.cc:2270] T 8ee7d6306b5146ed90a1b8392e062172 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:01.242009 426 tablet_replica.cc:331] T 5350a260b3364354b73176e6bdd77940 P 3d5b9823dfcd41cb92bd195c811cbf39: stopping tablet replica
W20250625 03:32:01.246730 3754 consensus_peers.cc:487] T caea215a97a344e88348ecb21035902d P 841018313ad649679de64e006582f4c5 -> Peer 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041): Couldn't send request to peer 3d5b9823dfcd41cb92bd195c811cbf39. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:32:01.249440 426 raft_consensus.cc:2241] T 5350a260b3364354b73176e6bdd77940 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:01.255470 426 raft_consensus.cc:2270] T 5350a260b3364354b73176e6bdd77940 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:01.258991 426 tablet_replica.cc:331] T e91e209dcfdb4fd0bebe666bbbe16b75 P 3d5b9823dfcd41cb92bd195c811cbf39: stopping tablet replica
I20250625 03:32:01.259874 426 raft_consensus.cc:2241] T e91e209dcfdb4fd0bebe666bbbe16b75 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:01.260504 426 raft_consensus.cc:2270] T e91e209dcfdb4fd0bebe666bbbe16b75 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:01.263099 426 tablet_replica.cc:331] T 6a179f065ae046df819a9bd88194dae6 P 3d5b9823dfcd41cb92bd195c811cbf39: stopping tablet replica
I20250625 03:32:01.264205 426 raft_consensus.cc:2241] T 6a179f065ae046df819a9bd88194dae6 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:01.264793 426 raft_consensus.cc:2270] T 6a179f065ae046df819a9bd88194dae6 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:01.267546 426 tablet_replica.cc:331] T 4b38a4199d1d44988233b6d8604d1a96 P 3d5b9823dfcd41cb92bd195c811cbf39: stopping tablet replica
I20250625 03:32:01.268525 426 raft_consensus.cc:2241] T 4b38a4199d1d44988233b6d8604d1a96 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:01.269124 426 raft_consensus.cc:2270] T 4b38a4199d1d44988233b6d8604d1a96 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:01.272222 426 tablet_replica.cc:331] T e638ce3a86d242fcadb10cdf57f5960d P 3d5b9823dfcd41cb92bd195c811cbf39: stopping tablet replica
I20250625 03:32:01.273196 426 raft_consensus.cc:2241] T e638ce3a86d242fcadb10cdf57f5960d P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:32:01.274312 426 raft_consensus.cc:2270] T e638ce3a86d242fcadb10cdf57f5960d P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:01.277033 426 tablet_replica.cc:331] T 049948eeceeb43c98ccda9e839b521a8 P 3d5b9823dfcd41cb92bd195c811cbf39: stopping tablet replica
I20250625 03:32:01.278023 426 raft_consensus.cc:2241] T 049948eeceeb43c98ccda9e839b521a8 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:01.278640 426 raft_consensus.cc:2270] T 049948eeceeb43c98ccda9e839b521a8 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:01.281680 426 tablet_replica.cc:331] T 03c46dae805341fdb9ec29725fa182a2 P 3d5b9823dfcd41cb92bd195c811cbf39: stopping tablet replica
I20250625 03:32:01.282836 426 raft_consensus.cc:2241] T 03c46dae805341fdb9ec29725fa182a2 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:01.283506 426 raft_consensus.cc:2270] T 03c46dae805341fdb9ec29725fa182a2 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:01.286679 426 tablet_replica.cc:331] T caea215a97a344e88348ecb21035902d P 3d5b9823dfcd41cb92bd195c811cbf39: stopping tablet replica
I20250625 03:32:01.287632 426 raft_consensus.cc:2241] T caea215a97a344e88348ecb21035902d P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:01.288280 426 raft_consensus.cc:2270] T caea215a97a344e88348ecb21035902d P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:01.291472 426 tablet_replica.cc:331] T 526951ad467a4708926096ed1162a722 P 3d5b9823dfcd41cb92bd195c811cbf39: stopping tablet replica
I20250625 03:32:01.293502 426 raft_consensus.cc:2241] T 526951ad467a4708926096ed1162a722 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:01.294332 426 raft_consensus.cc:2270] T 526951ad467a4708926096ed1162a722 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:01.299129 426 tablet_replica.cc:331] T a6b45bf21adf457d9a920f57d758ba15 P 3d5b9823dfcd41cb92bd195c811cbf39: stopping tablet replica
I20250625 03:32:01.300216 426 raft_consensus.cc:2241] T a6b45bf21adf457d9a920f57d758ba15 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:32:01.301458 426 raft_consensus.cc:2270] T a6b45bf21adf457d9a920f57d758ba15 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:01.304425 426 tablet_replica.cc:331] T 9d985eca3d6f497c86b94c53f16c8ae5 P 3d5b9823dfcd41cb92bd195c811cbf39: stopping tablet replica
I20250625 03:32:01.305405 426 raft_consensus.cc:2241] T 9d985eca3d6f497c86b94c53f16c8ae5 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:32:01.306465 426 raft_consensus.cc:2270] T 9d985eca3d6f497c86b94c53f16c8ae5 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:01.309567 426 tablet_replica.cc:331] T eeca5a85dddf4d1884917690e01ff81d P 3d5b9823dfcd41cb92bd195c811cbf39: stopping tablet replica
I20250625 03:32:01.310479 426 raft_consensus.cc:2241] T eeca5a85dddf4d1884917690e01ff81d P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:32:01.311663 426 raft_consensus.cc:2270] T eeca5a85dddf4d1884917690e01ff81d P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:01.314774 426 tablet_replica.cc:331] T 39da7c80318f4c408f8cdaf2229b0c96 P 3d5b9823dfcd41cb92bd195c811cbf39: stopping tablet replica
I20250625 03:32:01.315899 426 raft_consensus.cc:2241] T 39da7c80318f4c408f8cdaf2229b0c96 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:01.316524 426 raft_consensus.cc:2270] T 39da7c80318f4c408f8cdaf2229b0c96 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:01.331864 426 tablet_replica.cc:331] T 5e59ae16ec1a4c69aac820531e504206 P 3d5b9823dfcd41cb92bd195c811cbf39: stopping tablet replica
I20250625 03:32:01.332840 426 raft_consensus.cc:2241] T 5e59ae16ec1a4c69aac820531e504206 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 LEADER]: Raft consensus shutting down.
W20250625 03:32:01.293567 3754 consensus_peers.cc:487] T 5ece5f5b2a904c9cbef3065e210e9a30 P 841018313ad649679de64e006582f4c5 -> Peer 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041): Couldn't send request to peer 3d5b9823dfcd41cb92bd195c811cbf39. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250625 03:32:01.351696 3828 consensus_peers.cc:487] T d83c6c79a784452289ba414976adb9e0 P ddc0ad67020f45edb3ba9c83cab687a4 -> Peer 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041): Couldn't send request to peer 3d5b9823dfcd41cb92bd195c811cbf39. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250625 03:32:01.354665 3754 consensus_peers.cc:487] T 6de9e445ad834b008a2f513fac78dba1 P 841018313ad649679de64e006582f4c5 -> Peer 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041): Couldn't send request to peer 3d5b9823dfcd41cb92bd195c811cbf39. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250625 03:32:01.355767 3754 consensus_peers.cc:487] T 41d33fbc861a40338ae6da1732fb696b P 841018313ad649679de64e006582f4c5 -> Peer 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041): Couldn't send request to peer 3d5b9823dfcd41cb92bd195c811cbf39. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:32:01.355131 426 raft_consensus.cc:2270] T 5e59ae16ec1a4c69aac820531e504206 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:01.358851 426 tablet_replica.cc:331] T 7a8ecc65ca1140beb905dd6368bfaa2a P 3d5b9823dfcd41cb92bd195c811cbf39: stopping tablet replica
I20250625 03:32:01.359561 426 raft_consensus.cc:2241] T 7a8ecc65ca1140beb905dd6368bfaa2a P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:01.360143 426 raft_consensus.cc:2270] T 7a8ecc65ca1140beb905dd6368bfaa2a P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:01.362553 426 tablet_replica.cc:331] T 5dc5a179a27f462989b291e8133742da P 3d5b9823dfcd41cb92bd195c811cbf39: stopping tablet replica
I20250625 03:32:01.363106 426 raft_consensus.cc:2241] T 5dc5a179a27f462989b291e8133742da P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:01.363562 426 raft_consensus.cc:2270] T 5dc5a179a27f462989b291e8133742da P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:01.366130 426 tablet_replica.cc:331] T d00ad2472fd74bfc9065d9dc4808e0c1 P 3d5b9823dfcd41cb92bd195c811cbf39: stopping tablet replica
I20250625 03:32:01.366932 426 raft_consensus.cc:2241] T d00ad2472fd74bfc9065d9dc4808e0c1 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 LEADER]: Raft consensus shutting down.
W20250625 03:32:01.367574 3754 consensus_peers.cc:487] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 841018313ad649679de64e006582f4c5 -> Peer 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041): Couldn't send request to peer 3d5b9823dfcd41cb92bd195c811cbf39. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:32:01.368145 426 raft_consensus.cc:2270] T d00ad2472fd74bfc9065d9dc4808e0c1 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:01.370534 426 tablet_replica.cc:331] T 002d4371d5414440b756829fe3343d07 P 3d5b9823dfcd41cb92bd195c811cbf39: stopping tablet replica
I20250625 03:32:01.371119 426 raft_consensus.cc:2241] T 002d4371d5414440b756829fe3343d07 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:32:01.371948 426 raft_consensus.cc:2270] T 002d4371d5414440b756829fe3343d07 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:01.374320 426 tablet_replica.cc:331] T 6afeedd3b768470f921526d58704c21d P 3d5b9823dfcd41cb92bd195c811cbf39: stopping tablet replica
I20250625 03:32:01.375200 426 raft_consensus.cc:2241] T 6afeedd3b768470f921526d58704c21d P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:01.376679 426 raft_consensus.cc:2270] T 6afeedd3b768470f921526d58704c21d P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:01.379029 426 tablet_replica.cc:331] T 3ecdd525d6fd47deacf323decbc5c329 P 3d5b9823dfcd41cb92bd195c811cbf39: stopping tablet replica
I20250625 03:32:01.379592 426 raft_consensus.cc:2241] T 3ecdd525d6fd47deacf323decbc5c329 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:32:01.380597 426 raft_consensus.cc:2270] T 3ecdd525d6fd47deacf323decbc5c329 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:01.382645 426 tablet_replica.cc:331] T 2e956665b7e4411f86cf77259093c8aa P 3d5b9823dfcd41cb92bd195c811cbf39: stopping tablet replica
I20250625 03:32:01.383193 426 raft_consensus.cc:2241] T 2e956665b7e4411f86cf77259093c8aa P 3d5b9823dfcd41cb92bd195c811cbf39 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:01.383639 426 raft_consensus.cc:2270] T 2e956665b7e4411f86cf77259093c8aa P 3d5b9823dfcd41cb92bd195c811cbf39 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:01.387202 426 tablet_replica.cc:331] T b1ece928b2e2452191ee263cf19ec4f8 P 3d5b9823dfcd41cb92bd195c811cbf39: stopping tablet replica
I20250625 03:32:01.388087 426 raft_consensus.cc:2241] T b1ece928b2e2452191ee263cf19ec4f8 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:32:01.389218 426 raft_consensus.cc:2270] T b1ece928b2e2452191ee263cf19ec4f8 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:01.393517 426 tablet_replica.cc:331] T 06f309640df64f97a4065b1420fea692 P 3d5b9823dfcd41cb92bd195c811cbf39: stopping tablet replica
W20250625 03:32:01.394448 3828 consensus_peers.cc:487] T 5350a260b3364354b73176e6bdd77940 P ddc0ad67020f45edb3ba9c83cab687a4 -> Peer 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041): Couldn't send request to peer 3d5b9823dfcd41cb92bd195c811cbf39. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:32:01.395216 426 raft_consensus.cc:2241] T 06f309640df64f97a4065b1420fea692 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:32:01.396384 426 raft_consensus.cc:2270] T 06f309640df64f97a4065b1420fea692 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:01.399327 426 tablet_replica.cc:331] T 3d5b503929b24663a1f868ffaec34157 P 3d5b9823dfcd41cb92bd195c811cbf39: stopping tablet replica
I20250625 03:32:01.400148 426 raft_consensus.cc:2241] T 3d5b503929b24663a1f868ffaec34157 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:01.400717 426 raft_consensus.cc:2270] T 3d5b503929b24663a1f868ffaec34157 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:01.407389 426 tablet_replica.cc:331] T 0cf94f40d3434a11b3bfec277069c8c5 P 3d5b9823dfcd41cb92bd195c811cbf39: stopping tablet replica
I20250625 03:32:01.408295 426 raft_consensus.cc:2241] T 0cf94f40d3434a11b3bfec277069c8c5 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:01.408845 426 raft_consensus.cc:2270] T 0cf94f40d3434a11b3bfec277069c8c5 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:01.411746 426 tablet_replica.cc:331] T a07d77259251401d957af853b296750a P 3d5b9823dfcd41cb92bd195c811cbf39: stopping tablet replica
I20250625 03:32:01.412680 426 raft_consensus.cc:2241] T a07d77259251401d957af853b296750a P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:01.413332 426 raft_consensus.cc:2270] T a07d77259251401d957af853b296750a P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250625 03:32:01.415884 3754 consensus_peers.cc:487] T 6a179f065ae046df819a9bd88194dae6 P 841018313ad649679de64e006582f4c5 -> Peer 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041): Couldn't send request to peer 3d5b9823dfcd41cb92bd195c811cbf39. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:32:01.416841 426 tablet_replica.cc:331] T f3a33aa1d146468c986f0b1ba7d5fb84 P 3d5b9823dfcd41cb92bd195c811cbf39: stopping tablet replica
I20250625 03:32:01.417827 426 raft_consensus.cc:2241] T f3a33aa1d146468c986f0b1ba7d5fb84 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:01.418506 426 raft_consensus.cc:2270] T f3a33aa1d146468c986f0b1ba7d5fb84 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:01.421504 426 tablet_replica.cc:331] T c0c8dfded31e4566b07bc439f6e58ef6 P 3d5b9823dfcd41cb92bd195c811cbf39: stopping tablet replica
I20250625 03:32:01.422309 426 raft_consensus.cc:2241] T c0c8dfded31e4566b07bc439f6e58ef6 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:32:01.423529 426 raft_consensus.cc:2270] T c0c8dfded31e4566b07bc439f6e58ef6 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:01.426733 426 tablet_replica.cc:331] T 6fc84ca2087c4ded91412fb32117af48 P 3d5b9823dfcd41cb92bd195c811cbf39: stopping tablet replica
I20250625 03:32:01.427492 426 raft_consensus.cc:2241] T 6fc84ca2087c4ded91412fb32117af48 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:32:01.428546 426 raft_consensus.cc:2270] T 6fc84ca2087c4ded91412fb32117af48 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:01.431849 426 tablet_replica.cc:331] T 5ece5f5b2a904c9cbef3065e210e9a30 P 3d5b9823dfcd41cb92bd195c811cbf39: stopping tablet replica
I20250625 03:32:01.432682 426 raft_consensus.cc:2241] T 5ece5f5b2a904c9cbef3065e210e9a30 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Raft consensus shutting down.
W20250625 03:32:01.433899 3828 consensus_peers.cc:487] T a07d77259251401d957af853b296750a P ddc0ad67020f45edb3ba9c83cab687a4 -> Peer 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041): Couldn't send request to peer 3d5b9823dfcd41cb92bd195c811cbf39. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:32:01.433892 426 raft_consensus.cc:2270] T 5ece5f5b2a904c9cbef3065e210e9a30 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:01.437287 426 tablet_replica.cc:331] T aa64717b3f7d4af893e9908260f4520e P 3d5b9823dfcd41cb92bd195c811cbf39: stopping tablet replica
I20250625 03:32:01.438057 426 raft_consensus.cc:2241] T aa64717b3f7d4af893e9908260f4520e P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:01.438581 426 raft_consensus.cc:2270] T aa64717b3f7d4af893e9908260f4520e P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:01.441238 426 tablet_replica.cc:331] T c592f2c5305141c487b73e0867d0f36b P 3d5b9823dfcd41cb92bd195c811cbf39: stopping tablet replica
I20250625 03:32:01.441936 426 raft_consensus.cc:2241] T c592f2c5305141c487b73e0867d0f36b P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:32:01.442915 426 raft_consensus.cc:2270] T c592f2c5305141c487b73e0867d0f36b P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:01.445708 426 tablet_replica.cc:331] T d08de4c2326d46bab26f42d8d483ebd0 P 3d5b9823dfcd41cb92bd195c811cbf39: stopping tablet replica
I20250625 03:32:01.446403 426 raft_consensus.cc:2241] T d08de4c2326d46bab26f42d8d483ebd0 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:01.446925 426 raft_consensus.cc:2270] T d08de4c2326d46bab26f42d8d483ebd0 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:01.449446 426 tablet_replica.cc:331] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 3d5b9823dfcd41cb92bd195c811cbf39: stopping tablet replica
W20250625 03:32:01.453045 3828 consensus_peers.cc:487] T 5dc5a179a27f462989b291e8133742da P ddc0ad67020f45edb3ba9c83cab687a4 -> Peer 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041): Couldn't send request to peer 3d5b9823dfcd41cb92bd195c811cbf39. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:32:01.453830 426 raft_consensus.cc:2241] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:01.454471 426 raft_consensus.cc:2270] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:01.457299 426 tablet_replica.cc:331] T bccba871bcd747fd80a890b25628ebe2 P 3d5b9823dfcd41cb92bd195c811cbf39: stopping tablet replica
I20250625 03:32:01.457965 426 raft_consensus.cc:2241] T bccba871bcd747fd80a890b25628ebe2 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:32:01.458930 426 raft_consensus.cc:2270] T bccba871bcd747fd80a890b25628ebe2 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:01.461827 426 tablet_replica.cc:331] T 7e92fd94b9f24b1097e9a7373896cb26 P 3d5b9823dfcd41cb92bd195c811cbf39: stopping tablet replica
I20250625 03:32:01.462463 426 raft_consensus.cc:2241] T 7e92fd94b9f24b1097e9a7373896cb26 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:01.463886 426 raft_consensus.cc:2270] T 7e92fd94b9f24b1097e9a7373896cb26 P 3d5b9823dfcd41cb92bd195c811cbf39 [term 3 FOLLOWER]: Raft consensus is shut down!
W20250625 03:32:01.478018 3754 consensus_peers.cc:487] T 7a8ecc65ca1140beb905dd6368bfaa2a P 841018313ad649679de64e006582f4c5 -> Peer 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041): Couldn't send request to peer 3d5b9823dfcd41cb92bd195c811cbf39. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:32:01.506891 4743 raft_consensus.cc:491] T 7e92fd94b9f24b1097e9a7373896cb26 P 841018313ad649679de64e006582f4c5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 01873d289e0b4f9f9184b251369502a9)
I20250625 03:32:01.507441 4743 raft_consensus.cc:513] T 7e92fd94b9f24b1097e9a7373896cb26 P 841018313ad649679de64e006582f4c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:32:01.509431 4743 leader_election.cc:290] T 7e92fd94b9f24b1097e9a7373896cb26 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
W20250625 03:32:01.517001 3754 leader_election.cc:336] T 7e92fd94b9f24b1097e9a7373896cb26 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Network error: Client connection negotiation failed: client connection to 127.0.106.129:37771: connect: Connection refused (error 111)
W20250625 03:32:01.517452 3828 consensus_peers.cc:487] T 4b38a4199d1d44988233b6d8604d1a96 P ddc0ad67020f45edb3ba9c83cab687a4 -> Peer 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041): Couldn't send request to peer 3d5b9823dfcd41cb92bd195c811cbf39. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250625 03:32:01.518056 3754 leader_election.cc:336] T 7e92fd94b9f24b1097e9a7373896cb26 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20250625 03:32:01.518640 3754 leader_election.cc:304] T 7e92fd94b9f24b1097e9a7373896cb26 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841018313ad649679de64e006582f4c5; no voters: 01873d289e0b4f9f9184b251369502a9, 3d5b9823dfcd41cb92bd195c811cbf39
I20250625 03:32:01.519599 4769 raft_consensus.cc:2747] T 7e92fd94b9f24b1097e9a7373896cb26 P 841018313ad649679de64e006582f4c5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20250625 03:32:01.536789 3754 consensus_peers.cc:487] T 162ddcc09f594ed7bcb752f842b6c97c P 841018313ad649679de64e006582f4c5 -> Peer 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041): Couldn't send request to peer 3d5b9823dfcd41cb92bd195c811cbf39. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250625 03:32:01.537640 3828 consensus_peers.cc:487] T 3d5b503929b24663a1f868ffaec34157 P ddc0ad67020f45edb3ba9c83cab687a4 -> Peer 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041): Couldn't send request to peer 3d5b9823dfcd41cb92bd195c811cbf39. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:32:01.589036 426 tablet_server.cc:195] TabletServer@127.0.106.130:0 shutdown complete.
W20250625 03:32:01.602412 3754 consensus_peers.cc:487] T 2e956665b7e4411f86cf77259093c8aa P 841018313ad649679de64e006582f4c5 -> Peer 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041): Couldn't send request to peer 3d5b9823dfcd41cb92bd195c811cbf39. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.130:42041: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250625 03:32:01.663954 4738 raft_consensus.cc:491] T b74d9f11c2bc4a7bb6431d6222d45175 P ddc0ad67020f45edb3ba9c83cab687a4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 01873d289e0b4f9f9184b251369502a9)
I20250625 03:32:01.664568 4738 raft_consensus.cc:513] T b74d9f11c2bc4a7bb6431d6222d45175 P ddc0ad67020f45edb3ba9c83cab687a4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:32:01.666936 4738 leader_election.cc:290] T b74d9f11c2bc4a7bb6431d6222d45175 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
W20250625 03:32:01.675305 3828 leader_election.cc:336] T b74d9f11c2bc4a7bb6431d6222d45175 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Network error: Client connection negotiation failed: client connection to 127.0.106.129:37771: connect: Connection refused (error 111)
I20250625 03:32:01.688234 3781 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b74d9f11c2bc4a7bb6431d6222d45175" candidate_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "841018313ad649679de64e006582f4c5" is_pre_election: true
I20250625 03:32:01.691047 3828 leader_election.cc:304] T b74d9f11c2bc4a7bb6431d6222d45175 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddc0ad67020f45edb3ba9c83cab687a4; no voters: 01873d289e0b4f9f9184b251369502a9, 841018313ad649679de64e006582f4c5
I20250625 03:32:01.692965 4738 raft_consensus.cc:2747] T b74d9f11c2bc4a7bb6431d6222d45175 P ddc0ad67020f45edb3ba9c83cab687a4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20250625 03:32:01.701092 4738 raft_consensus.cc:491] T 526951ad467a4708926096ed1162a722 P ddc0ad67020f45edb3ba9c83cab687a4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 01873d289e0b4f9f9184b251369502a9)
I20250625 03:32:01.701226 4775 raft_consensus.cc:491] T 6afeedd3b768470f921526d58704c21d P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01873d289e0b4f9f9184b251369502a9)
I20250625 03:32:01.701756 4738 raft_consensus.cc:513] T 526951ad467a4708926096ed1162a722 P ddc0ad67020f45edb3ba9c83cab687a4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:32:01.701898 4775 raft_consensus.cc:513] T 6afeedd3b768470f921526d58704c21d P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:32:01.704237 4738 leader_election.cc:290] T 526951ad467a4708926096ed1162a722 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:32:01.704285 4775 leader_election.cc:290] T 6afeedd3b768470f921526d58704c21d P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
W20250625 03:32:01.710487 3828 leader_election.cc:336] T 526951ad467a4708926096ed1162a722 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Network error: Client connection negotiation failed: client connection to 127.0.106.129:37771: connect: Connection refused (error 111)
W20250625 03:32:01.711416 3828 leader_election.cc:336] T 6afeedd3b768470f921526d58704c21d P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Network error: Client connection negotiation failed: client connection to 127.0.106.129:37771: connect: Connection refused (error 111)
W20250625 03:32:01.712167 3828 leader_election.cc:336] T 526951ad467a4708926096ed1162a722 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041): Network error: Client connection negotiation failed: client connection to 127.0.106.130:42041: connect: Connection refused (error 111)
I20250625 03:32:01.712594 3828 leader_election.cc:304] T 526951ad467a4708926096ed1162a722 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddc0ad67020f45edb3ba9c83cab687a4; no voters: 01873d289e0b4f9f9184b251369502a9, 3d5b9823dfcd41cb92bd195c811cbf39
I20250625 03:32:01.713333 4775 raft_consensus.cc:2747] T 526951ad467a4708926096ed1162a722 P ddc0ad67020f45edb3ba9c83cab687a4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20250625 03:32:01.714650 3828 leader_election.cc:336] T 6afeedd3b768470f921526d58704c21d P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041): Network error: Client connection negotiation failed: client connection to 127.0.106.130:42041: connect: Connection refused (error 111)
I20250625 03:32:01.715196 3828 leader_election.cc:304] T 6afeedd3b768470f921526d58704c21d P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddc0ad67020f45edb3ba9c83cab687a4; no voters: 01873d289e0b4f9f9184b251369502a9, 3d5b9823dfcd41cb92bd195c811cbf39
I20250625 03:32:01.715950 4775 raft_consensus.cc:2747] T 6afeedd3b768470f921526d58704c21d P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20250625 03:32:01.737465 4800 raft_consensus.cc:491] T d657bcfa8eea4e7db43d4d2715857516 P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01873d289e0b4f9f9184b251369502a9)
I20250625 03:32:01.738152 4800 raft_consensus.cc:513] T d657bcfa8eea4e7db43d4d2715857516 P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:32:01.740571 4800 leader_election.cc:290] T d657bcfa8eea4e7db43d4d2715857516 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:32:01.744343 426 tablet_server.cc:178] TabletServer@127.0.106.131:0 shutting down...
W20250625 03:32:01.747382 3754 leader_election.cc:336] T d657bcfa8eea4e7db43d4d2715857516 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Network error: Client connection negotiation failed: client connection to 127.0.106.129:37771: connect: Connection refused (error 111)
W20250625 03:32:01.750324 3754 leader_election.cc:336] T d657bcfa8eea4e7db43d4d2715857516 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041): Network error: Client connection negotiation failed: client connection to 127.0.106.130:42041: connect: Connection refused (error 111)
I20250625 03:32:01.750885 3754 leader_election.cc:304] T d657bcfa8eea4e7db43d4d2715857516 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841018313ad649679de64e006582f4c5; no voters: 01873d289e0b4f9f9184b251369502a9, 3d5b9823dfcd41cb92bd195c811cbf39
I20250625 03:32:01.751772 4800 raft_consensus.cc:2747] T d657bcfa8eea4e7db43d4d2715857516 P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20250625 03:32:01.753273 4800 raft_consensus.cc:491] T 007d68495d594a73a5e2748f51e7c44c P 841018313ad649679de64e006582f4c5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 01873d289e0b4f9f9184b251369502a9)
I20250625 03:32:01.753852 4800 raft_consensus.cc:513] T 007d68495d594a73a5e2748f51e7c44c P 841018313ad649679de64e006582f4c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:32:01.756234 4800 leader_election.cc:290] T 007d68495d594a73a5e2748f51e7c44c P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:32:01.756978 3858 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "007d68495d594a73a5e2748f51e7c44c" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
W20250625 03:32:01.767171 3754 leader_election.cc:336] T 007d68495d594a73a5e2748f51e7c44c P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Network error: Client connection negotiation failed: client connection to 127.0.106.129:37771: connect: Connection refused (error 111)
I20250625 03:32:01.767984 3754 leader_election.cc:304] T 007d68495d594a73a5e2748f51e7c44c P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841018313ad649679de64e006582f4c5; no voters: 01873d289e0b4f9f9184b251369502a9, ddc0ad67020f45edb3ba9c83cab687a4
I20250625 03:32:01.768821 4800 raft_consensus.cc:2747] T 007d68495d594a73a5e2748f51e7c44c P 841018313ad649679de64e006582f4c5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20250625 03:32:01.782081 4738 raft_consensus.cc:491] T d08de4c2326d46bab26f42d8d483ebd0 P ddc0ad67020f45edb3ba9c83cab687a4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 01873d289e0b4f9f9184b251369502a9)
I20250625 03:32:01.782745 4738 raft_consensus.cc:513] T d08de4c2326d46bab26f42d8d483ebd0 P ddc0ad67020f45edb3ba9c83cab687a4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:32:01.787748 4738 leader_election.cc:290] T d08de4c2326d46bab26f42d8d483ebd0 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:32:01.788475 4738 raft_consensus.cc:491] T 39880aedaeca464f81d899dc222a35b9 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01873d289e0b4f9f9184b251369502a9)
I20250625 03:32:01.789024 4738 raft_consensus.cc:513] T 39880aedaeca464f81d899dc222a35b9 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:32:01.791534 4738 leader_election.cc:290] T 39880aedaeca464f81d899dc222a35b9 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
W20250625 03:32:01.825585 3828 leader_election.cc:336] T d08de4c2326d46bab26f42d8d483ebd0 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Network error: Client connection negotiation failed: client connection to 127.0.106.129:37771: connect: Connection refused (error 111)
W20250625 03:32:01.826164 3828 leader_election.cc:336] T 39880aedaeca464f81d899dc222a35b9 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Network error: Client connection negotiation failed: client connection to 127.0.106.129:37771: connect: Connection refused (error 111)
I20250625 03:32:01.830789 4769 raft_consensus.cc:491] T c5a9463f96314a83b7955d80444b1c29 P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01873d289e0b4f9f9184b251369502a9)
I20250625 03:32:01.831435 4769 raft_consensus.cc:513] T c5a9463f96314a83b7955d80444b1c29 P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } }
I20250625 03:32:01.833552 4769 leader_election.cc:290] T c5a9463f96314a83b7955d80444b1c29 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
W20250625 03:32:01.839502 3828 leader_election.cc:336] T d08de4c2326d46bab26f42d8d483ebd0 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041): Network error: Client connection negotiation failed: client connection to 127.0.106.130:42041: connect: Connection refused (error 111)
I20250625 03:32:01.840106 3828 leader_election.cc:304] T d08de4c2326d46bab26f42d8d483ebd0 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddc0ad67020f45edb3ba9c83cab687a4; no voters: 01873d289e0b4f9f9184b251369502a9, 3d5b9823dfcd41cb92bd195c811cbf39
I20250625 03:32:01.840884 4738 raft_consensus.cc:2747] T d08de4c2326d46bab26f42d8d483ebd0 P ddc0ad67020f45edb3ba9c83cab687a4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20250625 03:32:01.848884 4738 raft_consensus.cc:491] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01873d289e0b4f9f9184b251369502a9)
I20250625 03:32:01.849401 4738 raft_consensus.cc:513] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:32:01.851298 4738 leader_election.cc:290] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:32:01.853045 4738 raft_consensus.cc:491] T 8ee7d6306b5146ed90a1b8392e062172 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01873d289e0b4f9f9184b251369502a9)
I20250625 03:32:01.853505 4738 raft_consensus.cc:513] T 8ee7d6306b5146ed90a1b8392e062172 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
W20250625 03:32:01.862030 3828 leader_election.cc:336] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Network error: Client connection negotiation failed: client connection to 127.0.106.129:37771: connect: Connection refused (error 111)
W20250625 03:32:01.862612 3828 leader_election.cc:336] T 8ee7d6306b5146ed90a1b8392e062172 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Network error: Client connection negotiation failed: client connection to 127.0.106.129:37771: connect: Connection refused (error 111)
I20250625 03:32:01.855530 4738 leader_election.cc:290] T 8ee7d6306b5146ed90a1b8392e062172 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
W20250625 03:32:01.865516 3828 leader_election.cc:336] T 8ee7d6306b5146ed90a1b8392e062172 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041): Network error: Client connection negotiation failed: client connection to 127.0.106.130:42041: connect: Connection refused (error 111)
I20250625 03:32:01.865975 3828 leader_election.cc:304] T 8ee7d6306b5146ed90a1b8392e062172 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddc0ad67020f45edb3ba9c83cab687a4; no voters: 01873d289e0b4f9f9184b251369502a9, 3d5b9823dfcd41cb92bd195c811cbf39
W20250625 03:32:01.866520 3754 leader_election.cc:336] T c5a9463f96314a83b7955d80444b1c29 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Network error: Client connection negotiation failed: client connection to 127.0.106.129:37771: connect: Connection refused (error 111)
I20250625 03:32:01.866699 4738 raft_consensus.cc:2747] T 8ee7d6306b5146ed90a1b8392e062172 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20250625 03:32:01.868947 3754 leader_election.cc:336] T c5a9463f96314a83b7955d80444b1c29 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041): Network error: Client connection negotiation failed: client connection to 127.0.106.130:42041: connect: Connection refused (error 111)
I20250625 03:32:01.872205 3754 leader_election.cc:304] T c5a9463f96314a83b7955d80444b1c29 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841018313ad649679de64e006582f4c5; no voters: 01873d289e0b4f9f9184b251369502a9, 3d5b9823dfcd41cb92bd195c811cbf39
I20250625 03:32:01.873047 4743 raft_consensus.cc:2747] T c5a9463f96314a83b7955d80444b1c29 P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20250625 03:32:01.873945 3828 leader_election.cc:336] T 39880aedaeca464f81d899dc222a35b9 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 841018313ad649679de64e006582f4c5 (127.0.106.131:39467): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20250625 03:32:01.874856 3828 leader_election.cc:304] T 39880aedaeca464f81d899dc222a35b9 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddc0ad67020f45edb3ba9c83cab687a4; no voters: 01873d289e0b4f9f9184b251369502a9, 841018313ad649679de64e006582f4c5
I20250625 03:32:01.876230 4738 raft_consensus.cc:2747] T 39880aedaeca464f81d899dc222a35b9 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20250625 03:32:01.877427 3828 consensus_peers.cc:487] T 28cf5da85c864698894ed4e1ee38cd86 P ddc0ad67020f45edb3ba9c83cab687a4 -> Peer 841018313ad649679de64e006582f4c5 (127.0.106.131:39467): Couldn't send request to peer 841018313ad649679de64e006582f4c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250625 03:32:01.881671 3828 leader_election.cc:336] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 841018313ad649679de64e006582f4c5 (127.0.106.131:39467): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20250625 03:32:01.882135 3828 leader_election.cc:304] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddc0ad67020f45edb3ba9c83cab687a4; no voters: 01873d289e0b4f9f9184b251369502a9, 841018313ad649679de64e006582f4c5
I20250625 03:32:01.883647 4738 raft_consensus.cc:2747] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20250625 03:32:01.884876 426 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250625 03:32:01.885898 426 tablet_replica.cc:331] T 7c1dda599f144ecfab4c075ee4e28c16 P 841018313ad649679de64e006582f4c5: stopping tablet replica
I20250625 03:32:01.886937 426 raft_consensus.cc:2241] T 7c1dda599f144ecfab4c075ee4e28c16 P 841018313ad649679de64e006582f4c5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:32:01.888140 426 raft_consensus.cc:2270] T 7c1dda599f144ecfab4c075ee4e28c16 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:01.891446 426 tablet_replica.cc:331] T b6311a11ae9e44bea3a7340b8134679b P 841018313ad649679de64e006582f4c5: stopping tablet replica
I20250625 03:32:01.892530 426 raft_consensus.cc:2241] T b6311a11ae9e44bea3a7340b8134679b P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:01.893193 426 raft_consensus.cc:2270] T b6311a11ae9e44bea3a7340b8134679b P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:01.896320 426 tablet_replica.cc:331] T 7257f8e1d9b24e3a9650c5838fe1a8c5 P 841018313ad649679de64e006582f4c5: stopping tablet replica
I20250625 03:32:01.897243 426 raft_consensus.cc:2241] T 7257f8e1d9b24e3a9650c5838fe1a8c5 P 841018313ad649679de64e006582f4c5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:32:01.898324 426 raft_consensus.cc:2270] T 7257f8e1d9b24e3a9650c5838fe1a8c5 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:01.901414 426 tablet_replica.cc:331] T aa64717b3f7d4af893e9908260f4520e P 841018313ad649679de64e006582f4c5: stopping tablet replica
I20250625 03:32:01.903546 426 raft_consensus.cc:2241] T aa64717b3f7d4af893e9908260f4520e P 841018313ad649679de64e006582f4c5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:32:01.904825 426 raft_consensus.cc:2270] T aa64717b3f7d4af893e9908260f4520e P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:01.914054 426 tablet_replica.cc:331] T 6a179f065ae046df819a9bd88194dae6 P 841018313ad649679de64e006582f4c5: stopping tablet replica
I20250625 03:32:01.915117 426 raft_consensus.cc:2241] T 6a179f065ae046df819a9bd88194dae6 P 841018313ad649679de64e006582f4c5 [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:32:01.919243 426 raft_consensus.cc:2270] T 6a179f065ae046df819a9bd88194dae6 P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:01.927824 426 tablet_replica.cc:331] T 41d33fbc861a40338ae6da1732fb696b P 841018313ad649679de64e006582f4c5: stopping tablet replica
I20250625 03:32:01.928841 426 raft_consensus.cc:2241] T 41d33fbc861a40338ae6da1732fb696b P 841018313ad649679de64e006582f4c5 [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:32:01.941668 426 raft_consensus.cc:2270] T 41d33fbc861a40338ae6da1732fb696b P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:01.945988 426 tablet_replica.cc:331] T e91e209dcfdb4fd0bebe666bbbe16b75 P 841018313ad649679de64e006582f4c5: stopping tablet replica
I20250625 03:32:01.947029 426 raft_consensus.cc:2241] T e91e209dcfdb4fd0bebe666bbbe16b75 P 841018313ad649679de64e006582f4c5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:32:01.952930 426 raft_consensus.cc:2270] T e91e209dcfdb4fd0bebe666bbbe16b75 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250625 03:32:01.959133 3828 consensus_peers.cc:487] T e7d3871088394a3ba7a6d18baae1feba P ddc0ad67020f45edb3ba9c83cab687a4 -> Peer 841018313ad649679de64e006582f4c5 (127.0.106.131:39467): Couldn't send request to peer 841018313ad649679de64e006582f4c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:32:01.956168 426 tablet_replica.cc:331] T d657bcfa8eea4e7db43d4d2715857516 P 841018313ad649679de64e006582f4c5: stopping tablet replica
I20250625 03:32:01.961149 426 raft_consensus.cc:2241] T d657bcfa8eea4e7db43d4d2715857516 P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:01.961792 426 raft_consensus.cc:2270] T d657bcfa8eea4e7db43d4d2715857516 P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:01.964756 426 tablet_replica.cc:331] T 162ddcc09f594ed7bcb752f842b6c97c P 841018313ad649679de64e006582f4c5: stopping tablet replica
I20250625 03:32:01.965742 426 raft_consensus.cc:2241] T 162ddcc09f594ed7bcb752f842b6c97c P 841018313ad649679de64e006582f4c5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:32:01.966833 426 raft_consensus.cc:2270] T 162ddcc09f594ed7bcb752f842b6c97c P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:01.969980 426 tablet_replica.cc:331] T 39880aedaeca464f81d899dc222a35b9 P 841018313ad649679de64e006582f4c5: stopping tablet replica
I20250625 03:32:01.970902 426 raft_consensus.cc:2241] T 39880aedaeca464f81d899dc222a35b9 P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:01.971486 426 raft_consensus.cc:2270] T 39880aedaeca464f81d899dc222a35b9 P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:01.974490 426 tablet_replica.cc:331] T 0cf94f40d3434a11b3bfec277069c8c5 P 841018313ad649679de64e006582f4c5: stopping tablet replica
I20250625 03:32:01.975796 426 raft_consensus.cc:2241] T 0cf94f40d3434a11b3bfec277069c8c5 P 841018313ad649679de64e006582f4c5 [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:32:01.976963 426 raft_consensus.cc:2270] T 0cf94f40d3434a11b3bfec277069c8c5 P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:01.979883 426 tablet_replica.cc:331] T c5a9463f96314a83b7955d80444b1c29 P 841018313ad649679de64e006582f4c5: stopping tablet replica
I20250625 03:32:01.980835 426 raft_consensus.cc:2241] T c5a9463f96314a83b7955d80444b1c29 P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:01.981490 426 raft_consensus.cc:2270] T c5a9463f96314a83b7955d80444b1c29 P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:01.984558 426 tablet_replica.cc:331] T caea215a97a344e88348ecb21035902d P 841018313ad649679de64e006582f4c5: stopping tablet replica
I20250625 03:32:01.985524 426 raft_consensus.cc:2241] T caea215a97a344e88348ecb21035902d P 841018313ad649679de64e006582f4c5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:32:01.986690 426 raft_consensus.cc:2270] T caea215a97a344e88348ecb21035902d P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:01.989787 426 tablet_replica.cc:331] T ea706d649de940bf8652264ed57a901f P 841018313ad649679de64e006582f4c5: stopping tablet replica
I20250625 03:32:01.990696 426 raft_consensus.cc:2241] T ea706d649de940bf8652264ed57a901f P 841018313ad649679de64e006582f4c5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:32:01.991770 426 raft_consensus.cc:2270] T ea706d649de940bf8652264ed57a901f P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:01.994874 426 tablet_replica.cc:331] T 6de9e445ad834b008a2f513fac78dba1 P 841018313ad649679de64e006582f4c5: stopping tablet replica
I20250625 03:32:01.995751 426 raft_consensus.cc:2241] T 6de9e445ad834b008a2f513fac78dba1 P 841018313ad649679de64e006582f4c5 [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:32:01.996834 426 raft_consensus.cc:2270] T 6de9e445ad834b008a2f513fac78dba1 P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:01.999825 426 tablet_replica.cc:331] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 841018313ad649679de64e006582f4c5: stopping tablet replica
I20250625 03:32:02.000739 426 raft_consensus.cc:2241] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:02.001310 426 raft_consensus.cc:2270] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.004268 426 tablet_replica.cc:331] T e7d3871088394a3ba7a6d18baae1feba P 841018313ad649679de64e006582f4c5: stopping tablet replica
I20250625 03:32:02.005177 426 raft_consensus.cc:2241] T e7d3871088394a3ba7a6d18baae1feba P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:02.005807 426 raft_consensus.cc:2270] T e7d3871088394a3ba7a6d18baae1feba P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.008809 426 tablet_replica.cc:331] T 5e59ae16ec1a4c69aac820531e504206 P 841018313ad649679de64e006582f4c5: stopping tablet replica
I20250625 03:32:02.009583 426 raft_consensus.cc:2241] T 5e59ae16ec1a4c69aac820531e504206 P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:02.010226 426 raft_consensus.cc:2270] T 5e59ae16ec1a4c69aac820531e504206 P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.013195 426 tablet_replica.cc:331] T 39da7c80318f4c408f8cdaf2229b0c96 P 841018313ad649679de64e006582f4c5: stopping tablet replica
I20250625 03:32:02.014209 426 raft_consensus.cc:2241] T 39da7c80318f4c408f8cdaf2229b0c96 P 841018313ad649679de64e006582f4c5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:32:02.015341 426 raft_consensus.cc:2270] T 39da7c80318f4c408f8cdaf2229b0c96 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.018445 426 tablet_replica.cc:331] T a6b45bf21adf457d9a920f57d758ba15 P 841018313ad649679de64e006582f4c5: stopping tablet replica
I20250625 03:32:02.019343 426 raft_consensus.cc:2241] T a6b45bf21adf457d9a920f57d758ba15 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:02.019948 426 raft_consensus.cc:2270] T a6b45bf21adf457d9a920f57d758ba15 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.022722 426 tablet_replica.cc:331] T 9d985eca3d6f497c86b94c53f16c8ae5 P 841018313ad649679de64e006582f4c5: stopping tablet replica
I20250625 03:32:02.023535 426 raft_consensus.cc:2241] T 9d985eca3d6f497c86b94c53f16c8ae5 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:02.024113 426 raft_consensus.cc:2270] T 9d985eca3d6f497c86b94c53f16c8ae5 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.026963 426 tablet_replica.cc:331] T eeca5a85dddf4d1884917690e01ff81d P 841018313ad649679de64e006582f4c5: stopping tablet replica
I20250625 03:32:02.027745 426 raft_consensus.cc:2241] T eeca5a85dddf4d1884917690e01ff81d P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:02.028329 426 raft_consensus.cc:2270] T eeca5a85dddf4d1884917690e01ff81d P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.031492 4738 raft_consensus.cc:491] T 007d68495d594a73a5e2748f51e7c44c P ddc0ad67020f45edb3ba9c83cab687a4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 01873d289e0b4f9f9184b251369502a9)
I20250625 03:32:02.032169 4738 raft_consensus.cc:513] T 007d68495d594a73a5e2748f51e7c44c P ddc0ad67020f45edb3ba9c83cab687a4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:32:02.033032 426 tablet_replica.cc:331] T 007d68495d594a73a5e2748f51e7c44c P 841018313ad649679de64e006582f4c5: stopping tablet replica
I20250625 03:32:02.033999 426 raft_consensus.cc:2241] T 007d68495d594a73a5e2748f51e7c44c P 841018313ad649679de64e006582f4c5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:02.034296 4738 leader_election.cc:290] T 007d68495d594a73a5e2748f51e7c44c P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:32:02.034582 426 raft_consensus.cc:2270] T 007d68495d594a73a5e2748f51e7c44c P 841018313ad649679de64e006582f4c5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.035338 4743 raft_consensus.cc:491] T b74d9f11c2bc4a7bb6431d6222d45175 P 841018313ad649679de64e006582f4c5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 01873d289e0b4f9f9184b251369502a9)
I20250625 03:32:02.035866 4743 raft_consensus.cc:513] T b74d9f11c2bc4a7bb6431d6222d45175 P 841018313ad649679de64e006582f4c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:32:02.037750 426 tablet_replica.cc:331] T 002d4371d5414440b756829fe3343d07 P 841018313ad649679de64e006582f4c5: stopping tablet replica
I20250625 03:32:02.038534 4743 leader_election.cc:290] T b74d9f11c2bc4a7bb6431d6222d45175 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:32:02.040230 3858 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b74d9f11c2bc4a7bb6431d6222d45175" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:32:02.040896 3858 raft_consensus.cc:2466] T b74d9f11c2bc4a7bb6431d6222d45175 P ddc0ad67020f45edb3ba9c83cab687a4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841018313ad649679de64e006582f4c5 in term 3.
I20250625 03:32:02.042316 3753 leader_election.cc:304] T b74d9f11c2bc4a7bb6431d6222d45175 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841018313ad649679de64e006582f4c5, ddc0ad67020f45edb3ba9c83cab687a4; no voters:
W20250625 03:32:02.045053 3754 leader_election.cc:336] T b74d9f11c2bc4a7bb6431d6222d45175 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Network error: Client connection negotiation failed: client connection to 127.0.106.129:37771: connect: Connection refused (error 111)
I20250625 03:32:02.045933 4743 raft_consensus.cc:2802] T b74d9f11c2bc4a7bb6431d6222d45175 P 841018313ad649679de64e006582f4c5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20250625 03:32:02.046245 426 raft_consensus.cc:2241] T 002d4371d5414440b756829fe3343d07 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:02.046497 4743 raft_consensus.cc:491] T b74d9f11c2bc4a7bb6431d6222d45175 P 841018313ad649679de64e006582f4c5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 01873d289e0b4f9f9184b251369502a9)
I20250625 03:32:02.047022 426 raft_consensus.cc:2270] T 002d4371d5414440b756829fe3343d07 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.047133 4743 raft_consensus.cc:3058] T b74d9f11c2bc4a7bb6431d6222d45175 P 841018313ad649679de64e006582f4c5 [term 3 FOLLOWER]: Advancing to term 4
I20250625 03:32:02.050230 426 tablet_replica.cc:331] T d00ad2472fd74bfc9065d9dc4808e0c1 P 841018313ad649679de64e006582f4c5: stopping tablet replica
I20250625 03:32:02.051115 426 raft_consensus.cc:2241] T d00ad2472fd74bfc9065d9dc4808e0c1 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:02.051692 426 raft_consensus.cc:2270] T d00ad2472fd74bfc9065d9dc4808e0c1 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.055294 426 tablet_replica.cc:331] T 7a8ecc65ca1140beb905dd6368bfaa2a P 841018313ad649679de64e006582f4c5: stopping tablet replica
I20250625 03:32:02.056178 426 raft_consensus.cc:2241] T 7a8ecc65ca1140beb905dd6368bfaa2a P 841018313ad649679de64e006582f4c5 [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:32:02.057281 426 raft_consensus.cc:2270] T 7a8ecc65ca1140beb905dd6368bfaa2a P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.060441 426 tablet_replica.cc:331] T 1e9c146f8cd743f7ac35dc61d9226d1d P 841018313ad649679de64e006582f4c5: stopping tablet replica
I20250625 03:32:02.061339 426 raft_consensus.cc:2241] T 1e9c146f8cd743f7ac35dc61d9226d1d P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:02.061939 426 raft_consensus.cc:2270] T 1e9c146f8cd743f7ac35dc61d9226d1d P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.064805 426 tablet_replica.cc:331] T 28cf5da85c864698894ed4e1ee38cd86 P 841018313ad649679de64e006582f4c5: stopping tablet replica
I20250625 03:32:02.065637 426 raft_consensus.cc:2241] T 28cf5da85c864698894ed4e1ee38cd86 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:02.066226 426 raft_consensus.cc:2270] T 28cf5da85c864698894ed4e1ee38cd86 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.069049 426 tablet_replica.cc:331] T 5ece5f5b2a904c9cbef3065e210e9a30 P 841018313ad649679de64e006582f4c5: stopping tablet replica
I20250625 03:32:02.069948 426 raft_consensus.cc:2241] T 5ece5f5b2a904c9cbef3065e210e9a30 P 841018313ad649679de64e006582f4c5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:32:02.070997 426 raft_consensus.cc:2270] T 5ece5f5b2a904c9cbef3065e210e9a30 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.073907 426 tablet_replica.cc:331] T 6fc84ca2087c4ded91412fb32117af48 P 841018313ad649679de64e006582f4c5: stopping tablet replica
I20250625 03:32:02.074741 426 raft_consensus.cc:2241] T 6fc84ca2087c4ded91412fb32117af48 P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:02.075320 426 raft_consensus.cc:2270] T 6fc84ca2087c4ded91412fb32117af48 P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.078071 426 tablet_replica.cc:331] T 7e92fd94b9f24b1097e9a7373896cb26 P 841018313ad649679de64e006582f4c5: stopping tablet replica
I20250625 03:32:02.078876 426 raft_consensus.cc:2241] T 7e92fd94b9f24b1097e9a7373896cb26 P 841018313ad649679de64e006582f4c5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:02.079435 426 raft_consensus.cc:2270] T 7e92fd94b9f24b1097e9a7373896cb26 P 841018313ad649679de64e006582f4c5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.082440 426 tablet_replica.cc:331] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 841018313ad649679de64e006582f4c5: stopping tablet replica
I20250625 03:32:02.083266 426 raft_consensus.cc:2241] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:02.083882 426 raft_consensus.cc:2270] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.086799 426 tablet_replica.cc:331] T 06f309640df64f97a4065b1420fea692 P 841018313ad649679de64e006582f4c5: stopping tablet replica
I20250625 03:32:02.087647 426 raft_consensus.cc:2241] T 06f309640df64f97a4065b1420fea692 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:02.088392 426 raft_consensus.cc:2270] T 06f309640df64f97a4065b1420fea692 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.093999 426 tablet_replica.cc:331] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 841018313ad649679de64e006582f4c5: stopping tablet replica
I20250625 03:32:02.095837 426 raft_consensus.cc:2241] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Raft consensus shutting down.
W20250625 03:32:02.090174 3828 leader_election.cc:336] T 007d68495d594a73a5e2748f51e7c44c P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 841018313ad649679de64e006582f4c5 (127.0.106.131:39467): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20250625 03:32:02.094390 4743 raft_consensus.cc:513] T b74d9f11c2bc4a7bb6431d6222d45175 P 841018313ad649679de64e006582f4c5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:32:02.098469 4743 leader_election.cc:290] T b74d9f11c2bc4a7bb6431d6222d45175 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 4 election: Requested vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:32:02.096554 426 raft_consensus.cc:2270] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.099095 3858 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b74d9f11c2bc4a7bb6431d6222d45175" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4"
I20250625 03:32:02.101467 426 tablet_replica.cc:331] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 841018313ad649679de64e006582f4c5: stopping tablet replica
I20250625 03:32:02.102404 426 raft_consensus.cc:2241] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 841018313ad649679de64e006582f4c5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:32:02.103458 426 raft_consensus.cc:2270] T db241b7e8b2a45f297e0bbd9ba86cdd8 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.099761 3858 raft_consensus.cc:3058] T b74d9f11c2bc4a7bb6431d6222d45175 P ddc0ad67020f45edb3ba9c83cab687a4 [term 3 FOLLOWER]: Advancing to term 4
I20250625 03:32:02.106424 426 tablet_replica.cc:331] T bccba871bcd747fd80a890b25628ebe2 P 841018313ad649679de64e006582f4c5: stopping tablet replica
I20250625 03:32:02.107300 426 raft_consensus.cc:2241] T bccba871bcd747fd80a890b25628ebe2 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:02.107937 426 raft_consensus.cc:2270] T bccba871bcd747fd80a890b25628ebe2 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250625 03:32:02.110626 3754 leader_election.cc:336] T b74d9f11c2bc4a7bb6431d6222d45175 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Network error: Client connection negotiation failed: client connection to 127.0.106.129:37771: connect: Connection refused (error 111)
I20250625 03:32:02.111074 426 tablet_replica.cc:331] T b1ece928b2e2452191ee263cf19ec4f8 P 841018313ad649679de64e006582f4c5: stopping tablet replica
I20250625 03:32:02.111558 4738 raft_consensus.cc:491] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01873d289e0b4f9f9184b251369502a9)
I20250625 03:32:02.112267 426 raft_consensus.cc:2241] T b1ece928b2e2452191ee263cf19ec4f8 P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:02.112180 4738 raft_consensus.cc:513] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:32:02.113085 426 raft_consensus.cc:2270] T b1ece928b2e2452191ee263cf19ec4f8 P 841018313ad649679de64e006582f4c5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.114104 4775 raft_consensus.cc:491] T 49d4fb2581ed4ef998f6a113ea67c323 P ddc0ad67020f45edb3ba9c83cab687a4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 01873d289e0b4f9f9184b251369502a9)
I20250625 03:32:02.114678 4775 raft_consensus.cc:513] T 49d4fb2581ed4ef998f6a113ea67c323 P ddc0ad67020f45edb3ba9c83cab687a4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:32:02.116619 426 tablet_replica.cc:331] T 485f3e9350e245a9939133866b354302 P 841018313ad649679de64e006582f4c5: stopping tablet replica
I20250625 03:32:02.116734 4775 leader_election.cc:290] T 49d4fb2581ed4ef998f6a113ea67c323 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:32:02.117774 426 raft_consensus.cc:2241] T 485f3e9350e245a9939133866b354302 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:02.118455 426 raft_consensus.cc:2270] T 485f3e9350e245a9939133866b354302 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.121031 4743 raft_consensus.cc:491] T 49d4fb2581ed4ef998f6a113ea67c323 P 841018313ad649679de64e006582f4c5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 01873d289e0b4f9f9184b251369502a9)
I20250625 03:32:02.121555 4743 raft_consensus.cc:513] T 49d4fb2581ed4ef998f6a113ea67c323 P 841018313ad649679de64e006582f4c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:32:02.123768 4743 leader_election.cc:290] T 49d4fb2581ed4ef998f6a113ea67c323 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:32:02.124989 3859 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "49d4fb2581ed4ef998f6a113ea67c323" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" is_pre_election: true
I20250625 03:32:02.125339 426 tablet_replica.cc:331] T b74d9f11c2bc4a7bb6431d6222d45175 P 841018313ad649679de64e006582f4c5: stopping tablet replica
I20250625 03:32:02.125834 3859 raft_consensus.cc:2466] T 49d4fb2581ed4ef998f6a113ea67c323 P ddc0ad67020f45edb3ba9c83cab687a4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841018313ad649679de64e006582f4c5 in term 3.
I20250625 03:32:02.126439 426 raft_consensus.cc:2241] T b74d9f11c2bc4a7bb6431d6222d45175 P 841018313ad649679de64e006582f4c5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:02.127199 426 raft_consensus.cc:2270] T b74d9f11c2bc4a7bb6431d6222d45175 P 841018313ad649679de64e006582f4c5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.127480 3753 leader_election.cc:304] T 49d4fb2581ed4ef998f6a113ea67c323 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841018313ad649679de64e006582f4c5, ddc0ad67020f45edb3ba9c83cab687a4; no voters:
I20250625 03:32:02.128351 4743 raft_consensus.cc:2802] T 49d4fb2581ed4ef998f6a113ea67c323 P 841018313ad649679de64e006582f4c5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20250625 03:32:02.128738 4743 raft_consensus.cc:491] T 49d4fb2581ed4ef998f6a113ea67c323 P 841018313ad649679de64e006582f4c5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 01873d289e0b4f9f9184b251369502a9)
I20250625 03:32:02.129107 4743 raft_consensus.cc:3058] T 49d4fb2581ed4ef998f6a113ea67c323 P 841018313ad649679de64e006582f4c5 [term 3 FOLLOWER]: Advancing to term 4
I20250625 03:32:02.137336 4743 raft_consensus.cc:513] T 49d4fb2581ed4ef998f6a113ea67c323 P 841018313ad649679de64e006582f4c5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
I20250625 03:32:02.140475 426 tablet_replica.cc:331] T 036dfe9e6b844fc6964b3b5e371f8c95 P 841018313ad649679de64e006582f4c5: stopping tablet replica
I20250625 03:32:02.141443 426 raft_consensus.cc:2241] T 036dfe9e6b844fc6964b3b5e371f8c95 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:02.142196 426 raft_consensus.cc:2270] T 036dfe9e6b844fc6964b3b5e371f8c95 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.145067 426 tablet_replica.cc:331] T 3ecdd525d6fd47deacf323decbc5c329 P 841018313ad649679de64e006582f4c5: stopping tablet replica
I20250625 03:32:02.145897 426 raft_consensus.cc:2241] T 3ecdd525d6fd47deacf323decbc5c329 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:02.146487 426 raft_consensus.cc:2270] T 3ecdd525d6fd47deacf323decbc5c329 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250625 03:32:02.147014 3828 leader_election.cc:336] T 007d68495d594a73a5e2748f51e7c44c P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Network error: Client connection negotiation failed: client connection to 127.0.106.129:37771: connect: Connection refused (error 111)
W20250625 03:32:02.140512 3754 leader_election.cc:336] T 49d4fb2581ed4ef998f6a113ea67c323 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Network error: Client connection negotiation failed: client connection to 127.0.106.129:37771: connect: Connection refused (error 111)
I20250625 03:32:02.149935 3859 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "49d4fb2581ed4ef998f6a113ea67c323" candidate_uuid: "841018313ad649679de64e006582f4c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddc0ad67020f45edb3ba9c83cab687a4"
I20250625 03:32:02.150084 4743 leader_election.cc:290] T 49d4fb2581ed4ef998f6a113ea67c323 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 4 election: Requested vote from peers ddc0ad67020f45edb3ba9c83cab687a4 (127.0.106.132:37353), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:32:02.152905 3859 raft_consensus.cc:3058] T 49d4fb2581ed4ef998f6a113ea67c323 P ddc0ad67020f45edb3ba9c83cab687a4 [term 3 FOLLOWER]: Advancing to term 4
I20250625 03:32:02.152084 426 tablet_replica.cc:331] T 2e956665b7e4411f86cf77259093c8aa P 841018313ad649679de64e006582f4c5: stopping tablet replica
I20250625 03:32:02.154786 426 raft_consensus.cc:2241] T 2e956665b7e4411f86cf77259093c8aa P 841018313ad649679de64e006582f4c5 [term 3 LEADER]: Raft consensus shutting down.
I20250625 03:32:02.155812 426 raft_consensus.cc:2270] T 2e956665b7e4411f86cf77259093c8aa P 841018313ad649679de64e006582f4c5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.158668 426 tablet_replica.cc:331] T 49d4fb2581ed4ef998f6a113ea67c323 P 841018313ad649679de64e006582f4c5: stopping tablet replica
I20250625 03:32:02.159391 426 raft_consensus.cc:2241] T 49d4fb2581ed4ef998f6a113ea67c323 P 841018313ad649679de64e006582f4c5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:02.159951 426 raft_consensus.cc:2270] T 49d4fb2581ed4ef998f6a113ea67c323 P 841018313ad649679de64e006582f4c5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.162961 4775 raft_consensus.cc:491] T f3a33aa1d146468c986f0b1ba7d5fb84 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01873d289e0b4f9f9184b251369502a9)
I20250625 03:32:02.163579 4775 raft_consensus.cc:513] T f3a33aa1d146468c986f0b1ba7d5fb84 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } }
W20250625 03:32:02.163863 3754 leader_election.cc:336] T 49d4fb2581ed4ef998f6a113ea67c323 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Network error: Client connection negotiation failed: client connection to 127.0.106.129:37771: connect: Connection refused (error 111)
I20250625 03:32:02.165035 3828 leader_election.cc:304] T 007d68495d594a73a5e2748f51e7c44c P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddc0ad67020f45edb3ba9c83cab687a4; no voters: 01873d289e0b4f9f9184b251369502a9, 841018313ad649679de64e006582f4c5
I20250625 03:32:02.151939 4738 leader_election.cc:290] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 841018313ad649679de64e006582f4c5 (127.0.106.131:39467), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:32:02.165771 4775 leader_election.cc:290] T f3a33aa1d146468c986f0b1ba7d5fb84 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041), 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771)
I20250625 03:32:02.166484 4736 raft_consensus.cc:2747] T 007d68495d594a73a5e2748f51e7c44c P ddc0ad67020f45edb3ba9c83cab687a4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20250625 03:32:02.166777 426 tablet_replica.cc:331] T c0c8dfded31e4566b07bc439f6e58ef6 P 841018313ad649679de64e006582f4c5: stopping tablet replica
I20250625 03:32:02.167557 426 raft_consensus.cc:2241] T c0c8dfded31e4566b07bc439f6e58ef6 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:02.168144 426 raft_consensus.cc:2270] T c0c8dfded31e4566b07bc439f6e58ef6 P 841018313ad649679de64e006582f4c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.185820 3858 raft_consensus.cc:2466] T b74d9f11c2bc4a7bb6431d6222d45175 P ddc0ad67020f45edb3ba9c83cab687a4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841018313ad649679de64e006582f4c5 in term 4.
I20250625 03:32:02.188669 3753 leader_election.cc:304] T b74d9f11c2bc4a7bb6431d6222d45175 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841018313ad649679de64e006582f4c5, ddc0ad67020f45edb3ba9c83cab687a4; no voters: 01873d289e0b4f9f9184b251369502a9
W20250625 03:32:02.189502 3753 raft_consensus.cc:2684] T b74d9f11c2bc4a7bb6431d6222d45175 P 841018313ad649679de64e006582f4c5: unable to run election callback: Service unavailable: Thread pool token was shut down
I20250625 03:32:02.195415 3859 raft_consensus.cc:2466] T 49d4fb2581ed4ef998f6a113ea67c323 P ddc0ad67020f45edb3ba9c83cab687a4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841018313ad649679de64e006582f4c5 in term 4.
I20250625 03:32:02.202612 3753 leader_election.cc:304] T 49d4fb2581ed4ef998f6a113ea67c323 P 841018313ad649679de64e006582f4c5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841018313ad649679de64e006582f4c5, ddc0ad67020f45edb3ba9c83cab687a4; no voters: 01873d289e0b4f9f9184b251369502a9
W20250625 03:32:02.203809 3753 raft_consensus.cc:2684] T 49d4fb2581ed4ef998f6a113ea67c323 P 841018313ad649679de64e006582f4c5: unable to run election callback: Service unavailable: Thread pool token was shut down
W20250625 03:32:02.248582 3828 consensus_peers.cc:487] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P ddc0ad67020f45edb3ba9c83cab687a4 -> Peer 841018313ad649679de64e006582f4c5 (127.0.106.131:39467): Couldn't send request to peer 841018313ad649679de64e006582f4c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250625 03:32:02.249445 3828 consensus_peers.cc:487] T 485f3e9350e245a9939133866b354302 P ddc0ad67020f45edb3ba9c83cab687a4 -> Peer 841018313ad649679de64e006582f4c5 (127.0.106.131:39467): Couldn't send request to peer 841018313ad649679de64e006582f4c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250625 03:32:02.251045 3828 consensus_peers.cc:487] T 1e9c146f8cd743f7ac35dc61d9226d1d P ddc0ad67020f45edb3ba9c83cab687a4 -> Peer 841018313ad649679de64e006582f4c5 (127.0.106.131:39467): Couldn't send request to peer 841018313ad649679de64e006582f4c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250625 03:32:02.256567 3828 leader_election.cc:336] T 49d4fb2581ed4ef998f6a113ea67c323 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Network error: Client connection negotiation failed: client connection to 127.0.106.129:37771: connect: Connection refused (error 111)
W20250625 03:32:02.257360 3828 leader_election.cc:336] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Network error: Client connection negotiation failed: client connection to 127.0.106.129:37771: connect: Connection refused (error 111)
W20250625 03:32:02.257937 3828 leader_election.cc:336] T f3a33aa1d146468c986f0b1ba7d5fb84 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Network error: Client connection negotiation failed: client connection to 127.0.106.129:37771: connect: Connection refused (error 111)
W20250625 03:32:02.258816 3828 leader_election.cc:336] T f3a33aa1d146468c986f0b1ba7d5fb84 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041): Network error: Client connection negotiation failed: client connection to 127.0.106.130:42041: connect: Connection refused (error 111)
I20250625 03:32:02.259250 3828 leader_election.cc:304] T f3a33aa1d146468c986f0b1ba7d5fb84 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddc0ad67020f45edb3ba9c83cab687a4; no voters: 01873d289e0b4f9f9184b251369502a9, 3d5b9823dfcd41cb92bd195c811cbf39
I20250625 03:32:02.260079 4738 raft_consensus.cc:2747] T f3a33aa1d146468c986f0b1ba7d5fb84 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20250625 03:32:02.264369 3828 connection.cc:700] client connection to 127.0.106.131:39467 send error: Network error: sendmsg error: Broken pipe (error 32)
W20250625 03:32:02.264930 3828 consensus_peers.cc:487] T b6311a11ae9e44bea3a7340b8134679b P ddc0ad67020f45edb3ba9c83cab687a4 -> Peer 841018313ad649679de64e006582f4c5 (127.0.106.131:39467): Couldn't send request to peer 841018313ad649679de64e006582f4c5. Status: Network error: sendmsg error: Broken pipe (error 32). This is attempt 1: this message will repeat every 5th retry.
W20250625 03:32:02.265434 3828 leader_election.cc:336] T 49d4fb2581ed4ef998f6a113ea67c323 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 841018313ad649679de64e006582f4c5 (127.0.106.131:39467): Network error: sendmsg error: Broken pipe (error 32)
I20250625 03:32:02.265872 3828 leader_election.cc:304] T 49d4fb2581ed4ef998f6a113ea67c323 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddc0ad67020f45edb3ba9c83cab687a4; no voters: 01873d289e0b4f9f9184b251369502a9, 841018313ad649679de64e006582f4c5
I20250625 03:32:02.266698 4738 raft_consensus.cc:2747] T 49d4fb2581ed4ef998f6a113ea67c323 P ddc0ad67020f45edb3ba9c83cab687a4 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20250625 03:32:02.274595 3828 consensus_peers.cc:487] T 036dfe9e6b844fc6964b3b5e371f8c95 P ddc0ad67020f45edb3ba9c83cab687a4 -> Peer 841018313ad649679de64e006582f4c5 (127.0.106.131:39467): Couldn't send request to peer 841018313ad649679de64e006582f4c5. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.131:39467: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250625 03:32:02.275243 3828 leader_election.cc:336] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 841018313ad649679de64e006582f4c5 (127.0.106.131:39467): Network error: Client connection negotiation failed: client connection to 127.0.106.131:39467: connect: Connection refused (error 111)
I20250625 03:32:02.275619 3828 leader_election.cc:304] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddc0ad67020f45edb3ba9c83cab687a4; no voters: 01873d289e0b4f9f9184b251369502a9, 841018313ad649679de64e006582f4c5
I20250625 03:32:02.276201 426 tablet_server.cc:195] TabletServer@127.0.106.131:0 shutdown complete.
I20250625 03:32:02.276382 4738 raft_consensus.cc:2747] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20250625 03:32:02.386456 426 tablet_server.cc:178] TabletServer@127.0.106.132:0 shutting down...
I20250625 03:32:02.410555 4775 raft_consensus.cc:491] T eeca5a85dddf4d1884917690e01ff81d P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d5b9823dfcd41cb92bd195c811cbf39)
I20250625 03:32:02.411242 4775 raft_consensus.cc:513] T eeca5a85dddf4d1884917690e01ff81d P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
I20250625 03:32:02.413379 4775 leader_election.cc:290] T eeca5a85dddf4d1884917690e01ff81d P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041), 841018313ad649679de64e006582f4c5 (127.0.106.131:39467)
W20250625 03:32:02.423116 3828 leader_election.cc:336] T eeca5a85dddf4d1884917690e01ff81d P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041): Network error: Client connection negotiation failed: client connection to 127.0.106.130:42041: connect: Connection refused (error 111)
W20250625 03:32:02.425295 3828 leader_election.cc:336] T eeca5a85dddf4d1884917690e01ff81d P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 841018313ad649679de64e006582f4c5 (127.0.106.131:39467): Network error: Client connection negotiation failed: client connection to 127.0.106.131:39467: connect: Connection refused (error 111)
I20250625 03:32:02.425750 3828 leader_election.cc:304] T eeca5a85dddf4d1884917690e01ff81d P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddc0ad67020f45edb3ba9c83cab687a4; no voters: 3d5b9823dfcd41cb92bd195c811cbf39, 841018313ad649679de64e006582f4c5
I20250625 03:32:02.426739 4775 raft_consensus.cc:2747] T eeca5a85dddf4d1884917690e01ff81d P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20250625 03:32:02.451136 4736 raft_consensus.cc:491] T e638ce3a86d242fcadb10cdf57f5960d P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d5b9823dfcd41cb92bd195c811cbf39)
I20250625 03:32:02.451638 4736 raft_consensus.cc:513] T e638ce3a86d242fcadb10cdf57f5960d P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } } peers { permanent_uuid: "01873d289e0b4f9f9184b251369502a9" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 37771 } } peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } }
I20250625 03:32:02.453558 4736 leader_election.cc:290] T e638ce3a86d242fcadb10cdf57f5960d P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771), 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041)
I20250625 03:32:02.458518 4736 raft_consensus.cc:491] T 6fc84ca2087c4ded91412fb32117af48 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d5b9823dfcd41cb92bd195c811cbf39)
I20250625 03:32:02.459100 4736 raft_consensus.cc:513] T 6fc84ca2087c4ded91412fb32117af48 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5b9823dfcd41cb92bd195c811cbf39" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 42041 } } peers { permanent_uuid: "841018313ad649679de64e006582f4c5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 39467 } } peers { permanent_uuid: "ddc0ad67020f45edb3ba9c83cab687a4" member_type: VOTER last_known_addr { host: "127.0.106.132" port: 37353 } }
W20250625 03:32:02.459503 3828 leader_election.cc:336] T e638ce3a86d242fcadb10cdf57f5960d P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 01873d289e0b4f9f9184b251369502a9 (127.0.106.129:37771): Network error: Client connection negotiation failed: client connection to 127.0.106.129:37771: connect: Connection refused (error 111)
I20250625 03:32:02.460399 426 ts_tablet_manager.cc:1500] Shutting down tablet manager...
W20250625 03:32:02.460233 3828 leader_election.cc:336] T e638ce3a86d242fcadb10cdf57f5960d P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041): Network error: Client connection negotiation failed: client connection to 127.0.106.130:42041: connect: Connection refused (error 111)
I20250625 03:32:02.461262 4736 leader_election.cc:290] T 6fc84ca2087c4ded91412fb32117af48 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041), 841018313ad649679de64e006582f4c5 (127.0.106.131:39467)
I20250625 03:32:02.461385 426 tablet_replica.cc:331] T 7c1dda599f144ecfab4c075ee4e28c16 P ddc0ad67020f45edb3ba9c83cab687a4: stopping tablet replica
I20250625 03:32:02.462623 426 raft_consensus.cc:2241] T 7c1dda599f144ecfab4c075ee4e28c16 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:02.460803 3828 leader_election.cc:304] T e638ce3a86d242fcadb10cdf57f5960d P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddc0ad67020f45edb3ba9c83cab687a4; no voters: 01873d289e0b4f9f9184b251369502a9, 3d5b9823dfcd41cb92bd195c811cbf39
I20250625 03:32:02.463224 426 raft_consensus.cc:2270] T 7c1dda599f144ecfab4c075ee4e28c16 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.463577 4736 raft_consensus.cc:2747] T e638ce3a86d242fcadb10cdf57f5960d P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250625 03:32:02.465996 426 tablet_replica.cc:331] T 7257f8e1d9b24e3a9650c5838fe1a8c5 P ddc0ad67020f45edb3ba9c83cab687a4: stopping tablet replica
I20250625 03:32:02.466905 426 raft_consensus.cc:2241] T 7257f8e1d9b24e3a9650c5838fe1a8c5 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:02.468410 426 raft_consensus.cc:2270] T 7257f8e1d9b24e3a9650c5838fe1a8c5 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250625 03:32:02.470427 3828 leader_election.cc:336] T 6fc84ca2087c4ded91412fb32117af48 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3d5b9823dfcd41cb92bd195c811cbf39 (127.0.106.130:42041): Network error: Client connection negotiation failed: client connection to 127.0.106.130:42041: connect: Connection refused (error 111)
I20250625 03:32:02.471069 426 tablet_replica.cc:331] T b6311a11ae9e44bea3a7340b8134679b P ddc0ad67020f45edb3ba9c83cab687a4: stopping tablet replica
W20250625 03:32:02.471144 3828 leader_election.cc:336] T 6fc84ca2087c4ded91412fb32117af48 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 841018313ad649679de64e006582f4c5 (127.0.106.131:39467): Network error: Client connection negotiation failed: client connection to 127.0.106.131:39467: connect: Connection refused (error 111)
I20250625 03:32:02.471645 3828 leader_election.cc:304] T 6fc84ca2087c4ded91412fb32117af48 P ddc0ad67020f45edb3ba9c83cab687a4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddc0ad67020f45edb3ba9c83cab687a4; no voters: 3d5b9823dfcd41cb92bd195c811cbf39, 841018313ad649679de64e006582f4c5
I20250625 03:32:02.472110 426 raft_consensus.cc:2241] T b6311a11ae9e44bea3a7340b8134679b P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:32:02.472407 4736 raft_consensus.cc:2747] T 6fc84ca2087c4ded91412fb32117af48 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20250625 03:32:02.474052 426 raft_consensus.cc:2270] T b6311a11ae9e44bea3a7340b8134679b P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.477989 426 tablet_replica.cc:331] T d83c6c79a784452289ba414976adb9e0 P ddc0ad67020f45edb3ba9c83cab687a4: stopping tablet replica
I20250625 03:32:02.478804 426 raft_consensus.cc:2241] T d83c6c79a784452289ba414976adb9e0 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:32:02.480252 426 raft_consensus.cc:2270] T d83c6c79a784452289ba414976adb9e0 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.482420 426 tablet_replica.cc:331] T e91e209dcfdb4fd0bebe666bbbe16b75 P ddc0ad67020f45edb3ba9c83cab687a4: stopping tablet replica
I20250625 03:32:02.483035 426 raft_consensus.cc:2241] T e91e209dcfdb4fd0bebe666bbbe16b75 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:02.483426 426 raft_consensus.cc:2270] T e91e209dcfdb4fd0bebe666bbbe16b75 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.485311 426 tablet_replica.cc:331] T 5350a260b3364354b73176e6bdd77940 P ddc0ad67020f45edb3ba9c83cab687a4: stopping tablet replica
I20250625 03:32:02.485868 426 raft_consensus.cc:2241] T 5350a260b3364354b73176e6bdd77940 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:32:02.486562 426 raft_consensus.cc:2270] T 5350a260b3364354b73176e6bdd77940 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.489583 426 tablet_replica.cc:331] T 39880aedaeca464f81d899dc222a35b9 P ddc0ad67020f45edb3ba9c83cab687a4: stopping tablet replica
I20250625 03:32:02.491019 426 raft_consensus.cc:2241] T 39880aedaeca464f81d899dc222a35b9 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:02.491638 426 raft_consensus.cc:2270] T 39880aedaeca464f81d899dc222a35b9 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.493918 426 tablet_replica.cc:331] T 162ddcc09f594ed7bcb752f842b6c97c P ddc0ad67020f45edb3ba9c83cab687a4: stopping tablet replica
I20250625 03:32:02.494616 426 raft_consensus.cc:2241] T 162ddcc09f594ed7bcb752f842b6c97c P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:02.495117 426 raft_consensus.cc:2270] T 162ddcc09f594ed7bcb752f842b6c97c P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.498175 426 tablet_replica.cc:331] T 41d33fbc861a40338ae6da1732fb696b P ddc0ad67020f45edb3ba9c83cab687a4: stopping tablet replica
I20250625 03:32:02.498973 426 raft_consensus.cc:2241] T 41d33fbc861a40338ae6da1732fb696b P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:02.499500 426 raft_consensus.cc:2270] T 41d33fbc861a40338ae6da1732fb696b P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.502223 426 tablet_replica.cc:331] T 4b38a4199d1d44988233b6d8604d1a96 P ddc0ad67020f45edb3ba9c83cab687a4: stopping tablet replica
I20250625 03:32:02.503026 426 raft_consensus.cc:2241] T 4b38a4199d1d44988233b6d8604d1a96 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:32:02.503937 426 raft_consensus.cc:2270] T 4b38a4199d1d44988233b6d8604d1a96 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.507325 426 tablet_replica.cc:331] T caea215a97a344e88348ecb21035902d P ddc0ad67020f45edb3ba9c83cab687a4: stopping tablet replica
I20250625 03:32:02.508083 426 raft_consensus.cc:2241] T caea215a97a344e88348ecb21035902d P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:02.508594 426 raft_consensus.cc:2270] T caea215a97a344e88348ecb21035902d P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.510589 426 tablet_replica.cc:331] T 8ee7d6306b5146ed90a1b8392e062172 P ddc0ad67020f45edb3ba9c83cab687a4: stopping tablet replica
I20250625 03:32:02.511116 426 raft_consensus.cc:2241] T 8ee7d6306b5146ed90a1b8392e062172 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:02.511492 426 raft_consensus.cc:2270] T 8ee7d6306b5146ed90a1b8392e062172 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.513307 426 tablet_replica.cc:331] T eeca5a85dddf4d1884917690e01ff81d P ddc0ad67020f45edb3ba9c83cab687a4: stopping tablet replica
I20250625 03:32:02.513828 426 raft_consensus.cc:2241] T eeca5a85dddf4d1884917690e01ff81d P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:02.514201 426 raft_consensus.cc:2270] T eeca5a85dddf4d1884917690e01ff81d P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.516187 426 tablet_replica.cc:331] T 6de9e445ad834b008a2f513fac78dba1 P ddc0ad67020f45edb3ba9c83cab687a4: stopping tablet replica
I20250625 03:32:02.516752 426 raft_consensus.cc:2241] T 6de9e445ad834b008a2f513fac78dba1 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:02.517172 426 raft_consensus.cc:2270] T 6de9e445ad834b008a2f513fac78dba1 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.519007 426 tablet_replica.cc:331] T ea706d649de940bf8652264ed57a901f P ddc0ad67020f45edb3ba9c83cab687a4: stopping tablet replica
I20250625 03:32:02.519518 426 raft_consensus.cc:2241] T ea706d649de940bf8652264ed57a901f P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:02.519891 426 raft_consensus.cc:2270] T ea706d649de940bf8652264ed57a901f P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.521831 426 tablet_replica.cc:331] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P ddc0ad67020f45edb3ba9c83cab687a4: stopping tablet replica
I20250625 03:32:02.522341 426 raft_consensus.cc:2241] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:02.522730 426 raft_consensus.cc:2270] T 559ad5ac1bd14e8c8da7a2e7419cfcc6 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.524600 426 tablet_replica.cc:331] T 6afeedd3b768470f921526d58704c21d P ddc0ad67020f45edb3ba9c83cab687a4: stopping tablet replica
I20250625 03:32:02.525306 426 raft_consensus.cc:2241] T 6afeedd3b768470f921526d58704c21d P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:02.525862 426 raft_consensus.cc:2270] T 6afeedd3b768470f921526d58704c21d P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.528750 426 tablet_replica.cc:331] T 2e956665b7e4411f86cf77259093c8aa P ddc0ad67020f45edb3ba9c83cab687a4: stopping tablet replica
I20250625 03:32:02.529522 426 raft_consensus.cc:2241] T 2e956665b7e4411f86cf77259093c8aa P ddc0ad67020f45edb3ba9c83cab687a4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:02.530052 426 raft_consensus.cc:2270] T 2e956665b7e4411f86cf77259093c8aa P ddc0ad67020f45edb3ba9c83cab687a4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.532076 426 tablet_replica.cc:331] T 036dfe9e6b844fc6964b3b5e371f8c95 P ddc0ad67020f45edb3ba9c83cab687a4: stopping tablet replica
I20250625 03:32:02.532567 426 raft_consensus.cc:2241] T 036dfe9e6b844fc6964b3b5e371f8c95 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:32:02.533300 426 raft_consensus.cc:2270] T 036dfe9e6b844fc6964b3b5e371f8c95 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.535671 426 tablet_replica.cc:331] T b74d9f11c2bc4a7bb6431d6222d45175 P ddc0ad67020f45edb3ba9c83cab687a4: stopping tablet replica
I20250625 03:32:02.536397 426 raft_consensus.cc:2241] T b74d9f11c2bc4a7bb6431d6222d45175 P ddc0ad67020f45edb3ba9c83cab687a4 [term 4 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:02.536922 426 raft_consensus.cc:2270] T b74d9f11c2bc4a7bb6431d6222d45175 P ddc0ad67020f45edb3ba9c83cab687a4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.539330 426 tablet_replica.cc:331] T 526951ad467a4708926096ed1162a722 P ddc0ad67020f45edb3ba9c83cab687a4: stopping tablet replica
I20250625 03:32:02.540057 426 raft_consensus.cc:2241] T 526951ad467a4708926096ed1162a722 P ddc0ad67020f45edb3ba9c83cab687a4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:02.540547 426 raft_consensus.cc:2270] T 526951ad467a4708926096ed1162a722 P ddc0ad67020f45edb3ba9c83cab687a4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.543216 426 tablet_replica.cc:331] T a6b45bf21adf457d9a920f57d758ba15 P ddc0ad67020f45edb3ba9c83cab687a4: stopping tablet replica
I20250625 03:32:02.543987 426 raft_consensus.cc:2241] T a6b45bf21adf457d9a920f57d758ba15 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:02.544528 426 raft_consensus.cc:2270] T a6b45bf21adf457d9a920f57d758ba15 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.547091 426 tablet_replica.cc:331] T 5e59ae16ec1a4c69aac820531e504206 P ddc0ad67020f45edb3ba9c83cab687a4: stopping tablet replica
I20250625 03:32:02.547807 426 raft_consensus.cc:2241] T 5e59ae16ec1a4c69aac820531e504206 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:02.548305 426 raft_consensus.cc:2270] T 5e59ae16ec1a4c69aac820531e504206 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.551362 426 tablet_replica.cc:331] T e638ce3a86d242fcadb10cdf57f5960d P ddc0ad67020f45edb3ba9c83cab687a4: stopping tablet replica
I20250625 03:32:02.552124 426 raft_consensus.cc:2241] T e638ce3a86d242fcadb10cdf57f5960d P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:02.552615 426 raft_consensus.cc:2270] T e638ce3a86d242fcadb10cdf57f5960d P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.555699 426 tablet_replica.cc:331] T 28cf5da85c864698894ed4e1ee38cd86 P ddc0ad67020f45edb3ba9c83cab687a4: stopping tablet replica
I20250625 03:32:02.557075 426 raft_consensus.cc:2241] T 28cf5da85c864698894ed4e1ee38cd86 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:32:02.558013 426 raft_consensus.cc:2270] T 28cf5da85c864698894ed4e1ee38cd86 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.560472 426 tablet_replica.cc:331] T 5ece5f5b2a904c9cbef3065e210e9a30 P ddc0ad67020f45edb3ba9c83cab687a4: stopping tablet replica
I20250625 03:32:02.561182 426 raft_consensus.cc:2241] T 5ece5f5b2a904c9cbef3065e210e9a30 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:02.561702 426 raft_consensus.cc:2270] T 5ece5f5b2a904c9cbef3065e210e9a30 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.564236 426 tablet_replica.cc:331] T 6fc84ca2087c4ded91412fb32117af48 P ddc0ad67020f45edb3ba9c83cab687a4: stopping tablet replica
I20250625 03:32:02.564905 426 raft_consensus.cc:2241] T 6fc84ca2087c4ded91412fb32117af48 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:02.565395 426 raft_consensus.cc:2270] T 6fc84ca2087c4ded91412fb32117af48 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.567674 426 tablet_replica.cc:331] T 049948eeceeb43c98ccda9e839b521a8 P ddc0ad67020f45edb3ba9c83cab687a4: stopping tablet replica
I20250625 03:32:02.568385 426 raft_consensus.cc:2241] T 049948eeceeb43c98ccda9e839b521a8 P ddc0ad67020f45edb3ba9c83cab687a4 [term 3 LEADER]: Raft consensus shutting down.
I20250625 03:32:02.569283 426 raft_consensus.cc:2270] T 049948eeceeb43c98ccda9e839b521a8 P ddc0ad67020f45edb3ba9c83cab687a4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.572268 426 tablet_replica.cc:331] T 03c46dae805341fdb9ec29725fa182a2 P ddc0ad67020f45edb3ba9c83cab687a4: stopping tablet replica
I20250625 03:32:02.572965 426 raft_consensus.cc:2241] T 03c46dae805341fdb9ec29725fa182a2 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:32:02.573859 426 raft_consensus.cc:2270] T 03c46dae805341fdb9ec29725fa182a2 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.576429 426 tablet_replica.cc:331] T 007d68495d594a73a5e2748f51e7c44c P ddc0ad67020f45edb3ba9c83cab687a4: stopping tablet replica
I20250625 03:32:02.577121 426 raft_consensus.cc:2241] T 007d68495d594a73a5e2748f51e7c44c P ddc0ad67020f45edb3ba9c83cab687a4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:02.577621 426 raft_consensus.cc:2270] T 007d68495d594a73a5e2748f51e7c44c P ddc0ad67020f45edb3ba9c83cab687a4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.579937 426 tablet_replica.cc:331] T 5dc5a179a27f462989b291e8133742da P ddc0ad67020f45edb3ba9c83cab687a4: stopping tablet replica
I20250625 03:32:02.580657 426 raft_consensus.cc:2241] T 5dc5a179a27f462989b291e8133742da P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:32:02.581580 426 raft_consensus.cc:2270] T 5dc5a179a27f462989b291e8133742da P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.583966 426 tablet_replica.cc:331] T 1e9c146f8cd743f7ac35dc61d9226d1d P ddc0ad67020f45edb3ba9c83cab687a4: stopping tablet replica
I20250625 03:32:02.584630 426 raft_consensus.cc:2241] T 1e9c146f8cd743f7ac35dc61d9226d1d P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:32:02.585525 426 raft_consensus.cc:2270] T 1e9c146f8cd743f7ac35dc61d9226d1d P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.588079 426 tablet_replica.cc:331] T c592f2c5305141c487b73e0867d0f36b P ddc0ad67020f45edb3ba9c83cab687a4: stopping tablet replica
I20250625 03:32:02.588798 426 raft_consensus.cc:2241] T c592f2c5305141c487b73e0867d0f36b P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:02.589303 426 raft_consensus.cc:2270] T c592f2c5305141c487b73e0867d0f36b P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.591857 426 tablet_replica.cc:331] T 49d4fb2581ed4ef998f6a113ea67c323 P ddc0ad67020f45edb3ba9c83cab687a4: stopping tablet replica
I20250625 03:32:02.592553 426 raft_consensus.cc:2241] T 49d4fb2581ed4ef998f6a113ea67c323 P ddc0ad67020f45edb3ba9c83cab687a4 [term 4 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:02.593112 426 raft_consensus.cc:2270] T 49d4fb2581ed4ef998f6a113ea67c323 P ddc0ad67020f45edb3ba9c83cab687a4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.595480 426 tablet_replica.cc:331] T f3a33aa1d146468c986f0b1ba7d5fb84 P ddc0ad67020f45edb3ba9c83cab687a4: stopping tablet replica
I20250625 03:32:02.596205 426 raft_consensus.cc:2241] T f3a33aa1d146468c986f0b1ba7d5fb84 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:02.596711 426 raft_consensus.cc:2270] T f3a33aa1d146468c986f0b1ba7d5fb84 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.599120 426 tablet_replica.cc:331] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P ddc0ad67020f45edb3ba9c83cab687a4: stopping tablet replica
I20250625 03:32:02.599792 426 raft_consensus.cc:2241] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:02.600287 426 raft_consensus.cc:2270] T 3ae65ab4d0d2480cb3e4d2d0dd5f5c14 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.602672 426 tablet_replica.cc:331] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P ddc0ad67020f45edb3ba9c83cab687a4: stopping tablet replica
I20250625 03:32:02.603386 426 raft_consensus.cc:2241] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:32:02.604326 426 raft_consensus.cc:2270] T 2c4bb2d21b5242d387f6bc6ada60b4d5 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.606820 426 tablet_replica.cc:331] T e7d3871088394a3ba7a6d18baae1feba P ddc0ad67020f45edb3ba9c83cab687a4: stopping tablet replica
I20250625 03:32:02.607496 426 raft_consensus.cc:2241] T e7d3871088394a3ba7a6d18baae1feba P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:32:02.608421 426 raft_consensus.cc:2270] T e7d3871088394a3ba7a6d18baae1feba P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.610890 426 tablet_replica.cc:331] T d08de4c2326d46bab26f42d8d483ebd0 P ddc0ad67020f45edb3ba9c83cab687a4: stopping tablet replica
I20250625 03:32:02.611575 426 raft_consensus.cc:2241] T d08de4c2326d46bab26f42d8d483ebd0 P ddc0ad67020f45edb3ba9c83cab687a4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:02.612112 426 raft_consensus.cc:2270] T d08de4c2326d46bab26f42d8d483ebd0 P ddc0ad67020f45edb3ba9c83cab687a4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.614436 426 tablet_replica.cc:331] T bccba871bcd747fd80a890b25628ebe2 P ddc0ad67020f45edb3ba9c83cab687a4: stopping tablet replica
I20250625 03:32:02.615101 426 raft_consensus.cc:2241] T bccba871bcd747fd80a890b25628ebe2 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:02.615609 426 raft_consensus.cc:2270] T bccba871bcd747fd80a890b25628ebe2 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.618052 426 tablet_replica.cc:331] T 3d5b503929b24663a1f868ffaec34157 P ddc0ad67020f45edb3ba9c83cab687a4: stopping tablet replica
I20250625 03:32:02.618785 426 raft_consensus.cc:2241] T 3d5b503929b24663a1f868ffaec34157 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:32:02.619750 426 raft_consensus.cc:2270] T 3d5b503929b24663a1f868ffaec34157 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.622308 426 tablet_replica.cc:331] T a07d77259251401d957af853b296750a P ddc0ad67020f45edb3ba9c83cab687a4: stopping tablet replica
I20250625 03:32:02.622977 426 raft_consensus.cc:2241] T a07d77259251401d957af853b296750a P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:32:02.623857 426 raft_consensus.cc:2270] T a07d77259251401d957af853b296750a P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.626267 426 tablet_replica.cc:331] T 485f3e9350e245a9939133866b354302 P ddc0ad67020f45edb3ba9c83cab687a4: stopping tablet replica
I20250625 03:32:02.626890 426 raft_consensus.cc:2241] T 485f3e9350e245a9939133866b354302 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:32:02.627660 426 raft_consensus.cc:2270] T 485f3e9350e245a9939133866b354302 P ddc0ad67020f45edb3ba9c83cab687a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:02.629778 426 tablet_replica.cc:331] T b1ece928b2e2452191ee263cf19ec4f8 P ddc0ad67020f45edb3ba9c83cab687a4: stopping tablet replica
I20250625 03:32:02.630223 426 raft_consensus.cc:2241] T b1ece928b2e2452191ee263cf19ec4f8 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:02.630677 426 raft_consensus.cc:2270] T b1ece928b2e2452191ee263cf19ec4f8 P ddc0ad67020f45edb3ba9c83cab687a4 [term 2 FOLLOWER]: Raft consensus is shut down!
W20250625 03:32:03.720741 426 thread.cc:535] Waited for 1000ms trying to join with diag-logger (tid 3884)
W20250625 03:32:04.721176 426 thread.cc:535] Waited for 2000ms trying to join with diag-logger (tid 3884)
I20250625 03:32:04.979578 426 tablet_server.cc:195] TabletServer@127.0.106.132:0 shutdown complete.
I20250625 03:32:05.037199 426 master.cc:561] Master@127.0.106.190:40959 shutting down...
I20250625 03:32:05.065611 426 raft_consensus.cc:2241] T 00000000000000000000000000000000 P 9fa95fcbf1e74bd8826a5f32008a0ffe [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:32:05.066136 426 raft_consensus.cc:2270] T 00000000000000000000000000000000 P 9fa95fcbf1e74bd8826a5f32008a0ffe [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:05.066397 426 tablet_replica.cc:331] T 00000000000000000000000000000000 P 9fa95fcbf1e74bd8826a5f32008a0ffe: stopping tablet replica
I20250625 03:32:05.117918 426 master.cc:583] Master@127.0.106.190:40959 shutdown complete.
I20250625 03:32:05.152707 426 test_util.cc:183] -----------------------------------------------
I20250625 03:32:05.152920 426 test_util.cc:184] Had failures, leaving test files at /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1750822166717217-426-0
[ FAILED ] LeaderRebalancerTest.RestartTserver (32957 ms)
[ RUN ] LeaderRebalancerTest.TestMaintenanceMode
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/master/auto_leader_rebalancer-test.cc:475: Skipped
test is skipped; set KUDU_ALLOW_SLOW_TESTS=1 to run
[ SKIPPED ] LeaderRebalancerTest.TestMaintenanceMode (6 ms)
[----------] 5 tests from LeaderRebalancerTest (158281 ms total)
[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20250625 03:32:05.162588 426 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.106.190:33947
I20250625 03:32:05.163672 426 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250625 03:32:05.169036 4804 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250625 03:32:05.169276 4803 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250625 03:32:05.170083 4806 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250625 03:32:05.171417 426 server_base.cc:1048] running on GCE node
I20250625 03:32:05.172564 426 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250625 03:32:05.172752 426 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250625 03:32:05.172900 426 hybrid_clock.cc:648] HybridClock initialized: now 1750822325172881 us; error 0 us; skew 500 ppm
I20250625 03:32:05.173422 426 server_base.cc:848] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250625 03:32:05.180934 426 webserver.cc:469] Webserver started at http://127.0.106.190:35037/ using document root <none> and password file <none>
I20250625 03:32:05.181471 426 fs_manager.cc:362] Metadata directory not provided
I20250625 03:32:05.181648 426 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250625 03:32:05.181924 426 server_base.cc:896] This appears to be a new deployment of Kudu; creating new FS layout
I20250625 03:32:05.183058 426 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1750822166717217-426-0/minicluster-data/master-0-root/instance:
uuid: "b6cda8ac6eb0436b82b28989710a9c7a"
format_stamp: "Formatted at 2025-06-25 03:32:05 on dist-test-slave-lj23"
I20250625 03:32:05.187734 426 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20250625 03:32:05.193609 4811 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250625 03:32:05.194340 426 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20250625 03:32:05.194643 426 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1750822166717217-426-0/minicluster-data/master-0-root
uuid: "b6cda8ac6eb0436b82b28989710a9c7a"
format_stamp: "Formatted at 2025-06-25 03:32:05 on dist-test-slave-lj23"
I20250625 03:32:05.194921 426 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1750822166717217-426-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1750822166717217-426-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1750822166717217-426-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250625 03:32:05.212584 426 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250625 03:32:05.214035 426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250625 03:32:05.252632 426 rpc_server.cc:307] RPC server started. Bound to: 127.0.106.190:33947
I20250625 03:32:05.252744 4862 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.106.190:33947 every 8 connection(s)
I20250625 03:32:05.256531 4863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:05.273324 4863 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b6cda8ac6eb0436b82b28989710a9c7a: Bootstrap starting.
I20250625 03:32:05.280367 4863 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b6cda8ac6eb0436b82b28989710a9c7a: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:05.285674 4863 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b6cda8ac6eb0436b82b28989710a9c7a: No bootstrap required, opened a new log
I20250625 03:32:05.288861 4863 raft_consensus.cc:357] T 00000000000000000000000000000000 P b6cda8ac6eb0436b82b28989710a9c7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6cda8ac6eb0436b82b28989710a9c7a" member_type: VOTER }
I20250625 03:32:05.289469 4863 raft_consensus.cc:383] T 00000000000000000000000000000000 P b6cda8ac6eb0436b82b28989710a9c7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:05.289783 4863 raft_consensus.cc:738] T 00000000000000000000000000000000 P b6cda8ac6eb0436b82b28989710a9c7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6cda8ac6eb0436b82b28989710a9c7a, State: Initialized, Role: FOLLOWER
I20250625 03:32:05.290572 4863 consensus_queue.cc:260] T 00000000000000000000000000000000 P b6cda8ac6eb0436b82b28989710a9c7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6cda8ac6eb0436b82b28989710a9c7a" member_type: VOTER }
I20250625 03:32:05.291222 4863 raft_consensus.cc:397] T 00000000000000000000000000000000 P b6cda8ac6eb0436b82b28989710a9c7a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250625 03:32:05.291433 4863 raft_consensus.cc:491] T 00000000000000000000000000000000 P b6cda8ac6eb0436b82b28989710a9c7a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250625 03:32:05.291642 4863 raft_consensus.cc:3058] T 00000000000000000000000000000000 P b6cda8ac6eb0436b82b28989710a9c7a [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:05.298323 4863 raft_consensus.cc:513] T 00000000000000000000000000000000 P b6cda8ac6eb0436b82b28989710a9c7a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6cda8ac6eb0436b82b28989710a9c7a" member_type: VOTER }
I20250625 03:32:05.298988 4863 leader_election.cc:304] T 00000000000000000000000000000000 P b6cda8ac6eb0436b82b28989710a9c7a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b6cda8ac6eb0436b82b28989710a9c7a; no voters:
I20250625 03:32:05.300462 4863 leader_election.cc:290] T 00000000000000000000000000000000 P b6cda8ac6eb0436b82b28989710a9c7a [CANDIDATE]: Term 1 election: Requested vote from peers
I20250625 03:32:05.301071 4866 raft_consensus.cc:2802] T 00000000000000000000000000000000 P b6cda8ac6eb0436b82b28989710a9c7a [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:32:05.302860 4866 raft_consensus.cc:695] T 00000000000000000000000000000000 P b6cda8ac6eb0436b82b28989710a9c7a [term 1 LEADER]: Becoming Leader. State: Replica: b6cda8ac6eb0436b82b28989710a9c7a, State: Running, Role: LEADER
I20250625 03:32:05.303936 4863 sys_catalog.cc:564] T 00000000000000000000000000000000 P b6cda8ac6eb0436b82b28989710a9c7a [sys.catalog]: configured and running, proceeding with master startup.
I20250625 03:32:05.303758 4866 consensus_queue.cc:237] T 00000000000000000000000000000000 P b6cda8ac6eb0436b82b28989710a9c7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6cda8ac6eb0436b82b28989710a9c7a" member_type: VOTER }
I20250625 03:32:05.308964 4868 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6cda8ac6eb0436b82b28989710a9c7a [sys.catalog]: SysCatalogTable state changed. Reason: New leader b6cda8ac6eb0436b82b28989710a9c7a. Latest consensus state: current_term: 1 leader_uuid: "b6cda8ac6eb0436b82b28989710a9c7a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6cda8ac6eb0436b82b28989710a9c7a" member_type: VOTER } }
I20250625 03:32:05.309036 4867 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6cda8ac6eb0436b82b28989710a9c7a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b6cda8ac6eb0436b82b28989710a9c7a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6cda8ac6eb0436b82b28989710a9c7a" member_type: VOTER } }
I20250625 03:32:05.309572 4868 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6cda8ac6eb0436b82b28989710a9c7a [sys.catalog]: This master's current role is: LEADER
I20250625 03:32:05.309710 4867 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6cda8ac6eb0436b82b28989710a9c7a [sys.catalog]: This master's current role is: LEADER
I20250625 03:32:05.311868 4872 catalog_manager.cc:1477] Loading table and tablet metadata into memory...
I20250625 03:32:05.319710 4872 catalog_manager.cc:1486] Initializing Kudu cluster ID...
I20250625 03:32:05.326217 426 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20250625 03:32:05.330226 4872 catalog_manager.cc:1349] Generated new cluster ID: e580a2845b204f398fc03fe70969e575
I20250625 03:32:05.330459 4872 catalog_manager.cc:1497] Initializing Kudu internal certificate authority...
I20250625 03:32:05.356916 4872 catalog_manager.cc:1372] Generated new certificate authority record
I20250625 03:32:05.358170 4872 catalog_manager.cc:1506] Loading token signing keys...
I20250625 03:32:05.378593 4872 catalog_manager.cc:5955] T 00000000000000000000000000000000 P b6cda8ac6eb0436b82b28989710a9c7a: Generated new TSK 0
I20250625 03:32:05.379156 4872 catalog_manager.cc:1516] Initializing in-progress tserver states...
I20250625 03:32:05.393568 426 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250625 03:32:05.399242 4884 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250625 03:32:05.401059 4885 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250625 03:32:05.406440 426 server_base.cc:1048] running on GCE node
W20250625 03:32:05.406391 4887 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250625 03:32:05.408295 426 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250625 03:32:05.408509 426 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250625 03:32:05.408632 426 hybrid_clock.cc:648] HybridClock initialized: now 1750822325408622 us; error 0 us; skew 500 ppm
I20250625 03:32:05.409091 426 server_base.cc:848] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250625 03:32:05.415961 426 webserver.cc:469] Webserver started at http://127.0.106.129:45877/ using document root <none> and password file <none>
I20250625 03:32:05.416502 426 fs_manager.cc:362] Metadata directory not provided
I20250625 03:32:05.416661 426 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250625 03:32:05.416867 426 server_base.cc:896] This appears to be a new deployment of Kudu; creating new FS layout
I20250625 03:32:05.417913 426 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1750822166717217-426-0/minicluster-data/ts-0-root/instance:
uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5"
format_stamp: "Formatted at 2025-06-25 03:32:05 on dist-test-slave-lj23"
I20250625 03:32:05.422518 426 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.003s sys 0.002s
I20250625 03:32:05.425810 4892 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250625 03:32:05.426539 426 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20250625 03:32:05.426820 426 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1750822166717217-426-0/minicluster-data/ts-0-root
uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5"
format_stamp: "Formatted at 2025-06-25 03:32:05 on dist-test-slave-lj23"
I20250625 03:32:05.427078 426 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1750822166717217-426-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1750822166717217-426-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1750822166717217-426-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250625 03:32:05.446434 426 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250625 03:32:05.447674 426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250625 03:32:05.449167 426 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20250625 03:32:05.451465 426 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250625 03:32:05.451668 426 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250625 03:32:05.451896 426 ts_tablet_manager.cc:610] Registered 0 tablets
I20250625 03:32:05.452091 426 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20250625 03:32:05.493315 426 rpc_server.cc:307] RPC server started. Bound to: 127.0.106.129:33373
I20250625 03:32:05.493408 4954 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.106.129:33373 every 8 connection(s)
I20250625 03:32:05.498633 426 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250625 03:32:05.505223 4959 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250625 03:32:05.506628 4960 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250625 03:32:05.510314 4962 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250625 03:32:05.511345 426 server_base.cc:1048] running on GCE node
I20250625 03:32:05.514006 4955 heartbeater.cc:344] Connected to a master server at 127.0.106.190:33947
I20250625 03:32:05.514053 426 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250625 03:32:05.514453 426 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250625 03:32:05.514472 4955 heartbeater.cc:461] Registering TS with master...
I20250625 03:32:05.514693 426 hybrid_clock.cc:648] HybridClock initialized: now 1750822325514680 us; error 0 us; skew 500 ppm
I20250625 03:32:05.515323 426 server_base.cc:848] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250625 03:32:05.515329 4955 heartbeater.cc:507] Master 127.0.106.190:33947 requested a full tablet report, sending...
I20250625 03:32:05.517781 4828 ts_manager.cc:194] Registered new tserver with Master: 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373)
I20250625 03:32:05.518083 426 webserver.cc:469] Webserver started at http://127.0.106.130:36021/ using document root <none> and password file <none>
I20250625 03:32:05.518831 426 fs_manager.cc:362] Metadata directory not provided
I20250625 03:32:05.519073 426 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250625 03:32:05.519411 426 server_base.cc:896] This appears to be a new deployment of Kudu; creating new FS layout
I20250625 03:32:05.520419 4828 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55882
I20250625 03:32:05.520995 426 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1750822166717217-426-0/minicluster-data/ts-1-root/instance:
uuid: "e1270a01a1c04e8c9013a17569afebf5"
format_stamp: "Formatted at 2025-06-25 03:32:05 on dist-test-slave-lj23"
I20250625 03:32:05.525561 426 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20250625 03:32:05.528795 4967 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250625 03:32:05.529520 426 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20250625 03:32:05.529775 426 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1750822166717217-426-0/minicluster-data/ts-1-root
uuid: "e1270a01a1c04e8c9013a17569afebf5"
format_stamp: "Formatted at 2025-06-25 03:32:05 on dist-test-slave-lj23"
I20250625 03:32:05.530014 426 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1750822166717217-426-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1750822166717217-426-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1750822166717217-426-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250625 03:32:05.544371 426 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250625 03:32:05.545522 426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250625 03:32:05.546921 426 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20250625 03:32:05.549142 426 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250625 03:32:05.549325 426 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250625 03:32:05.549587 426 ts_tablet_manager.cc:610] Registered 0 tablets
I20250625 03:32:05.549723 426 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250625 03:32:05.589738 426 rpc_server.cc:307] RPC server started. Bound to: 127.0.106.130:41071
I20250625 03:32:05.589864 5029 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.106.130:41071 every 8 connection(s)
I20250625 03:32:05.594529 426 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250625 03:32:05.601886 5033 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250625 03:32:05.604113 5034 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250625 03:32:05.607352 5030 heartbeater.cc:344] Connected to a master server at 127.0.106.190:33947
I20250625 03:32:05.607951 5030 heartbeater.cc:461] Registering TS with master...
W20250625 03:32:05.608131 5036 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250625 03:32:05.608289 426 server_base.cc:1048] running on GCE node
I20250625 03:32:05.608986 5030 heartbeater.cc:507] Master 127.0.106.190:33947 requested a full tablet report, sending...
I20250625 03:32:05.609338 426 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250625 03:32:05.609597 426 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250625 03:32:05.609757 426 hybrid_clock.cc:648] HybridClock initialized: now 1750822325609739 us; error 0 us; skew 500 ppm
I20250625 03:32:05.610476 426 server_base.cc:848] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250625 03:32:05.611109 4828 ts_manager.cc:194] Registered new tserver with Master: e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130:41071)
I20250625 03:32:05.612905 4828 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55894
I20250625 03:32:05.613306 426 webserver.cc:469] Webserver started at http://127.0.106.131:36083/ using document root <none> and password file <none>
I20250625 03:32:05.613919 426 fs_manager.cc:362] Metadata directory not provided
I20250625 03:32:05.614180 426 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250625 03:32:05.614408 426 server_base.cc:896] This appears to be a new deployment of Kudu; creating new FS layout
I20250625 03:32:05.615514 426 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1750822166717217-426-0/minicluster-data/ts-2-root/instance:
uuid: "c37a035bb2d44c709a64f282940bdc6b"
format_stamp: "Formatted at 2025-06-25 03:32:05 on dist-test-slave-lj23"
I20250625 03:32:05.619899 426 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20250625 03:32:05.623476 5041 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250625 03:32:05.624338 426 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20250625 03:32:05.624610 426 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1750822166717217-426-0/minicluster-data/ts-2-root
uuid: "c37a035bb2d44c709a64f282940bdc6b"
format_stamp: "Formatted at 2025-06-25 03:32:05 on dist-test-slave-lj23"
I20250625 03:32:05.624862 426 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1750822166717217-426-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1750822166717217-426-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1750822166717217-426-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250625 03:32:05.643715 426 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250625 03:32:05.644906 426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250625 03:32:05.646401 426 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20250625 03:32:05.648669 426 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250625 03:32:05.648849 426 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250625 03:32:05.649096 426 ts_tablet_manager.cc:610] Registered 0 tablets
I20250625 03:32:05.649241 426 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250625 03:32:05.689236 426 rpc_server.cc:307] RPC server started. Bound to: 127.0.106.131:35169
I20250625 03:32:05.689361 5103 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.106.131:35169 every 8 connection(s)
I20250625 03:32:05.704325 5104 heartbeater.cc:344] Connected to a master server at 127.0.106.190:33947
I20250625 03:32:05.704746 5104 heartbeater.cc:461] Registering TS with master...
I20250625 03:32:05.705497 5104 heartbeater.cc:507] Master 127.0.106.190:33947 requested a full tablet report, sending...
I20250625 03:32:05.707360 4828 ts_manager.cc:194] Registered new tserver with Master: c37a035bb2d44c709a64f282940bdc6b (127.0.106.131:35169)
I20250625 03:32:05.708071 426 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015649051s
I20250625 03:32:05.708989 4828 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55906
I20250625 03:32:05.710808 426 test_util.cc:276] Using random seed: 382332870
I20250625 03:32:05.733879 4828 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55922:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 03:32:05.736500 4828 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 03:32:05.804183 4920 tablet_service.cc:1468] Processing CreateTablet for tablet 2e7642d019e54a80ad09b22cfa20119e (DEFAULT_TABLE table=test-workload [id=37dba9a9a0f74541a312f0f8445c7a14]), partition=RANGE (key) PARTITION VALUES < 238609294
I20250625 03:32:05.805789 4920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e7642d019e54a80ad09b22cfa20119e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:05.806543 4995 tablet_service.cc:1468] Processing CreateTablet for tablet 2e7642d019e54a80ad09b22cfa20119e (DEFAULT_TABLE table=test-workload [id=37dba9a9a0f74541a312f0f8445c7a14]), partition=RANGE (key) PARTITION VALUES < 238609294
I20250625 03:32:05.807982 4995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e7642d019e54a80ad09b22cfa20119e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:05.808126 4919 tablet_service.cc:1468] Processing CreateTablet for tablet f5296bbece6b404387af92d2c22ab91e (DEFAULT_TABLE table=test-workload [id=37dba9a9a0f74541a312f0f8445c7a14]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20250625 03:32:05.809780 4918 tablet_service.cc:1468] Processing CreateTablet for tablet ad39583185dd49dd860e678ad2e166ac (DEFAULT_TABLE table=test-workload [id=37dba9a9a0f74541a312f0f8445c7a14]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20250625 03:32:05.810541 4919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5296bbece6b404387af92d2c22ab91e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:05.811311 4918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad39583185dd49dd860e678ad2e166ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:05.817148 4994 tablet_service.cc:1468] Processing CreateTablet for tablet f5296bbece6b404387af92d2c22ab91e (DEFAULT_TABLE table=test-workload [id=37dba9a9a0f74541a312f0f8445c7a14]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20250625 03:32:05.818603 4994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5296bbece6b404387af92d2c22ab91e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:05.820513 5069 tablet_service.cc:1468] Processing CreateTablet for tablet 2e7642d019e54a80ad09b22cfa20119e (DEFAULT_TABLE table=test-workload [id=37dba9a9a0f74541a312f0f8445c7a14]), partition=RANGE (key) PARTITION VALUES < 238609294
I20250625 03:32:05.821134 4993 tablet_service.cc:1468] Processing CreateTablet for tablet ad39583185dd49dd860e678ad2e166ac (DEFAULT_TABLE table=test-workload [id=37dba9a9a0f74541a312f0f8445c7a14]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20250625 03:32:05.821056 4917 tablet_service.cc:1468] Processing CreateTablet for tablet d6ccc7e94aa248ac9313c70ae601b6c5 (DEFAULT_TABLE table=test-workload [id=37dba9a9a0f74541a312f0f8445c7a14]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20250625 03:32:05.821998 5069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e7642d019e54a80ad09b22cfa20119e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:05.822525 4993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad39583185dd49dd860e678ad2e166ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:05.822697 4917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6ccc7e94aa248ac9313c70ae601b6c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:05.825246 4992 tablet_service.cc:1468] Processing CreateTablet for tablet d6ccc7e94aa248ac9313c70ae601b6c5 (DEFAULT_TABLE table=test-workload [id=37dba9a9a0f74541a312f0f8445c7a14]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20250625 03:32:05.826705 4992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6ccc7e94aa248ac9313c70ae601b6c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:05.835390 5065 tablet_service.cc:1468] Processing CreateTablet for tablet 5e6f0a34fdec4f4f8d38ad88f6c88390 (DEFAULT_TABLE table=test-workload [id=37dba9a9a0f74541a312f0f8445c7a14]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20250625 03:32:05.837424 5065 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e6f0a34fdec4f4f8d38ad88f6c88390. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:05.837272 4916 tablet_service.cc:1468] Processing CreateTablet for tablet 5e6f0a34fdec4f4f8d38ad88f6c88390 (DEFAULT_TABLE table=test-workload [id=37dba9a9a0f74541a312f0f8445c7a14]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20250625 03:32:05.838716 4916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e6f0a34fdec4f4f8d38ad88f6c88390. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:05.838750 4991 tablet_service.cc:1468] Processing CreateTablet for tablet 5e6f0a34fdec4f4f8d38ad88f6c88390 (DEFAULT_TABLE table=test-workload [id=37dba9a9a0f74541a312f0f8445c7a14]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20250625 03:32:05.840251 4991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e6f0a34fdec4f4f8d38ad88f6c88390. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:05.841167 5064 tablet_service.cc:1468] Processing CreateTablet for tablet 06b41733ebac42daa85ec1c23c8588a7 (DEFAULT_TABLE table=test-workload [id=37dba9a9a0f74541a312f0f8445c7a14]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20250625 03:32:05.842594 5064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06b41733ebac42daa85ec1c23c8588a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:05.842312 4990 tablet_service.cc:1468] Processing CreateTablet for tablet 06b41733ebac42daa85ec1c23c8588a7 (DEFAULT_TABLE table=test-workload [id=37dba9a9a0f74541a312f0f8445c7a14]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20250625 03:32:05.843729 4990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06b41733ebac42daa85ec1c23c8588a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:05.837015 4988 tablet_service.cc:1468] Processing CreateTablet for tablet a592afb64620423cb8ef5ac5da6558f0 (DEFAULT_TABLE table=test-workload [id=37dba9a9a0f74541a312f0f8445c7a14]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20250625 03:32:05.844197 4920 tablet_service.cc:1468] Processing CreateTablet for tablet 06b41733ebac42daa85ec1c23c8588a7 (DEFAULT_TABLE table=test-workload [id=37dba9a9a0f74541a312f0f8445c7a14]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20250625 03:32:05.844825 4988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a592afb64620423cb8ef5ac5da6558f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:05.851931 4987 tablet_service.cc:1468] Processing CreateTablet for tablet 78d8c392f87643228ae9a6cd204f713b (DEFAULT_TABLE table=test-workload [id=37dba9a9a0f74541a312f0f8445c7a14]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20250625 03:32:05.853368 4987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78d8c392f87643228ae9a6cd204f713b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:05.845803 4915 tablet_service.cc:1468] Processing CreateTablet for tablet 8e6ebae6c4f34a34b8addf32082aa13c (DEFAULT_TABLE table=test-workload [id=37dba9a9a0f74541a312f0f8445c7a14]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20250625 03:32:05.841181 4989 tablet_service.cc:1468] Processing CreateTablet for tablet 8e6ebae6c4f34a34b8addf32082aa13c (DEFAULT_TABLE table=test-workload [id=37dba9a9a0f74541a312f0f8445c7a14]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20250625 03:32:05.857753 4989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e6ebae6c4f34a34b8addf32082aa13c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:05.848371 5066 tablet_service.cc:1468] Processing CreateTablet for tablet d6ccc7e94aa248ac9313c70ae601b6c5 (DEFAULT_TABLE table=test-workload [id=37dba9a9a0f74541a312f0f8445c7a14]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20250625 03:32:05.860457 5066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6ccc7e94aa248ac9313c70ae601b6c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:05.866490 4920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06b41733ebac42daa85ec1c23c8588a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:05.876369 4915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e6ebae6c4f34a34b8addf32082aa13c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:05.849365 5067 tablet_service.cc:1468] Processing CreateTablet for tablet ad39583185dd49dd860e678ad2e166ac (DEFAULT_TABLE table=test-workload [id=37dba9a9a0f74541a312f0f8445c7a14]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20250625 03:32:05.880892 5067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad39583185dd49dd860e678ad2e166ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:05.832739 5068 tablet_service.cc:1468] Processing CreateTablet for tablet f5296bbece6b404387af92d2c22ab91e (DEFAULT_TABLE table=test-workload [id=37dba9a9a0f74541a312f0f8445c7a14]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20250625 03:32:05.850126 4914 tablet_service.cc:1468] Processing CreateTablet for tablet a592afb64620423cb8ef5ac5da6558f0 (DEFAULT_TABLE table=test-workload [id=37dba9a9a0f74541a312f0f8445c7a14]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20250625 03:32:05.881779 5063 tablet_service.cc:1468] Processing CreateTablet for tablet 8e6ebae6c4f34a34b8addf32082aa13c (DEFAULT_TABLE table=test-workload [id=37dba9a9a0f74541a312f0f8445c7a14]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20250625 03:32:05.883800 5068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5296bbece6b404387af92d2c22ab91e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:05.884785 4914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a592afb64620423cb8ef5ac5da6558f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:05.885267 5063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e6ebae6c4f34a34b8addf32082aa13c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:05.885304 4913 tablet_service.cc:1468] Processing CreateTablet for tablet 78d8c392f87643228ae9a6cd204f713b (DEFAULT_TABLE table=test-workload [id=37dba9a9a0f74541a312f0f8445c7a14]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20250625 03:32:05.890503 4913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78d8c392f87643228ae9a6cd204f713b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:05.889165 5062 tablet_service.cc:1468] Processing CreateTablet for tablet a592afb64620423cb8ef5ac5da6558f0 (DEFAULT_TABLE table=test-workload [id=37dba9a9a0f74541a312f0f8445c7a14]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20250625 03:32:05.893002 5062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a592afb64620423cb8ef5ac5da6558f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:05.918465 5061 tablet_service.cc:1468] Processing CreateTablet for tablet 78d8c392f87643228ae9a6cd204f713b (DEFAULT_TABLE table=test-workload [id=37dba9a9a0f74541a312f0f8445c7a14]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20250625 03:32:05.919871 5061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78d8c392f87643228ae9a6cd204f713b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:05.936360 5119 tablet_bootstrap.cc:492] T 2e7642d019e54a80ad09b22cfa20119e P 21b63b7bf1b94396bf2ea6cc8359f4e5: Bootstrap starting.
I20250625 03:32:05.958005 5119 tablet_bootstrap.cc:654] T 2e7642d019e54a80ad09b22cfa20119e P 21b63b7bf1b94396bf2ea6cc8359f4e5: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:05.970769 5120 tablet_bootstrap.cc:492] T f5296bbece6b404387af92d2c22ab91e P e1270a01a1c04e8c9013a17569afebf5: Bootstrap starting.
I20250625 03:32:05.999570 5120 tablet_bootstrap.cc:654] T f5296bbece6b404387af92d2c22ab91e P e1270a01a1c04e8c9013a17569afebf5: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:06.009011 5121 tablet_bootstrap.cc:492] T 06b41733ebac42daa85ec1c23c8588a7 P c37a035bb2d44c709a64f282940bdc6b: Bootstrap starting.
I20250625 03:32:06.013195 5119 tablet_bootstrap.cc:492] T 2e7642d019e54a80ad09b22cfa20119e P 21b63b7bf1b94396bf2ea6cc8359f4e5: No bootstrap required, opened a new log
I20250625 03:32:06.014775 5119 ts_tablet_manager.cc:1397] T 2e7642d019e54a80ad09b22cfa20119e P 21b63b7bf1b94396bf2ea6cc8359f4e5: Time spent bootstrapping tablet: real 0.079s user 0.007s sys 0.008s
I20250625 03:32:06.014873 5120 tablet_bootstrap.cc:492] T f5296bbece6b404387af92d2c22ab91e P e1270a01a1c04e8c9013a17569afebf5: No bootstrap required, opened a new log
I20250625 03:32:06.015439 5120 ts_tablet_manager.cc:1397] T f5296bbece6b404387af92d2c22ab91e P e1270a01a1c04e8c9013a17569afebf5: Time spent bootstrapping tablet: real 0.051s user 0.014s sys 0.000s
I20250625 03:32:06.017105 5119 raft_consensus.cc:357] T 2e7642d019e54a80ad09b22cfa20119e P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.017711 5119 raft_consensus.cc:383] T 2e7642d019e54a80ad09b22cfa20119e P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:06.017961 5119 raft_consensus.cc:738] T 2e7642d019e54a80ad09b22cfa20119e P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b63b7bf1b94396bf2ea6cc8359f4e5, State: Initialized, Role: FOLLOWER
I20250625 03:32:06.017974 5121 tablet_bootstrap.cc:654] T 06b41733ebac42daa85ec1c23c8588a7 P c37a035bb2d44c709a64f282940bdc6b: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:06.018328 5120 raft_consensus.cc:357] T f5296bbece6b404387af92d2c22ab91e P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.018633 5119 consensus_queue.cc:260] T 2e7642d019e54a80ad09b22cfa20119e P 21b63b7bf1b94396bf2ea6cc8359f4e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.019124 5120 raft_consensus.cc:383] T f5296bbece6b404387af92d2c22ab91e P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:06.019492 5120 raft_consensus.cc:738] T f5296bbece6b404387af92d2c22ab91e P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1270a01a1c04e8c9013a17569afebf5, State: Initialized, Role: FOLLOWER
I20250625 03:32:06.020917 4955 heartbeater.cc:499] Master 127.0.106.190:33947 was elected leader, sending a full tablet report...
I20250625 03:32:06.021431 5119 ts_tablet_manager.cc:1428] T 2e7642d019e54a80ad09b22cfa20119e P 21b63b7bf1b94396bf2ea6cc8359f4e5: Time spent starting tablet: real 0.006s user 0.003s sys 0.003s
I20250625 03:32:06.022519 5119 tablet_bootstrap.cc:492] T 06b41733ebac42daa85ec1c23c8588a7 P 21b63b7bf1b94396bf2ea6cc8359f4e5: Bootstrap starting.
I20250625 03:32:06.023959 5121 tablet_bootstrap.cc:492] T 06b41733ebac42daa85ec1c23c8588a7 P c37a035bb2d44c709a64f282940bdc6b: No bootstrap required, opened a new log
I20250625 03:32:06.024516 5121 ts_tablet_manager.cc:1397] T 06b41733ebac42daa85ec1c23c8588a7 P c37a035bb2d44c709a64f282940bdc6b: Time spent bootstrapping tablet: real 0.016s user 0.010s sys 0.003s
I20250625 03:32:06.020376 5120 consensus_queue.cc:260] T f5296bbece6b404387af92d2c22ab91e P e1270a01a1c04e8c9013a17569afebf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.027312 5121 raft_consensus.cc:357] T 06b41733ebac42daa85ec1c23c8588a7 P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.027581 5120 ts_tablet_manager.cc:1428] T f5296bbece6b404387af92d2c22ab91e P e1270a01a1c04e8c9013a17569afebf5: Time spent starting tablet: real 0.012s user 0.003s sys 0.005s
I20250625 03:32:06.028252 5121 raft_consensus.cc:383] T 06b41733ebac42daa85ec1c23c8588a7 P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:06.028585 5121 raft_consensus.cc:738] T 06b41733ebac42daa85ec1c23c8588a7 P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c37a035bb2d44c709a64f282940bdc6b, State: Initialized, Role: FOLLOWER
I20250625 03:32:06.028824 5120 tablet_bootstrap.cc:492] T ad39583185dd49dd860e678ad2e166ac P e1270a01a1c04e8c9013a17569afebf5: Bootstrap starting.
I20250625 03:32:06.029445 5121 consensus_queue.cc:260] T 06b41733ebac42daa85ec1c23c8588a7 P c37a035bb2d44c709a64f282940bdc6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.031615 5104 heartbeater.cc:499] Master 127.0.106.190:33947 was elected leader, sending a full tablet report...
I20250625 03:32:06.032191 5030 heartbeater.cc:499] Master 127.0.106.190:33947 was elected leader, sending a full tablet report...
I20250625 03:32:06.035178 5119 tablet_bootstrap.cc:654] T 06b41733ebac42daa85ec1c23c8588a7 P 21b63b7bf1b94396bf2ea6cc8359f4e5: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:06.036139 5120 tablet_bootstrap.cc:654] T ad39583185dd49dd860e678ad2e166ac P e1270a01a1c04e8c9013a17569afebf5: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:06.041247 5121 ts_tablet_manager.cc:1428] T 06b41733ebac42daa85ec1c23c8588a7 P c37a035bb2d44c709a64f282940bdc6b: Time spent starting tablet: real 0.016s user 0.006s sys 0.001s
I20250625 03:32:06.042907 5121 tablet_bootstrap.cc:492] T a592afb64620423cb8ef5ac5da6558f0 P c37a035bb2d44c709a64f282940bdc6b: Bootstrap starting.
I20250625 03:32:06.055732 5119 tablet_bootstrap.cc:492] T 06b41733ebac42daa85ec1c23c8588a7 P 21b63b7bf1b94396bf2ea6cc8359f4e5: No bootstrap required, opened a new log
I20250625 03:32:06.055997 5120 tablet_bootstrap.cc:492] T ad39583185dd49dd860e678ad2e166ac P e1270a01a1c04e8c9013a17569afebf5: No bootstrap required, opened a new log
I20250625 03:32:06.056336 5119 ts_tablet_manager.cc:1397] T 06b41733ebac42daa85ec1c23c8588a7 P 21b63b7bf1b94396bf2ea6cc8359f4e5: Time spent bootstrapping tablet: real 0.034s user 0.005s sys 0.021s
I20250625 03:32:06.056617 5120 ts_tablet_manager.cc:1397] T ad39583185dd49dd860e678ad2e166ac P e1270a01a1c04e8c9013a17569afebf5: Time spent bootstrapping tablet: real 0.028s user 0.006s sys 0.021s
I20250625 03:32:06.058560 5119 raft_consensus.cc:357] T 06b41733ebac42daa85ec1c23c8588a7 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.059147 5119 raft_consensus.cc:383] T 06b41733ebac42daa85ec1c23c8588a7 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:06.059450 5119 raft_consensus.cc:738] T 06b41733ebac42daa85ec1c23c8588a7 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b63b7bf1b94396bf2ea6cc8359f4e5, State: Initialized, Role: FOLLOWER
I20250625 03:32:06.059625 5120 raft_consensus.cc:357] T ad39583185dd49dd860e678ad2e166ac P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.060477 5120 raft_consensus.cc:383] T ad39583185dd49dd860e678ad2e166ac P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:06.060175 5119 consensus_queue.cc:260] T 06b41733ebac42daa85ec1c23c8588a7 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.060788 5120 raft_consensus.cc:738] T ad39583185dd49dd860e678ad2e166ac P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1270a01a1c04e8c9013a17569afebf5, State: Initialized, Role: FOLLOWER
I20250625 03:32:06.061872 5120 consensus_queue.cc:260] T ad39583185dd49dd860e678ad2e166ac P e1270a01a1c04e8c9013a17569afebf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.062703 5121 tablet_bootstrap.cc:654] T a592afb64620423cb8ef5ac5da6558f0 P c37a035bb2d44c709a64f282940bdc6b: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:06.064385 5120 ts_tablet_manager.cc:1428] T ad39583185dd49dd860e678ad2e166ac P e1270a01a1c04e8c9013a17569afebf5: Time spent starting tablet: real 0.007s user 0.005s sys 0.003s
I20250625 03:32:06.065425 5120 tablet_bootstrap.cc:492] T a592afb64620423cb8ef5ac5da6558f0 P e1270a01a1c04e8c9013a17569afebf5: Bootstrap starting.
I20250625 03:32:06.062536 5119 ts_tablet_manager.cc:1428] T 06b41733ebac42daa85ec1c23c8588a7 P 21b63b7bf1b94396bf2ea6cc8359f4e5: Time spent starting tablet: real 0.006s user 0.001s sys 0.003s
I20250625 03:32:06.066617 5119 tablet_bootstrap.cc:492] T a592afb64620423cb8ef5ac5da6558f0 P 21b63b7bf1b94396bf2ea6cc8359f4e5: Bootstrap starting.
I20250625 03:32:06.072410 5120 tablet_bootstrap.cc:654] T a592afb64620423cb8ef5ac5da6558f0 P e1270a01a1c04e8c9013a17569afebf5: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:06.072511 5119 tablet_bootstrap.cc:654] T a592afb64620423cb8ef5ac5da6558f0 P 21b63b7bf1b94396bf2ea6cc8359f4e5: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:06.091678 5121 tablet_bootstrap.cc:492] T a592afb64620423cb8ef5ac5da6558f0 P c37a035bb2d44c709a64f282940bdc6b: No bootstrap required, opened a new log
I20250625 03:32:06.092418 5121 ts_tablet_manager.cc:1397] T a592afb64620423cb8ef5ac5da6558f0 P c37a035bb2d44c709a64f282940bdc6b: Time spent bootstrapping tablet: real 0.050s user 0.016s sys 0.000s
W20250625 03:32:06.093897 5031 tablet.cc:2378] T ad39583185dd49dd860e678ad2e166ac P e1270a01a1c04e8c9013a17569afebf5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20250625 03:32:06.100135 5121 raft_consensus.cc:357] T a592afb64620423cb8ef5ac5da6558f0 P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.102085 5121 raft_consensus.cc:383] T a592afb64620423cb8ef5ac5da6558f0 P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:06.102763 5119 tablet_bootstrap.cc:492] T a592afb64620423cb8ef5ac5da6558f0 P 21b63b7bf1b94396bf2ea6cc8359f4e5: No bootstrap required, opened a new log
I20250625 03:32:06.103395 5121 raft_consensus.cc:738] T a592afb64620423cb8ef5ac5da6558f0 P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c37a035bb2d44c709a64f282940bdc6b, State: Initialized, Role: FOLLOWER
I20250625 03:32:06.103705 5119 ts_tablet_manager.cc:1397] T a592afb64620423cb8ef5ac5da6558f0 P 21b63b7bf1b94396bf2ea6cc8359f4e5: Time spent bootstrapping tablet: real 0.037s user 0.034s sys 0.002s
I20250625 03:32:06.103996 5120 tablet_bootstrap.cc:492] T a592afb64620423cb8ef5ac5da6558f0 P e1270a01a1c04e8c9013a17569afebf5: No bootstrap required, opened a new log
I20250625 03:32:06.104557 5120 ts_tablet_manager.cc:1397] T a592afb64620423cb8ef5ac5da6558f0 P e1270a01a1c04e8c9013a17569afebf5: Time spent bootstrapping tablet: real 0.039s user 0.021s sys 0.015s
I20250625 03:32:06.104449 5121 consensus_queue.cc:260] T a592afb64620423cb8ef5ac5da6558f0 P c37a035bb2d44c709a64f282940bdc6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.106314 5119 raft_consensus.cc:357] T a592afb64620423cb8ef5ac5da6558f0 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.106889 5119 raft_consensus.cc:383] T a592afb64620423cb8ef5ac5da6558f0 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:06.107187 5119 raft_consensus.cc:738] T a592afb64620423cb8ef5ac5da6558f0 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b63b7bf1b94396bf2ea6cc8359f4e5, State: Initialized, Role: FOLLOWER
I20250625 03:32:06.108433 5121 ts_tablet_manager.cc:1428] T a592afb64620423cb8ef5ac5da6558f0 P c37a035bb2d44c709a64f282940bdc6b: Time spent starting tablet: real 0.016s user 0.009s sys 0.000s
I20250625 03:32:06.107998 5119 consensus_queue.cc:260] T a592afb64620423cb8ef5ac5da6558f0 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.108067 5120 raft_consensus.cc:357] T a592afb64620423cb8ef5ac5da6558f0 P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.109100 5120 raft_consensus.cc:383] T a592afb64620423cb8ef5ac5da6558f0 P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:06.109463 5120 raft_consensus.cc:738] T a592afb64620423cb8ef5ac5da6558f0 P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1270a01a1c04e8c9013a17569afebf5, State: Initialized, Role: FOLLOWER
I20250625 03:32:06.109493 5121 tablet_bootstrap.cc:492] T 2e7642d019e54a80ad09b22cfa20119e P c37a035bb2d44c709a64f282940bdc6b: Bootstrap starting.
I20250625 03:32:06.111241 5119 ts_tablet_manager.cc:1428] T a592afb64620423cb8ef5ac5da6558f0 P 21b63b7bf1b94396bf2ea6cc8359f4e5: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20250625 03:32:06.112164 5119 tablet_bootstrap.cc:492] T ad39583185dd49dd860e678ad2e166ac P 21b63b7bf1b94396bf2ea6cc8359f4e5: Bootstrap starting.
I20250625 03:32:06.111791 5120 consensus_queue.cc:260] T a592afb64620423cb8ef5ac5da6558f0 P e1270a01a1c04e8c9013a17569afebf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.114288 5120 ts_tablet_manager.cc:1428] T a592afb64620423cb8ef5ac5da6558f0 P e1270a01a1c04e8c9013a17569afebf5: Time spent starting tablet: real 0.009s user 0.006s sys 0.000s
I20250625 03:32:06.115296 5120 tablet_bootstrap.cc:492] T 8e6ebae6c4f34a34b8addf32082aa13c P e1270a01a1c04e8c9013a17569afebf5: Bootstrap starting.
I20250625 03:32:06.119083 5119 tablet_bootstrap.cc:654] T ad39583185dd49dd860e678ad2e166ac P 21b63b7bf1b94396bf2ea6cc8359f4e5: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:06.126608 5126 raft_consensus.cc:491] T a592afb64620423cb8ef5ac5da6558f0 P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:32:06.127097 5121 tablet_bootstrap.cc:654] T 2e7642d019e54a80ad09b22cfa20119e P c37a035bb2d44c709a64f282940bdc6b: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:06.127465 5126 raft_consensus.cc:513] T a592afb64620423cb8ef5ac5da6558f0 P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.130949 5120 tablet_bootstrap.cc:654] T 8e6ebae6c4f34a34b8addf32082aa13c P e1270a01a1c04e8c9013a17569afebf5: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:06.136497 5121 tablet_bootstrap.cc:492] T 2e7642d019e54a80ad09b22cfa20119e P c37a035bb2d44c709a64f282940bdc6b: No bootstrap required, opened a new log
I20250625 03:32:06.136929 5119 tablet_bootstrap.cc:492] T ad39583185dd49dd860e678ad2e166ac P 21b63b7bf1b94396bf2ea6cc8359f4e5: No bootstrap required, opened a new log
I20250625 03:32:06.137620 5119 ts_tablet_manager.cc:1397] T ad39583185dd49dd860e678ad2e166ac P 21b63b7bf1b94396bf2ea6cc8359f4e5: Time spent bootstrapping tablet: real 0.026s user 0.008s sys 0.015s
I20250625 03:32:06.136996 5121 ts_tablet_manager.cc:1397] T 2e7642d019e54a80ad09b22cfa20119e P c37a035bb2d44c709a64f282940bdc6b: Time spent bootstrapping tablet: real 0.028s user 0.012s sys 0.000s
I20250625 03:32:06.138646 5126 leader_election.cc:290] T a592afb64620423cb8ef5ac5da6558f0 P e1270a01a1c04e8c9013a17569afebf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373), c37a035bb2d44c709a64f282940bdc6b (127.0.106.131:35169)
I20250625 03:32:06.141937 5119 raft_consensus.cc:357] T ad39583185dd49dd860e678ad2e166ac P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.143023 5119 raft_consensus.cc:383] T ad39583185dd49dd860e678ad2e166ac P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:06.143412 5119 raft_consensus.cc:738] T ad39583185dd49dd860e678ad2e166ac P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b63b7bf1b94396bf2ea6cc8359f4e5, State: Initialized, Role: FOLLOWER
I20250625 03:32:06.144407 5119 consensus_queue.cc:260] T ad39583185dd49dd860e678ad2e166ac P 21b63b7bf1b94396bf2ea6cc8359f4e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.147827 5119 ts_tablet_manager.cc:1428] T ad39583185dd49dd860e678ad2e166ac P 21b63b7bf1b94396bf2ea6cc8359f4e5: Time spent starting tablet: real 0.010s user 0.007s sys 0.000s
I20250625 03:32:06.149266 5119 tablet_bootstrap.cc:492] T 78d8c392f87643228ae9a6cd204f713b P 21b63b7bf1b94396bf2ea6cc8359f4e5: Bootstrap starting.
I20250625 03:32:06.144878 5121 raft_consensus.cc:357] T 2e7642d019e54a80ad09b22cfa20119e P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.155377 5120 tablet_bootstrap.cc:492] T 8e6ebae6c4f34a34b8addf32082aa13c P e1270a01a1c04e8c9013a17569afebf5: No bootstrap required, opened a new log
I20250625 03:32:06.155989 5120 ts_tablet_manager.cc:1397] T 8e6ebae6c4f34a34b8addf32082aa13c P e1270a01a1c04e8c9013a17569afebf5: Time spent bootstrapping tablet: real 0.041s user 0.016s sys 0.011s
I20250625 03:32:06.158293 5119 tablet_bootstrap.cc:654] T 78d8c392f87643228ae9a6cd204f713b P 21b63b7bf1b94396bf2ea6cc8359f4e5: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:06.158987 5120 raft_consensus.cc:357] T 8e6ebae6c4f34a34b8addf32082aa13c P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.159848 5120 raft_consensus.cc:383] T 8e6ebae6c4f34a34b8addf32082aa13c P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:06.160207 5120 raft_consensus.cc:738] T 8e6ebae6c4f34a34b8addf32082aa13c P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1270a01a1c04e8c9013a17569afebf5, State: Initialized, Role: FOLLOWER
I20250625 03:32:06.161099 5120 consensus_queue.cc:260] T 8e6ebae6c4f34a34b8addf32082aa13c P e1270a01a1c04e8c9013a17569afebf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.151996 5121 raft_consensus.cc:383] T 2e7642d019e54a80ad09b22cfa20119e P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:06.164522 5121 raft_consensus.cc:738] T 2e7642d019e54a80ad09b22cfa20119e P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c37a035bb2d44c709a64f282940bdc6b, State: Initialized, Role: FOLLOWER
I20250625 03:32:06.164624 4930 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a592afb64620423cb8ef5ac5da6558f0" candidate_uuid: "e1270a01a1c04e8c9013a17569afebf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" is_pre_election: true
I20250625 03:32:06.165345 4930 raft_consensus.cc:2466] T a592afb64620423cb8ef5ac5da6558f0 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1270a01a1c04e8c9013a17569afebf5 in term 0.
I20250625 03:32:06.166088 5121 consensus_queue.cc:260] T 2e7642d019e54a80ad09b22cfa20119e P c37a035bb2d44c709a64f282940bdc6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.166952 4969 leader_election.cc:304] T a592afb64620423cb8ef5ac5da6558f0 P e1270a01a1c04e8c9013a17569afebf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b63b7bf1b94396bf2ea6cc8359f4e5, e1270a01a1c04e8c9013a17569afebf5; no voters:
I20250625 03:32:06.167232 5120 ts_tablet_manager.cc:1428] T 8e6ebae6c4f34a34b8addf32082aa13c P e1270a01a1c04e8c9013a17569afebf5: Time spent starting tablet: real 0.011s user 0.004s sys 0.002s
I20250625 03:32:06.168768 5120 tablet_bootstrap.cc:492] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P e1270a01a1c04e8c9013a17569afebf5: Bootstrap starting.
I20250625 03:32:06.168792 5121 ts_tablet_manager.cc:1428] T 2e7642d019e54a80ad09b22cfa20119e P c37a035bb2d44c709a64f282940bdc6b: Time spent starting tablet: real 0.031s user 0.008s sys 0.000s
I20250625 03:32:06.170199 5126 raft_consensus.cc:2802] T a592afb64620423cb8ef5ac5da6558f0 P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:32:06.170610 5126 raft_consensus.cc:491] T a592afb64620423cb8ef5ac5da6558f0 P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:32:06.170944 5126 raft_consensus.cc:3058] T a592afb64620423cb8ef5ac5da6558f0 P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:06.178483 5120 tablet_bootstrap.cc:654] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P e1270a01a1c04e8c9013a17569afebf5: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:06.179843 5126 raft_consensus.cc:513] T a592afb64620423cb8ef5ac5da6558f0 P e1270a01a1c04e8c9013a17569afebf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.182696 5121 tablet_bootstrap.cc:492] T f5296bbece6b404387af92d2c22ab91e P c37a035bb2d44c709a64f282940bdc6b: Bootstrap starting.
I20250625 03:32:06.182956 4930 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a592afb64620423cb8ef5ac5da6558f0" candidate_uuid: "e1270a01a1c04e8c9013a17569afebf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5"
I20250625 03:32:06.183559 4930 raft_consensus.cc:3058] T a592afb64620423cb8ef5ac5da6558f0 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:06.189929 5126 leader_election.cc:290] T a592afb64620423cb8ef5ac5da6558f0 P e1270a01a1c04e8c9013a17569afebf5 [CANDIDATE]: Term 1 election: Requested vote from peers 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373), c37a035bb2d44c709a64f282940bdc6b (127.0.106.131:35169)
I20250625 03:32:06.193254 5121 tablet_bootstrap.cc:654] T f5296bbece6b404387af92d2c22ab91e P c37a035bb2d44c709a64f282940bdc6b: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:06.194190 4930 raft_consensus.cc:2466] T a592afb64620423cb8ef5ac5da6558f0 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1270a01a1c04e8c9013a17569afebf5 in term 1.
I20250625 03:32:06.195521 4969 leader_election.cc:304] T a592afb64620423cb8ef5ac5da6558f0 P e1270a01a1c04e8c9013a17569afebf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b63b7bf1b94396bf2ea6cc8359f4e5, e1270a01a1c04e8c9013a17569afebf5; no voters:
I20250625 03:32:06.196422 5126 raft_consensus.cc:2802] T a592afb64620423cb8ef5ac5da6558f0 P e1270a01a1c04e8c9013a17569afebf5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:32:06.199648 5124 raft_consensus.cc:491] T 2e7642d019e54a80ad09b22cfa20119e P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:32:06.200501 5120 tablet_bootstrap.cc:492] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P e1270a01a1c04e8c9013a17569afebf5: No bootstrap required, opened a new log
I20250625 03:32:06.200311 5124 raft_consensus.cc:513] T 2e7642d019e54a80ad09b22cfa20119e P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.201023 5120 ts_tablet_manager.cc:1397] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P e1270a01a1c04e8c9013a17569afebf5: Time spent bootstrapping tablet: real 0.033s user 0.010s sys 0.012s
I20250625 03:32:06.202888 5124 leader_election.cc:290] T 2e7642d019e54a80ad09b22cfa20119e P 21b63b7bf1b94396bf2ea6cc8359f4e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130:41071), c37a035bb2d44c709a64f282940bdc6b (127.0.106.131:35169)
I20250625 03:32:06.210072 5120 raft_consensus.cc:357] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.213773 5120 raft_consensus.cc:383] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:06.214143 5120 raft_consensus.cc:738] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1270a01a1c04e8c9013a17569afebf5, State: Initialized, Role: FOLLOWER
I20250625 03:32:06.214905 5120 consensus_queue.cc:260] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P e1270a01a1c04e8c9013a17569afebf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.220293 5126 raft_consensus.cc:695] T a592afb64620423cb8ef5ac5da6558f0 P e1270a01a1c04e8c9013a17569afebf5 [term 1 LEADER]: Becoming Leader. State: Replica: e1270a01a1c04e8c9013a17569afebf5, State: Running, Role: LEADER
I20250625 03:32:06.223994 5079 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a592afb64620423cb8ef5ac5da6558f0" candidate_uuid: "e1270a01a1c04e8c9013a17569afebf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c37a035bb2d44c709a64f282940bdc6b" is_pre_election: true
I20250625 03:32:06.224936 5079 raft_consensus.cc:2466] T a592afb64620423cb8ef5ac5da6558f0 P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1270a01a1c04e8c9013a17569afebf5 in term 0.
I20250625 03:32:06.225685 5119 tablet_bootstrap.cc:492] T 78d8c392f87643228ae9a6cd204f713b P 21b63b7bf1b94396bf2ea6cc8359f4e5: No bootstrap required, opened a new log
I20250625 03:32:06.225922 5078 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a592afb64620423cb8ef5ac5da6558f0" candidate_uuid: "e1270a01a1c04e8c9013a17569afebf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c37a035bb2d44c709a64f282940bdc6b"
I20250625 03:32:06.226564 5119 ts_tablet_manager.cc:1397] T 78d8c392f87643228ae9a6cd204f713b P 21b63b7bf1b94396bf2ea6cc8359f4e5: Time spent bootstrapping tablet: real 0.078s user 0.021s sys 0.040s
I20250625 03:32:06.227134 5078 raft_consensus.cc:3058] T a592afb64620423cb8ef5ac5da6558f0 P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:06.227134 5120 ts_tablet_manager.cc:1428] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P e1270a01a1c04e8c9013a17569afebf5: Time spent starting tablet: real 0.026s user 0.010s sys 0.001s
I20250625 03:32:06.229017 5120 tablet_bootstrap.cc:492] T 06b41733ebac42daa85ec1c23c8588a7 P e1270a01a1c04e8c9013a17569afebf5: Bootstrap starting.
I20250625 03:32:06.227802 5126 consensus_queue.cc:237] T a592afb64620423cb8ef5ac5da6558f0 P e1270a01a1c04e8c9013a17569afebf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.231135 5121 tablet_bootstrap.cc:492] T f5296bbece6b404387af92d2c22ab91e P c37a035bb2d44c709a64f282940bdc6b: No bootstrap required, opened a new log
I20250625 03:32:06.231757 5121 ts_tablet_manager.cc:1397] T f5296bbece6b404387af92d2c22ab91e P c37a035bb2d44c709a64f282940bdc6b: Time spent bootstrapping tablet: real 0.049s user 0.018s sys 0.003s
I20250625 03:32:06.238008 5127 raft_consensus.cc:491] T 2e7642d019e54a80ad09b22cfa20119e P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:32:06.238610 5127 raft_consensus.cc:513] T 2e7642d019e54a80ad09b22cfa20119e P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.243733 5119 raft_consensus.cc:357] T 78d8c392f87643228ae9a6cd204f713b P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.250869 5119 raft_consensus.cc:383] T 78d8c392f87643228ae9a6cd204f713b P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:06.251333 5119 raft_consensus.cc:738] T 78d8c392f87643228ae9a6cd204f713b P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b63b7bf1b94396bf2ea6cc8359f4e5, State: Initialized, Role: FOLLOWER
I20250625 03:32:06.252148 5119 consensus_queue.cc:260] T 78d8c392f87643228ae9a6cd204f713b P 21b63b7bf1b94396bf2ea6cc8359f4e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.252955 5079 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2e7642d019e54a80ad09b22cfa20119e" candidate_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c37a035bb2d44c709a64f282940bdc6b" is_pre_election: true
I20250625 03:32:06.253103 5127 leader_election.cc:290] T 2e7642d019e54a80ad09b22cfa20119e P c37a035bb2d44c709a64f282940bdc6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130:41071), 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373)
I20250625 03:32:06.249930 5121 raft_consensus.cc:357] T f5296bbece6b404387af92d2c22ab91e P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.253681 5079 raft_consensus.cc:2466] T 2e7642d019e54a80ad09b22cfa20119e P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21b63b7bf1b94396bf2ea6cc8359f4e5 in term 0.
I20250625 03:32:06.263360 5121 raft_consensus.cc:383] T f5296bbece6b404387af92d2c22ab91e P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:06.246268 5120 tablet_bootstrap.cc:654] T 06b41733ebac42daa85ec1c23c8588a7 P e1270a01a1c04e8c9013a17569afebf5: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:06.263872 5121 raft_consensus.cc:738] T f5296bbece6b404387af92d2c22ab91e P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c37a035bb2d44c709a64f282940bdc6b, State: Initialized, Role: FOLLOWER
I20250625 03:32:06.265470 5078 raft_consensus.cc:2466] T a592afb64620423cb8ef5ac5da6558f0 P c37a035bb2d44c709a64f282940bdc6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1270a01a1c04e8c9013a17569afebf5 in term 1.
I20250625 03:32:06.266876 5121 consensus_queue.cc:260] T f5296bbece6b404387af92d2c22ab91e P c37a035bb2d44c709a64f282940bdc6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.267365 4893 leader_election.cc:304] T 2e7642d019e54a80ad09b22cfa20119e P 21b63b7bf1b94396bf2ea6cc8359f4e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b63b7bf1b94396bf2ea6cc8359f4e5, c37a035bb2d44c709a64f282940bdc6b; no voters:
I20250625 03:32:06.255435 5119 ts_tablet_manager.cc:1428] T 78d8c392f87643228ae9a6cd204f713b P 21b63b7bf1b94396bf2ea6cc8359f4e5: Time spent starting tablet: real 0.022s user 0.003s sys 0.006s
I20250625 03:32:06.269089 5119 tablet_bootstrap.cc:492] T d6ccc7e94aa248ac9313c70ae601b6c5 P 21b63b7bf1b94396bf2ea6cc8359f4e5: Bootstrap starting.
I20250625 03:32:06.269758 5124 raft_consensus.cc:2802] T 2e7642d019e54a80ad09b22cfa20119e P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:32:06.270187 5124 raft_consensus.cc:491] T 2e7642d019e54a80ad09b22cfa20119e P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:32:06.270543 5124 raft_consensus.cc:3058] T 2e7642d019e54a80ad09b22cfa20119e P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:06.276335 5119 tablet_bootstrap.cc:654] T d6ccc7e94aa248ac9313c70ae601b6c5 P 21b63b7bf1b94396bf2ea6cc8359f4e5: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:06.279412 4827 catalog_manager.cc:5582] T a592afb64620423cb8ef5ac5da6558f0 P e1270a01a1c04e8c9013a17569afebf5 reported cstate change: term changed from 0 to 1, leader changed from <none> to e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "e1270a01a1c04e8c9013a17569afebf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } health_report { overall_health: UNKNOWN } } }
I20250625 03:32:06.280764 4930 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2e7642d019e54a80ad09b22cfa20119e" candidate_uuid: "c37a035bb2d44c709a64f282940bdc6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" is_pre_election: true
I20250625 03:32:06.282332 5005 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2e7642d019e54a80ad09b22cfa20119e" candidate_uuid: "c37a035bb2d44c709a64f282940bdc6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1270a01a1c04e8c9013a17569afebf5" is_pre_election: true
W20250625 03:32:06.283944 5042 leader_election.cc:343] T 2e7642d019e54a80ad09b22cfa20119e P c37a035bb2d44c709a64f282940bdc6b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130:41071): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:32:06.286592 5124 raft_consensus.cc:513] T 2e7642d019e54a80ad09b22cfa20119e P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.288205 4930 raft_consensus.cc:2391] T 2e7642d019e54a80ad09b22cfa20119e P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c37a035bb2d44c709a64f282940bdc6b in current term 1: Already voted for candidate 21b63b7bf1b94396bf2ea6cc8359f4e5 in this term.
I20250625 03:32:06.288893 5005 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2e7642d019e54a80ad09b22cfa20119e" candidate_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1270a01a1c04e8c9013a17569afebf5" is_pre_election: true
W20250625 03:32:06.290359 4893 leader_election.cc:343] T 2e7642d019e54a80ad09b22cfa20119e P 21b63b7bf1b94396bf2ea6cc8359f4e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130:41071): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:32:06.281019 5121 ts_tablet_manager.cc:1428] T f5296bbece6b404387af92d2c22ab91e P c37a035bb2d44c709a64f282940bdc6b: Time spent starting tablet: real 0.043s user 0.004s sys 0.003s
I20250625 03:32:06.291427 5043 leader_election.cc:304] T 2e7642d019e54a80ad09b22cfa20119e P c37a035bb2d44c709a64f282940bdc6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c37a035bb2d44c709a64f282940bdc6b; no voters: 21b63b7bf1b94396bf2ea6cc8359f4e5, e1270a01a1c04e8c9013a17569afebf5
I20250625 03:32:06.292238 5119 tablet_bootstrap.cc:492] T d6ccc7e94aa248ac9313c70ae601b6c5 P 21b63b7bf1b94396bf2ea6cc8359f4e5: No bootstrap required, opened a new log
I20250625 03:32:06.292968 5119 ts_tablet_manager.cc:1397] T d6ccc7e94aa248ac9313c70ae601b6c5 P 21b63b7bf1b94396bf2ea6cc8359f4e5: Time spent bootstrapping tablet: real 0.024s user 0.010s sys 0.008s
I20250625 03:32:06.293758 5127 raft_consensus.cc:3058] T 2e7642d019e54a80ad09b22cfa20119e P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:06.295830 5005 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2e7642d019e54a80ad09b22cfa20119e" candidate_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1270a01a1c04e8c9013a17569afebf5"
W20250625 03:32:06.297581 4893 leader_election.cc:343] T 2e7642d019e54a80ad09b22cfa20119e P 21b63b7bf1b94396bf2ea6cc8359f4e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130:41071): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:32:06.297065 5119 raft_consensus.cc:357] T d6ccc7e94aa248ac9313c70ae601b6c5 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.298346 5119 raft_consensus.cc:383] T d6ccc7e94aa248ac9313c70ae601b6c5 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:06.298767 5119 raft_consensus.cc:738] T d6ccc7e94aa248ac9313c70ae601b6c5 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b63b7bf1b94396bf2ea6cc8359f4e5, State: Initialized, Role: FOLLOWER
I20250625 03:32:06.299669 5124 leader_election.cc:290] T 2e7642d019e54a80ad09b22cfa20119e P 21b63b7bf1b94396bf2ea6cc8359f4e5 [CANDIDATE]: Term 1 election: Requested vote from peers e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130:41071), c37a035bb2d44c709a64f282940bdc6b (127.0.106.131:35169)
I20250625 03:32:06.299870 5119 consensus_queue.cc:260] T d6ccc7e94aa248ac9313c70ae601b6c5 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.303277 5119 ts_tablet_manager.cc:1428] T d6ccc7e94aa248ac9313c70ae601b6c5 P 21b63b7bf1b94396bf2ea6cc8359f4e5: Time spent starting tablet: real 0.010s user 0.005s sys 0.004s
I20250625 03:32:06.304741 5119 tablet_bootstrap.cc:492] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P 21b63b7bf1b94396bf2ea6cc8359f4e5: Bootstrap starting.
I20250625 03:32:06.305404 5078 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2e7642d019e54a80ad09b22cfa20119e" candidate_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c37a035bb2d44c709a64f282940bdc6b"
I20250625 03:32:06.308934 5127 raft_consensus.cc:2747] T 2e7642d019e54a80ad09b22cfa20119e P c37a035bb2d44c709a64f282940bdc6b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:32:06.313997 5119 tablet_bootstrap.cc:654] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P 21b63b7bf1b94396bf2ea6cc8359f4e5: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:06.310048 5121 tablet_bootstrap.cc:492] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P c37a035bb2d44c709a64f282940bdc6b: Bootstrap starting.
I20250625 03:32:06.316398 5120 tablet_bootstrap.cc:492] T 06b41733ebac42daa85ec1c23c8588a7 P e1270a01a1c04e8c9013a17569afebf5: No bootstrap required, opened a new log
I20250625 03:32:06.317016 5120 ts_tablet_manager.cc:1397] T 06b41733ebac42daa85ec1c23c8588a7 P e1270a01a1c04e8c9013a17569afebf5: Time spent bootstrapping tablet: real 0.088s user 0.022s sys 0.024s
I20250625 03:32:06.320441 5120 raft_consensus.cc:357] T 06b41733ebac42daa85ec1c23c8588a7 P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.321731 5120 raft_consensus.cc:383] T 06b41733ebac42daa85ec1c23c8588a7 P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:06.322121 5120 raft_consensus.cc:738] T 06b41733ebac42daa85ec1c23c8588a7 P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1270a01a1c04e8c9013a17569afebf5, State: Initialized, Role: FOLLOWER
I20250625 03:32:06.323043 5120 consensus_queue.cc:260] T 06b41733ebac42daa85ec1c23c8588a7 P e1270a01a1c04e8c9013a17569afebf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.326078 5120 ts_tablet_manager.cc:1428] T 06b41733ebac42daa85ec1c23c8588a7 P e1270a01a1c04e8c9013a17569afebf5: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
I20250625 03:32:06.326817 5078 raft_consensus.cc:2466] T 2e7642d019e54a80ad09b22cfa20119e P c37a035bb2d44c709a64f282940bdc6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21b63b7bf1b94396bf2ea6cc8359f4e5 in term 1.
I20250625 03:32:06.327116 5120 tablet_bootstrap.cc:492] T 78d8c392f87643228ae9a6cd204f713b P e1270a01a1c04e8c9013a17569afebf5: Bootstrap starting.
W20250625 03:32:06.327597 4876 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20250625 03:32:06.328761 5121 tablet_bootstrap.cc:654] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P c37a035bb2d44c709a64f282940bdc6b: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:06.328666 4893 leader_election.cc:304] T 2e7642d019e54a80ad09b22cfa20119e P 21b63b7bf1b94396bf2ea6cc8359f4e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21b63b7bf1b94396bf2ea6cc8359f4e5, c37a035bb2d44c709a64f282940bdc6b; no voters: e1270a01a1c04e8c9013a17569afebf5
I20250625 03:32:06.329174 5126 raft_consensus.cc:491] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:32:06.329715 5126 raft_consensus.cc:513] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.330309 5124 raft_consensus.cc:2802] T 2e7642d019e54a80ad09b22cfa20119e P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:32:06.332000 5126 leader_election.cc:290] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P e1270a01a1c04e8c9013a17569afebf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373), c37a035bb2d44c709a64f282940bdc6b (127.0.106.131:35169)
I20250625 03:32:06.333806 5078 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5e6f0a34fdec4f4f8d38ad88f6c88390" candidate_uuid: "e1270a01a1c04e8c9013a17569afebf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c37a035bb2d44c709a64f282940bdc6b" is_pre_election: true
I20250625 03:32:06.334262 4930 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5e6f0a34fdec4f4f8d38ad88f6c88390" candidate_uuid: "e1270a01a1c04e8c9013a17569afebf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" is_pre_election: true
W20250625 03:32:06.335253 4968 leader_election.cc:343] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P e1270a01a1c04e8c9013a17569afebf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c37a035bb2d44c709a64f282940bdc6b (127.0.106.131:35169): Illegal state: must be running to vote when last-logged opid is not known
W20250625 03:32:06.335753 4969 leader_election.cc:343] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P e1270a01a1c04e8c9013a17569afebf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:32:06.336345 4969 leader_election.cc:304] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P e1270a01a1c04e8c9013a17569afebf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1270a01a1c04e8c9013a17569afebf5; no voters: 21b63b7bf1b94396bf2ea6cc8359f4e5, c37a035bb2d44c709a64f282940bdc6b
I20250625 03:32:06.338078 5126 raft_consensus.cc:2747] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:32:06.339058 5120 tablet_bootstrap.cc:654] T 78d8c392f87643228ae9a6cd204f713b P e1270a01a1c04e8c9013a17569afebf5: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:06.343910 5119 tablet_bootstrap.cc:492] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P 21b63b7bf1b94396bf2ea6cc8359f4e5: No bootstrap required, opened a new log
I20250625 03:32:06.344691 5119 ts_tablet_manager.cc:1397] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P 21b63b7bf1b94396bf2ea6cc8359f4e5: Time spent bootstrapping tablet: real 0.040s user 0.008s sys 0.007s
I20250625 03:32:06.347827 5119 raft_consensus.cc:357] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.348407 5126 raft_consensus.cc:491] T 06b41733ebac42daa85ec1c23c8588a7 P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:32:06.348801 5119 raft_consensus.cc:383] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:06.348963 5126 raft_consensus.cc:513] T 06b41733ebac42daa85ec1c23c8588a7 P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.349280 5119 raft_consensus.cc:738] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b63b7bf1b94396bf2ea6cc8359f4e5, State: Initialized, Role: FOLLOWER
I20250625 03:32:06.350356 5119 consensus_queue.cc:260] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.351155 5126 leader_election.cc:290] T 06b41733ebac42daa85ec1c23c8588a7 P e1270a01a1c04e8c9013a17569afebf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373), c37a035bb2d44c709a64f282940bdc6b (127.0.106.131:35169)
I20250625 03:32:06.352710 5078 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "06b41733ebac42daa85ec1c23c8588a7" candidate_uuid: "e1270a01a1c04e8c9013a17569afebf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c37a035bb2d44c709a64f282940bdc6b" is_pre_election: true
I20250625 03:32:06.353109 4930 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "06b41733ebac42daa85ec1c23c8588a7" candidate_uuid: "e1270a01a1c04e8c9013a17569afebf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" is_pre_election: true
I20250625 03:32:06.353431 5078 raft_consensus.cc:2466] T 06b41733ebac42daa85ec1c23c8588a7 P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1270a01a1c04e8c9013a17569afebf5 in term 0.
I20250625 03:32:06.353747 4930 raft_consensus.cc:2466] T 06b41733ebac42daa85ec1c23c8588a7 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1270a01a1c04e8c9013a17569afebf5 in term 0.
I20250625 03:32:06.354713 4968 leader_election.cc:304] T 06b41733ebac42daa85ec1c23c8588a7 P e1270a01a1c04e8c9013a17569afebf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c37a035bb2d44c709a64f282940bdc6b, e1270a01a1c04e8c9013a17569afebf5; no voters:
I20250625 03:32:06.355566 5126 raft_consensus.cc:491] T 8e6ebae6c4f34a34b8addf32082aa13c P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:32:06.355942 5143 raft_consensus.cc:2802] T 06b41733ebac42daa85ec1c23c8588a7 P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:32:06.356426 5143 raft_consensus.cc:491] T 06b41733ebac42daa85ec1c23c8588a7 P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:32:06.356122 5126 raft_consensus.cc:513] T 8e6ebae6c4f34a34b8addf32082aa13c P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.356781 5143 raft_consensus.cc:3058] T 06b41733ebac42daa85ec1c23c8588a7 P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:06.361989 5126 leader_election.cc:290] T 8e6ebae6c4f34a34b8addf32082aa13c P e1270a01a1c04e8c9013a17569afebf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373), c37a035bb2d44c709a64f282940bdc6b (127.0.106.131:35169)
I20250625 03:32:06.348111 5124 raft_consensus.cc:695] T 2e7642d019e54a80ad09b22cfa20119e P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 1 LEADER]: Becoming Leader. State: Replica: 21b63b7bf1b94396bf2ea6cc8359f4e5, State: Running, Role: LEADER
I20250625 03:32:06.362717 4930 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8e6ebae6c4f34a34b8addf32082aa13c" candidate_uuid: "e1270a01a1c04e8c9013a17569afebf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" is_pre_election: true
I20250625 03:32:06.363008 5078 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8e6ebae6c4f34a34b8addf32082aa13c" candidate_uuid: "e1270a01a1c04e8c9013a17569afebf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c37a035bb2d44c709a64f282940bdc6b" is_pre_election: true
W20250625 03:32:06.364315 4968 leader_election.cc:343] T 8e6ebae6c4f34a34b8addf32082aa13c P e1270a01a1c04e8c9013a17569afebf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c37a035bb2d44c709a64f282940bdc6b (127.0.106.131:35169): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:32:06.363823 5124 consensus_queue.cc:237] T 2e7642d019e54a80ad09b22cfa20119e P 21b63b7bf1b94396bf2ea6cc8359f4e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
W20250625 03:32:06.364876 4969 leader_election.cc:343] T 8e6ebae6c4f34a34b8addf32082aa13c P e1270a01a1c04e8c9013a17569afebf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:32:06.365365 4969 leader_election.cc:304] T 8e6ebae6c4f34a34b8addf32082aa13c P e1270a01a1c04e8c9013a17569afebf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1270a01a1c04e8c9013a17569afebf5; no voters: 21b63b7bf1b94396bf2ea6cc8359f4e5, c37a035bb2d44c709a64f282940bdc6b
I20250625 03:32:06.366151 5126 raft_consensus.cc:2747] T 8e6ebae6c4f34a34b8addf32082aa13c P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:32:06.370383 5143 raft_consensus.cc:513] T 06b41733ebac42daa85ec1c23c8588a7 P e1270a01a1c04e8c9013a17569afebf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.370663 5121 tablet_bootstrap.cc:492] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P c37a035bb2d44c709a64f282940bdc6b: No bootstrap required, opened a new log
I20250625 03:32:06.371109 5119 ts_tablet_manager.cc:1428] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P 21b63b7bf1b94396bf2ea6cc8359f4e5: Time spent starting tablet: real 0.026s user 0.013s sys 0.012s
I20250625 03:32:06.371244 5121 ts_tablet_manager.cc:1397] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P c37a035bb2d44c709a64f282940bdc6b: Time spent bootstrapping tablet: real 0.061s user 0.009s sys 0.010s
I20250625 03:32:06.372285 5119 tablet_bootstrap.cc:492] T f5296bbece6b404387af92d2c22ab91e P 21b63b7bf1b94396bf2ea6cc8359f4e5: Bootstrap starting.
I20250625 03:32:06.372495 5120 tablet_bootstrap.cc:492] T 78d8c392f87643228ae9a6cd204f713b P e1270a01a1c04e8c9013a17569afebf5: No bootstrap required, opened a new log
I20250625 03:32:06.373004 5120 ts_tablet_manager.cc:1397] T 78d8c392f87643228ae9a6cd204f713b P e1270a01a1c04e8c9013a17569afebf5: Time spent bootstrapping tablet: real 0.046s user 0.009s sys 0.016s
I20250625 03:32:06.373704 5121 raft_consensus.cc:357] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.374267 5121 raft_consensus.cc:383] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:06.374513 5121 raft_consensus.cc:738] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c37a035bb2d44c709a64f282940bdc6b, State: Initialized, Role: FOLLOWER
I20250625 03:32:06.375167 5121 consensus_queue.cc:260] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P c37a035bb2d44c709a64f282940bdc6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.376060 5120 raft_consensus.cc:357] T 78d8c392f87643228ae9a6cd204f713b P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.376866 5120 raft_consensus.cc:383] T 78d8c392f87643228ae9a6cd204f713b P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:06.377166 5120 raft_consensus.cc:738] T 78d8c392f87643228ae9a6cd204f713b P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1270a01a1c04e8c9013a17569afebf5, State: Initialized, Role: FOLLOWER
I20250625 03:32:06.377912 5120 consensus_queue.cc:260] T 78d8c392f87643228ae9a6cd204f713b P e1270a01a1c04e8c9013a17569afebf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.379453 5121 ts_tablet_manager.cc:1428] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P c37a035bb2d44c709a64f282940bdc6b: Time spent starting tablet: real 0.008s user 0.005s sys 0.000s
I20250625 03:32:06.379544 5119 tablet_bootstrap.cc:654] T f5296bbece6b404387af92d2c22ab91e P 21b63b7bf1b94396bf2ea6cc8359f4e5: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:06.381385 5120 ts_tablet_manager.cc:1428] T 78d8c392f87643228ae9a6cd204f713b P e1270a01a1c04e8c9013a17569afebf5: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s
I20250625 03:32:06.381901 5121 tablet_bootstrap.cc:492] T ad39583185dd49dd860e678ad2e166ac P c37a035bb2d44c709a64f282940bdc6b: Bootstrap starting.
I20250625 03:32:06.384100 5120 tablet_bootstrap.cc:492] T d6ccc7e94aa248ac9313c70ae601b6c5 P e1270a01a1c04e8c9013a17569afebf5: Bootstrap starting.
I20250625 03:32:06.384583 4930 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "06b41733ebac42daa85ec1c23c8588a7" candidate_uuid: "e1270a01a1c04e8c9013a17569afebf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5"
I20250625 03:32:06.385231 4930 raft_consensus.cc:3058] T 06b41733ebac42daa85ec1c23c8588a7 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:06.392832 4930 raft_consensus.cc:2466] T 06b41733ebac42daa85ec1c23c8588a7 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1270a01a1c04e8c9013a17569afebf5 in term 1.
I20250625 03:32:06.393908 4969 leader_election.cc:304] T 06b41733ebac42daa85ec1c23c8588a7 P e1270a01a1c04e8c9013a17569afebf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b63b7bf1b94396bf2ea6cc8359f4e5, e1270a01a1c04e8c9013a17569afebf5; no voters:
I20250625 03:32:06.394795 5126 raft_consensus.cc:2802] T 06b41733ebac42daa85ec1c23c8588a7 P e1270a01a1c04e8c9013a17569afebf5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:32:06.395257 5126 raft_consensus.cc:695] T 06b41733ebac42daa85ec1c23c8588a7 P e1270a01a1c04e8c9013a17569afebf5 [term 1 LEADER]: Becoming Leader. State: Replica: e1270a01a1c04e8c9013a17569afebf5, State: Running, Role: LEADER
I20250625 03:32:06.396267 5126 consensus_queue.cc:237] T 06b41733ebac42daa85ec1c23c8588a7 P e1270a01a1c04e8c9013a17569afebf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.400641 5120 tablet_bootstrap.cc:654] T d6ccc7e94aa248ac9313c70ae601b6c5 P e1270a01a1c04e8c9013a17569afebf5: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:06.400913 5143 leader_election.cc:290] T 06b41733ebac42daa85ec1c23c8588a7 P e1270a01a1c04e8c9013a17569afebf5 [CANDIDATE]: Term 1 election: Requested vote from peers 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373), c37a035bb2d44c709a64f282940bdc6b (127.0.106.131:35169)
I20250625 03:32:06.402151 5078 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "06b41733ebac42daa85ec1c23c8588a7" candidate_uuid: "e1270a01a1c04e8c9013a17569afebf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c37a035bb2d44c709a64f282940bdc6b"
I20250625 03:32:06.402864 5078 raft_consensus.cc:3058] T 06b41733ebac42daa85ec1c23c8588a7 P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:06.411019 5143 raft_consensus.cc:491] T ad39583185dd49dd860e678ad2e166ac P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:32:06.411640 5143 raft_consensus.cc:513] T ad39583185dd49dd860e678ad2e166ac P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.414536 4930 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ad39583185dd49dd860e678ad2e166ac" candidate_uuid: "e1270a01a1c04e8c9013a17569afebf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" is_pre_election: true
I20250625 03:32:06.415198 4930 raft_consensus.cc:2466] T ad39583185dd49dd860e678ad2e166ac P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1270a01a1c04e8c9013a17569afebf5 in term 0.
I20250625 03:32:06.416270 4969 leader_election.cc:304] T ad39583185dd49dd860e678ad2e166ac P e1270a01a1c04e8c9013a17569afebf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b63b7bf1b94396bf2ea6cc8359f4e5, e1270a01a1c04e8c9013a17569afebf5; no voters:
I20250625 03:32:06.417135 5140 raft_consensus.cc:2802] T ad39583185dd49dd860e678ad2e166ac P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:32:06.417515 5140 raft_consensus.cc:491] T ad39583185dd49dd860e678ad2e166ac P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:32:06.417569 5143 leader_election.cc:290] T ad39583185dd49dd860e678ad2e166ac P e1270a01a1c04e8c9013a17569afebf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373), c37a035bb2d44c709a64f282940bdc6b (127.0.106.131:35169)
I20250625 03:32:06.417902 5140 raft_consensus.cc:3058] T ad39583185dd49dd860e678ad2e166ac P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:06.422801 5121 tablet_bootstrap.cc:654] T ad39583185dd49dd860e678ad2e166ac P c37a035bb2d44c709a64f282940bdc6b: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:06.423974 5079 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ad39583185dd49dd860e678ad2e166ac" candidate_uuid: "e1270a01a1c04e8c9013a17569afebf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c37a035bb2d44c709a64f282940bdc6b" is_pre_election: true
W20250625 03:32:06.425613 4968 leader_election.cc:343] T ad39583185dd49dd860e678ad2e166ac P e1270a01a1c04e8c9013a17569afebf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c37a035bb2d44c709a64f282940bdc6b (127.0.106.131:35169): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:32:06.426690 5120 tablet_bootstrap.cc:492] T d6ccc7e94aa248ac9313c70ae601b6c5 P e1270a01a1c04e8c9013a17569afebf5: No bootstrap required, opened a new log
I20250625 03:32:06.427377 5120 ts_tablet_manager.cc:1397] T d6ccc7e94aa248ac9313c70ae601b6c5 P e1270a01a1c04e8c9013a17569afebf5: Time spent bootstrapping tablet: real 0.045s user 0.017s sys 0.000s
I20250625 03:32:06.430580 5120 raft_consensus.cc:357] T d6ccc7e94aa248ac9313c70ae601b6c5 P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.431236 5120 raft_consensus.cc:383] T d6ccc7e94aa248ac9313c70ae601b6c5 P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:06.431531 5120 raft_consensus.cc:738] T d6ccc7e94aa248ac9313c70ae601b6c5 P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1270a01a1c04e8c9013a17569afebf5, State: Initialized, Role: FOLLOWER
I20250625 03:32:06.432201 5119 tablet_bootstrap.cc:492] T f5296bbece6b404387af92d2c22ab91e P 21b63b7bf1b94396bf2ea6cc8359f4e5: No bootstrap required, opened a new log
I20250625 03:32:06.432201 5120 consensus_queue.cc:260] T d6ccc7e94aa248ac9313c70ae601b6c5 P e1270a01a1c04e8c9013a17569afebf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.432798 5119 ts_tablet_manager.cc:1397] T f5296bbece6b404387af92d2c22ab91e P 21b63b7bf1b94396bf2ea6cc8359f4e5: Time spent bootstrapping tablet: real 0.061s user 0.028s sys 0.030s
I20250625 03:32:06.434659 5120 ts_tablet_manager.cc:1428] T d6ccc7e94aa248ac9313c70ae601b6c5 P e1270a01a1c04e8c9013a17569afebf5: Time spent starting tablet: real 0.007s user 0.004s sys 0.004s
I20250625 03:32:06.435616 5120 tablet_bootstrap.cc:492] T 2e7642d019e54a80ad09b22cfa20119e P e1270a01a1c04e8c9013a17569afebf5: Bootstrap starting.
I20250625 03:32:06.435352 5119 raft_consensus.cc:357] T f5296bbece6b404387af92d2c22ab91e P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.436072 5119 raft_consensus.cc:383] T f5296bbece6b404387af92d2c22ab91e P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:06.436393 5119 raft_consensus.cc:738] T f5296bbece6b404387af92d2c22ab91e P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b63b7bf1b94396bf2ea6cc8359f4e5, State: Initialized, Role: FOLLOWER
I20250625 03:32:06.437160 5119 consensus_queue.cc:260] T f5296bbece6b404387af92d2c22ab91e P 21b63b7bf1b94396bf2ea6cc8359f4e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.439584 5119 ts_tablet_manager.cc:1428] T f5296bbece6b404387af92d2c22ab91e P 21b63b7bf1b94396bf2ea6cc8359f4e5: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20250625 03:32:06.430814 4827 catalog_manager.cc:5582] T 2e7642d019e54a80ad09b22cfa20119e P 21b63b7bf1b94396bf2ea6cc8359f4e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129). New cstate: current_term: 1 leader_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } health_report { overall_health: UNKNOWN } } }
I20250625 03:32:06.440569 5119 tablet_bootstrap.cc:492] T 8e6ebae6c4f34a34b8addf32082aa13c P 21b63b7bf1b94396bf2ea6cc8359f4e5: Bootstrap starting.
I20250625 03:32:06.441581 5120 tablet_bootstrap.cc:654] T 2e7642d019e54a80ad09b22cfa20119e P e1270a01a1c04e8c9013a17569afebf5: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:06.442816 5078 raft_consensus.cc:2466] T 06b41733ebac42daa85ec1c23c8588a7 P c37a035bb2d44c709a64f282940bdc6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1270a01a1c04e8c9013a17569afebf5 in term 1.
I20250625 03:32:06.447320 5124 raft_consensus.cc:491] T f5296bbece6b404387af92d2c22ab91e P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:32:06.448088 5124 raft_consensus.cc:513] T f5296bbece6b404387af92d2c22ab91e P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.451599 5124 leader_election.cc:290] T f5296bbece6b404387af92d2c22ab91e P 21b63b7bf1b94396bf2ea6cc8359f4e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130:41071), c37a035bb2d44c709a64f282940bdc6b (127.0.106.131:35169)
I20250625 03:32:06.451535 5005 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f5296bbece6b404387af92d2c22ab91e" candidate_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1270a01a1c04e8c9013a17569afebf5" is_pre_election: true
I20250625 03:32:06.452232 5078 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f5296bbece6b404387af92d2c22ab91e" candidate_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c37a035bb2d44c709a64f282940bdc6b" is_pre_election: true
I20250625 03:32:06.452468 5005 raft_consensus.cc:2466] T f5296bbece6b404387af92d2c22ab91e P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21b63b7bf1b94396bf2ea6cc8359f4e5 in term 0.
I20250625 03:32:06.452911 5078 raft_consensus.cc:2466] T f5296bbece6b404387af92d2c22ab91e P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21b63b7bf1b94396bf2ea6cc8359f4e5 in term 0.
I20250625 03:32:06.454154 4893 leader_election.cc:304] T f5296bbece6b404387af92d2c22ab91e P 21b63b7bf1b94396bf2ea6cc8359f4e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b63b7bf1b94396bf2ea6cc8359f4e5, c37a035bb2d44c709a64f282940bdc6b; no voters:
I20250625 03:32:06.454982 5119 tablet_bootstrap.cc:654] T 8e6ebae6c4f34a34b8addf32082aa13c P 21b63b7bf1b94396bf2ea6cc8359f4e5: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:06.455507 5120 tablet_bootstrap.cc:492] T 2e7642d019e54a80ad09b22cfa20119e P e1270a01a1c04e8c9013a17569afebf5: No bootstrap required, opened a new log
I20250625 03:32:06.456105 5120 ts_tablet_manager.cc:1397] T 2e7642d019e54a80ad09b22cfa20119e P e1270a01a1c04e8c9013a17569afebf5: Time spent bootstrapping tablet: real 0.021s user 0.011s sys 0.002s
I20250625 03:32:06.456321 5124 raft_consensus.cc:2802] T f5296bbece6b404387af92d2c22ab91e P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:32:06.456847 5124 raft_consensus.cc:491] T f5296bbece6b404387af92d2c22ab91e P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:32:06.457270 5124 raft_consensus.cc:3058] T f5296bbece6b404387af92d2c22ab91e P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:06.459717 5120 raft_consensus.cc:357] T 2e7642d019e54a80ad09b22cfa20119e P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.460983 5120 raft_consensus.cc:383] T 2e7642d019e54a80ad09b22cfa20119e P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:06.461405 5120 raft_consensus.cc:738] T 2e7642d019e54a80ad09b22cfa20119e P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1270a01a1c04e8c9013a17569afebf5, State: Initialized, Role: FOLLOWER
I20250625 03:32:06.462507 5120 consensus_queue.cc:260] T 2e7642d019e54a80ad09b22cfa20119e P e1270a01a1c04e8c9013a17569afebf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.465976 5120 ts_tablet_manager.cc:1428] T 2e7642d019e54a80ad09b22cfa20119e P e1270a01a1c04e8c9013a17569afebf5: Time spent starting tablet: real 0.010s user 0.006s sys 0.000s
I20250625 03:32:06.465387 5140 raft_consensus.cc:513] T ad39583185dd49dd860e678ad2e166ac P e1270a01a1c04e8c9013a17569afebf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.470399 4826 catalog_manager.cc:5582] T 06b41733ebac42daa85ec1c23c8588a7 P e1270a01a1c04e8c9013a17569afebf5 reported cstate change: term changed from 0 to 1, leader changed from <none> to e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "e1270a01a1c04e8c9013a17569afebf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } health_report { overall_health: UNKNOWN } } }
I20250625 03:32:06.473951 4930 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ad39583185dd49dd860e678ad2e166ac" candidate_uuid: "e1270a01a1c04e8c9013a17569afebf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5"
I20250625 03:32:06.474778 4930 raft_consensus.cc:3058] T ad39583185dd49dd860e678ad2e166ac P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:06.476604 5119 tablet_bootstrap.cc:492] T 8e6ebae6c4f34a34b8addf32082aa13c P 21b63b7bf1b94396bf2ea6cc8359f4e5: No bootstrap required, opened a new log
I20250625 03:32:06.477136 5119 ts_tablet_manager.cc:1397] T 8e6ebae6c4f34a34b8addf32082aa13c P 21b63b7bf1b94396bf2ea6cc8359f4e5: Time spent bootstrapping tablet: real 0.037s user 0.010s sys 0.012s
I20250625 03:32:06.481659 5140 leader_election.cc:290] T ad39583185dd49dd860e678ad2e166ac P e1270a01a1c04e8c9013a17569afebf5 [CANDIDATE]: Term 1 election: Requested vote from peers 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373), c37a035bb2d44c709a64f282940bdc6b (127.0.106.131:35169)
I20250625 03:32:06.482897 5078 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ad39583185dd49dd860e678ad2e166ac" candidate_uuid: "e1270a01a1c04e8c9013a17569afebf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c37a035bb2d44c709a64f282940bdc6b"
I20250625 03:32:06.485153 4930 raft_consensus.cc:2466] T ad39583185dd49dd860e678ad2e166ac P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1270a01a1c04e8c9013a17569afebf5 in term 1.
W20250625 03:32:06.487306 4968 leader_election.cc:343] T ad39583185dd49dd860e678ad2e166ac P e1270a01a1c04e8c9013a17569afebf5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c37a035bb2d44c709a64f282940bdc6b (127.0.106.131:35169): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:32:06.488088 4969 leader_election.cc:304] T ad39583185dd49dd860e678ad2e166ac P e1270a01a1c04e8c9013a17569afebf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21b63b7bf1b94396bf2ea6cc8359f4e5, e1270a01a1c04e8c9013a17569afebf5; no voters: c37a035bb2d44c709a64f282940bdc6b
I20250625 03:32:06.488863 5119 raft_consensus.cc:357] T 8e6ebae6c4f34a34b8addf32082aa13c P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.489231 5140 raft_consensus.cc:2802] T ad39583185dd49dd860e678ad2e166ac P e1270a01a1c04e8c9013a17569afebf5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:32:06.489629 5119 raft_consensus.cc:383] T 8e6ebae6c4f34a34b8addf32082aa13c P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:06.485261 5124 raft_consensus.cc:513] T f5296bbece6b404387af92d2c22ab91e P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.489843 5121 tablet_bootstrap.cc:492] T ad39583185dd49dd860e678ad2e166ac P c37a035bb2d44c709a64f282940bdc6b: No bootstrap required, opened a new log
I20250625 03:32:06.489933 5119 raft_consensus.cc:738] T 8e6ebae6c4f34a34b8addf32082aa13c P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b63b7bf1b94396bf2ea6cc8359f4e5, State: Initialized, Role: FOLLOWER
I20250625 03:32:06.490828 5121 ts_tablet_manager.cc:1397] T ad39583185dd49dd860e678ad2e166ac P c37a035bb2d44c709a64f282940bdc6b: Time spent bootstrapping tablet: real 0.109s user 0.022s sys 0.018s
I20250625 03:32:06.489964 5140 raft_consensus.cc:695] T ad39583185dd49dd860e678ad2e166ac P e1270a01a1c04e8c9013a17569afebf5 [term 1 LEADER]: Becoming Leader. State: Replica: e1270a01a1c04e8c9013a17569afebf5, State: Running, Role: LEADER
I20250625 03:32:06.491367 5119 consensus_queue.cc:260] T 8e6ebae6c4f34a34b8addf32082aa13c P 21b63b7bf1b94396bf2ea6cc8359f4e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.492136 5140 consensus_queue.cc:237] T ad39583185dd49dd860e678ad2e166ac P e1270a01a1c04e8c9013a17569afebf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.493817 5119 ts_tablet_manager.cc:1428] T 8e6ebae6c4f34a34b8addf32082aa13c P 21b63b7bf1b94396bf2ea6cc8359f4e5: Time spent starting tablet: real 0.016s user 0.004s sys 0.003s
I20250625 03:32:06.493841 5121 raft_consensus.cc:357] T ad39583185dd49dd860e678ad2e166ac P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.494706 5121 raft_consensus.cc:383] T ad39583185dd49dd860e678ad2e166ac P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:06.495092 5121 raft_consensus.cc:738] T ad39583185dd49dd860e678ad2e166ac P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c37a035bb2d44c709a64f282940bdc6b, State: Initialized, Role: FOLLOWER
I20250625 03:32:06.496291 5121 consensus_queue.cc:260] T ad39583185dd49dd860e678ad2e166ac P c37a035bb2d44c709a64f282940bdc6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.497609 5005 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f5296bbece6b404387af92d2c22ab91e" candidate_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1270a01a1c04e8c9013a17569afebf5"
I20250625 03:32:06.498224 5005 raft_consensus.cc:3058] T f5296bbece6b404387af92d2c22ab91e P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:06.500989 5121 ts_tablet_manager.cc:1428] T ad39583185dd49dd860e678ad2e166ac P c37a035bb2d44c709a64f282940bdc6b: Time spent starting tablet: real 0.010s user 0.007s sys 0.000s
I20250625 03:32:06.502183 5121 tablet_bootstrap.cc:492] T 8e6ebae6c4f34a34b8addf32082aa13c P c37a035bb2d44c709a64f282940bdc6b: Bootstrap starting.
I20250625 03:32:06.509405 5124 leader_election.cc:290] T f5296bbece6b404387af92d2c22ab91e P 21b63b7bf1b94396bf2ea6cc8359f4e5 [CANDIDATE]: Term 1 election: Requested vote from peers e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130:41071), c37a035bb2d44c709a64f282940bdc6b (127.0.106.131:35169)
I20250625 03:32:06.510005 5078 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f5296bbece6b404387af92d2c22ab91e" candidate_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c37a035bb2d44c709a64f282940bdc6b"
I20250625 03:32:06.510547 5121 tablet_bootstrap.cc:654] T 8e6ebae6c4f34a34b8addf32082aa13c P c37a035bb2d44c709a64f282940bdc6b: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:06.510666 5078 raft_consensus.cc:3058] T f5296bbece6b404387af92d2c22ab91e P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:06.511338 5005 raft_consensus.cc:2466] T f5296bbece6b404387af92d2c22ab91e P e1270a01a1c04e8c9013a17569afebf5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21b63b7bf1b94396bf2ea6cc8359f4e5 in term 1.
I20250625 03:32:06.512543 4893 leader_election.cc:304] T f5296bbece6b404387af92d2c22ab91e P 21b63b7bf1b94396bf2ea6cc8359f4e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b63b7bf1b94396bf2ea6cc8359f4e5, e1270a01a1c04e8c9013a17569afebf5; no voters:
I20250625 03:32:06.513525 5124 raft_consensus.cc:2802] T f5296bbece6b404387af92d2c22ab91e P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:32:06.513993 5124 raft_consensus.cc:695] T f5296bbece6b404387af92d2c22ab91e P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 1 LEADER]: Becoming Leader. State: Replica: 21b63b7bf1b94396bf2ea6cc8359f4e5, State: Running, Role: LEADER
I20250625 03:32:06.514814 5124 consensus_queue.cc:237] T f5296bbece6b404387af92d2c22ab91e P 21b63b7bf1b94396bf2ea6cc8359f4e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.519143 5078 raft_consensus.cc:2466] T f5296bbece6b404387af92d2c22ab91e P c37a035bb2d44c709a64f282940bdc6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21b63b7bf1b94396bf2ea6cc8359f4e5 in term 1.
I20250625 03:32:06.526499 4826 catalog_manager.cc:5582] T ad39583185dd49dd860e678ad2e166ac P e1270a01a1c04e8c9013a17569afebf5 reported cstate change: term changed from 0 to 1, leader changed from <none> to e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "e1270a01a1c04e8c9013a17569afebf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } health_report { overall_health: UNKNOWN } } }
I20250625 03:32:06.528398 5140 raft_consensus.cc:491] T 2e7642d019e54a80ad09b22cfa20119e P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:32:06.528991 5140 raft_consensus.cc:513] T 2e7642d019e54a80ad09b22cfa20119e P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.529932 5121 tablet_bootstrap.cc:492] T 8e6ebae6c4f34a34b8addf32082aa13c P c37a035bb2d44c709a64f282940bdc6b: No bootstrap required, opened a new log
I20250625 03:32:06.530516 5121 ts_tablet_manager.cc:1397] T 8e6ebae6c4f34a34b8addf32082aa13c P c37a035bb2d44c709a64f282940bdc6b: Time spent bootstrapping tablet: real 0.029s user 0.014s sys 0.007s
I20250625 03:32:06.531164 5140 leader_election.cc:290] T 2e7642d019e54a80ad09b22cfa20119e P e1270a01a1c04e8c9013a17569afebf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373), c37a035bb2d44c709a64f282940bdc6b (127.0.106.131:35169)
I20250625 03:32:06.532286 4930 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2e7642d019e54a80ad09b22cfa20119e" candidate_uuid: "e1270a01a1c04e8c9013a17569afebf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" is_pre_election: true
I20250625 03:32:06.533236 5078 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2e7642d019e54a80ad09b22cfa20119e" candidate_uuid: "e1270a01a1c04e8c9013a17569afebf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c37a035bb2d44c709a64f282940bdc6b" is_pre_election: true
I20250625 03:32:06.534018 5078 raft_consensus.cc:2391] T 2e7642d019e54a80ad09b22cfa20119e P c37a035bb2d44c709a64f282940bdc6b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e1270a01a1c04e8c9013a17569afebf5 in current term 1: Already voted for candidate 21b63b7bf1b94396bf2ea6cc8359f4e5 in this term.
I20250625 03:32:06.533681 5121 raft_consensus.cc:357] T 8e6ebae6c4f34a34b8addf32082aa13c P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.534462 5121 raft_consensus.cc:383] T 8e6ebae6c4f34a34b8addf32082aa13c P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:06.534797 5121 raft_consensus.cc:738] T 8e6ebae6c4f34a34b8addf32082aa13c P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c37a035bb2d44c709a64f282940bdc6b, State: Initialized, Role: FOLLOWER
I20250625 03:32:06.534299 4827 catalog_manager.cc:5582] T f5296bbece6b404387af92d2c22ab91e P 21b63b7bf1b94396bf2ea6cc8359f4e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129). New cstate: current_term: 1 leader_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } health_report { overall_health: UNKNOWN } } }
I20250625 03:32:06.535193 4968 leader_election.cc:304] T 2e7642d019e54a80ad09b22cfa20119e P e1270a01a1c04e8c9013a17569afebf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1270a01a1c04e8c9013a17569afebf5; no voters: 21b63b7bf1b94396bf2ea6cc8359f4e5, c37a035bb2d44c709a64f282940bdc6b
I20250625 03:32:06.535511 5121 consensus_queue.cc:260] T 8e6ebae6c4f34a34b8addf32082aa13c P c37a035bb2d44c709a64f282940bdc6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.536947 5140 raft_consensus.cc:3058] T 2e7642d019e54a80ad09b22cfa20119e P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:06.539939 5121 ts_tablet_manager.cc:1428] T 8e6ebae6c4f34a34b8addf32082aa13c P c37a035bb2d44c709a64f282940bdc6b: Time spent starting tablet: real 0.009s user 0.008s sys 0.000s
I20250625 03:32:06.541054 5121 tablet_bootstrap.cc:492] T 78d8c392f87643228ae9a6cd204f713b P c37a035bb2d44c709a64f282940bdc6b: Bootstrap starting.
I20250625 03:32:06.545207 5140 raft_consensus.cc:2747] T 2e7642d019e54a80ad09b22cfa20119e P e1270a01a1c04e8c9013a17569afebf5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:32:06.548709 5121 tablet_bootstrap.cc:654] T 78d8c392f87643228ae9a6cd204f713b P c37a035bb2d44c709a64f282940bdc6b: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:06.553717 5121 tablet_bootstrap.cc:492] T 78d8c392f87643228ae9a6cd204f713b P c37a035bb2d44c709a64f282940bdc6b: No bootstrap required, opened a new log
I20250625 03:32:06.554095 5121 ts_tablet_manager.cc:1397] T 78d8c392f87643228ae9a6cd204f713b P c37a035bb2d44c709a64f282940bdc6b: Time spent bootstrapping tablet: real 0.013s user 0.008s sys 0.003s
I20250625 03:32:06.555497 5140 raft_consensus.cc:491] T 78d8c392f87643228ae9a6cd204f713b P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:32:06.555969 5140 raft_consensus.cc:513] T 78d8c392f87643228ae9a6cd204f713b P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.556286 5121 raft_consensus.cc:357] T 78d8c392f87643228ae9a6cd204f713b P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.556840 5121 raft_consensus.cc:383] T 78d8c392f87643228ae9a6cd204f713b P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:06.557034 5121 raft_consensus.cc:738] T 78d8c392f87643228ae9a6cd204f713b P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c37a035bb2d44c709a64f282940bdc6b, State: Initialized, Role: FOLLOWER
I20250625 03:32:06.557628 5140 leader_election.cc:290] T 78d8c392f87643228ae9a6cd204f713b P e1270a01a1c04e8c9013a17569afebf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373), c37a035bb2d44c709a64f282940bdc6b (127.0.106.131:35169)
I20250625 03:32:06.557649 5121 consensus_queue.cc:260] T 78d8c392f87643228ae9a6cd204f713b P c37a035bb2d44c709a64f282940bdc6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.558513 4930 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "78d8c392f87643228ae9a6cd204f713b" candidate_uuid: "e1270a01a1c04e8c9013a17569afebf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" is_pre_election: true
I20250625 03:32:06.558646 5078 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "78d8c392f87643228ae9a6cd204f713b" candidate_uuid: "e1270a01a1c04e8c9013a17569afebf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c37a035bb2d44c709a64f282940bdc6b" is_pre_election: true
I20250625 03:32:06.559207 4930 raft_consensus.cc:2466] T 78d8c392f87643228ae9a6cd204f713b P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1270a01a1c04e8c9013a17569afebf5 in term 0.
I20250625 03:32:06.559268 5078 raft_consensus.cc:2466] T 78d8c392f87643228ae9a6cd204f713b P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1270a01a1c04e8c9013a17569afebf5 in term 0.
I20250625 03:32:06.560354 5121 ts_tablet_manager.cc:1428] T 78d8c392f87643228ae9a6cd204f713b P c37a035bb2d44c709a64f282940bdc6b: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20250625 03:32:06.560321 4969 leader_election.cc:304] T 78d8c392f87643228ae9a6cd204f713b P e1270a01a1c04e8c9013a17569afebf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b63b7bf1b94396bf2ea6cc8359f4e5, e1270a01a1c04e8c9013a17569afebf5; no voters:
I20250625 03:32:06.561427 5121 tablet_bootstrap.cc:492] T d6ccc7e94aa248ac9313c70ae601b6c5 P c37a035bb2d44c709a64f282940bdc6b: Bootstrap starting.
I20250625 03:32:06.561445 5140 raft_consensus.cc:2802] T 78d8c392f87643228ae9a6cd204f713b P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:32:06.561923 5140 raft_consensus.cc:491] T 78d8c392f87643228ae9a6cd204f713b P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:32:06.562259 5140 raft_consensus.cc:3058] T 78d8c392f87643228ae9a6cd204f713b P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:06.567791 5121 tablet_bootstrap.cc:654] T d6ccc7e94aa248ac9313c70ae601b6c5 P c37a035bb2d44c709a64f282940bdc6b: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:06.570008 5140 raft_consensus.cc:513] T 78d8c392f87643228ae9a6cd204f713b P e1270a01a1c04e8c9013a17569afebf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.572139 5140 leader_election.cc:290] T 78d8c392f87643228ae9a6cd204f713b P e1270a01a1c04e8c9013a17569afebf5 [CANDIDATE]: Term 1 election: Requested vote from peers 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373), c37a035bb2d44c709a64f282940bdc6b (127.0.106.131:35169)
I20250625 03:32:06.572764 5121 tablet_bootstrap.cc:492] T d6ccc7e94aa248ac9313c70ae601b6c5 P c37a035bb2d44c709a64f282940bdc6b: No bootstrap required, opened a new log
I20250625 03:32:06.572769 4930 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "78d8c392f87643228ae9a6cd204f713b" candidate_uuid: "e1270a01a1c04e8c9013a17569afebf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5"
I20250625 03:32:06.573416 5121 ts_tablet_manager.cc:1397] T d6ccc7e94aa248ac9313c70ae601b6c5 P c37a035bb2d44c709a64f282940bdc6b: Time spent bootstrapping tablet: real 0.012s user 0.011s sys 0.000s
I20250625 03:32:06.573509 4930 raft_consensus.cc:3058] T 78d8c392f87643228ae9a6cd204f713b P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:06.575361 5121 raft_consensus.cc:357] T d6ccc7e94aa248ac9313c70ae601b6c5 P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.575822 5121 raft_consensus.cc:383] T d6ccc7e94aa248ac9313c70ae601b6c5 P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:06.576071 5121 raft_consensus.cc:738] T d6ccc7e94aa248ac9313c70ae601b6c5 P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c37a035bb2d44c709a64f282940bdc6b, State: Initialized, Role: FOLLOWER
I20250625 03:32:06.576678 5121 consensus_queue.cc:260] T d6ccc7e94aa248ac9313c70ae601b6c5 P c37a035bb2d44c709a64f282940bdc6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.577289 5078 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "78d8c392f87643228ae9a6cd204f713b" candidate_uuid: "e1270a01a1c04e8c9013a17569afebf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c37a035bb2d44c709a64f282940bdc6b"
I20250625 03:32:06.577939 5078 raft_consensus.cc:3058] T 78d8c392f87643228ae9a6cd204f713b P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:06.579087 4930 raft_consensus.cc:2466] T 78d8c392f87643228ae9a6cd204f713b P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1270a01a1c04e8c9013a17569afebf5 in term 1.
I20250625 03:32:06.580349 4969 leader_election.cc:304] T 78d8c392f87643228ae9a6cd204f713b P e1270a01a1c04e8c9013a17569afebf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b63b7bf1b94396bf2ea6cc8359f4e5, e1270a01a1c04e8c9013a17569afebf5; no voters:
I20250625 03:32:06.581172 5121 ts_tablet_manager.cc:1428] T d6ccc7e94aa248ac9313c70ae601b6c5 P c37a035bb2d44c709a64f282940bdc6b: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20250625 03:32:06.581300 5140 raft_consensus.cc:2802] T 78d8c392f87643228ae9a6cd204f713b P e1270a01a1c04e8c9013a17569afebf5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:32:06.581981 5140 raft_consensus.cc:695] T 78d8c392f87643228ae9a6cd204f713b P e1270a01a1c04e8c9013a17569afebf5 [term 1 LEADER]: Becoming Leader. State: Replica: e1270a01a1c04e8c9013a17569afebf5, State: Running, Role: LEADER
I20250625 03:32:06.582896 5140 consensus_queue.cc:237] T 78d8c392f87643228ae9a6cd204f713b P e1270a01a1c04e8c9013a17569afebf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.585721 5078 raft_consensus.cc:2466] T 78d8c392f87643228ae9a6cd204f713b P c37a035bb2d44c709a64f282940bdc6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1270a01a1c04e8c9013a17569afebf5 in term 1.
I20250625 03:32:06.591570 4824 catalog_manager.cc:5582] T 78d8c392f87643228ae9a6cd204f713b P e1270a01a1c04e8c9013a17569afebf5 reported cstate change: term changed from 0 to 1, leader changed from <none> to e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "e1270a01a1c04e8c9013a17569afebf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } health_report { overall_health: UNKNOWN } } }
I20250625 03:32:06.597457 5124 raft_consensus.cc:491] T d6ccc7e94aa248ac9313c70ae601b6c5 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:32:06.597978 5124 raft_consensus.cc:513] T d6ccc7e94aa248ac9313c70ae601b6c5 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.599948 5124 leader_election.cc:290] T d6ccc7e94aa248ac9313c70ae601b6c5 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130:41071), c37a035bb2d44c709a64f282940bdc6b (127.0.106.131:35169)
I20250625 03:32:06.600839 5005 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d6ccc7e94aa248ac9313c70ae601b6c5" candidate_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1270a01a1c04e8c9013a17569afebf5" is_pre_election: true
I20250625 03:32:06.601465 5005 raft_consensus.cc:2466] T d6ccc7e94aa248ac9313c70ae601b6c5 P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21b63b7bf1b94396bf2ea6cc8359f4e5 in term 0.
I20250625 03:32:06.601898 5078 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d6ccc7e94aa248ac9313c70ae601b6c5" candidate_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c37a035bb2d44c709a64f282940bdc6b" is_pre_election: true
I20250625 03:32:06.602607 5078 raft_consensus.cc:2466] T d6ccc7e94aa248ac9313c70ae601b6c5 P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21b63b7bf1b94396bf2ea6cc8359f4e5 in term 0.
I20250625 03:32:06.602478 4893 leader_election.cc:304] T d6ccc7e94aa248ac9313c70ae601b6c5 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b63b7bf1b94396bf2ea6cc8359f4e5, e1270a01a1c04e8c9013a17569afebf5; no voters:
I20250625 03:32:06.603525 5124 raft_consensus.cc:2802] T d6ccc7e94aa248ac9313c70ae601b6c5 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:32:06.603928 5124 raft_consensus.cc:491] T d6ccc7e94aa248ac9313c70ae601b6c5 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:32:06.604316 5124 raft_consensus.cc:3058] T d6ccc7e94aa248ac9313c70ae601b6c5 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:06.609270 5124 raft_consensus.cc:513] T d6ccc7e94aa248ac9313c70ae601b6c5 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.610803 5124 leader_election.cc:290] T d6ccc7e94aa248ac9313c70ae601b6c5 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [CANDIDATE]: Term 1 election: Requested vote from peers e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130:41071), c37a035bb2d44c709a64f282940bdc6b (127.0.106.131:35169)
I20250625 03:32:06.611752 5005 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d6ccc7e94aa248ac9313c70ae601b6c5" candidate_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1270a01a1c04e8c9013a17569afebf5"
I20250625 03:32:06.611923 5078 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d6ccc7e94aa248ac9313c70ae601b6c5" candidate_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c37a035bb2d44c709a64f282940bdc6b"
I20250625 03:32:06.612394 5005 raft_consensus.cc:3058] T d6ccc7e94aa248ac9313c70ae601b6c5 P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:06.612592 5078 raft_consensus.cc:3058] T d6ccc7e94aa248ac9313c70ae601b6c5 P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:06.617529 5005 raft_consensus.cc:2466] T d6ccc7e94aa248ac9313c70ae601b6c5 P e1270a01a1c04e8c9013a17569afebf5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21b63b7bf1b94396bf2ea6cc8359f4e5 in term 1.
I20250625 03:32:06.617602 5078 raft_consensus.cc:2466] T d6ccc7e94aa248ac9313c70ae601b6c5 P c37a035bb2d44c709a64f282940bdc6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21b63b7bf1b94396bf2ea6cc8359f4e5 in term 1.
I20250625 03:32:06.618639 4893 leader_election.cc:304] T d6ccc7e94aa248ac9313c70ae601b6c5 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b63b7bf1b94396bf2ea6cc8359f4e5, e1270a01a1c04e8c9013a17569afebf5; no voters:
I20250625 03:32:06.619328 5124 raft_consensus.cc:2802] T d6ccc7e94aa248ac9313c70ae601b6c5 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:32:06.619727 5124 raft_consensus.cc:695] T d6ccc7e94aa248ac9313c70ae601b6c5 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 1 LEADER]: Becoming Leader. State: Replica: 21b63b7bf1b94396bf2ea6cc8359f4e5, State: Running, Role: LEADER
I20250625 03:32:06.620537 5124 consensus_queue.cc:237] T d6ccc7e94aa248ac9313c70ae601b6c5 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.627172 4824 catalog_manager.cc:5582] T d6ccc7e94aa248ac9313c70ae601b6c5 P 21b63b7bf1b94396bf2ea6cc8359f4e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129). New cstate: current_term: 1 leader_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } health_report { overall_health: UNKNOWN } } }
I20250625 03:32:06.717394 5140 consensus_queue.cc:1035] T a592afb64620423cb8ef5ac5da6558f0 P e1270a01a1c04e8c9013a17569afebf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:32:06.730410 5140 consensus_queue.cc:1035] T a592afb64620423cb8ef5ac5da6558f0 P e1270a01a1c04e8c9013a17569afebf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:32:06.735384 5127 raft_consensus.cc:491] T ad39583185dd49dd860e678ad2e166ac P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:32:06.736167 5127 raft_consensus.cc:513] T ad39583185dd49dd860e678ad2e166ac P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.739082 5127 leader_election.cc:290] T ad39583185dd49dd860e678ad2e166ac P c37a035bb2d44c709a64f282940bdc6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373), e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130:41071)
I20250625 03:32:06.739625 5127 raft_consensus.cc:491] T 8e6ebae6c4f34a34b8addf32082aa13c P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:32:06.739859 4930 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ad39583185dd49dd860e678ad2e166ac" candidate_uuid: "c37a035bb2d44c709a64f282940bdc6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" is_pre_election: true
I20250625 03:32:06.740147 5127 raft_consensus.cc:513] T 8e6ebae6c4f34a34b8addf32082aa13c P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.740440 5005 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ad39583185dd49dd860e678ad2e166ac" candidate_uuid: "c37a035bb2d44c709a64f282940bdc6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1270a01a1c04e8c9013a17569afebf5" is_pre_election: true
I20250625 03:32:06.740768 4930 raft_consensus.cc:2391] T ad39583185dd49dd860e678ad2e166ac P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c37a035bb2d44c709a64f282940bdc6b in current term 1: Already voted for candidate e1270a01a1c04e8c9013a17569afebf5 in this term.
I20250625 03:32:06.742200 5127 leader_election.cc:290] T 8e6ebae6c4f34a34b8addf32082aa13c P c37a035bb2d44c709a64f282940bdc6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373), e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130:41071)
I20250625 03:32:06.742508 5043 leader_election.cc:304] T ad39583185dd49dd860e678ad2e166ac P c37a035bb2d44c709a64f282940bdc6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c37a035bb2d44c709a64f282940bdc6b; no voters: 21b63b7bf1b94396bf2ea6cc8359f4e5, e1270a01a1c04e8c9013a17569afebf5
I20250625 03:32:06.743352 5127 raft_consensus.cc:3058] T ad39583185dd49dd860e678ad2e166ac P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:06.743405 5005 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8e6ebae6c4f34a34b8addf32082aa13c" candidate_uuid: "c37a035bb2d44c709a64f282940bdc6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1270a01a1c04e8c9013a17569afebf5" is_pre_election: true
I20250625 03:32:06.744140 5005 raft_consensus.cc:2466] T 8e6ebae6c4f34a34b8addf32082aa13c P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c37a035bb2d44c709a64f282940bdc6b in term 0.
I20250625 03:32:06.745065 4930 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8e6ebae6c4f34a34b8addf32082aa13c" candidate_uuid: "c37a035bb2d44c709a64f282940bdc6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" is_pre_election: true
I20250625 03:32:06.745213 5042 leader_election.cc:304] T 8e6ebae6c4f34a34b8addf32082aa13c P c37a035bb2d44c709a64f282940bdc6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c37a035bb2d44c709a64f282940bdc6b, e1270a01a1c04e8c9013a17569afebf5; no voters:
I20250625 03:32:06.745764 4930 raft_consensus.cc:2466] T 8e6ebae6c4f34a34b8addf32082aa13c P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c37a035bb2d44c709a64f282940bdc6b in term 0.
I20250625 03:32:06.746409 5178 raft_consensus.cc:2802] T 8e6ebae6c4f34a34b8addf32082aa13c P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:32:06.746846 5178 raft_consensus.cc:491] T 8e6ebae6c4f34a34b8addf32082aa13c P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:32:06.747169 5178 raft_consensus.cc:3058] T 8e6ebae6c4f34a34b8addf32082aa13c P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:06.751181 5127 raft_consensus.cc:2747] T ad39583185dd49dd860e678ad2e166ac P c37a035bb2d44c709a64f282940bdc6b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:32:06.754009 5178 raft_consensus.cc:513] T 8e6ebae6c4f34a34b8addf32082aa13c P c37a035bb2d44c709a64f282940bdc6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.755735 5178 leader_election.cc:290] T 8e6ebae6c4f34a34b8addf32082aa13c P c37a035bb2d44c709a64f282940bdc6b [CANDIDATE]: Term 1 election: Requested vote from peers 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373), e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130:41071)
I20250625 03:32:06.756616 4930 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8e6ebae6c4f34a34b8addf32082aa13c" candidate_uuid: "c37a035bb2d44c709a64f282940bdc6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5"
I20250625 03:32:06.756781 5005 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8e6ebae6c4f34a34b8addf32082aa13c" candidate_uuid: "c37a035bb2d44c709a64f282940bdc6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1270a01a1c04e8c9013a17569afebf5"
I20250625 03:32:06.757304 4930 raft_consensus.cc:3058] T 8e6ebae6c4f34a34b8addf32082aa13c P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:06.757323 5005 raft_consensus.cc:3058] T 8e6ebae6c4f34a34b8addf32082aa13c P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:06.764617 4930 raft_consensus.cc:2466] T 8e6ebae6c4f34a34b8addf32082aa13c P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c37a035bb2d44c709a64f282940bdc6b in term 1.
I20250625 03:32:06.764638 5005 raft_consensus.cc:2466] T 8e6ebae6c4f34a34b8addf32082aa13c P e1270a01a1c04e8c9013a17569afebf5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c37a035bb2d44c709a64f282940bdc6b in term 1.
I20250625 03:32:06.765987 5043 leader_election.cc:304] T 8e6ebae6c4f34a34b8addf32082aa13c P c37a035bb2d44c709a64f282940bdc6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b63b7bf1b94396bf2ea6cc8359f4e5, c37a035bb2d44c709a64f282940bdc6b; no voters:
I20250625 03:32:06.766794 5178 raft_consensus.cc:2802] T 8e6ebae6c4f34a34b8addf32082aa13c P c37a035bb2d44c709a64f282940bdc6b [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:32:06.767194 5178 raft_consensus.cc:695] T 8e6ebae6c4f34a34b8addf32082aa13c P c37a035bb2d44c709a64f282940bdc6b [term 1 LEADER]: Becoming Leader. State: Replica: c37a035bb2d44c709a64f282940bdc6b, State: Running, Role: LEADER
I20250625 03:32:06.767999 5178 consensus_queue.cc:237] T 8e6ebae6c4f34a34b8addf32082aa13c P c37a035bb2d44c709a64f282940bdc6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.775014 4827 catalog_manager.cc:5582] T 8e6ebae6c4f34a34b8addf32082aa13c P c37a035bb2d44c709a64f282940bdc6b reported cstate change: term changed from 0 to 1, leader changed from <none> to c37a035bb2d44c709a64f282940bdc6b (127.0.106.131). New cstate: current_term: 1 leader_uuid: "c37a035bb2d44c709a64f282940bdc6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } health_report { overall_health: HEALTHY } } }
I20250625 03:32:06.780043 5124 raft_consensus.cc:491] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:32:06.780627 5124 raft_consensus.cc:513] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.782438 5124 leader_election.cc:290] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130:41071), c37a035bb2d44c709a64f282940bdc6b (127.0.106.131:35169)
I20250625 03:32:06.783646 5005 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5e6f0a34fdec4f4f8d38ad88f6c88390" candidate_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1270a01a1c04e8c9013a17569afebf5" is_pre_election: true
I20250625 03:32:06.783648 5078 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5e6f0a34fdec4f4f8d38ad88f6c88390" candidate_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c37a035bb2d44c709a64f282940bdc6b" is_pre_election: true
I20250625 03:32:06.784552 5005 raft_consensus.cc:2466] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21b63b7bf1b94396bf2ea6cc8359f4e5 in term 0.
I20250625 03:32:06.784564 5078 raft_consensus.cc:2466] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21b63b7bf1b94396bf2ea6cc8359f4e5 in term 0.
I20250625 03:32:06.785744 4893 leader_election.cc:304] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b63b7bf1b94396bf2ea6cc8359f4e5, e1270a01a1c04e8c9013a17569afebf5; no voters:
I20250625 03:32:06.786339 5124 raft_consensus.cc:2802] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:32:06.786651 5124 raft_consensus.cc:491] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:32:06.786899 5124 raft_consensus.cc:3058] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:06.791760 5124 raft_consensus.cc:513] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.793336 5124 leader_election.cc:290] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [CANDIDATE]: Term 1 election: Requested vote from peers e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130:41071), c37a035bb2d44c709a64f282940bdc6b (127.0.106.131:35169)
I20250625 03:32:06.794221 5005 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5e6f0a34fdec4f4f8d38ad88f6c88390" candidate_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1270a01a1c04e8c9013a17569afebf5"
I20250625 03:32:06.794413 5078 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5e6f0a34fdec4f4f8d38ad88f6c88390" candidate_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c37a035bb2d44c709a64f282940bdc6b"
I20250625 03:32:06.794917 5005 raft_consensus.cc:3058] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:06.794945 5078 raft_consensus.cc:3058] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:06.802373 5005 raft_consensus.cc:2466] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P e1270a01a1c04e8c9013a17569afebf5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21b63b7bf1b94396bf2ea6cc8359f4e5 in term 1.
I20250625 03:32:06.802373 5078 raft_consensus.cc:2466] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P c37a035bb2d44c709a64f282940bdc6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21b63b7bf1b94396bf2ea6cc8359f4e5 in term 1.
I20250625 03:32:06.803646 4893 leader_election.cc:304] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b63b7bf1b94396bf2ea6cc8359f4e5, c37a035bb2d44c709a64f282940bdc6b; no voters:
I20250625 03:32:06.804329 5124 raft_consensus.cc:2802] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:32:06.804724 5124 raft_consensus.cc:695] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 1 LEADER]: Becoming Leader. State: Replica: 21b63b7bf1b94396bf2ea6cc8359f4e5, State: Running, Role: LEADER
I20250625 03:32:06.805522 5124 consensus_queue.cc:237] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.812817 4827 catalog_manager.cc:5582] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P 21b63b7bf1b94396bf2ea6cc8359f4e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129). New cstate: current_term: 1 leader_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } health_report { overall_health: UNKNOWN } } }
I20250625 03:32:06.878578 5005 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "ad39583185dd49dd860e678ad2e166ac"
dest_uuid: "e1270a01a1c04e8c9013a17569afebf5"
mode: GRACEFUL
new_leader_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5"
from {username='slave'} at 127.0.0.1:54568
I20250625 03:32:06.879200 5005 raft_consensus.cc:604] T ad39583185dd49dd860e678ad2e166ac P e1270a01a1c04e8c9013a17569afebf5 [term 1 LEADER]: Received request to transfer leadership to TS 21b63b7bf1b94396bf2ea6cc8359f4e5
I20250625 03:32:06.880714 5140 consensus_queue.cc:1035] T 06b41733ebac42daa85ec1c23c8588a7 P e1270a01a1c04e8c9013a17569afebf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:32:06.894011 5124 consensus_queue.cc:1035] T 2e7642d019e54a80ad09b22cfa20119e P 21b63b7bf1b94396bf2ea6cc8359f4e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:32:06.896680 5140 consensus_queue.cc:1035] T 06b41733ebac42daa85ec1c23c8588a7 P e1270a01a1c04e8c9013a17569afebf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:32:06.912721 4929 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "5e6f0a34fdec4f4f8d38ad88f6c88390"
dest_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5"
mode: GRACEFUL
new_leader_uuid: "e1270a01a1c04e8c9013a17569afebf5"
from {username='slave'} at 127.0.0.1:51692
I20250625 03:32:06.913751 4929 raft_consensus.cc:604] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 1 LEADER]: Received request to transfer leadership to TS e1270a01a1c04e8c9013a17569afebf5
I20250625 03:32:06.912784 5124 consensus_queue.cc:1035] T 2e7642d019e54a80ad09b22cfa20119e P 21b63b7bf1b94396bf2ea6cc8359f4e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:32:06.925212 5187 consensus_queue.cc:1035] T f5296bbece6b404387af92d2c22ab91e P 21b63b7bf1b94396bf2ea6cc8359f4e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:32:06.927078 5140 consensus_queue.cc:1035] T ad39583185dd49dd860e678ad2e166ac P e1270a01a1c04e8c9013a17569afebf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:32:06.944773 5124 consensus_queue.cc:1035] T f5296bbece6b404387af92d2c22ab91e P 21b63b7bf1b94396bf2ea6cc8359f4e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:32:06.956261 5143 consensus_queue.cc:1035] T ad39583185dd49dd860e678ad2e166ac P e1270a01a1c04e8c9013a17569afebf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:32:06.957134 5140 raft_consensus.cc:991] T ad39583185dd49dd860e678ad2e166ac P e1270a01a1c04e8c9013a17569afebf5: : Instructing follower 21b63b7bf1b94396bf2ea6cc8359f4e5 to start an election
I20250625 03:32:06.957656 5143 raft_consensus.cc:1079] T ad39583185dd49dd860e678ad2e166ac P e1270a01a1c04e8c9013a17569afebf5 [term 1 LEADER]: Signalling peer 21b63b7bf1b94396bf2ea6cc8359f4e5 to start an election
I20250625 03:32:06.961199 4929 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "ad39583185dd49dd860e678ad2e166ac"
dest_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5"
from {username='slave'} at 127.0.0.1:51664
I20250625 03:32:06.961692 4929 raft_consensus.cc:491] T ad39583185dd49dd860e678ad2e166ac P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:32:06.961935 4929 raft_consensus.cc:3058] T ad39583185dd49dd860e678ad2e166ac P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:06.968899 4929 raft_consensus.cc:513] T ad39583185dd49dd860e678ad2e166ac P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.971894 4929 leader_election.cc:290] T ad39583185dd49dd860e678ad2e166ac P 21b63b7bf1b94396bf2ea6cc8359f4e5 [CANDIDATE]: Term 2 election: Requested vote from peers e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130:41071), c37a035bb2d44c709a64f282940bdc6b (127.0.106.131:35169)
I20250625 03:32:06.972749 5079 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ad39583185dd49dd860e678ad2e166ac" candidate_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c37a035bb2d44c709a64f282940bdc6b"
I20250625 03:32:06.973417 5079 raft_consensus.cc:3058] T ad39583185dd49dd860e678ad2e166ac P c37a035bb2d44c709a64f282940bdc6b [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:06.974197 5005 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ad39583185dd49dd860e678ad2e166ac" candidate_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e1270a01a1c04e8c9013a17569afebf5"
I20250625 03:32:06.974848 5005 raft_consensus.cc:3053] T ad39583185dd49dd860e678ad2e166ac P e1270a01a1c04e8c9013a17569afebf5 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:32:06.975167 5005 raft_consensus.cc:738] T ad39583185dd49dd860e678ad2e166ac P e1270a01a1c04e8c9013a17569afebf5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e1270a01a1c04e8c9013a17569afebf5, State: Running, Role: LEADER
I20250625 03:32:06.975987 5005 consensus_queue.cc:260] T ad39583185dd49dd860e678ad2e166ac P e1270a01a1c04e8c9013a17569afebf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.977267 5005 raft_consensus.cc:3058] T ad39583185dd49dd860e678ad2e166ac P e1270a01a1c04e8c9013a17569afebf5 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:06.981372 5079 raft_consensus.cc:2466] T ad39583185dd49dd860e678ad2e166ac P c37a035bb2d44c709a64f282940bdc6b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21b63b7bf1b94396bf2ea6cc8359f4e5 in term 2.
I20250625 03:32:06.982519 4893 leader_election.cc:304] T ad39583185dd49dd860e678ad2e166ac P 21b63b7bf1b94396bf2ea6cc8359f4e5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b63b7bf1b94396bf2ea6cc8359f4e5, c37a035bb2d44c709a64f282940bdc6b; no voters:
I20250625 03:32:06.983412 5158 raft_consensus.cc:2802] T ad39583185dd49dd860e678ad2e166ac P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:32:06.984342 5158 raft_consensus.cc:695] T ad39583185dd49dd860e678ad2e166ac P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 2 LEADER]: Becoming Leader. State: Replica: 21b63b7bf1b94396bf2ea6cc8359f4e5, State: Running, Role: LEADER
I20250625 03:32:06.985176 5158 consensus_queue.cc:237] T ad39583185dd49dd860e678ad2e166ac P 21b63b7bf1b94396bf2ea6cc8359f4e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:06.988291 5005 raft_consensus.cc:2466] T ad39583185dd49dd860e678ad2e166ac P e1270a01a1c04e8c9013a17569afebf5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21b63b7bf1b94396bf2ea6cc8359f4e5 in term 2.
I20250625 03:32:06.994242 5079 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "8e6ebae6c4f34a34b8addf32082aa13c"
dest_uuid: "c37a035bb2d44c709a64f282940bdc6b"
mode: GRACEFUL
new_leader_uuid: "e1270a01a1c04e8c9013a17569afebf5"
from {username='slave'} at 127.0.0.1:39616
I20250625 03:32:06.994896 5079 raft_consensus.cc:604] T 8e6ebae6c4f34a34b8addf32082aa13c P c37a035bb2d44c709a64f282940bdc6b [term 1 LEADER]: Received request to transfer leadership to TS e1270a01a1c04e8c9013a17569afebf5
I20250625 03:32:06.995739 4827 catalog_manager.cc:5582] T ad39583185dd49dd860e678ad2e166ac P 21b63b7bf1b94396bf2ea6cc8359f4e5 reported cstate change: term changed from 1 to 2, leader changed from e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130) to 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129). New cstate: current_term: 2 leader_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } health_report { overall_health: UNKNOWN } } }
I20250625 03:32:07.003227 5005 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "78d8c392f87643228ae9a6cd204f713b"
dest_uuid: "e1270a01a1c04e8c9013a17569afebf5"
mode: GRACEFUL
new_leader_uuid: "c37a035bb2d44c709a64f282940bdc6b"
from {username='slave'} at 127.0.0.1:54568
I20250625 03:32:07.003734 5005 raft_consensus.cc:604] T 78d8c392f87643228ae9a6cd204f713b P e1270a01a1c04e8c9013a17569afebf5 [term 1 LEADER]: Received request to transfer leadership to TS c37a035bb2d44c709a64f282940bdc6b
I20250625 03:32:07.008384 5158 consensus_queue.cc:1035] T d6ccc7e94aa248ac9313c70ae601b6c5 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:32:07.019187 5158 consensus_queue.cc:1035] T d6ccc7e94aa248ac9313c70ae601b6c5 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:32:07.078532 5194 consensus_queue.cc:1035] T 78d8c392f87643228ae9a6cd204f713b P e1270a01a1c04e8c9013a17569afebf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:32:07.089394 5126 consensus_queue.cc:1035] T 78d8c392f87643228ae9a6cd204f713b P e1270a01a1c04e8c9013a17569afebf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:32:07.096709 5194 raft_consensus.cc:991] T 78d8c392f87643228ae9a6cd204f713b P e1270a01a1c04e8c9013a17569afebf5: : Instructing follower c37a035bb2d44c709a64f282940bdc6b to start an election
I20250625 03:32:07.097164 5126 raft_consensus.cc:1079] T 78d8c392f87643228ae9a6cd204f713b P e1270a01a1c04e8c9013a17569afebf5 [term 1 LEADER]: Signalling peer c37a035bb2d44c709a64f282940bdc6b to start an election
I20250625 03:32:07.098544 5079 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "78d8c392f87643228ae9a6cd204f713b"
dest_uuid: "c37a035bb2d44c709a64f282940bdc6b"
from {username='slave'} at 127.0.0.1:39592
I20250625 03:32:07.099120 5079 raft_consensus.cc:491] T 78d8c392f87643228ae9a6cd204f713b P c37a035bb2d44c709a64f282940bdc6b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:32:07.099479 5079 raft_consensus.cc:3058] T 78d8c392f87643228ae9a6cd204f713b P c37a035bb2d44c709a64f282940bdc6b [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:07.104350 5079 raft_consensus.cc:513] T 78d8c392f87643228ae9a6cd204f713b P c37a035bb2d44c709a64f282940bdc6b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:07.106658 5079 leader_election.cc:290] T 78d8c392f87643228ae9a6cd204f713b P c37a035bb2d44c709a64f282940bdc6b [CANDIDATE]: Term 2 election: Requested vote from peers 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373), e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130:41071)
I20250625 03:32:07.107088 5005 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "78d8c392f87643228ae9a6cd204f713b" candidate_uuid: "c37a035bb2d44c709a64f282940bdc6b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e1270a01a1c04e8c9013a17569afebf5"
I20250625 03:32:07.107393 4929 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "78d8c392f87643228ae9a6cd204f713b" candidate_uuid: "c37a035bb2d44c709a64f282940bdc6b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5"
I20250625 03:32:07.107766 5005 raft_consensus.cc:3053] T 78d8c392f87643228ae9a6cd204f713b P e1270a01a1c04e8c9013a17569afebf5 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:32:07.108083 4929 raft_consensus.cc:3058] T 78d8c392f87643228ae9a6cd204f713b P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:07.108181 5005 raft_consensus.cc:738] T 78d8c392f87643228ae9a6cd204f713b P e1270a01a1c04e8c9013a17569afebf5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e1270a01a1c04e8c9013a17569afebf5, State: Running, Role: LEADER
I20250625 03:32:07.109112 5005 consensus_queue.cc:260] T 78d8c392f87643228ae9a6cd204f713b P e1270a01a1c04e8c9013a17569afebf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:07.110435 5005 raft_consensus.cc:3058] T 78d8c392f87643228ae9a6cd204f713b P e1270a01a1c04e8c9013a17569afebf5 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:07.113984 4929 raft_consensus.cc:2466] T 78d8c392f87643228ae9a6cd204f713b P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c37a035bb2d44c709a64f282940bdc6b in term 2.
I20250625 03:32:07.115110 5043 leader_election.cc:304] T 78d8c392f87643228ae9a6cd204f713b P c37a035bb2d44c709a64f282940bdc6b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b63b7bf1b94396bf2ea6cc8359f4e5, c37a035bb2d44c709a64f282940bdc6b; no voters:
I20250625 03:32:07.115945 5178 raft_consensus.cc:2802] T 78d8c392f87643228ae9a6cd204f713b P c37a035bb2d44c709a64f282940bdc6b [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:32:07.116379 5178 raft_consensus.cc:695] T 78d8c392f87643228ae9a6cd204f713b P c37a035bb2d44c709a64f282940bdc6b [term 2 LEADER]: Becoming Leader. State: Replica: c37a035bb2d44c709a64f282940bdc6b, State: Running, Role: LEADER
I20250625 03:32:07.117067 5005 raft_consensus.cc:2466] T 78d8c392f87643228ae9a6cd204f713b P e1270a01a1c04e8c9013a17569afebf5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c37a035bb2d44c709a64f282940bdc6b in term 2.
I20250625 03:32:07.117141 5178 consensus_queue.cc:237] T 78d8c392f87643228ae9a6cd204f713b P c37a035bb2d44c709a64f282940bdc6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:07.123250 4827 catalog_manager.cc:5582] T 78d8c392f87643228ae9a6cd204f713b P c37a035bb2d44c709a64f282940bdc6b reported cstate change: term changed from 1 to 2, leader changed from e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130) to c37a035bb2d44c709a64f282940bdc6b (127.0.106.131). New cstate: current_term: 2 leader_uuid: "c37a035bb2d44c709a64f282940bdc6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } health_report { overall_health: HEALTHY } } }
I20250625 03:32:07.166790 5178 consensus_queue.cc:1035] T 8e6ebae6c4f34a34b8addf32082aa13c P c37a035bb2d44c709a64f282940bdc6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:32:07.177095 5201 consensus_queue.cc:1035] T 8e6ebae6c4f34a34b8addf32082aa13c P c37a035bb2d44c709a64f282940bdc6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:32:07.185261 5127 raft_consensus.cc:991] T 8e6ebae6c4f34a34b8addf32082aa13c P c37a035bb2d44c709a64f282940bdc6b: : Instructing follower e1270a01a1c04e8c9013a17569afebf5 to start an election
I20250625 03:32:07.185776 5201 raft_consensus.cc:1079] T 8e6ebae6c4f34a34b8addf32082aa13c P c37a035bb2d44c709a64f282940bdc6b [term 1 LEADER]: Signalling peer e1270a01a1c04e8c9013a17569afebf5 to start an election
I20250625 03:32:07.187390 5005 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "8e6ebae6c4f34a34b8addf32082aa13c"
dest_uuid: "e1270a01a1c04e8c9013a17569afebf5"
from {username='slave'} at 127.0.0.1:54552
I20250625 03:32:07.187925 5005 raft_consensus.cc:491] T 8e6ebae6c4f34a34b8addf32082aa13c P e1270a01a1c04e8c9013a17569afebf5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:32:07.188287 5005 raft_consensus.cc:3058] T 8e6ebae6c4f34a34b8addf32082aa13c P e1270a01a1c04e8c9013a17569afebf5 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:07.193652 5005 raft_consensus.cc:513] T 8e6ebae6c4f34a34b8addf32082aa13c P e1270a01a1c04e8c9013a17569afebf5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:07.195466 5005 leader_election.cc:290] T 8e6ebae6c4f34a34b8addf32082aa13c P e1270a01a1c04e8c9013a17569afebf5 [CANDIDATE]: Term 2 election: Requested vote from peers 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373), c37a035bb2d44c709a64f282940bdc6b (127.0.106.131:35169)
I20250625 03:32:07.196631 5079 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8e6ebae6c4f34a34b8addf32082aa13c" candidate_uuid: "e1270a01a1c04e8c9013a17569afebf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c37a035bb2d44c709a64f282940bdc6b"
I20250625 03:32:07.196604 4929 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8e6ebae6c4f34a34b8addf32082aa13c" candidate_uuid: "e1270a01a1c04e8c9013a17569afebf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5"
I20250625 03:32:07.197448 5079 raft_consensus.cc:3053] T 8e6ebae6c4f34a34b8addf32082aa13c P c37a035bb2d44c709a64f282940bdc6b [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:32:07.197549 4929 raft_consensus.cc:3058] T 8e6ebae6c4f34a34b8addf32082aa13c P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:07.197820 5079 raft_consensus.cc:738] T 8e6ebae6c4f34a34b8addf32082aa13c P c37a035bb2d44c709a64f282940bdc6b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c37a035bb2d44c709a64f282940bdc6b, State: Running, Role: LEADER
I20250625 03:32:07.198709 5079 consensus_queue.cc:260] T 8e6ebae6c4f34a34b8addf32082aa13c P c37a035bb2d44c709a64f282940bdc6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:07.200053 5079 raft_consensus.cc:3058] T 8e6ebae6c4f34a34b8addf32082aa13c P c37a035bb2d44c709a64f282940bdc6b [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:07.203375 4929 raft_consensus.cc:2466] T 8e6ebae6c4f34a34b8addf32082aa13c P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1270a01a1c04e8c9013a17569afebf5 in term 2.
I20250625 03:32:07.204555 4969 leader_election.cc:304] T 8e6ebae6c4f34a34b8addf32082aa13c P e1270a01a1c04e8c9013a17569afebf5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b63b7bf1b94396bf2ea6cc8359f4e5, e1270a01a1c04e8c9013a17569afebf5; no voters:
I20250625 03:32:07.205210 5126 raft_consensus.cc:2802] T 8e6ebae6c4f34a34b8addf32082aa13c P e1270a01a1c04e8c9013a17569afebf5 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:32:07.205459 5079 raft_consensus.cc:2466] T 8e6ebae6c4f34a34b8addf32082aa13c P c37a035bb2d44c709a64f282940bdc6b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1270a01a1c04e8c9013a17569afebf5 in term 2.
I20250625 03:32:07.205606 5126 raft_consensus.cc:695] T 8e6ebae6c4f34a34b8addf32082aa13c P e1270a01a1c04e8c9013a17569afebf5 [term 2 LEADER]: Becoming Leader. State: Replica: e1270a01a1c04e8c9013a17569afebf5, State: Running, Role: LEADER
I20250625 03:32:07.206580 5126 consensus_queue.cc:237] T 8e6ebae6c4f34a34b8addf32082aa13c P e1270a01a1c04e8c9013a17569afebf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:07.212692 4824 catalog_manager.cc:5582] T 8e6ebae6c4f34a34b8addf32082aa13c P e1270a01a1c04e8c9013a17569afebf5 reported cstate change: term changed from 1 to 2, leader changed from c37a035bb2d44c709a64f282940bdc6b (127.0.106.131) to e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130). New cstate: current_term: 2 leader_uuid: "e1270a01a1c04e8c9013a17569afebf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } health_report { overall_health: UNKNOWN } } }
I20250625 03:32:07.218319 5158 consensus_queue.cc:1035] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:32:07.230145 5188 consensus_queue.cc:1035] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:32:07.238178 5158 raft_consensus.cc:991] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P 21b63b7bf1b94396bf2ea6cc8359f4e5: : Instructing follower e1270a01a1c04e8c9013a17569afebf5 to start an election
I20250625 03:32:07.238684 5188 raft_consensus.cc:1079] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 1 LEADER]: Signalling peer e1270a01a1c04e8c9013a17569afebf5 to start an election
I20250625 03:32:07.240370 5005 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "5e6f0a34fdec4f4f8d38ad88f6c88390"
dest_uuid: "e1270a01a1c04e8c9013a17569afebf5"
from {username='slave'} at 127.0.0.1:54544
I20250625 03:32:07.240976 5005 raft_consensus.cc:491] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P e1270a01a1c04e8c9013a17569afebf5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:32:07.241375 5005 raft_consensus.cc:3058] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P e1270a01a1c04e8c9013a17569afebf5 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:07.246671 5005 raft_consensus.cc:513] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P e1270a01a1c04e8c9013a17569afebf5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:07.248952 5005 leader_election.cc:290] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P e1270a01a1c04e8c9013a17569afebf5 [CANDIDATE]: Term 2 election: Requested vote from peers 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373), c37a035bb2d44c709a64f282940bdc6b (127.0.106.131:35169)
I20250625 03:32:07.249519 5079 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5e6f0a34fdec4f4f8d38ad88f6c88390" candidate_uuid: "e1270a01a1c04e8c9013a17569afebf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c37a035bb2d44c709a64f282940bdc6b"
I20250625 03:32:07.249352 4929 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5e6f0a34fdec4f4f8d38ad88f6c88390" candidate_uuid: "e1270a01a1c04e8c9013a17569afebf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5"
I20250625 03:32:07.250315 5079 raft_consensus.cc:3058] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P c37a035bb2d44c709a64f282940bdc6b [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:07.250358 4929 raft_consensus.cc:3053] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:32:07.250857 4929 raft_consensus.cc:738] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 21b63b7bf1b94396bf2ea6cc8359f4e5, State: Running, Role: LEADER
I20250625 03:32:07.251638 4929 consensus_queue.cc:260] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:07.252925 4929 raft_consensus.cc:3058] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:07.257826 5079 raft_consensus.cc:2466] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P c37a035bb2d44c709a64f282940bdc6b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1270a01a1c04e8c9013a17569afebf5 in term 2.
I20250625 03:32:07.259196 4968 leader_election.cc:304] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P e1270a01a1c04e8c9013a17569afebf5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c37a035bb2d44c709a64f282940bdc6b, e1270a01a1c04e8c9013a17569afebf5; no voters:
I20250625 03:32:07.259814 4929 raft_consensus.cc:2466] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1270a01a1c04e8c9013a17569afebf5 in term 2.
I20250625 03:32:07.259891 5126 raft_consensus.cc:2802] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P e1270a01a1c04e8c9013a17569afebf5 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:32:07.260671 5126 raft_consensus.cc:695] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P e1270a01a1c04e8c9013a17569afebf5 [term 2 LEADER]: Becoming Leader. State: Replica: e1270a01a1c04e8c9013a17569afebf5, State: Running, Role: LEADER
I20250625 03:32:07.261548 5126 consensus_queue.cc:237] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P e1270a01a1c04e8c9013a17569afebf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:07.267222 4827 catalog_manager.cc:5582] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P e1270a01a1c04e8c9013a17569afebf5 reported cstate change: term changed from 1 to 2, leader changed from 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129) to e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130). New cstate: current_term: 2 leader_uuid: "e1270a01a1c04e8c9013a17569afebf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } health_report { overall_health: UNKNOWN } } }
I20250625 03:32:07.401659 5079 raft_consensus.cc:1273] T ad39583185dd49dd860e678ad2e166ac P c37a035bb2d44c709a64f282940bdc6b [term 2 FOLLOWER]: Refusing update from remote peer 21b63b7bf1b94396bf2ea6cc8359f4e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:32:07.402833 5188 consensus_queue.cc:1035] T ad39583185dd49dd860e678ad2e166ac P 21b63b7bf1b94396bf2ea6cc8359f4e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:32:07.410250 5005 raft_consensus.cc:1273] T ad39583185dd49dd860e678ad2e166ac P e1270a01a1c04e8c9013a17569afebf5 [term 2 FOLLOWER]: Refusing update from remote peer 21b63b7bf1b94396bf2ea6cc8359f4e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:32:07.412333 5158 consensus_queue.cc:1035] T ad39583185dd49dd860e678ad2e166ac P 21b63b7bf1b94396bf2ea6cc8359f4e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:32:07.575734 5005 raft_consensus.cc:1273] T 78d8c392f87643228ae9a6cd204f713b P e1270a01a1c04e8c9013a17569afebf5 [term 2 FOLLOWER]: Refusing update from remote peer c37a035bb2d44c709a64f282940bdc6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:32:07.577023 5201 consensus_queue.cc:1035] T 78d8c392f87643228ae9a6cd204f713b P c37a035bb2d44c709a64f282940bdc6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:32:07.584232 4929 raft_consensus.cc:1273] T 78d8c392f87643228ae9a6cd204f713b P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 2 FOLLOWER]: Refusing update from remote peer c37a035bb2d44c709a64f282940bdc6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:32:07.585996 5178 consensus_queue.cc:1035] T 78d8c392f87643228ae9a6cd204f713b P c37a035bb2d44c709a64f282940bdc6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:32:07.639868 4929 raft_consensus.cc:1273] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 2 FOLLOWER]: Refusing update from remote peer e1270a01a1c04e8c9013a17569afebf5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:32:07.641093 5126 consensus_queue.cc:1035] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P e1270a01a1c04e8c9013a17569afebf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:32:07.649398 5079 raft_consensus.cc:1273] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P c37a035bb2d44c709a64f282940bdc6b [term 2 FOLLOWER]: Refusing update from remote peer e1270a01a1c04e8c9013a17569afebf5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:32:07.650628 5194 consensus_queue.cc:1035] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P e1270a01a1c04e8c9013a17569afebf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:32:07.722749 4929 raft_consensus.cc:1273] T 8e6ebae6c4f34a34b8addf32082aa13c P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 2 FOLLOWER]: Refusing update from remote peer e1270a01a1c04e8c9013a17569afebf5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:32:07.723865 5194 consensus_queue.cc:1035] T 8e6ebae6c4f34a34b8addf32082aa13c P e1270a01a1c04e8c9013a17569afebf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:32:07.731621 5079 raft_consensus.cc:1273] T 8e6ebae6c4f34a34b8addf32082aa13c P c37a035bb2d44c709a64f282940bdc6b [term 2 FOLLOWER]: Refusing update from remote peer e1270a01a1c04e8c9013a17569afebf5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:32:07.733151 5126 consensus_queue.cc:1035] T 8e6ebae6c4f34a34b8addf32082aa13c P e1270a01a1c04e8c9013a17569afebf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:32:10.005323 426 test_util.cc:276] Using random seed: 386627268
I20250625 03:32:10.034539 4824 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55926:
name: "soft_deleted_table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 03:32:10.037513 4824 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 03:32:10.093616 4915 tablet_service.cc:1468] Processing CreateTablet for tablet 05b3b289074d43638ab6ae336e13f3ef (DEFAULT_TABLE table=soft_deleted_table [id=b192f87db3e447aeb6757bef1a480a1c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20250625 03:32:10.094596 4992 tablet_service.cc:1468] Processing CreateTablet for tablet 05b3b289074d43638ab6ae336e13f3ef (DEFAULT_TABLE table=soft_deleted_table [id=b192f87db3e447aeb6757bef1a480a1c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20250625 03:32:10.095649 4915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05b3b289074d43638ab6ae336e13f3ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:10.096480 4992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05b3b289074d43638ab6ae336e13f3ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:10.097430 5066 tablet_service.cc:1468] Processing CreateTablet for tablet 05b3b289074d43638ab6ae336e13f3ef (DEFAULT_TABLE table=soft_deleted_table [id=b192f87db3e447aeb6757bef1a480a1c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20250625 03:32:10.099086 5066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05b3b289074d43638ab6ae336e13f3ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:10.100219 5061 tablet_service.cc:1468] Processing CreateTablet for tablet 391a5defcbd64e7999b0dffb39848744 (DEFAULT_TABLE table=soft_deleted_table [id=b192f87db3e447aeb6757bef1a480a1c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20250625 03:32:10.101713 5061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 391a5defcbd64e7999b0dffb39848744. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:10.101497 4919 tablet_service.cc:1468] Processing CreateTablet for tablet 40422f6c986f41ae8c8067019d882fb2 (DEFAULT_TABLE table=soft_deleted_table [id=b192f87db3e447aeb6757bef1a480a1c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20250625 03:32:10.104199 5063 tablet_service.cc:1468] Processing CreateTablet for tablet 40422f6c986f41ae8c8067019d882fb2 (DEFAULT_TABLE table=soft_deleted_table [id=b192f87db3e447aeb6757bef1a480a1c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20250625 03:32:10.105664 5063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40422f6c986f41ae8c8067019d882fb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:10.106945 5067 tablet_service.cc:1468] Processing CreateTablet for tablet 8177d088f97c4dd4b031a1c9e7eae427 (DEFAULT_TABLE table=soft_deleted_table [id=b192f87db3e447aeb6757bef1a480a1c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20250625 03:32:10.108911 4917 tablet_service.cc:1468] Processing CreateTablet for tablet 8177d088f97c4dd4b031a1c9e7eae427 (DEFAULT_TABLE table=soft_deleted_table [id=b192f87db3e447aeb6757bef1a480a1c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20250625 03:32:10.109915 4916 tablet_service.cc:1468] Processing CreateTablet for tablet 391a5defcbd64e7999b0dffb39848744 (DEFAULT_TABLE table=soft_deleted_table [id=b192f87db3e447aeb6757bef1a480a1c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20250625 03:32:10.110060 4990 tablet_service.cc:1468] Processing CreateTablet for tablet 8177d088f97c4dd4b031a1c9e7eae427 (DEFAULT_TABLE table=soft_deleted_table [id=b192f87db3e447aeb6757bef1a480a1c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20250625 03:32:10.110999 4917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8177d088f97c4dd4b031a1c9e7eae427. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:10.111449 4990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8177d088f97c4dd4b031a1c9e7eae427. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:10.112552 5065 tablet_service.cc:1468] Processing CreateTablet for tablet 53747834cb32485eb3f79f699e401024 (DEFAULT_TABLE table=soft_deleted_table [id=b192f87db3e447aeb6757bef1a480a1c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20250625 03:32:10.113221 4995 tablet_service.cc:1468] Processing CreateTablet for tablet 40422f6c986f41ae8c8067019d882fb2 (DEFAULT_TABLE table=soft_deleted_table [id=b192f87db3e447aeb6757bef1a480a1c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20250625 03:32:10.114871 4918 tablet_service.cc:1468] Processing CreateTablet for tablet 65572804041f4d5591d561279d92cd49 (DEFAULT_TABLE table=soft_deleted_table [id=b192f87db3e447aeb6757bef1a480a1c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20250625 03:32:10.116500 4991 tablet_service.cc:1468] Processing CreateTablet for tablet 53747834cb32485eb3f79f699e401024 (DEFAULT_TABLE table=soft_deleted_table [id=b192f87db3e447aeb6757bef1a480a1c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20250625 03:32:10.116770 4913 tablet_service.cc:1468] Processing CreateTablet for tablet 53747834cb32485eb3f79f699e401024 (DEFAULT_TABLE table=soft_deleted_table [id=b192f87db3e447aeb6757bef1a480a1c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20250625 03:32:10.117189 5068 tablet_service.cc:1468] Processing CreateTablet for tablet 65572804041f4d5591d561279d92cd49 (DEFAULT_TABLE table=soft_deleted_table [id=b192f87db3e447aeb6757bef1a480a1c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20250625 03:32:10.118352 4918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65572804041f4d5591d561279d92cd49. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:10.118943 4989 tablet_service.cc:1468] Processing CreateTablet for tablet 65572804041f4d5591d561279d92cd49 (DEFAULT_TABLE table=soft_deleted_table [id=b192f87db3e447aeb6757bef1a480a1c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20250625 03:32:10.119669 4914 tablet_service.cc:1468] Processing CreateTablet for tablet b21ac1fdf14d484daf2e5e657e2fdc6d (DEFAULT_TABLE table=soft_deleted_table [id=b192f87db3e447aeb6757bef1a480a1c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20250625 03:32:10.121181 4914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b21ac1fdf14d484daf2e5e657e2fdc6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:10.121905 4988 tablet_service.cc:1468] Processing CreateTablet for tablet b21ac1fdf14d484daf2e5e657e2fdc6d (DEFAULT_TABLE table=soft_deleted_table [id=b192f87db3e447aeb6757bef1a480a1c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20250625 03:32:10.122040 5069 tablet_service.cc:1468] Processing CreateTablet for tablet b21ac1fdf14d484daf2e5e657e2fdc6d (DEFAULT_TABLE table=soft_deleted_table [id=b192f87db3e447aeb6757bef1a480a1c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20250625 03:32:10.123808 4913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53747834cb32485eb3f79f699e401024. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:10.124429 4920 tablet_service.cc:1468] Processing CreateTablet for tablet 149bd3c081bc4cf0a4de280a4dd4fd1b (DEFAULT_TABLE table=soft_deleted_table [id=b192f87db3e447aeb6757bef1a480a1c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20250625 03:32:10.125836 4920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 149bd3c081bc4cf0a4de280a4dd4fd1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:10.126732 5062 tablet_service.cc:1468] Processing CreateTablet for tablet 149bd3c081bc4cf0a4de280a4dd4fd1b (DEFAULT_TABLE table=soft_deleted_table [id=b192f87db3e447aeb6757bef1a480a1c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20250625 03:32:10.128820 4912 tablet_service.cc:1468] Processing CreateTablet for tablet b7f4f7f28226468ea72e221eac6a1fdb (DEFAULT_TABLE table=soft_deleted_table [id=b192f87db3e447aeb6757bef1a480a1c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20250625 03:32:10.129861 5062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 149bd3c081bc4cf0a4de280a4dd4fd1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:10.108935 4987 tablet_service.cc:1468] Processing CreateTablet for tablet 391a5defcbd64e7999b0dffb39848744 (DEFAULT_TABLE table=soft_deleted_table [id=b192f87db3e447aeb6757bef1a480a1c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20250625 03:32:10.131564 5064 tablet_service.cc:1468] Processing CreateTablet for tablet b7f4f7f28226468ea72e221eac6a1fdb (DEFAULT_TABLE table=soft_deleted_table [id=b192f87db3e447aeb6757bef1a480a1c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20250625 03:32:10.132476 5068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65572804041f4d5591d561279d92cd49. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:10.133250 5067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8177d088f97c4dd4b031a1c9e7eae427. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:10.133994 4993 tablet_service.cc:1468] Processing CreateTablet for tablet 149bd3c081bc4cf0a4de280a4dd4fd1b (DEFAULT_TABLE table=soft_deleted_table [id=b192f87db3e447aeb6757bef1a480a1c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20250625 03:32:10.136353 5069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b21ac1fdf14d484daf2e5e657e2fdc6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:10.136461 4994 tablet_service.cc:1468] Processing CreateTablet for tablet b7f4f7f28226468ea72e221eac6a1fdb (DEFAULT_TABLE table=soft_deleted_table [id=b192f87db3e447aeb6757bef1a480a1c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20250625 03:32:10.140369 5065 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53747834cb32485eb3f79f699e401024. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:10.143761 4988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b21ac1fdf14d484daf2e5e657e2fdc6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:10.144170 4912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7f4f7f28226468ea72e221eac6a1fdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:10.145282 4916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 391a5defcbd64e7999b0dffb39848744. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:10.145624 4989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65572804041f4d5591d561279d92cd49. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:10.147022 4919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40422f6c986f41ae8c8067019d882fb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:10.149734 4987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 391a5defcbd64e7999b0dffb39848744. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:10.150859 5064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7f4f7f28226468ea72e221eac6a1fdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:10.152915 4994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7f4f7f28226468ea72e221eac6a1fdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:10.155055 4993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 149bd3c081bc4cf0a4de280a4dd4fd1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:10.157124 4991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53747834cb32485eb3f79f699e401024. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:10.159276 4995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40422f6c986f41ae8c8067019d882fb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:10.182891 5218 tablet_bootstrap.cc:492] T 05b3b289074d43638ab6ae336e13f3ef P 21b63b7bf1b94396bf2ea6cc8359f4e5: Bootstrap starting.
I20250625 03:32:10.192090 5218 tablet_bootstrap.cc:654] T 05b3b289074d43638ab6ae336e13f3ef P 21b63b7bf1b94396bf2ea6cc8359f4e5: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:10.347566 5218 tablet_bootstrap.cc:492] T 05b3b289074d43638ab6ae336e13f3ef P 21b63b7bf1b94396bf2ea6cc8359f4e5: No bootstrap required, opened a new log
I20250625 03:32:10.348346 5218 ts_tablet_manager.cc:1397] T 05b3b289074d43638ab6ae336e13f3ef P 21b63b7bf1b94396bf2ea6cc8359f4e5: Time spent bootstrapping tablet: real 0.166s user 0.069s sys 0.071s
I20250625 03:32:10.354890 5218 raft_consensus.cc:357] T 05b3b289074d43638ab6ae336e13f3ef P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.357335 5218 raft_consensus.cc:383] T 05b3b289074d43638ab6ae336e13f3ef P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:10.357683 5218 raft_consensus.cc:738] T 05b3b289074d43638ab6ae336e13f3ef P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b63b7bf1b94396bf2ea6cc8359f4e5, State: Initialized, Role: FOLLOWER
I20250625 03:32:10.358654 5218 consensus_queue.cc:260] T 05b3b289074d43638ab6ae336e13f3ef P 21b63b7bf1b94396bf2ea6cc8359f4e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.360222 5220 tablet_bootstrap.cc:492] T 149bd3c081bc4cf0a4de280a4dd4fd1b P c37a035bb2d44c709a64f282940bdc6b: Bootstrap starting.
I20250625 03:32:10.365634 5218 ts_tablet_manager.cc:1428] T 05b3b289074d43638ab6ae336e13f3ef P 21b63b7bf1b94396bf2ea6cc8359f4e5: Time spent starting tablet: real 0.017s user 0.004s sys 0.006s
I20250625 03:32:10.362617 5206 raft_consensus.cc:491] T 05b3b289074d43638ab6ae336e13f3ef P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:32:10.366514 5206 raft_consensus.cc:513] T 05b3b289074d43638ab6ae336e13f3ef P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
W20250625 03:32:10.369148 4876 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20250625 03:32:10.369673 5218 tablet_bootstrap.cc:492] T b21ac1fdf14d484daf2e5e657e2fdc6d P 21b63b7bf1b94396bf2ea6cc8359f4e5: Bootstrap starting.
I20250625 03:32:10.369897 5206 leader_election.cc:290] T 05b3b289074d43638ab6ae336e13f3ef P 21b63b7bf1b94396bf2ea6cc8359f4e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130:41071), c37a035bb2d44c709a64f282940bdc6b (127.0.106.131:35169)
I20250625 03:32:10.375592 5220 tablet_bootstrap.cc:654] T 149bd3c081bc4cf0a4de280a4dd4fd1b P c37a035bb2d44c709a64f282940bdc6b: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:10.377417 5005 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "05b3b289074d43638ab6ae336e13f3ef" candidate_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1270a01a1c04e8c9013a17569afebf5" is_pre_election: true
I20250625 03:32:10.378628 5218 tablet_bootstrap.cc:654] T b21ac1fdf14d484daf2e5e657e2fdc6d P 21b63b7bf1b94396bf2ea6cc8359f4e5: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:10.378686 5221 tablet_bootstrap.cc:492] T 40422f6c986f41ae8c8067019d882fb2 P e1270a01a1c04e8c9013a17569afebf5: Bootstrap starting.
I20250625 03:32:10.379240 5079 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "05b3b289074d43638ab6ae336e13f3ef" candidate_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c37a035bb2d44c709a64f282940bdc6b" is_pre_election: true
W20250625 03:32:10.385793 4893 leader_election.cc:343] T 05b3b289074d43638ab6ae336e13f3ef P 21b63b7bf1b94396bf2ea6cc8359f4e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130:41071): Illegal state: must be running to vote when last-logged opid is not known
W20250625 03:32:10.386559 4893 leader_election.cc:343] T 05b3b289074d43638ab6ae336e13f3ef P 21b63b7bf1b94396bf2ea6cc8359f4e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c37a035bb2d44c709a64f282940bdc6b (127.0.106.131:35169): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:32:10.386976 4893 leader_election.cc:304] T 05b3b289074d43638ab6ae336e13f3ef P 21b63b7bf1b94396bf2ea6cc8359f4e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21b63b7bf1b94396bf2ea6cc8359f4e5; no voters: c37a035bb2d44c709a64f282940bdc6b, e1270a01a1c04e8c9013a17569afebf5
I20250625 03:32:10.387799 5206 raft_consensus.cc:2747] T 05b3b289074d43638ab6ae336e13f3ef P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:32:10.388769 5221 tablet_bootstrap.cc:654] T 40422f6c986f41ae8c8067019d882fb2 P e1270a01a1c04e8c9013a17569afebf5: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:10.391542 5220 tablet_bootstrap.cc:492] T 149bd3c081bc4cf0a4de280a4dd4fd1b P c37a035bb2d44c709a64f282940bdc6b: No bootstrap required, opened a new log
I20250625 03:32:10.392177 5220 ts_tablet_manager.cc:1397] T 149bd3c081bc4cf0a4de280a4dd4fd1b P c37a035bb2d44c709a64f282940bdc6b: Time spent bootstrapping tablet: real 0.032s user 0.006s sys 0.014s
I20250625 03:32:10.393986 5218 tablet_bootstrap.cc:492] T b21ac1fdf14d484daf2e5e657e2fdc6d P 21b63b7bf1b94396bf2ea6cc8359f4e5: No bootstrap required, opened a new log
I20250625 03:32:10.394467 5218 ts_tablet_manager.cc:1397] T b21ac1fdf14d484daf2e5e657e2fdc6d P 21b63b7bf1b94396bf2ea6cc8359f4e5: Time spent bootstrapping tablet: real 0.025s user 0.013s sys 0.005s
I20250625 03:32:10.395035 5221 tablet_bootstrap.cc:492] T 40422f6c986f41ae8c8067019d882fb2 P e1270a01a1c04e8c9013a17569afebf5: No bootstrap required, opened a new log
I20250625 03:32:10.395696 5221 ts_tablet_manager.cc:1397] T 40422f6c986f41ae8c8067019d882fb2 P e1270a01a1c04e8c9013a17569afebf5: Time spent bootstrapping tablet: real 0.017s user 0.004s sys 0.012s
I20250625 03:32:10.395136 5220 raft_consensus.cc:357] T 149bd3c081bc4cf0a4de280a4dd4fd1b P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.396377 5220 raft_consensus.cc:383] T 149bd3c081bc4cf0a4de280a4dd4fd1b P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:10.396778 5220 raft_consensus.cc:738] T 149bd3c081bc4cf0a4de280a4dd4fd1b P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c37a035bb2d44c709a64f282940bdc6b, State: Initialized, Role: FOLLOWER
I20250625 03:32:10.397696 5218 raft_consensus.cc:357] T b21ac1fdf14d484daf2e5e657e2fdc6d P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.397627 5220 consensus_queue.cc:260] T 149bd3c081bc4cf0a4de280a4dd4fd1b P c37a035bb2d44c709a64f282940bdc6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.398372 5218 raft_consensus.cc:383] T b21ac1fdf14d484daf2e5e657e2fdc6d P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:10.398697 5218 raft_consensus.cc:738] T b21ac1fdf14d484daf2e5e657e2fdc6d P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b63b7bf1b94396bf2ea6cc8359f4e5, State: Initialized, Role: FOLLOWER
I20250625 03:32:10.399308 5221 raft_consensus.cc:357] T 40422f6c986f41ae8c8067019d882fb2 P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.399492 5218 consensus_queue.cc:260] T b21ac1fdf14d484daf2e5e657e2fdc6d P 21b63b7bf1b94396bf2ea6cc8359f4e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.400239 5221 raft_consensus.cc:383] T 40422f6c986f41ae8c8067019d882fb2 P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:10.400729 5221 raft_consensus.cc:738] T 40422f6c986f41ae8c8067019d882fb2 P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1270a01a1c04e8c9013a17569afebf5, State: Initialized, Role: FOLLOWER
I20250625 03:32:10.401486 5221 consensus_queue.cc:260] T 40422f6c986f41ae8c8067019d882fb2 P e1270a01a1c04e8c9013a17569afebf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.402194 5218 ts_tablet_manager.cc:1428] T b21ac1fdf14d484daf2e5e657e2fdc6d P 21b63b7bf1b94396bf2ea6cc8359f4e5: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20250625 03:32:10.403170 5218 tablet_bootstrap.cc:492] T 391a5defcbd64e7999b0dffb39848744 P 21b63b7bf1b94396bf2ea6cc8359f4e5: Bootstrap starting.
I20250625 03:32:10.400403 5220 ts_tablet_manager.cc:1428] T 149bd3c081bc4cf0a4de280a4dd4fd1b P c37a035bb2d44c709a64f282940bdc6b: Time spent starting tablet: real 0.008s user 0.005s sys 0.002s
I20250625 03:32:10.404419 5220 tablet_bootstrap.cc:492] T 8177d088f97c4dd4b031a1c9e7eae427 P c37a035bb2d44c709a64f282940bdc6b: Bootstrap starting.
I20250625 03:32:10.404419 5221 ts_tablet_manager.cc:1428] T 40422f6c986f41ae8c8067019d882fb2 P e1270a01a1c04e8c9013a17569afebf5: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20250625 03:32:10.411052 5218 tablet_bootstrap.cc:654] T 391a5defcbd64e7999b0dffb39848744 P 21b63b7bf1b94396bf2ea6cc8359f4e5: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:10.416059 5220 tablet_bootstrap.cc:654] T 8177d088f97c4dd4b031a1c9e7eae427 P c37a035bb2d44c709a64f282940bdc6b: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:10.419276 5218 tablet_bootstrap.cc:492] T 391a5defcbd64e7999b0dffb39848744 P 21b63b7bf1b94396bf2ea6cc8359f4e5: No bootstrap required, opened a new log
I20250625 03:32:10.419813 5218 ts_tablet_manager.cc:1397] T 391a5defcbd64e7999b0dffb39848744 P 21b63b7bf1b94396bf2ea6cc8359f4e5: Time spent bootstrapping tablet: real 0.017s user 0.008s sys 0.004s
I20250625 03:32:10.422127 5220 tablet_bootstrap.cc:492] T 8177d088f97c4dd4b031a1c9e7eae427 P c37a035bb2d44c709a64f282940bdc6b: No bootstrap required, opened a new log
I20250625 03:32:10.422652 5220 ts_tablet_manager.cc:1397] T 8177d088f97c4dd4b031a1c9e7eae427 P c37a035bb2d44c709a64f282940bdc6b: Time spent bootstrapping tablet: real 0.018s user 0.012s sys 0.000s
I20250625 03:32:10.422796 5218 raft_consensus.cc:357] T 391a5defcbd64e7999b0dffb39848744 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.423588 5218 raft_consensus.cc:383] T 391a5defcbd64e7999b0dffb39848744 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:10.423902 5218 raft_consensus.cc:738] T 391a5defcbd64e7999b0dffb39848744 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b63b7bf1b94396bf2ea6cc8359f4e5, State: Initialized, Role: FOLLOWER
I20250625 03:32:10.424369 5221 tablet_bootstrap.cc:492] T 149bd3c081bc4cf0a4de280a4dd4fd1b P e1270a01a1c04e8c9013a17569afebf5: Bootstrap starting.
I20250625 03:32:10.424744 5218 consensus_queue.cc:260] T 391a5defcbd64e7999b0dffb39848744 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.425673 5220 raft_consensus.cc:357] T 8177d088f97c4dd4b031a1c9e7eae427 P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.426484 5220 raft_consensus.cc:383] T 8177d088f97c4dd4b031a1c9e7eae427 P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:10.426784 5220 raft_consensus.cc:738] T 8177d088f97c4dd4b031a1c9e7eae427 P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c37a035bb2d44c709a64f282940bdc6b, State: Initialized, Role: FOLLOWER
I20250625 03:32:10.427524 5220 consensus_queue.cc:260] T 8177d088f97c4dd4b031a1c9e7eae427 P c37a035bb2d44c709a64f282940bdc6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.428088 5218 ts_tablet_manager.cc:1428] T 391a5defcbd64e7999b0dffb39848744 P 21b63b7bf1b94396bf2ea6cc8359f4e5: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20250625 03:32:10.429407 5218 tablet_bootstrap.cc:492] T 8177d088f97c4dd4b031a1c9e7eae427 P 21b63b7bf1b94396bf2ea6cc8359f4e5: Bootstrap starting.
I20250625 03:32:10.433883 5220 ts_tablet_manager.cc:1428] T 8177d088f97c4dd4b031a1c9e7eae427 P c37a035bb2d44c709a64f282940bdc6b: Time spent starting tablet: real 0.011s user 0.006s sys 0.000s
I20250625 03:32:10.434971 5220 tablet_bootstrap.cc:492] T 53747834cb32485eb3f79f699e401024 P c37a035bb2d44c709a64f282940bdc6b: Bootstrap starting.
I20250625 03:32:10.436249 5218 tablet_bootstrap.cc:654] T 8177d088f97c4dd4b031a1c9e7eae427 P 21b63b7bf1b94396bf2ea6cc8359f4e5: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:10.439813 5221 tablet_bootstrap.cc:654] T 149bd3c081bc4cf0a4de280a4dd4fd1b P e1270a01a1c04e8c9013a17569afebf5: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:10.442576 5220 tablet_bootstrap.cc:654] T 53747834cb32485eb3f79f699e401024 P c37a035bb2d44c709a64f282940bdc6b: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:10.460523 5218 tablet_bootstrap.cc:492] T 8177d088f97c4dd4b031a1c9e7eae427 P 21b63b7bf1b94396bf2ea6cc8359f4e5: No bootstrap required, opened a new log
I20250625 03:32:10.461246 5218 ts_tablet_manager.cc:1397] T 8177d088f97c4dd4b031a1c9e7eae427 P 21b63b7bf1b94396bf2ea6cc8359f4e5: Time spent bootstrapping tablet: real 0.032s user 0.010s sys 0.018s
I20250625 03:32:10.465013 5218 raft_consensus.cc:357] T 8177d088f97c4dd4b031a1c9e7eae427 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.467288 5218 raft_consensus.cc:383] T 8177d088f97c4dd4b031a1c9e7eae427 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:10.467629 5218 raft_consensus.cc:738] T 8177d088f97c4dd4b031a1c9e7eae427 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b63b7bf1b94396bf2ea6cc8359f4e5, State: Initialized, Role: FOLLOWER
I20250625 03:32:10.468326 5218 consensus_queue.cc:260] T 8177d088f97c4dd4b031a1c9e7eae427 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.469000 5220 tablet_bootstrap.cc:492] T 53747834cb32485eb3f79f699e401024 P c37a035bb2d44c709a64f282940bdc6b: No bootstrap required, opened a new log
I20250625 03:32:10.469539 5220 ts_tablet_manager.cc:1397] T 53747834cb32485eb3f79f699e401024 P c37a035bb2d44c709a64f282940bdc6b: Time spent bootstrapping tablet: real 0.035s user 0.013s sys 0.019s
I20250625 03:32:10.469555 5221 tablet_bootstrap.cc:492] T 149bd3c081bc4cf0a4de280a4dd4fd1b P e1270a01a1c04e8c9013a17569afebf5: No bootstrap required, opened a new log
I20250625 03:32:10.470127 5221 ts_tablet_manager.cc:1397] T 149bd3c081bc4cf0a4de280a4dd4fd1b P e1270a01a1c04e8c9013a17569afebf5: Time spent bootstrapping tablet: real 0.048s user 0.015s sys 0.020s
I20250625 03:32:10.472530 5220 raft_consensus.cc:357] T 53747834cb32485eb3f79f699e401024 P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.473347 5220 raft_consensus.cc:383] T 53747834cb32485eb3f79f699e401024 P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:10.473074 5221 raft_consensus.cc:357] T 149bd3c081bc4cf0a4de280a4dd4fd1b P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.473666 5220 raft_consensus.cc:738] T 53747834cb32485eb3f79f699e401024 P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c37a035bb2d44c709a64f282940bdc6b, State: Initialized, Role: FOLLOWER
I20250625 03:32:10.473839 5221 raft_consensus.cc:383] T 149bd3c081bc4cf0a4de280a4dd4fd1b P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:10.474193 5221 raft_consensus.cc:738] T 149bd3c081bc4cf0a4de280a4dd4fd1b P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1270a01a1c04e8c9013a17569afebf5, State: Initialized, Role: FOLLOWER
I20250625 03:32:10.474448 5220 consensus_queue.cc:260] T 53747834cb32485eb3f79f699e401024 P c37a035bb2d44c709a64f282940bdc6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.475060 5221 consensus_queue.cc:260] T 149bd3c081bc4cf0a4de280a4dd4fd1b P e1270a01a1c04e8c9013a17569afebf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.475739 5218 ts_tablet_manager.cc:1428] T 8177d088f97c4dd4b031a1c9e7eae427 P 21b63b7bf1b94396bf2ea6cc8359f4e5: Time spent starting tablet: real 0.014s user 0.007s sys 0.001s
I20250625 03:32:10.479851 5218 tablet_bootstrap.cc:492] T 53747834cb32485eb3f79f699e401024 P 21b63b7bf1b94396bf2ea6cc8359f4e5: Bootstrap starting.
I20250625 03:32:10.476996 5220 ts_tablet_manager.cc:1428] T 53747834cb32485eb3f79f699e401024 P c37a035bb2d44c709a64f282940bdc6b: Time spent starting tablet: real 0.007s user 0.006s sys 0.002s
I20250625 03:32:10.482789 5220 tablet_bootstrap.cc:492] T b7f4f7f28226468ea72e221eac6a1fdb P c37a035bb2d44c709a64f282940bdc6b: Bootstrap starting.
I20250625 03:32:10.477727 5221 ts_tablet_manager.cc:1428] T 149bd3c081bc4cf0a4de280a4dd4fd1b P e1270a01a1c04e8c9013a17569afebf5: Time spent starting tablet: real 0.007s user 0.004s sys 0.002s
I20250625 03:32:10.485021 5221 tablet_bootstrap.cc:492] T 65572804041f4d5591d561279d92cd49 P e1270a01a1c04e8c9013a17569afebf5: Bootstrap starting.
I20250625 03:32:10.486946 5218 tablet_bootstrap.cc:654] T 53747834cb32485eb3f79f699e401024 P 21b63b7bf1b94396bf2ea6cc8359f4e5: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:10.489780 5220 tablet_bootstrap.cc:654] T b7f4f7f28226468ea72e221eac6a1fdb P c37a035bb2d44c709a64f282940bdc6b: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:10.490516 5126 raft_consensus.cc:491] T 40422f6c986f41ae8c8067019d882fb2 P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:32:10.491250 5126 raft_consensus.cc:513] T 40422f6c986f41ae8c8067019d882fb2 P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.493342 5221 tablet_bootstrap.cc:654] T 65572804041f4d5591d561279d92cd49 P e1270a01a1c04e8c9013a17569afebf5: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:10.496308 5079 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "40422f6c986f41ae8c8067019d882fb2" candidate_uuid: "e1270a01a1c04e8c9013a17569afebf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c37a035bb2d44c709a64f282940bdc6b" is_pre_election: true
I20250625 03:32:10.497771 5126 leader_election.cc:290] T 40422f6c986f41ae8c8067019d882fb2 P e1270a01a1c04e8c9013a17569afebf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373), c37a035bb2d44c709a64f282940bdc6b (127.0.106.131:35169)
I20250625 03:32:10.499050 4929 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "40422f6c986f41ae8c8067019d882fb2" candidate_uuid: "e1270a01a1c04e8c9013a17569afebf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" is_pre_election: true
W20250625 03:32:10.501433 4969 leader_election.cc:343] T 40422f6c986f41ae8c8067019d882fb2 P e1270a01a1c04e8c9013a17569afebf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373): Illegal state: must be running to vote when last-logged opid is not known
W20250625 03:32:10.503284 4968 leader_election.cc:343] T 40422f6c986f41ae8c8067019d882fb2 P e1270a01a1c04e8c9013a17569afebf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c37a035bb2d44c709a64f282940bdc6b (127.0.106.131:35169): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:32:10.503893 4968 leader_election.cc:304] T 40422f6c986f41ae8c8067019d882fb2 P e1270a01a1c04e8c9013a17569afebf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1270a01a1c04e8c9013a17569afebf5; no voters: 21b63b7bf1b94396bf2ea6cc8359f4e5, c37a035bb2d44c709a64f282940bdc6b
I20250625 03:32:10.509342 5126 raft_consensus.cc:2747] T 40422f6c986f41ae8c8067019d882fb2 P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:32:10.510859 5127 raft_consensus.cc:491] T 8177d088f97c4dd4b031a1c9e7eae427 P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:32:10.511395 5127 raft_consensus.cc:513] T 8177d088f97c4dd4b031a1c9e7eae427 P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.513514 5127 leader_election.cc:290] T 8177d088f97c4dd4b031a1c9e7eae427 P c37a035bb2d44c709a64f282940bdc6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373), e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130:41071)
I20250625 03:32:10.515755 5221 tablet_bootstrap.cc:492] T 65572804041f4d5591d561279d92cd49 P e1270a01a1c04e8c9013a17569afebf5: No bootstrap required, opened a new log
I20250625 03:32:10.516366 5221 ts_tablet_manager.cc:1397] T 65572804041f4d5591d561279d92cd49 P e1270a01a1c04e8c9013a17569afebf5: Time spent bootstrapping tablet: real 0.032s user 0.010s sys 0.005s
I20250625 03:32:10.515813 5005 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8177d088f97c4dd4b031a1c9e7eae427" candidate_uuid: "c37a035bb2d44c709a64f282940bdc6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1270a01a1c04e8c9013a17569afebf5" is_pre_election: true
W20250625 03:32:10.518214 5042 leader_election.cc:343] T 8177d088f97c4dd4b031a1c9e7eae427 P c37a035bb2d44c709a64f282940bdc6b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130:41071): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:32:10.516206 4929 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8177d088f97c4dd4b031a1c9e7eae427" candidate_uuid: "c37a035bb2d44c709a64f282940bdc6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" is_pre_election: true
I20250625 03:32:10.519044 4929 raft_consensus.cc:2466] T 8177d088f97c4dd4b031a1c9e7eae427 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c37a035bb2d44c709a64f282940bdc6b in term 0.
I20250625 03:32:10.520305 5043 leader_election.cc:304] T 8177d088f97c4dd4b031a1c9e7eae427 P c37a035bb2d44c709a64f282940bdc6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21b63b7bf1b94396bf2ea6cc8359f4e5, c37a035bb2d44c709a64f282940bdc6b; no voters: e1270a01a1c04e8c9013a17569afebf5
I20250625 03:32:10.520493 5221 raft_consensus.cc:357] T 65572804041f4d5591d561279d92cd49 P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.521490 5221 raft_consensus.cc:383] T 65572804041f4d5591d561279d92cd49 P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:10.521476 5127 raft_consensus.cc:2802] T 8177d088f97c4dd4b031a1c9e7eae427 P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:32:10.522097 5221 raft_consensus.cc:738] T 65572804041f4d5591d561279d92cd49 P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1270a01a1c04e8c9013a17569afebf5, State: Initialized, Role: FOLLOWER
I20250625 03:32:10.522125 5127 raft_consensus.cc:491] T 8177d088f97c4dd4b031a1c9e7eae427 P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:32:10.522755 5127 raft_consensus.cc:3058] T 8177d088f97c4dd4b031a1c9e7eae427 P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:10.523154 5221 consensus_queue.cc:260] T 65572804041f4d5591d561279d92cd49 P e1270a01a1c04e8c9013a17569afebf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.529455 5221 ts_tablet_manager.cc:1428] T 65572804041f4d5591d561279d92cd49 P e1270a01a1c04e8c9013a17569afebf5: Time spent starting tablet: real 0.013s user 0.008s sys 0.000s
I20250625 03:32:10.530576 5221 tablet_bootstrap.cc:492] T 391a5defcbd64e7999b0dffb39848744 P e1270a01a1c04e8c9013a17569afebf5: Bootstrap starting.
I20250625 03:32:10.532949 5127 raft_consensus.cc:513] T 8177d088f97c4dd4b031a1c9e7eae427 P c37a035bb2d44c709a64f282940bdc6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.535856 5206 raft_consensus.cc:491] T 391a5defcbd64e7999b0dffb39848744 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:32:10.536396 5206 raft_consensus.cc:513] T 391a5defcbd64e7999b0dffb39848744 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.537647 5221 tablet_bootstrap.cc:654] T 391a5defcbd64e7999b0dffb39848744 P e1270a01a1c04e8c9013a17569afebf5: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:10.538467 5206 leader_election.cc:290] T 391a5defcbd64e7999b0dffb39848744 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130:41071), c37a035bb2d44c709a64f282940bdc6b (127.0.106.131:35169)
I20250625 03:32:10.539379 4929 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8177d088f97c4dd4b031a1c9e7eae427" candidate_uuid: "c37a035bb2d44c709a64f282940bdc6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5"
I20250625 03:32:10.540064 4929 raft_consensus.cc:3058] T 8177d088f97c4dd4b031a1c9e7eae427 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:10.541100 5005 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "391a5defcbd64e7999b0dffb39848744" candidate_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1270a01a1c04e8c9013a17569afebf5" is_pre_election: true
W20250625 03:32:10.544085 4893 leader_election.cc:343] T 391a5defcbd64e7999b0dffb39848744 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130:41071): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:32:10.544265 5206 raft_consensus.cc:491] T b21ac1fdf14d484daf2e5e657e2fdc6d P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:32:10.544997 5206 raft_consensus.cc:513] T b21ac1fdf14d484daf2e5e657e2fdc6d P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.545297 5079 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "391a5defcbd64e7999b0dffb39848744" candidate_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c37a035bb2d44c709a64f282940bdc6b" is_pre_election: true
W20250625 03:32:10.547221 4893 leader_election.cc:343] T 391a5defcbd64e7999b0dffb39848744 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c37a035bb2d44c709a64f282940bdc6b (127.0.106.131:35169): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:32:10.547606 5206 leader_election.cc:290] T b21ac1fdf14d484daf2e5e657e2fdc6d P 21b63b7bf1b94396bf2ea6cc8359f4e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130:41071), c37a035bb2d44c709a64f282940bdc6b (127.0.106.131:35169)
I20250625 03:32:10.547855 4893 leader_election.cc:304] T 391a5defcbd64e7999b0dffb39848744 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21b63b7bf1b94396bf2ea6cc8359f4e5; no voters: c37a035bb2d44c709a64f282940bdc6b, e1270a01a1c04e8c9013a17569afebf5
I20250625 03:32:10.551121 5005 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b21ac1fdf14d484daf2e5e657e2fdc6d" candidate_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1270a01a1c04e8c9013a17569afebf5" is_pre_election: true
W20250625 03:32:10.553681 4893 leader_election.cc:343] T b21ac1fdf14d484daf2e5e657e2fdc6d P 21b63b7bf1b94396bf2ea6cc8359f4e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130:41071): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:32:10.554667 5079 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b21ac1fdf14d484daf2e5e657e2fdc6d" candidate_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c37a035bb2d44c709a64f282940bdc6b" is_pre_election: true
I20250625 03:32:10.559626 5236 raft_consensus.cc:491] T 149bd3c081bc4cf0a4de280a4dd4fd1b P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:32:10.560446 5236 raft_consensus.cc:513] T 149bd3c081bc4cf0a4de280a4dd4fd1b P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
W20250625 03:32:10.562337 4893 leader_election.cc:343] T b21ac1fdf14d484daf2e5e657e2fdc6d P 21b63b7bf1b94396bf2ea6cc8359f4e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c37a035bb2d44c709a64f282940bdc6b (127.0.106.131:35169): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:32:10.563022 4893 leader_election.cc:304] T b21ac1fdf14d484daf2e5e657e2fdc6d P 21b63b7bf1b94396bf2ea6cc8359f4e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21b63b7bf1b94396bf2ea6cc8359f4e5; no voters: c37a035bb2d44c709a64f282940bdc6b, e1270a01a1c04e8c9013a17569afebf5
I20250625 03:32:10.564440 4930 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "149bd3c081bc4cf0a4de280a4dd4fd1b" candidate_uuid: "c37a035bb2d44c709a64f282940bdc6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" is_pre_election: true
W20250625 03:32:10.566147 5043 leader_election.cc:343] T 149bd3c081bc4cf0a4de280a4dd4fd1b P c37a035bb2d44c709a64f282940bdc6b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:32:10.567962 4929 raft_consensus.cc:2466] T 8177d088f97c4dd4b031a1c9e7eae427 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c37a035bb2d44c709a64f282940bdc6b in term 1.
I20250625 03:32:10.551112 5206 raft_consensus.cc:2747] T 391a5defcbd64e7999b0dffb39848744 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:32:10.569932 5043 leader_election.cc:304] T 8177d088f97c4dd4b031a1c9e7eae427 P c37a035bb2d44c709a64f282940bdc6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b63b7bf1b94396bf2ea6cc8359f4e5, c37a035bb2d44c709a64f282940bdc6b; no voters:
I20250625 03:32:10.573599 5206 raft_consensus.cc:2747] T b21ac1fdf14d484daf2e5e657e2fdc6d P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:32:10.581836 5237 raft_consensus.cc:2802] T 8177d088f97c4dd4b031a1c9e7eae427 P c37a035bb2d44c709a64f282940bdc6b [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:32:10.595130 5005 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8177d088f97c4dd4b031a1c9e7eae427" candidate_uuid: "c37a035bb2d44c709a64f282940bdc6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1270a01a1c04e8c9013a17569afebf5"
W20250625 03:32:10.597164 5042 leader_election.cc:343] T 8177d088f97c4dd4b031a1c9e7eae427 P c37a035bb2d44c709a64f282940bdc6b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130:41071): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:32:10.602562 5127 leader_election.cc:290] T 8177d088f97c4dd4b031a1c9e7eae427 P c37a035bb2d44c709a64f282940bdc6b [CANDIDATE]: Term 1 election: Requested vote from peers 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373), e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130:41071)
I20250625 03:32:10.604875 5236 leader_election.cc:290] T 149bd3c081bc4cf0a4de280a4dd4fd1b P c37a035bb2d44c709a64f282940bdc6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373), e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130:41071)
I20250625 03:32:10.606094 5005 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "149bd3c081bc4cf0a4de280a4dd4fd1b" candidate_uuid: "c37a035bb2d44c709a64f282940bdc6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1270a01a1c04e8c9013a17569afebf5" is_pre_election: true
I20250625 03:32:10.606889 5005 raft_consensus.cc:2466] T 149bd3c081bc4cf0a4de280a4dd4fd1b P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c37a035bb2d44c709a64f282940bdc6b in term 0.
I20250625 03:32:10.607698 5221 tablet_bootstrap.cc:492] T 391a5defcbd64e7999b0dffb39848744 P e1270a01a1c04e8c9013a17569afebf5: No bootstrap required, opened a new log
I20250625 03:32:10.607856 5220 tablet_bootstrap.cc:492] T b7f4f7f28226468ea72e221eac6a1fdb P c37a035bb2d44c709a64f282940bdc6b: No bootstrap required, opened a new log
I20250625 03:32:10.608314 5221 ts_tablet_manager.cc:1397] T 391a5defcbd64e7999b0dffb39848744 P e1270a01a1c04e8c9013a17569afebf5: Time spent bootstrapping tablet: real 0.078s user 0.030s sys 0.039s
I20250625 03:32:10.608453 5220 ts_tablet_manager.cc:1397] T b7f4f7f28226468ea72e221eac6a1fdb P c37a035bb2d44c709a64f282940bdc6b: Time spent bootstrapping tablet: real 0.126s user 0.045s sys 0.070s
I20250625 03:32:10.608208 5042 leader_election.cc:304] T 149bd3c081bc4cf0a4de280a4dd4fd1b P c37a035bb2d44c709a64f282940bdc6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c37a035bb2d44c709a64f282940bdc6b, e1270a01a1c04e8c9013a17569afebf5; no voters: 21b63b7bf1b94396bf2ea6cc8359f4e5
I20250625 03:32:10.610188 5218 tablet_bootstrap.cc:492] T 53747834cb32485eb3f79f699e401024 P 21b63b7bf1b94396bf2ea6cc8359f4e5: No bootstrap required, opened a new log
I20250625 03:32:10.610743 5218 ts_tablet_manager.cc:1397] T 53747834cb32485eb3f79f699e401024 P 21b63b7bf1b94396bf2ea6cc8359f4e5: Time spent bootstrapping tablet: real 0.131s user 0.023s sys 0.014s
I20250625 03:32:10.611471 5220 raft_consensus.cc:357] T b7f4f7f28226468ea72e221eac6a1fdb P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.612099 5220 raft_consensus.cc:383] T b7f4f7f28226468ea72e221eac6a1fdb P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:10.612583 5220 raft_consensus.cc:738] T b7f4f7f28226468ea72e221eac6a1fdb P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c37a035bb2d44c709a64f282940bdc6b, State: Initialized, Role: FOLLOWER
I20250625 03:32:10.612035 5221 raft_consensus.cc:357] T 391a5defcbd64e7999b0dffb39848744 P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.613022 5221 raft_consensus.cc:383] T 391a5defcbd64e7999b0dffb39848744 P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:10.613325 5221 raft_consensus.cc:738] T 391a5defcbd64e7999b0dffb39848744 P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1270a01a1c04e8c9013a17569afebf5, State: Initialized, Role: FOLLOWER
I20250625 03:32:10.613271 5220 consensus_queue.cc:260] T b7f4f7f28226468ea72e221eac6a1fdb P c37a035bb2d44c709a64f282940bdc6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.613685 5218 raft_consensus.cc:357] T 53747834cb32485eb3f79f699e401024 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.614459 5218 raft_consensus.cc:383] T 53747834cb32485eb3f79f699e401024 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:10.614212 5221 consensus_queue.cc:260] T 391a5defcbd64e7999b0dffb39848744 P e1270a01a1c04e8c9013a17569afebf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.614508 5238 raft_consensus.cc:2802] T 149bd3c081bc4cf0a4de280a4dd4fd1b P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:32:10.614837 5218 raft_consensus.cc:738] T 53747834cb32485eb3f79f699e401024 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b63b7bf1b94396bf2ea6cc8359f4e5, State: Initialized, Role: FOLLOWER
I20250625 03:32:10.615273 5238 raft_consensus.cc:491] T 149bd3c081bc4cf0a4de280a4dd4fd1b P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:32:10.615752 5238 raft_consensus.cc:3058] T 149bd3c081bc4cf0a4de280a4dd4fd1b P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:10.615895 5220 ts_tablet_manager.cc:1428] T b7f4f7f28226468ea72e221eac6a1fdb P c37a035bb2d44c709a64f282940bdc6b: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20250625 03:32:10.616636 5237 raft_consensus.cc:695] T 8177d088f97c4dd4b031a1c9e7eae427 P c37a035bb2d44c709a64f282940bdc6b [term 1 LEADER]: Becoming Leader. State: Replica: c37a035bb2d44c709a64f282940bdc6b, State: Running, Role: LEADER
I20250625 03:32:10.617190 5220 tablet_bootstrap.cc:492] T 05b3b289074d43638ab6ae336e13f3ef P c37a035bb2d44c709a64f282940bdc6b: Bootstrap starting.
I20250625 03:32:10.617686 5237 consensus_queue.cc:237] T 8177d088f97c4dd4b031a1c9e7eae427 P c37a035bb2d44c709a64f282940bdc6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.621685 5239 raft_consensus.cc:491] T 53747834cb32485eb3f79f699e401024 P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:32:10.622210 5239 raft_consensus.cc:513] T 53747834cb32485eb3f79f699e401024 P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.624653 5221 ts_tablet_manager.cc:1428] T 391a5defcbd64e7999b0dffb39848744 P e1270a01a1c04e8c9013a17569afebf5: Time spent starting tablet: real 0.016s user 0.007s sys 0.001s
I20250625 03:32:10.625137 5220 tablet_bootstrap.cc:654] T 05b3b289074d43638ab6ae336e13f3ef P c37a035bb2d44c709a64f282940bdc6b: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:10.625240 4929 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "53747834cb32485eb3f79f699e401024" candidate_uuid: "c37a035bb2d44c709a64f282940bdc6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" is_pre_election: true
I20250625 03:32:10.625798 5221 tablet_bootstrap.cc:492] T 05b3b289074d43638ab6ae336e13f3ef P e1270a01a1c04e8c9013a17569afebf5: Bootstrap starting.
I20250625 03:32:10.626109 5218 consensus_queue.cc:260] T 53747834cb32485eb3f79f699e401024 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.627381 4929 raft_consensus.cc:2466] T 53747834cb32485eb3f79f699e401024 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c37a035bb2d44c709a64f282940bdc6b in term 0.
I20250625 03:32:10.629911 5235 raft_consensus.cc:491] T 65572804041f4d5591d561279d92cd49 P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:32:10.630491 5235 raft_consensus.cc:513] T 65572804041f4d5591d561279d92cd49 P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.631076 5238 raft_consensus.cc:513] T 149bd3c081bc4cf0a4de280a4dd4fd1b P c37a035bb2d44c709a64f282940bdc6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.632758 5235 leader_election.cc:290] T 65572804041f4d5591d561279d92cd49 P e1270a01a1c04e8c9013a17569afebf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373), c37a035bb2d44c709a64f282940bdc6b (127.0.106.131:35169)
I20250625 03:32:10.634765 4930 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "65572804041f4d5591d561279d92cd49" candidate_uuid: "e1270a01a1c04e8c9013a17569afebf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" is_pre_election: true
I20250625 03:32:10.635586 5043 leader_election.cc:304] T 53747834cb32485eb3f79f699e401024 P c37a035bb2d44c709a64f282940bdc6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b63b7bf1b94396bf2ea6cc8359f4e5, c37a035bb2d44c709a64f282940bdc6b; no voters:
I20250625 03:32:10.636150 5079 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "65572804041f4d5591d561279d92cd49" candidate_uuid: "e1270a01a1c04e8c9013a17569afebf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c37a035bb2d44c709a64f282940bdc6b" is_pre_election: true
I20250625 03:32:10.636518 5236 raft_consensus.cc:2802] T 53747834cb32485eb3f79f699e401024 P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:32:10.637127 5236 raft_consensus.cc:491] T 53747834cb32485eb3f79f699e401024 P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:32:10.637460 5236 raft_consensus.cc:3058] T 53747834cb32485eb3f79f699e401024 P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:10.637605 5220 tablet_bootstrap.cc:492] T 05b3b289074d43638ab6ae336e13f3ef P c37a035bb2d44c709a64f282940bdc6b: No bootstrap required, opened a new log
W20250625 03:32:10.638170 4969 leader_election.cc:343] T 65572804041f4d5591d561279d92cd49 P e1270a01a1c04e8c9013a17569afebf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:32:10.638163 5220 ts_tablet_manager.cc:1397] T 05b3b289074d43638ab6ae336e13f3ef P c37a035bb2d44c709a64f282940bdc6b: Time spent bootstrapping tablet: real 0.021s user 0.009s sys 0.008s
W20250625 03:32:10.638765 4968 leader_election.cc:343] T 65572804041f4d5591d561279d92cd49 P e1270a01a1c04e8c9013a17569afebf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c37a035bb2d44c709a64f282940bdc6b (127.0.106.131:35169): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:32:10.639304 4968 leader_election.cc:304] T 65572804041f4d5591d561279d92cd49 P e1270a01a1c04e8c9013a17569afebf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1270a01a1c04e8c9013a17569afebf5; no voters: 21b63b7bf1b94396bf2ea6cc8359f4e5, c37a035bb2d44c709a64f282940bdc6b
I20250625 03:32:10.641471 5221 tablet_bootstrap.cc:654] T 05b3b289074d43638ab6ae336e13f3ef P e1270a01a1c04e8c9013a17569afebf5: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:10.642120 5220 raft_consensus.cc:357] T 05b3b289074d43638ab6ae336e13f3ef P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.642884 5220 raft_consensus.cc:383] T 05b3b289074d43638ab6ae336e13f3ef P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:10.643178 5220 raft_consensus.cc:738] T 05b3b289074d43638ab6ae336e13f3ef P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c37a035bb2d44c709a64f282940bdc6b, State: Initialized, Role: FOLLOWER
I20250625 03:32:10.643926 5220 consensus_queue.cc:260] T 05b3b289074d43638ab6ae336e13f3ef P c37a035bb2d44c709a64f282940bdc6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.645234 5239 leader_election.cc:290] T 53747834cb32485eb3f79f699e401024 P c37a035bb2d44c709a64f282940bdc6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373), e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130:41071)
I20250625 03:32:10.646466 5220 ts_tablet_manager.cc:1428] T 05b3b289074d43638ab6ae336e13f3ef P c37a035bb2d44c709a64f282940bdc6b: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20250625 03:32:10.647676 5220 tablet_bootstrap.cc:492] T 65572804041f4d5591d561279d92cd49 P c37a035bb2d44c709a64f282940bdc6b: Bootstrap starting.
I20250625 03:32:10.648233 5218 ts_tablet_manager.cc:1428] T 53747834cb32485eb3f79f699e401024 P 21b63b7bf1b94396bf2ea6cc8359f4e5: Time spent starting tablet: real 0.037s user 0.008s sys 0.001s
I20250625 03:32:10.649329 5218 tablet_bootstrap.cc:492] T b7f4f7f28226468ea72e221eac6a1fdb P 21b63b7bf1b94396bf2ea6cc8359f4e5: Bootstrap starting.
I20250625 03:32:10.652644 5236 raft_consensus.cc:513] T 53747834cb32485eb3f79f699e401024 P c37a035bb2d44c709a64f282940bdc6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.655694 5220 tablet_bootstrap.cc:654] T 65572804041f4d5591d561279d92cd49 P c37a035bb2d44c709a64f282940bdc6b: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:10.645421 5005 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "53747834cb32485eb3f79f699e401024" candidate_uuid: "c37a035bb2d44c709a64f282940bdc6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1270a01a1c04e8c9013a17569afebf5" is_pre_election: true
I20250625 03:32:10.655825 4929 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "53747834cb32485eb3f79f699e401024" candidate_uuid: "c37a035bb2d44c709a64f282940bdc6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5"
I20250625 03:32:10.656530 4929 raft_consensus.cc:3058] T 53747834cb32485eb3f79f699e401024 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Advancing to term 1
W20250625 03:32:10.657421 5042 leader_election.cc:343] T 53747834cb32485eb3f79f699e401024 P c37a035bb2d44c709a64f282940bdc6b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130:41071): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:32:10.658502 5235 raft_consensus.cc:2747] T 65572804041f4d5591d561279d92cd49 P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:32:10.664435 4930 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "149bd3c081bc4cf0a4de280a4dd4fd1b" candidate_uuid: "c37a035bb2d44c709a64f282940bdc6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5"
W20250625 03:32:10.666437 5043 leader_election.cc:343] T 149bd3c081bc4cf0a4de280a4dd4fd1b P c37a035bb2d44c709a64f282940bdc6b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:32:10.668383 5220 tablet_bootstrap.cc:492] T 65572804041f4d5591d561279d92cd49 P c37a035bb2d44c709a64f282940bdc6b: No bootstrap required, opened a new log
I20250625 03:32:10.668973 5220 ts_tablet_manager.cc:1397] T 65572804041f4d5591d561279d92cd49 P c37a035bb2d44c709a64f282940bdc6b: Time spent bootstrapping tablet: real 0.022s user 0.016s sys 0.003s
I20250625 03:32:10.675662 5237 raft_consensus.cc:491] T 05b3b289074d43638ab6ae336e13f3ef P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:32:10.676642 5237 raft_consensus.cc:513] T 05b3b289074d43638ab6ae336e13f3ef P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.672046 5220 raft_consensus.cc:357] T 65572804041f4d5591d561279d92cd49 P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.679472 5220 raft_consensus.cc:383] T 65572804041f4d5591d561279d92cd49 P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:10.679797 4930 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "05b3b289074d43638ab6ae336e13f3ef" candidate_uuid: "c37a035bb2d44c709a64f282940bdc6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" is_pre_election: true
I20250625 03:32:10.679967 5220 raft_consensus.cc:738] T 65572804041f4d5591d561279d92cd49 P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c37a035bb2d44c709a64f282940bdc6b, State: Initialized, Role: FOLLOWER
I20250625 03:32:10.678680 5005 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "53747834cb32485eb3f79f699e401024" candidate_uuid: "c37a035bb2d44c709a64f282940bdc6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1270a01a1c04e8c9013a17569afebf5"
I20250625 03:32:10.680524 4930 raft_consensus.cc:2466] T 05b3b289074d43638ab6ae336e13f3ef P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c37a035bb2d44c709a64f282940bdc6b in term 0.
I20250625 03:32:10.680800 5220 consensus_queue.cc:260] T 65572804041f4d5591d561279d92cd49 P c37a035bb2d44c709a64f282940bdc6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
W20250625 03:32:10.682003 5042 leader_election.cc:343] T 53747834cb32485eb3f79f699e401024 P c37a035bb2d44c709a64f282940bdc6b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130:41071): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:32:10.682111 5043 leader_election.cc:304] T 05b3b289074d43638ab6ae336e13f3ef P c37a035bb2d44c709a64f282940bdc6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b63b7bf1b94396bf2ea6cc8359f4e5, c37a035bb2d44c709a64f282940bdc6b; no voters:
I20250625 03:32:10.683225 5127 raft_consensus.cc:2802] T 05b3b289074d43638ab6ae336e13f3ef P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:32:10.683398 5220 ts_tablet_manager.cc:1428] T 65572804041f4d5591d561279d92cd49 P c37a035bb2d44c709a64f282940bdc6b: Time spent starting tablet: real 0.014s user 0.006s sys 0.000s
I20250625 03:32:10.683580 5237 leader_election.cc:290] T 05b3b289074d43638ab6ae336e13f3ef P c37a035bb2d44c709a64f282940bdc6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373), e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130:41071)
I20250625 03:32:10.684576 5220 tablet_bootstrap.cc:492] T 391a5defcbd64e7999b0dffb39848744 P c37a035bb2d44c709a64f282940bdc6b: Bootstrap starting.
I20250625 03:32:10.684813 5238 leader_election.cc:290] T 149bd3c081bc4cf0a4de280a4dd4fd1b P c37a035bb2d44c709a64f282940bdc6b [CANDIDATE]: Term 1 election: Requested vote from peers 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373), e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130:41071)
I20250625 03:32:10.675570 4929 raft_consensus.cc:2466] T 53747834cb32485eb3f79f699e401024 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c37a035bb2d44c709a64f282940bdc6b in term 1.
I20250625 03:32:10.686502 5004 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "149bd3c081bc4cf0a4de280a4dd4fd1b" candidate_uuid: "c37a035bb2d44c709a64f282940bdc6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1270a01a1c04e8c9013a17569afebf5"
I20250625 03:32:10.686923 5043 leader_election.cc:304] T 53747834cb32485eb3f79f699e401024 P c37a035bb2d44c709a64f282940bdc6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21b63b7bf1b94396bf2ea6cc8359f4e5, c37a035bb2d44c709a64f282940bdc6b; no voters: e1270a01a1c04e8c9013a17569afebf5
I20250625 03:32:10.687465 5004 raft_consensus.cc:3058] T 149bd3c081bc4cf0a4de280a4dd4fd1b P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:10.690915 5238 raft_consensus.cc:2802] T 53747834cb32485eb3f79f699e401024 P c37a035bb2d44c709a64f282940bdc6b [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:32:10.691572 5238 raft_consensus.cc:695] T 53747834cb32485eb3f79f699e401024 P c37a035bb2d44c709a64f282940bdc6b [term 1 LEADER]: Becoming Leader. State: Replica: c37a035bb2d44c709a64f282940bdc6b, State: Running, Role: LEADER
I20250625 03:32:10.692031 5220 tablet_bootstrap.cc:654] T 391a5defcbd64e7999b0dffb39848744 P c37a035bb2d44c709a64f282940bdc6b: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:10.692366 5005 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "05b3b289074d43638ab6ae336e13f3ef" candidate_uuid: "c37a035bb2d44c709a64f282940bdc6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1270a01a1c04e8c9013a17569afebf5" is_pre_election: true
I20250625 03:32:10.683812 5127 raft_consensus.cc:491] T 05b3b289074d43638ab6ae336e13f3ef P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:32:10.692945 5238 consensus_queue.cc:237] T 53747834cb32485eb3f79f699e401024 P c37a035bb2d44c709a64f282940bdc6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.693488 5127 raft_consensus.cc:3058] T 05b3b289074d43638ab6ae336e13f3ef P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Advancing to term 1
W20250625 03:32:10.700986 5042 leader_election.cc:343] T 05b3b289074d43638ab6ae336e13f3ef P c37a035bb2d44c709a64f282940bdc6b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130:41071): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:32:10.678759 4825 catalog_manager.cc:5582] T 8177d088f97c4dd4b031a1c9e7eae427 P c37a035bb2d44c709a64f282940bdc6b reported cstate change: term changed from 0 to 1, leader changed from <none> to c37a035bb2d44c709a64f282940bdc6b (127.0.106.131). New cstate: current_term: 1 leader_uuid: "c37a035bb2d44c709a64f282940bdc6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } health_report { overall_health: HEALTHY } } }
I20250625 03:32:10.702559 5221 tablet_bootstrap.cc:492] T 05b3b289074d43638ab6ae336e13f3ef P e1270a01a1c04e8c9013a17569afebf5: No bootstrap required, opened a new log
I20250625 03:32:10.703133 5221 ts_tablet_manager.cc:1397] T 05b3b289074d43638ab6ae336e13f3ef P e1270a01a1c04e8c9013a17569afebf5: Time spent bootstrapping tablet: real 0.078s user 0.025s sys 0.026s
I20250625 03:32:10.706302 5221 raft_consensus.cc:357] T 05b3b289074d43638ab6ae336e13f3ef P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.707070 5221 raft_consensus.cc:383] T 05b3b289074d43638ab6ae336e13f3ef P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:10.707373 5221 raft_consensus.cc:738] T 05b3b289074d43638ab6ae336e13f3ef P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1270a01a1c04e8c9013a17569afebf5, State: Initialized, Role: FOLLOWER
I20250625 03:32:10.708091 5221 consensus_queue.cc:260] T 05b3b289074d43638ab6ae336e13f3ef P e1270a01a1c04e8c9013a17569afebf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.708669 5236 leader_election.cc:290] T 53747834cb32485eb3f79f699e401024 P c37a035bb2d44c709a64f282940bdc6b [CANDIDATE]: Term 1 election: Requested vote from peers 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373), e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130:41071)
I20250625 03:32:10.713543 5004 raft_consensus.cc:2466] T 149bd3c081bc4cf0a4de280a4dd4fd1b P e1270a01a1c04e8c9013a17569afebf5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c37a035bb2d44c709a64f282940bdc6b in term 1.
I20250625 03:32:10.714293 5220 tablet_bootstrap.cc:492] T 391a5defcbd64e7999b0dffb39848744 P c37a035bb2d44c709a64f282940bdc6b: No bootstrap required, opened a new log
I20250625 03:32:10.714977 5220 ts_tablet_manager.cc:1397] T 391a5defcbd64e7999b0dffb39848744 P c37a035bb2d44c709a64f282940bdc6b: Time spent bootstrapping tablet: real 0.031s user 0.015s sys 0.007s
I20250625 03:32:10.715288 5042 leader_election.cc:304] T 149bd3c081bc4cf0a4de280a4dd4fd1b P c37a035bb2d44c709a64f282940bdc6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c37a035bb2d44c709a64f282940bdc6b, e1270a01a1c04e8c9013a17569afebf5; no voters: 21b63b7bf1b94396bf2ea6cc8359f4e5
I20250625 03:32:10.716926 5218 tablet_bootstrap.cc:654] T b7f4f7f28226468ea72e221eac6a1fdb P 21b63b7bf1b94396bf2ea6cc8359f4e5: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:10.717000 5236 raft_consensus.cc:2802] T 149bd3c081bc4cf0a4de280a4dd4fd1b P c37a035bb2d44c709a64f282940bdc6b [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:32:10.710608 5127 raft_consensus.cc:513] T 05b3b289074d43638ab6ae336e13f3ef P c37a035bb2d44c709a64f282940bdc6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.708254 5238 raft_consensus.cc:491] T b7f4f7f28226468ea72e221eac6a1fdb P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:32:10.718104 5220 raft_consensus.cc:357] T 391a5defcbd64e7999b0dffb39848744 P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.718441 5238 raft_consensus.cc:513] T b7f4f7f28226468ea72e221eac6a1fdb P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.719056 5220 raft_consensus.cc:383] T 391a5defcbd64e7999b0dffb39848744 P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:10.719465 5220 raft_consensus.cc:738] T 391a5defcbd64e7999b0dffb39848744 P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c37a035bb2d44c709a64f282940bdc6b, State: Initialized, Role: FOLLOWER
I20250625 03:32:10.720264 5220 consensus_queue.cc:260] T 391a5defcbd64e7999b0dffb39848744 P c37a035bb2d44c709a64f282940bdc6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.721450 4929 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b7f4f7f28226468ea72e221eac6a1fdb" candidate_uuid: "c37a035bb2d44c709a64f282940bdc6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" is_pre_election: true
W20250625 03:32:10.722911 5043 leader_election.cc:343] T b7f4f7f28226468ea72e221eac6a1fdb P c37a035bb2d44c709a64f282940bdc6b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:32:10.723649 5220 ts_tablet_manager.cc:1428] T 391a5defcbd64e7999b0dffb39848744 P c37a035bb2d44c709a64f282940bdc6b: Time spent starting tablet: real 0.008s user 0.004s sys 0.004s
I20250625 03:32:10.723929 5221 ts_tablet_manager.cc:1428] T 05b3b289074d43638ab6ae336e13f3ef P e1270a01a1c04e8c9013a17569afebf5: Time spent starting tablet: real 0.020s user 0.007s sys 0.000s
I20250625 03:32:10.724179 5238 leader_election.cc:290] T b7f4f7f28226468ea72e221eac6a1fdb P c37a035bb2d44c709a64f282940bdc6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373), e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130:41071)
I20250625 03:32:10.725157 5220 tablet_bootstrap.cc:492] T 40422f6c986f41ae8c8067019d882fb2 P c37a035bb2d44c709a64f282940bdc6b: Bootstrap starting.
I20250625 03:32:10.725909 5005 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b7f4f7f28226468ea72e221eac6a1fdb" candidate_uuid: "c37a035bb2d44c709a64f282940bdc6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1270a01a1c04e8c9013a17569afebf5" is_pre_election: true
W20250625 03:32:10.727821 5042 leader_election.cc:343] T b7f4f7f28226468ea72e221eac6a1fdb P c37a035bb2d44c709a64f282940bdc6b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130:41071): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:32:10.718133 5236 raft_consensus.cc:695] T 149bd3c081bc4cf0a4de280a4dd4fd1b P c37a035bb2d44c709a64f282940bdc6b [term 1 LEADER]: Becoming Leader. State: Replica: c37a035bb2d44c709a64f282940bdc6b, State: Running, Role: LEADER
I20250625 03:32:10.729820 5236 consensus_queue.cc:237] T 149bd3c081bc4cf0a4de280a4dd4fd1b P c37a035bb2d44c709a64f282940bdc6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.728318 5042 leader_election.cc:304] T b7f4f7f28226468ea72e221eac6a1fdb P c37a035bb2d44c709a64f282940bdc6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c37a035bb2d44c709a64f282940bdc6b; no voters: 21b63b7bf1b94396bf2ea6cc8359f4e5, e1270a01a1c04e8c9013a17569afebf5
I20250625 03:32:10.732471 5238 raft_consensus.cc:2747] T b7f4f7f28226468ea72e221eac6a1fdb P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:32:10.734469 5238 raft_consensus.cc:491] T 65572804041f4d5591d561279d92cd49 P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:32:10.734956 5238 raft_consensus.cc:513] T 65572804041f4d5591d561279d92cd49 P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.736441 5220 tablet_bootstrap.cc:654] T 40422f6c986f41ae8c8067019d882fb2 P c37a035bb2d44c709a64f282940bdc6b: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:10.737689 5218 tablet_bootstrap.cc:492] T b7f4f7f28226468ea72e221eac6a1fdb P 21b63b7bf1b94396bf2ea6cc8359f4e5: No bootstrap required, opened a new log
I20250625 03:32:10.738335 5218 ts_tablet_manager.cc:1397] T b7f4f7f28226468ea72e221eac6a1fdb P 21b63b7bf1b94396bf2ea6cc8359f4e5: Time spent bootstrapping tablet: real 0.089s user 0.022s sys 0.006s
I20250625 03:32:10.738734 4929 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "65572804041f4d5591d561279d92cd49" candidate_uuid: "c37a035bb2d44c709a64f282940bdc6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" is_pre_election: true
I20250625 03:32:10.725121 5221 tablet_bootstrap.cc:492] T b21ac1fdf14d484daf2e5e657e2fdc6d P e1270a01a1c04e8c9013a17569afebf5: Bootstrap starting.
W20250625 03:32:10.740628 5043 leader_election.cc:343] T 65572804041f4d5591d561279d92cd49 P c37a035bb2d44c709a64f282940bdc6b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:32:10.741677 5238 leader_election.cc:290] T 65572804041f4d5591d561279d92cd49 P c37a035bb2d44c709a64f282940bdc6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373), e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130:41071)
I20250625 03:32:10.742569 5218 raft_consensus.cc:357] T b7f4f7f28226468ea72e221eac6a1fdb P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.743274 5005 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "65572804041f4d5591d561279d92cd49" candidate_uuid: "c37a035bb2d44c709a64f282940bdc6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1270a01a1c04e8c9013a17569afebf5" is_pre_election: true
I20250625 03:32:10.743829 5218 raft_consensus.cc:383] T b7f4f7f28226468ea72e221eac6a1fdb P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:10.744307 5005 raft_consensus.cc:2466] T 65572804041f4d5591d561279d92cd49 P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c37a035bb2d44c709a64f282940bdc6b in term 0.
I20250625 03:32:10.744486 5218 raft_consensus.cc:738] T b7f4f7f28226468ea72e221eac6a1fdb P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b63b7bf1b94396bf2ea6cc8359f4e5, State: Initialized, Role: FOLLOWER
I20250625 03:32:10.745704 5218 consensus_queue.cc:260] T b7f4f7f28226468ea72e221eac6a1fdb P 21b63b7bf1b94396bf2ea6cc8359f4e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.745936 5042 leader_election.cc:304] T 65572804041f4d5591d561279d92cd49 P c37a035bb2d44c709a64f282940bdc6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c37a035bb2d44c709a64f282940bdc6b, e1270a01a1c04e8c9013a17569afebf5; no voters: 21b63b7bf1b94396bf2ea6cc8359f4e5
I20250625 03:32:10.748265 5220 tablet_bootstrap.cc:492] T 40422f6c986f41ae8c8067019d882fb2 P c37a035bb2d44c709a64f282940bdc6b: No bootstrap required, opened a new log
I20250625 03:32:10.748769 5220 ts_tablet_manager.cc:1397] T 40422f6c986f41ae8c8067019d882fb2 P c37a035bb2d44c709a64f282940bdc6b: Time spent bootstrapping tablet: real 0.024s user 0.013s sys 0.008s
I20250625 03:32:10.748845 4929 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "05b3b289074d43638ab6ae336e13f3ef" candidate_uuid: "c37a035bb2d44c709a64f282940bdc6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5"
I20250625 03:32:10.749745 4929 raft_consensus.cc:3058] T 05b3b289074d43638ab6ae336e13f3ef P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:10.751538 5220 raft_consensus.cc:357] T 40422f6c986f41ae8c8067019d882fb2 P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.752195 5238 raft_consensus.cc:2802] T 65572804041f4d5591d561279d92cd49 P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:32:10.752336 5220 raft_consensus.cc:383] T 40422f6c986f41ae8c8067019d882fb2 P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:10.752960 5238 raft_consensus.cc:491] T 65572804041f4d5591d561279d92cd49 P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:32:10.752990 5220 raft_consensus.cc:738] T 40422f6c986f41ae8c8067019d882fb2 P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c37a035bb2d44c709a64f282940bdc6b, State: Initialized, Role: FOLLOWER
I20250625 03:32:10.754107 5238 raft_consensus.cc:3058] T 65572804041f4d5591d561279d92cd49 P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:10.754556 5220 consensus_queue.cc:260] T 40422f6c986f41ae8c8067019d882fb2 P c37a035bb2d44c709a64f282940bdc6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.753748 5218 ts_tablet_manager.cc:1428] T b7f4f7f28226468ea72e221eac6a1fdb P 21b63b7bf1b94396bf2ea6cc8359f4e5: Time spent starting tablet: real 0.015s user 0.008s sys 0.001s
I20250625 03:32:10.757198 5218 tablet_bootstrap.cc:492] T 149bd3c081bc4cf0a4de280a4dd4fd1b P 21b63b7bf1b94396bf2ea6cc8359f4e5: Bootstrap starting.
I20250625 03:32:10.757118 5235 raft_consensus.cc:491] T 391a5defcbd64e7999b0dffb39848744 P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:32:10.757753 5235 raft_consensus.cc:513] T 391a5defcbd64e7999b0dffb39848744 P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.759809 5235 leader_election.cc:290] T 391a5defcbd64e7999b0dffb39848744 P e1270a01a1c04e8c9013a17569afebf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373), c37a035bb2d44c709a64f282940bdc6b (127.0.106.131:35169)
I20250625 03:32:10.760550 5220 ts_tablet_manager.cc:1428] T 40422f6c986f41ae8c8067019d882fb2 P c37a035bb2d44c709a64f282940bdc6b: Time spent starting tablet: real 0.012s user 0.008s sys 0.000s
I20250625 03:32:10.761567 5220 tablet_bootstrap.cc:492] T b21ac1fdf14d484daf2e5e657e2fdc6d P c37a035bb2d44c709a64f282940bdc6b: Bootstrap starting.
I20250625 03:32:10.762390 5079 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "391a5defcbd64e7999b0dffb39848744" candidate_uuid: "e1270a01a1c04e8c9013a17569afebf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c37a035bb2d44c709a64f282940bdc6b" is_pre_election: true
I20250625 03:32:10.762663 4930 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "391a5defcbd64e7999b0dffb39848744" candidate_uuid: "e1270a01a1c04e8c9013a17569afebf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" is_pre_election: true
I20250625 03:32:10.763083 5079 raft_consensus.cc:2466] T 391a5defcbd64e7999b0dffb39848744 P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1270a01a1c04e8c9013a17569afebf5 in term 0.
I20250625 03:32:10.763325 4930 raft_consensus.cc:2466] T 391a5defcbd64e7999b0dffb39848744 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1270a01a1c04e8c9013a17569afebf5 in term 0.
I20250625 03:32:10.764359 4968 leader_election.cc:304] T 391a5defcbd64e7999b0dffb39848744 P e1270a01a1c04e8c9013a17569afebf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c37a035bb2d44c709a64f282940bdc6b, e1270a01a1c04e8c9013a17569afebf5; no voters:
I20250625 03:32:10.765558 5126 raft_consensus.cc:2802] T 391a5defcbd64e7999b0dffb39848744 P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:32:10.765933 5126 raft_consensus.cc:491] T 391a5defcbd64e7999b0dffb39848744 P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:32:10.766280 5126 raft_consensus.cc:3058] T 391a5defcbd64e7999b0dffb39848744 P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:10.766928 5004 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "05b3b289074d43638ab6ae336e13f3ef" candidate_uuid: "c37a035bb2d44c709a64f282940bdc6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1270a01a1c04e8c9013a17569afebf5"
I20250625 03:32:10.767577 5004 raft_consensus.cc:3058] T 05b3b289074d43638ab6ae336e13f3ef P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:10.768256 5220 tablet_bootstrap.cc:654] T b21ac1fdf14d484daf2e5e657e2fdc6d P c37a035bb2d44c709a64f282940bdc6b: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:10.771194 5127 leader_election.cc:290] T 05b3b289074d43638ab6ae336e13f3ef P c37a035bb2d44c709a64f282940bdc6b [CANDIDATE]: Term 1 election: Requested vote from peers 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373), e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130:41071)
I20250625 03:32:10.771658 5221 tablet_bootstrap.cc:654] T b21ac1fdf14d484daf2e5e657e2fdc6d P e1270a01a1c04e8c9013a17569afebf5: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:10.761175 4929 raft_consensus.cc:2466] T 05b3b289074d43638ab6ae336e13f3ef P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c37a035bb2d44c709a64f282940bdc6b in term 1.
I20250625 03:32:10.775705 5126 raft_consensus.cc:513] T 391a5defcbd64e7999b0dffb39848744 P e1270a01a1c04e8c9013a17569afebf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.781373 5043 leader_election.cc:304] T 05b3b289074d43638ab6ae336e13f3ef P c37a035bb2d44c709a64f282940bdc6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b63b7bf1b94396bf2ea6cc8359f4e5, c37a035bb2d44c709a64f282940bdc6b; no voters:
I20250625 03:32:10.781993 5126 leader_election.cc:290] T 391a5defcbd64e7999b0dffb39848744 P e1270a01a1c04e8c9013a17569afebf5 [CANDIDATE]: Term 1 election: Requested vote from peers 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373), c37a035bb2d44c709a64f282940bdc6b (127.0.106.131:35169)
I20250625 03:32:10.782712 4930 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "391a5defcbd64e7999b0dffb39848744" candidate_uuid: "e1270a01a1c04e8c9013a17569afebf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5"
I20250625 03:32:10.783347 4930 raft_consensus.cc:3058] T 391a5defcbd64e7999b0dffb39848744 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:10.782788 5127 raft_consensus.cc:2802] T 05b3b289074d43638ab6ae336e13f3ef P c37a035bb2d44c709a64f282940bdc6b [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:32:10.787575 5127 raft_consensus.cc:695] T 05b3b289074d43638ab6ae336e13f3ef P c37a035bb2d44c709a64f282940bdc6b [term 1 LEADER]: Becoming Leader. State: Replica: c37a035bb2d44c709a64f282940bdc6b, State: Running, Role: LEADER
I20250625 03:32:10.789474 5079 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "391a5defcbd64e7999b0dffb39848744" candidate_uuid: "e1270a01a1c04e8c9013a17569afebf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c37a035bb2d44c709a64f282940bdc6b"
I20250625 03:32:10.790153 5079 raft_consensus.cc:3058] T 391a5defcbd64e7999b0dffb39848744 P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:10.790566 5238 raft_consensus.cc:513] T 65572804041f4d5591d561279d92cd49 P c37a035bb2d44c709a64f282940bdc6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.791100 5004 raft_consensus.cc:2466] T 05b3b289074d43638ab6ae336e13f3ef P e1270a01a1c04e8c9013a17569afebf5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c37a035bb2d44c709a64f282940bdc6b in term 1.
I20250625 03:32:10.795094 5127 consensus_queue.cc:237] T 05b3b289074d43638ab6ae336e13f3ef P c37a035bb2d44c709a64f282940bdc6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.800490 5004 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "65572804041f4d5591d561279d92cd49" candidate_uuid: "c37a035bb2d44c709a64f282940bdc6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1270a01a1c04e8c9013a17569afebf5"
I20250625 03:32:10.801457 5004 raft_consensus.cc:3058] T 65572804041f4d5591d561279d92cd49 P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:10.801883 4929 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "65572804041f4d5591d561279d92cd49" candidate_uuid: "c37a035bb2d44c709a64f282940bdc6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5"
I20250625 03:32:10.803292 5238 leader_election.cc:290] T 65572804041f4d5591d561279d92cd49 P c37a035bb2d44c709a64f282940bdc6b [CANDIDATE]: Term 1 election: Requested vote from peers 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373), e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130:41071)
W20250625 03:32:10.803944 5043 leader_election.cc:343] T 65572804041f4d5591d561279d92cd49 P c37a035bb2d44c709a64f282940bdc6b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:32:10.809634 4930 raft_consensus.cc:2466] T 391a5defcbd64e7999b0dffb39848744 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1270a01a1c04e8c9013a17569afebf5 in term 1.
I20250625 03:32:10.811101 4969 leader_election.cc:304] T 391a5defcbd64e7999b0dffb39848744 P e1270a01a1c04e8c9013a17569afebf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b63b7bf1b94396bf2ea6cc8359f4e5, e1270a01a1c04e8c9013a17569afebf5; no voters:
I20250625 03:32:10.812153 5126 raft_consensus.cc:2802] T 391a5defcbd64e7999b0dffb39848744 P e1270a01a1c04e8c9013a17569afebf5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:32:10.812613 5126 raft_consensus.cc:695] T 391a5defcbd64e7999b0dffb39848744 P e1270a01a1c04e8c9013a17569afebf5 [term 1 LEADER]: Becoming Leader. State: Replica: e1270a01a1c04e8c9013a17569afebf5, State: Running, Role: LEADER
I20250625 03:32:10.815150 5126 consensus_queue.cc:237] T 391a5defcbd64e7999b0dffb39848744 P e1270a01a1c04e8c9013a17569afebf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.815796 5220 tablet_bootstrap.cc:492] T b21ac1fdf14d484daf2e5e657e2fdc6d P c37a035bb2d44c709a64f282940bdc6b: No bootstrap required, opened a new log
I20250625 03:32:10.816346 5220 ts_tablet_manager.cc:1397] T b21ac1fdf14d484daf2e5e657e2fdc6d P c37a035bb2d44c709a64f282940bdc6b: Time spent bootstrapping tablet: real 0.055s user 0.020s sys 0.002s
I20250625 03:32:10.814716 5218 tablet_bootstrap.cc:654] T 149bd3c081bc4cf0a4de280a4dd4fd1b P 21b63b7bf1b94396bf2ea6cc8359f4e5: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:10.818539 5079 raft_consensus.cc:2466] T 391a5defcbd64e7999b0dffb39848744 P c37a035bb2d44c709a64f282940bdc6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1270a01a1c04e8c9013a17569afebf5 in term 1.
I20250625 03:32:10.822459 5221 tablet_bootstrap.cc:492] T b21ac1fdf14d484daf2e5e657e2fdc6d P e1270a01a1c04e8c9013a17569afebf5: No bootstrap required, opened a new log
I20250625 03:32:10.812814 5004 raft_consensus.cc:2466] T 65572804041f4d5591d561279d92cd49 P e1270a01a1c04e8c9013a17569afebf5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c37a035bb2d44c709a64f282940bdc6b in term 1.
I20250625 03:32:10.822264 5220 raft_consensus.cc:357] T b21ac1fdf14d484daf2e5e657e2fdc6d P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.824465 5220 raft_consensus.cc:383] T b21ac1fdf14d484daf2e5e657e2fdc6d P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:10.824716 5220 raft_consensus.cc:738] T b21ac1fdf14d484daf2e5e657e2fdc6d P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c37a035bb2d44c709a64f282940bdc6b, State: Initialized, Role: FOLLOWER
I20250625 03:32:10.825570 5220 consensus_queue.cc:260] T b21ac1fdf14d484daf2e5e657e2fdc6d P c37a035bb2d44c709a64f282940bdc6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.824652 5221 ts_tablet_manager.cc:1397] T b21ac1fdf14d484daf2e5e657e2fdc6d P e1270a01a1c04e8c9013a17569afebf5: Time spent bootstrapping tablet: real 0.100s user 0.015s sys 0.003s
I20250625 03:32:10.827739 5220 ts_tablet_manager.cc:1428] T b21ac1fdf14d484daf2e5e657e2fdc6d P c37a035bb2d44c709a64f282940bdc6b: Time spent starting tablet: real 0.011s user 0.003s sys 0.001s
I20250625 03:32:10.828935 5042 leader_election.cc:304] T 65572804041f4d5591d561279d92cd49 P c37a035bb2d44c709a64f282940bdc6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c37a035bb2d44c709a64f282940bdc6b, e1270a01a1c04e8c9013a17569afebf5; no voters: 21b63b7bf1b94396bf2ea6cc8359f4e5
I20250625 03:32:10.829890 5127 raft_consensus.cc:2802] T 65572804041f4d5591d561279d92cd49 P c37a035bb2d44c709a64f282940bdc6b [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:32:10.830377 5127 raft_consensus.cc:695] T 65572804041f4d5591d561279d92cd49 P c37a035bb2d44c709a64f282940bdc6b [term 1 LEADER]: Becoming Leader. State: Replica: c37a035bb2d44c709a64f282940bdc6b, State: Running, Role: LEADER
I20250625 03:32:10.831187 5221 raft_consensus.cc:357] T b21ac1fdf14d484daf2e5e657e2fdc6d P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.831204 5127 consensus_queue.cc:237] T 65572804041f4d5591d561279d92cd49 P c37a035bb2d44c709a64f282940bdc6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.832109 5221 raft_consensus.cc:383] T b21ac1fdf14d484daf2e5e657e2fdc6d P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:10.832428 5221 raft_consensus.cc:738] T b21ac1fdf14d484daf2e5e657e2fdc6d P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1270a01a1c04e8c9013a17569afebf5, State: Initialized, Role: FOLLOWER
I20250625 03:32:10.832653 4824 catalog_manager.cc:5582] T 391a5defcbd64e7999b0dffb39848744 P e1270a01a1c04e8c9013a17569afebf5 reported cstate change: term changed from 0 to 1, leader changed from <none> to e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "e1270a01a1c04e8c9013a17569afebf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } health_report { overall_health: UNKNOWN } } }
I20250625 03:32:10.836735 5221 consensus_queue.cc:260] T b21ac1fdf14d484daf2e5e657e2fdc6d P e1270a01a1c04e8c9013a17569afebf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.839303 5221 ts_tablet_manager.cc:1428] T b21ac1fdf14d484daf2e5e657e2fdc6d P e1270a01a1c04e8c9013a17569afebf5: Time spent starting tablet: real 0.012s user 0.002s sys 0.002s
I20250625 03:32:10.840246 5221 tablet_bootstrap.cc:492] T b7f4f7f28226468ea72e221eac6a1fdb P e1270a01a1c04e8c9013a17569afebf5: Bootstrap starting.
I20250625 03:32:10.848651 5218 tablet_bootstrap.cc:492] T 149bd3c081bc4cf0a4de280a4dd4fd1b P 21b63b7bf1b94396bf2ea6cc8359f4e5: No bootstrap required, opened a new log
I20250625 03:32:10.849287 5218 ts_tablet_manager.cc:1397] T 149bd3c081bc4cf0a4de280a4dd4fd1b P 21b63b7bf1b94396bf2ea6cc8359f4e5: Time spent bootstrapping tablet: real 0.092s user 0.011s sys 0.001s
I20250625 03:32:10.846892 5221 tablet_bootstrap.cc:654] T b7f4f7f28226468ea72e221eac6a1fdb P e1270a01a1c04e8c9013a17569afebf5: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:10.851766 5218 raft_consensus.cc:357] T 149bd3c081bc4cf0a4de280a4dd4fd1b P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.852399 5218 raft_consensus.cc:383] T 149bd3c081bc4cf0a4de280a4dd4fd1b P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:10.852643 5218 raft_consensus.cc:738] T 149bd3c081bc4cf0a4de280a4dd4fd1b P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b63b7bf1b94396bf2ea6cc8359f4e5, State: Initialized, Role: FOLLOWER
I20250625 03:32:10.853255 5218 consensus_queue.cc:260] T 149bd3c081bc4cf0a4de280a4dd4fd1b P 21b63b7bf1b94396bf2ea6cc8359f4e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.855454 5218 ts_tablet_manager.cc:1428] T 149bd3c081bc4cf0a4de280a4dd4fd1b P 21b63b7bf1b94396bf2ea6cc8359f4e5: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20250625 03:32:10.856643 5218 tablet_bootstrap.cc:492] T 40422f6c986f41ae8c8067019d882fb2 P 21b63b7bf1b94396bf2ea6cc8359f4e5: Bootstrap starting.
I20250625 03:32:10.855895 4825 catalog_manager.cc:5582] T 05b3b289074d43638ab6ae336e13f3ef P c37a035bb2d44c709a64f282940bdc6b reported cstate change: term changed from 0 to 1, leader changed from <none> to c37a035bb2d44c709a64f282940bdc6b (127.0.106.131). New cstate: current_term: 1 leader_uuid: "c37a035bb2d44c709a64f282940bdc6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } health_report { overall_health: HEALTHY } } }
I20250625 03:32:10.858383 4825 catalog_manager.cc:5582] T 65572804041f4d5591d561279d92cd49 P c37a035bb2d44c709a64f282940bdc6b reported cstate change: term changed from 0 to 1, leader changed from <none> to c37a035bb2d44c709a64f282940bdc6b (127.0.106.131). New cstate: current_term: 1 leader_uuid: "c37a035bb2d44c709a64f282940bdc6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } health_report { overall_health: HEALTHY } } }
I20250625 03:32:10.861260 4825 catalog_manager.cc:5582] T 53747834cb32485eb3f79f699e401024 P c37a035bb2d44c709a64f282940bdc6b reported cstate change: term changed from 0 to 1, leader changed from <none> to c37a035bb2d44c709a64f282940bdc6b (127.0.106.131). New cstate: current_term: 1 leader_uuid: "c37a035bb2d44c709a64f282940bdc6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } health_report { overall_health: HEALTHY } } }
I20250625 03:32:10.862622 5218 tablet_bootstrap.cc:654] T 40422f6c986f41ae8c8067019d882fb2 P 21b63b7bf1b94396bf2ea6cc8359f4e5: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:10.863267 4825 catalog_manager.cc:5582] T 149bd3c081bc4cf0a4de280a4dd4fd1b P c37a035bb2d44c709a64f282940bdc6b reported cstate change: term changed from 0 to 1, leader changed from <none> to c37a035bb2d44c709a64f282940bdc6b (127.0.106.131). New cstate: current_term: 1 leader_uuid: "c37a035bb2d44c709a64f282940bdc6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } health_report { overall_health: HEALTHY } } }
I20250625 03:32:10.864625 5221 tablet_bootstrap.cc:492] T b7f4f7f28226468ea72e221eac6a1fdb P e1270a01a1c04e8c9013a17569afebf5: No bootstrap required, opened a new log
I20250625 03:32:10.865149 5221 ts_tablet_manager.cc:1397] T b7f4f7f28226468ea72e221eac6a1fdb P e1270a01a1c04e8c9013a17569afebf5: Time spent bootstrapping tablet: real 0.025s user 0.017s sys 0.001s
I20250625 03:32:10.867288 5218 tablet_bootstrap.cc:492] T 40422f6c986f41ae8c8067019d882fb2 P 21b63b7bf1b94396bf2ea6cc8359f4e5: No bootstrap required, opened a new log
I20250625 03:32:10.867765 5218 ts_tablet_manager.cc:1397] T 40422f6c986f41ae8c8067019d882fb2 P 21b63b7bf1b94396bf2ea6cc8359f4e5: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.003s
I20250625 03:32:10.868171 5221 raft_consensus.cc:357] T b7f4f7f28226468ea72e221eac6a1fdb P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.868942 5221 raft_consensus.cc:383] T b7f4f7f28226468ea72e221eac6a1fdb P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:10.869252 5221 raft_consensus.cc:738] T b7f4f7f28226468ea72e221eac6a1fdb P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1270a01a1c04e8c9013a17569afebf5, State: Initialized, Role: FOLLOWER
I20250625 03:32:10.869875 5218 raft_consensus.cc:357] T 40422f6c986f41ae8c8067019d882fb2 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.870479 5218 raft_consensus.cc:383] T 40422f6c986f41ae8c8067019d882fb2 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:10.870792 5218 raft_consensus.cc:738] T 40422f6c986f41ae8c8067019d882fb2 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b63b7bf1b94396bf2ea6cc8359f4e5, State: Initialized, Role: FOLLOWER
I20250625 03:32:10.869951 5221 consensus_queue.cc:260] T b7f4f7f28226468ea72e221eac6a1fdb P e1270a01a1c04e8c9013a17569afebf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.871395 5218 consensus_queue.cc:260] T 40422f6c986f41ae8c8067019d882fb2 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.873463 5221 ts_tablet_manager.cc:1428] T b7f4f7f28226468ea72e221eac6a1fdb P e1270a01a1c04e8c9013a17569afebf5: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20250625 03:32:10.873740 5218 ts_tablet_manager.cc:1428] T 40422f6c986f41ae8c8067019d882fb2 P 21b63b7bf1b94396bf2ea6cc8359f4e5: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20250625 03:32:10.874450 5221 tablet_bootstrap.cc:492] T 53747834cb32485eb3f79f699e401024 P e1270a01a1c04e8c9013a17569afebf5: Bootstrap starting.
I20250625 03:32:10.874680 5218 tablet_bootstrap.cc:492] T 65572804041f4d5591d561279d92cd49 P 21b63b7bf1b94396bf2ea6cc8359f4e5: Bootstrap starting.
I20250625 03:32:10.881098 5218 tablet_bootstrap.cc:654] T 65572804041f4d5591d561279d92cd49 P 21b63b7bf1b94396bf2ea6cc8359f4e5: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:10.881172 5221 tablet_bootstrap.cc:654] T 53747834cb32485eb3f79f699e401024 P e1270a01a1c04e8c9013a17569afebf5: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:10.892306 5218 tablet_bootstrap.cc:492] T 65572804041f4d5591d561279d92cd49 P 21b63b7bf1b94396bf2ea6cc8359f4e5: No bootstrap required, opened a new log
I20250625 03:32:10.893237 5218 ts_tablet_manager.cc:1397] T 65572804041f4d5591d561279d92cd49 P 21b63b7bf1b94396bf2ea6cc8359f4e5: Time spent bootstrapping tablet: real 0.019s user 0.009s sys 0.008s
I20250625 03:32:10.893991 5221 tablet_bootstrap.cc:492] T 53747834cb32485eb3f79f699e401024 P e1270a01a1c04e8c9013a17569afebf5: No bootstrap required, opened a new log
I20250625 03:32:10.894555 5221 ts_tablet_manager.cc:1397] T 53747834cb32485eb3f79f699e401024 P e1270a01a1c04e8c9013a17569afebf5: Time spent bootstrapping tablet: real 0.020s user 0.010s sys 0.008s
I20250625 03:32:10.895862 5218 raft_consensus.cc:357] T 65572804041f4d5591d561279d92cd49 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.896617 5218 raft_consensus.cc:383] T 65572804041f4d5591d561279d92cd49 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:10.896907 5218 raft_consensus.cc:738] T 65572804041f4d5591d561279d92cd49 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b63b7bf1b94396bf2ea6cc8359f4e5, State: Initialized, Role: FOLLOWER
I20250625 03:32:10.897516 5218 consensus_queue.cc:260] T 65572804041f4d5591d561279d92cd49 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.897912 5221 raft_consensus.cc:357] T 53747834cb32485eb3f79f699e401024 P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.898614 5221 raft_consensus.cc:383] T 53747834cb32485eb3f79f699e401024 P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:10.899447 5218 ts_tablet_manager.cc:1428] T 65572804041f4d5591d561279d92cd49 P 21b63b7bf1b94396bf2ea6cc8359f4e5: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20250625 03:32:10.900216 5221 raft_consensus.cc:738] T 53747834cb32485eb3f79f699e401024 P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1270a01a1c04e8c9013a17569afebf5, State: Initialized, Role: FOLLOWER
I20250625 03:32:10.901247 5221 consensus_queue.cc:260] T 53747834cb32485eb3f79f699e401024 P e1270a01a1c04e8c9013a17569afebf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.904289 5221 ts_tablet_manager.cc:1428] T 53747834cb32485eb3f79f699e401024 P e1270a01a1c04e8c9013a17569afebf5: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
I20250625 03:32:10.905494 5221 tablet_bootstrap.cc:492] T 8177d088f97c4dd4b031a1c9e7eae427 P e1270a01a1c04e8c9013a17569afebf5: Bootstrap starting.
I20250625 03:32:10.913620 5221 tablet_bootstrap.cc:654] T 8177d088f97c4dd4b031a1c9e7eae427 P e1270a01a1c04e8c9013a17569afebf5: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:10.922700 5221 tablet_bootstrap.cc:492] T 8177d088f97c4dd4b031a1c9e7eae427 P e1270a01a1c04e8c9013a17569afebf5: No bootstrap required, opened a new log
I20250625 03:32:10.923271 5221 ts_tablet_manager.cc:1397] T 8177d088f97c4dd4b031a1c9e7eae427 P e1270a01a1c04e8c9013a17569afebf5: Time spent bootstrapping tablet: real 0.018s user 0.010s sys 0.005s
I20250625 03:32:10.926079 5221 raft_consensus.cc:357] T 8177d088f97c4dd4b031a1c9e7eae427 P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.926844 5221 raft_consensus.cc:383] T 8177d088f97c4dd4b031a1c9e7eae427 P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:10.927255 5221 raft_consensus.cc:738] T 8177d088f97c4dd4b031a1c9e7eae427 P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1270a01a1c04e8c9013a17569afebf5, State: Initialized, Role: FOLLOWER
I20250625 03:32:10.927846 5221 consensus_queue.cc:260] T 8177d088f97c4dd4b031a1c9e7eae427 P e1270a01a1c04e8c9013a17569afebf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.930024 5221 ts_tablet_manager.cc:1428] T 8177d088f97c4dd4b031a1c9e7eae427 P e1270a01a1c04e8c9013a17569afebf5: Time spent starting tablet: real 0.006s user 0.003s sys 0.002s
I20250625 03:32:10.944096 5262 raft_consensus.cc:491] T b7f4f7f28226468ea72e221eac6a1fdb P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:32:10.944509 5262 raft_consensus.cc:513] T b7f4f7f28226468ea72e221eac6a1fdb P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.946401 5262 leader_election.cc:290] T b7f4f7f28226468ea72e221eac6a1fdb P 21b63b7bf1b94396bf2ea6cc8359f4e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130:41071), c37a035bb2d44c709a64f282940bdc6b (127.0.106.131:35169)
I20250625 03:32:10.946988 5005 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b7f4f7f28226468ea72e221eac6a1fdb" candidate_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1270a01a1c04e8c9013a17569afebf5" is_pre_election: true
I20250625 03:32:10.947243 5079 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b7f4f7f28226468ea72e221eac6a1fdb" candidate_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c37a035bb2d44c709a64f282940bdc6b" is_pre_election: true
I20250625 03:32:10.947530 5005 raft_consensus.cc:2466] T b7f4f7f28226468ea72e221eac6a1fdb P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21b63b7bf1b94396bf2ea6cc8359f4e5 in term 0.
I20250625 03:32:10.947865 5079 raft_consensus.cc:2466] T b7f4f7f28226468ea72e221eac6a1fdb P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21b63b7bf1b94396bf2ea6cc8359f4e5 in term 0.
I20250625 03:32:10.948406 4893 leader_election.cc:304] T b7f4f7f28226468ea72e221eac6a1fdb P 21b63b7bf1b94396bf2ea6cc8359f4e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b63b7bf1b94396bf2ea6cc8359f4e5, e1270a01a1c04e8c9013a17569afebf5; no voters:
I20250625 03:32:10.949075 5262 raft_consensus.cc:2802] T b7f4f7f28226468ea72e221eac6a1fdb P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:32:10.949353 5262 raft_consensus.cc:491] T b7f4f7f28226468ea72e221eac6a1fdb P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:32:10.949590 5262 raft_consensus.cc:3058] T b7f4f7f28226468ea72e221eac6a1fdb P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:10.954579 5262 raft_consensus.cc:513] T b7f4f7f28226468ea72e221eac6a1fdb P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.956046 5262 leader_election.cc:290] T b7f4f7f28226468ea72e221eac6a1fdb P 21b63b7bf1b94396bf2ea6cc8359f4e5 [CANDIDATE]: Term 1 election: Requested vote from peers e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130:41071), c37a035bb2d44c709a64f282940bdc6b (127.0.106.131:35169)
I20250625 03:32:10.956883 5005 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b7f4f7f28226468ea72e221eac6a1fdb" candidate_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1270a01a1c04e8c9013a17569afebf5"
I20250625 03:32:10.956980 5079 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b7f4f7f28226468ea72e221eac6a1fdb" candidate_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c37a035bb2d44c709a64f282940bdc6b"
I20250625 03:32:10.957437 5005 raft_consensus.cc:3058] T b7f4f7f28226468ea72e221eac6a1fdb P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:10.957530 5079 raft_consensus.cc:3058] T b7f4f7f28226468ea72e221eac6a1fdb P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:10.962313 5005 raft_consensus.cc:2466] T b7f4f7f28226468ea72e221eac6a1fdb P e1270a01a1c04e8c9013a17569afebf5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21b63b7bf1b94396bf2ea6cc8359f4e5 in term 1.
I20250625 03:32:10.962576 5079 raft_consensus.cc:2466] T b7f4f7f28226468ea72e221eac6a1fdb P c37a035bb2d44c709a64f282940bdc6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21b63b7bf1b94396bf2ea6cc8359f4e5 in term 1.
I20250625 03:32:10.963321 4893 leader_election.cc:304] T b7f4f7f28226468ea72e221eac6a1fdb P 21b63b7bf1b94396bf2ea6cc8359f4e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b63b7bf1b94396bf2ea6cc8359f4e5, e1270a01a1c04e8c9013a17569afebf5; no voters:
I20250625 03:32:10.964133 5262 raft_consensus.cc:2802] T b7f4f7f28226468ea72e221eac6a1fdb P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:32:10.964505 5262 raft_consensus.cc:695] T b7f4f7f28226468ea72e221eac6a1fdb P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 1 LEADER]: Becoming Leader. State: Replica: 21b63b7bf1b94396bf2ea6cc8359f4e5, State: Running, Role: LEADER
I20250625 03:32:10.965184 5262 consensus_queue.cc:237] T b7f4f7f28226468ea72e221eac6a1fdb P 21b63b7bf1b94396bf2ea6cc8359f4e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.974042 4824 catalog_manager.cc:5582] T b7f4f7f28226468ea72e221eac6a1fdb P 21b63b7bf1b94396bf2ea6cc8359f4e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129). New cstate: current_term: 1 leader_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } health_report { overall_health: UNKNOWN } } }
I20250625 03:32:10.981194 5262 raft_consensus.cc:491] T 65572804041f4d5591d561279d92cd49 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:32:10.981794 5262 raft_consensus.cc:513] T 65572804041f4d5591d561279d92cd49 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:10.983296 5262 leader_election.cc:290] T 65572804041f4d5591d561279d92cd49 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130:41071), c37a035bb2d44c709a64f282940bdc6b (127.0.106.131:35169)
I20250625 03:32:10.984117 5005 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "65572804041f4d5591d561279d92cd49" candidate_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1270a01a1c04e8c9013a17569afebf5" is_pre_election: true
I20250625 03:32:10.984266 5079 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "65572804041f4d5591d561279d92cd49" candidate_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c37a035bb2d44c709a64f282940bdc6b" is_pre_election: true
I20250625 03:32:10.984799 5005 raft_consensus.cc:2391] T 65572804041f4d5591d561279d92cd49 P e1270a01a1c04e8c9013a17569afebf5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21b63b7bf1b94396bf2ea6cc8359f4e5 in current term 1: Already voted for candidate c37a035bb2d44c709a64f282940bdc6b in this term.
I20250625 03:32:10.985734 4893 leader_election.cc:304] T 65572804041f4d5591d561279d92cd49 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21b63b7bf1b94396bf2ea6cc8359f4e5; no voters: c37a035bb2d44c709a64f282940bdc6b, e1270a01a1c04e8c9013a17569afebf5
I20250625 03:32:10.986398 5262 raft_consensus.cc:3058] T 65572804041f4d5591d561279d92cd49 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:10.991410 5262 raft_consensus.cc:2747] T 65572804041f4d5591d561279d92cd49 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:32:11.008872 5126 raft_consensus.cc:491] T 53747834cb32485eb3f79f699e401024 P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:32:11.009460 5126 raft_consensus.cc:513] T 53747834cb32485eb3f79f699e401024 P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:11.011008 5126 leader_election.cc:290] T 53747834cb32485eb3f79f699e401024 P e1270a01a1c04e8c9013a17569afebf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373), c37a035bb2d44c709a64f282940bdc6b (127.0.106.131:35169)
I20250625 03:32:11.011778 4930 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "53747834cb32485eb3f79f699e401024" candidate_uuid: "e1270a01a1c04e8c9013a17569afebf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" is_pre_election: true
I20250625 03:32:11.011929 5079 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "53747834cb32485eb3f79f699e401024" candidate_uuid: "e1270a01a1c04e8c9013a17569afebf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c37a035bb2d44c709a64f282940bdc6b" is_pre_election: true
I20250625 03:32:11.012521 4930 raft_consensus.cc:2391] T 53747834cb32485eb3f79f699e401024 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e1270a01a1c04e8c9013a17569afebf5 in current term 1: Already voted for candidate c37a035bb2d44c709a64f282940bdc6b in this term.
I20250625 03:32:11.013347 4969 leader_election.cc:304] T 53747834cb32485eb3f79f699e401024 P e1270a01a1c04e8c9013a17569afebf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1270a01a1c04e8c9013a17569afebf5; no voters: 21b63b7bf1b94396bf2ea6cc8359f4e5, c37a035bb2d44c709a64f282940bdc6b
I20250625 03:32:11.013968 5126 raft_consensus.cc:3058] T 53747834cb32485eb3f79f699e401024 P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:11.019017 5126 raft_consensus.cc:2747] T 53747834cb32485eb3f79f699e401024 P e1270a01a1c04e8c9013a17569afebf5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:32:11.024318 5127 raft_consensus.cc:491] T b21ac1fdf14d484daf2e5e657e2fdc6d P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:32:11.024823 5127 raft_consensus.cc:513] T b21ac1fdf14d484daf2e5e657e2fdc6d P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:11.026504 5127 leader_election.cc:290] T b21ac1fdf14d484daf2e5e657e2fdc6d P c37a035bb2d44c709a64f282940bdc6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373), e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130:41071)
I20250625 03:32:11.027208 4930 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b21ac1fdf14d484daf2e5e657e2fdc6d" candidate_uuid: "c37a035bb2d44c709a64f282940bdc6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" is_pre_election: true
I20250625 03:32:11.027374 5005 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b21ac1fdf14d484daf2e5e657e2fdc6d" candidate_uuid: "c37a035bb2d44c709a64f282940bdc6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1270a01a1c04e8c9013a17569afebf5" is_pre_election: true
I20250625 03:32:11.027850 4930 raft_consensus.cc:2466] T b21ac1fdf14d484daf2e5e657e2fdc6d P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c37a035bb2d44c709a64f282940bdc6b in term 0.
I20250625 03:32:11.027976 5005 raft_consensus.cc:2466] T b21ac1fdf14d484daf2e5e657e2fdc6d P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c37a035bb2d44c709a64f282940bdc6b in term 0.
I20250625 03:32:11.028815 5043 leader_election.cc:304] T b21ac1fdf14d484daf2e5e657e2fdc6d P c37a035bb2d44c709a64f282940bdc6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b63b7bf1b94396bf2ea6cc8359f4e5, c37a035bb2d44c709a64f282940bdc6b; no voters:
I20250625 03:32:11.029482 5127 raft_consensus.cc:2802] T b21ac1fdf14d484daf2e5e657e2fdc6d P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:32:11.029736 5127 raft_consensus.cc:491] T b21ac1fdf14d484daf2e5e657e2fdc6d P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:32:11.030009 5127 raft_consensus.cc:3058] T b21ac1fdf14d484daf2e5e657e2fdc6d P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:11.035292 5127 raft_consensus.cc:513] T b21ac1fdf14d484daf2e5e657e2fdc6d P c37a035bb2d44c709a64f282940bdc6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:11.036963 5127 leader_election.cc:290] T b21ac1fdf14d484daf2e5e657e2fdc6d P c37a035bb2d44c709a64f282940bdc6b [CANDIDATE]: Term 1 election: Requested vote from peers 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373), e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130:41071)
I20250625 03:32:11.037940 5005 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b21ac1fdf14d484daf2e5e657e2fdc6d" candidate_uuid: "c37a035bb2d44c709a64f282940bdc6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1270a01a1c04e8c9013a17569afebf5"
I20250625 03:32:11.037900 4930 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b21ac1fdf14d484daf2e5e657e2fdc6d" candidate_uuid: "c37a035bb2d44c709a64f282940bdc6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5"
I20250625 03:32:11.038625 5005 raft_consensus.cc:3058] T b21ac1fdf14d484daf2e5e657e2fdc6d P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:11.038688 4930 raft_consensus.cc:3058] T b21ac1fdf14d484daf2e5e657e2fdc6d P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:11.043200 5005 raft_consensus.cc:2466] T b21ac1fdf14d484daf2e5e657e2fdc6d P e1270a01a1c04e8c9013a17569afebf5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c37a035bb2d44c709a64f282940bdc6b in term 1.
I20250625 03:32:11.044184 5042 leader_election.cc:304] T b21ac1fdf14d484daf2e5e657e2fdc6d P c37a035bb2d44c709a64f282940bdc6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c37a035bb2d44c709a64f282940bdc6b, e1270a01a1c04e8c9013a17569afebf5; no voters:
I20250625 03:32:11.044968 5127 raft_consensus.cc:2802] T b21ac1fdf14d484daf2e5e657e2fdc6d P c37a035bb2d44c709a64f282940bdc6b [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:32:11.045356 5127 raft_consensus.cc:695] T b21ac1fdf14d484daf2e5e657e2fdc6d P c37a035bb2d44c709a64f282940bdc6b [term 1 LEADER]: Becoming Leader. State: Replica: c37a035bb2d44c709a64f282940bdc6b, State: Running, Role: LEADER
I20250625 03:32:11.045408 4930 raft_consensus.cc:2466] T b21ac1fdf14d484daf2e5e657e2fdc6d P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c37a035bb2d44c709a64f282940bdc6b in term 1.
I20250625 03:32:11.046201 5127 consensus_queue.cc:237] T b21ac1fdf14d484daf2e5e657e2fdc6d P c37a035bb2d44c709a64f282940bdc6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:11.053889 4824 catalog_manager.cc:5582] T b21ac1fdf14d484daf2e5e657e2fdc6d P c37a035bb2d44c709a64f282940bdc6b reported cstate change: term changed from 0 to 1, leader changed from <none> to c37a035bb2d44c709a64f282940bdc6b (127.0.106.131). New cstate: current_term: 1 leader_uuid: "c37a035bb2d44c709a64f282940bdc6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } health_report { overall_health: HEALTHY } } }
I20250625 03:32:11.085153 5005 raft_consensus.cc:3058] T 8177d088f97c4dd4b031a1c9e7eae427 P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:11.090950 5127 consensus_queue.cc:1035] T 8177d088f97c4dd4b031a1c9e7eae427 P c37a035bb2d44c709a64f282940bdc6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:32:11.099797 5262 raft_consensus.cc:491] T 149bd3c081bc4cf0a4de280a4dd4fd1b P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:32:11.100432 5262 raft_consensus.cc:513] T 149bd3c081bc4cf0a4de280a4dd4fd1b P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:11.102533 5262 leader_election.cc:290] T 149bd3c081bc4cf0a4de280a4dd4fd1b P 21b63b7bf1b94396bf2ea6cc8359f4e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130:41071), c37a035bb2d44c709a64f282940bdc6b (127.0.106.131:35169)
I20250625 03:32:11.103639 5079 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "149bd3c081bc4cf0a4de280a4dd4fd1b" candidate_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c37a035bb2d44c709a64f282940bdc6b" is_pre_election: true
I20250625 03:32:11.103706 5004 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "149bd3c081bc4cf0a4de280a4dd4fd1b" candidate_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1270a01a1c04e8c9013a17569afebf5" is_pre_election: true
I20250625 03:32:11.104635 5004 raft_consensus.cc:2391] T 149bd3c081bc4cf0a4de280a4dd4fd1b P e1270a01a1c04e8c9013a17569afebf5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21b63b7bf1b94396bf2ea6cc8359f4e5 in current term 1: Already voted for candidate c37a035bb2d44c709a64f282940bdc6b in this term.
I20250625 03:32:11.105863 4893 leader_election.cc:304] T 149bd3c081bc4cf0a4de280a4dd4fd1b P 21b63b7bf1b94396bf2ea6cc8359f4e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21b63b7bf1b94396bf2ea6cc8359f4e5; no voters: c37a035bb2d44c709a64f282940bdc6b, e1270a01a1c04e8c9013a17569afebf5
I20250625 03:32:11.106069 5127 consensus_queue.cc:1035] T 8177d088f97c4dd4b031a1c9e7eae427 P c37a035bb2d44c709a64f282940bdc6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:32:11.107044 5262 raft_consensus.cc:3058] T 149bd3c081bc4cf0a4de280a4dd4fd1b P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:11.114697 5262 raft_consensus.cc:2747] T 149bd3c081bc4cf0a4de280a4dd4fd1b P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:32:11.152189 5238 raft_consensus.cc:491] T 40422f6c986f41ae8c8067019d882fb2 P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:32:11.152680 5238 raft_consensus.cc:513] T 40422f6c986f41ae8c8067019d882fb2 P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:11.154515 5238 leader_election.cc:290] T 40422f6c986f41ae8c8067019d882fb2 P c37a035bb2d44c709a64f282940bdc6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373), e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130:41071)
I20250625 03:32:11.155360 4930 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "40422f6c986f41ae8c8067019d882fb2" candidate_uuid: "c37a035bb2d44c709a64f282940bdc6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" is_pre_election: true
I20250625 03:32:11.155472 5005 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "40422f6c986f41ae8c8067019d882fb2" candidate_uuid: "c37a035bb2d44c709a64f282940bdc6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1270a01a1c04e8c9013a17569afebf5" is_pre_election: true
I20250625 03:32:11.155953 4930 raft_consensus.cc:2466] T 40422f6c986f41ae8c8067019d882fb2 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c37a035bb2d44c709a64f282940bdc6b in term 0.
I20250625 03:32:11.156069 5005 raft_consensus.cc:2466] T 40422f6c986f41ae8c8067019d882fb2 P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c37a035bb2d44c709a64f282940bdc6b in term 0.
I20250625 03:32:11.156908 5043 leader_election.cc:304] T 40422f6c986f41ae8c8067019d882fb2 P c37a035bb2d44c709a64f282940bdc6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b63b7bf1b94396bf2ea6cc8359f4e5, c37a035bb2d44c709a64f282940bdc6b; no voters:
I20250625 03:32:11.157549 5238 raft_consensus.cc:2802] T 40422f6c986f41ae8c8067019d882fb2 P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:32:11.157859 5238 raft_consensus.cc:491] T 40422f6c986f41ae8c8067019d882fb2 P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:32:11.158113 5238 raft_consensus.cc:3058] T 40422f6c986f41ae8c8067019d882fb2 P c37a035bb2d44c709a64f282940bdc6b [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:11.162961 5238 raft_consensus.cc:513] T 40422f6c986f41ae8c8067019d882fb2 P c37a035bb2d44c709a64f282940bdc6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:11.164521 5238 leader_election.cc:290] T 40422f6c986f41ae8c8067019d882fb2 P c37a035bb2d44c709a64f282940bdc6b [CANDIDATE]: Term 1 election: Requested vote from peers 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373), e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130:41071)
I20250625 03:32:11.165477 5005 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "40422f6c986f41ae8c8067019d882fb2" candidate_uuid: "c37a035bb2d44c709a64f282940bdc6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1270a01a1c04e8c9013a17569afebf5"
I20250625 03:32:11.165488 4930 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "40422f6c986f41ae8c8067019d882fb2" candidate_uuid: "c37a035bb2d44c709a64f282940bdc6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5"
I20250625 03:32:11.166018 5005 raft_consensus.cc:3058] T 40422f6c986f41ae8c8067019d882fb2 P e1270a01a1c04e8c9013a17569afebf5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:11.166191 4930 raft_consensus.cc:3058] T 40422f6c986f41ae8c8067019d882fb2 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:11.170389 5005 raft_consensus.cc:2466] T 40422f6c986f41ae8c8067019d882fb2 P e1270a01a1c04e8c9013a17569afebf5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c37a035bb2d44c709a64f282940bdc6b in term 1.
I20250625 03:32:11.170888 4930 raft_consensus.cc:2466] T 40422f6c986f41ae8c8067019d882fb2 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c37a035bb2d44c709a64f282940bdc6b in term 1.
I20250625 03:32:11.171293 5042 leader_election.cc:304] T 40422f6c986f41ae8c8067019d882fb2 P c37a035bb2d44c709a64f282940bdc6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c37a035bb2d44c709a64f282940bdc6b, e1270a01a1c04e8c9013a17569afebf5; no voters:
I20250625 03:32:11.172150 5238 raft_consensus.cc:2802] T 40422f6c986f41ae8c8067019d882fb2 P c37a035bb2d44c709a64f282940bdc6b [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:32:11.172616 5238 raft_consensus.cc:695] T 40422f6c986f41ae8c8067019d882fb2 P c37a035bb2d44c709a64f282940bdc6b [term 1 LEADER]: Becoming Leader. State: Replica: c37a035bb2d44c709a64f282940bdc6b, State: Running, Role: LEADER
I20250625 03:32:11.173331 5238 consensus_queue.cc:237] T 40422f6c986f41ae8c8067019d882fb2 P c37a035bb2d44c709a64f282940bdc6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:11.180927 4824 catalog_manager.cc:5582] T 40422f6c986f41ae8c8067019d882fb2 P c37a035bb2d44c709a64f282940bdc6b reported cstate change: term changed from 0 to 1, leader changed from <none> to c37a035bb2d44c709a64f282940bdc6b (127.0.106.131). New cstate: current_term: 1 leader_uuid: "c37a035bb2d44c709a64f282940bdc6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } health_report { overall_health: HEALTHY } } }
I20250625 03:32:11.199373 5238 consensus_queue.cc:1035] T 149bd3c081bc4cf0a4de280a4dd4fd1b P c37a035bb2d44c709a64f282940bdc6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:32:11.209789 5238 consensus_queue.cc:1035] T 149bd3c081bc4cf0a4de280a4dd4fd1b P c37a035bb2d44c709a64f282940bdc6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20250625 03:32:11.237133 5238 consensus_queue.cc:1035] T 05b3b289074d43638ab6ae336e13f3ef P c37a035bb2d44c709a64f282940bdc6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:32:11.237140 5126 consensus_queue.cc:1035] T 391a5defcbd64e7999b0dffb39848744 P e1270a01a1c04e8c9013a17569afebf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:32:11.248214 5239 consensus_queue.cc:1035] T 05b3b289074d43638ab6ae336e13f3ef P c37a035bb2d44c709a64f282940bdc6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:32:11.256057 5239 consensus_queue.cc:1035] T 53747834cb32485eb3f79f699e401024 P c37a035bb2d44c709a64f282940bdc6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:32:11.261042 5235 consensus_queue.cc:1035] T 391a5defcbd64e7999b0dffb39848744 P e1270a01a1c04e8c9013a17569afebf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:32:11.267827 5238 consensus_queue.cc:1035] T 53747834cb32485eb3f79f699e401024 P c37a035bb2d44c709a64f282940bdc6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:32:11.317931 5079 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "05b3b289074d43638ab6ae336e13f3ef"
dest_uuid: "c37a035bb2d44c709a64f282940bdc6b"
mode: GRACEFUL
new_leader_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5"
from {username='slave'} at 127.0.0.1:39616
I20250625 03:32:11.318466 5079 raft_consensus.cc:604] T 05b3b289074d43638ab6ae336e13f3ef P c37a035bb2d44c709a64f282940bdc6b [term 1 LEADER]: Received request to transfer leadership to TS 21b63b7bf1b94396bf2ea6cc8359f4e5
I20250625 03:32:11.323861 5079 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "40422f6c986f41ae8c8067019d882fb2"
dest_uuid: "c37a035bb2d44c709a64f282940bdc6b"
mode: GRACEFUL
new_leader_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5"
from {username='slave'} at 127.0.0.1:39616
I20250625 03:32:11.324471 5079 raft_consensus.cc:604] T 40422f6c986f41ae8c8067019d882fb2 P c37a035bb2d44c709a64f282940bdc6b [term 1 LEADER]: Received request to transfer leadership to TS 21b63b7bf1b94396bf2ea6cc8359f4e5
I20250625 03:32:11.329564 5004 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "391a5defcbd64e7999b0dffb39848744"
dest_uuid: "e1270a01a1c04e8c9013a17569afebf5"
mode: GRACEFUL
new_leader_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5"
from {username='slave'} at 127.0.0.1:54568
I20250625 03:32:11.330204 5004 raft_consensus.cc:604] T 391a5defcbd64e7999b0dffb39848744 P e1270a01a1c04e8c9013a17569afebf5 [term 1 LEADER]: Received request to transfer leadership to TS 21b63b7bf1b94396bf2ea6cc8359f4e5
I20250625 03:32:11.333874 5239 consensus_queue.cc:1035] T 65572804041f4d5591d561279d92cd49 P c37a035bb2d44c709a64f282940bdc6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:32:11.335736 5079 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "8177d088f97c4dd4b031a1c9e7eae427"
dest_uuid: "c37a035bb2d44c709a64f282940bdc6b"
mode: GRACEFUL
new_leader_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5"
from {username='slave'} at 127.0.0.1:39616
I20250625 03:32:11.336304 5079 raft_consensus.cc:604] T 8177d088f97c4dd4b031a1c9e7eae427 P c37a035bb2d44c709a64f282940bdc6b [term 1 LEADER]: Received request to transfer leadership to TS 21b63b7bf1b94396bf2ea6cc8359f4e5
I20250625 03:32:11.343489 5079 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "53747834cb32485eb3f79f699e401024"
dest_uuid: "c37a035bb2d44c709a64f282940bdc6b"
mode: GRACEFUL
new_leader_uuid: "e1270a01a1c04e8c9013a17569afebf5"
from {username='slave'} at 127.0.0.1:39616
I20250625 03:32:11.344108 5079 raft_consensus.cc:604] T 53747834cb32485eb3f79f699e401024 P c37a035bb2d44c709a64f282940bdc6b [term 1 LEADER]: Received request to transfer leadership to TS e1270a01a1c04e8c9013a17569afebf5
I20250625 03:32:11.348865 5239 consensus_queue.cc:1035] T 65572804041f4d5591d561279d92cd49 P c37a035bb2d44c709a64f282940bdc6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:32:11.353924 5078 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "65572804041f4d5591d561279d92cd49"
dest_uuid: "c37a035bb2d44c709a64f282940bdc6b"
mode: GRACEFUL
new_leader_uuid: "e1270a01a1c04e8c9013a17569afebf5"
from {username='slave'} at 127.0.0.1:39616
I20250625 03:32:11.354610 5078 raft_consensus.cc:604] T 65572804041f4d5591d561279d92cd49 P c37a035bb2d44c709a64f282940bdc6b [term 1 LEADER]: Received request to transfer leadership to TS e1270a01a1c04e8c9013a17569afebf5
I20250625 03:32:11.363112 5078 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "b21ac1fdf14d484daf2e5e657e2fdc6d"
dest_uuid: "c37a035bb2d44c709a64f282940bdc6b"
mode: GRACEFUL
new_leader_uuid: "e1270a01a1c04e8c9013a17569afebf5"
from {username='slave'} at 127.0.0.1:39616
I20250625 03:32:11.363737 5078 raft_consensus.cc:604] T b21ac1fdf14d484daf2e5e657e2fdc6d P c37a035bb2d44c709a64f282940bdc6b [term 1 LEADER]: Received request to transfer leadership to TS e1270a01a1c04e8c9013a17569afebf5
I20250625 03:32:11.369185 5078 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "149bd3c081bc4cf0a4de280a4dd4fd1b"
dest_uuid: "c37a035bb2d44c709a64f282940bdc6b"
mode: GRACEFUL
new_leader_uuid: "e1270a01a1c04e8c9013a17569afebf5"
from {username='slave'} at 127.0.0.1:39616
I20250625 03:32:11.369709 5078 raft_consensus.cc:604] T 149bd3c081bc4cf0a4de280a4dd4fd1b P c37a035bb2d44c709a64f282940bdc6b [term 1 LEADER]: Received request to transfer leadership to TS e1270a01a1c04e8c9013a17569afebf5
I20250625 03:32:11.374709 4929 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "b7f4f7f28226468ea72e221eac6a1fdb"
dest_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5"
mode: GRACEFUL
new_leader_uuid: "c37a035bb2d44c709a64f282940bdc6b"
from {username='slave'} at 127.0.0.1:51692
I20250625 03:32:11.375244 4929 raft_consensus.cc:604] T b7f4f7f28226468ea72e221eac6a1fdb P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 1 LEADER]: Received request to transfer leadership to TS c37a035bb2d44c709a64f282940bdc6b
I20250625 03:32:11.474731 5239 consensus_queue.cc:1035] T b21ac1fdf14d484daf2e5e657e2fdc6d P c37a035bb2d44c709a64f282940bdc6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:32:11.484408 5239 consensus_queue.cc:1035] T b21ac1fdf14d484daf2e5e657e2fdc6d P c37a035bb2d44c709a64f282940bdc6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:32:11.492465 5262 consensus_queue.cc:1035] T b7f4f7f28226468ea72e221eac6a1fdb P 21b63b7bf1b94396bf2ea6cc8359f4e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:32:11.493767 5127 raft_consensus.cc:991] T b21ac1fdf14d484daf2e5e657e2fdc6d P c37a035bb2d44c709a64f282940bdc6b: : Instructing follower e1270a01a1c04e8c9013a17569afebf5 to start an election
I20250625 03:32:11.494426 5127 raft_consensus.cc:1079] T b21ac1fdf14d484daf2e5e657e2fdc6d P c37a035bb2d44c709a64f282940bdc6b [term 1 LEADER]: Signalling peer e1270a01a1c04e8c9013a17569afebf5 to start an election
I20250625 03:32:11.496711 5004 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "b21ac1fdf14d484daf2e5e657e2fdc6d"
dest_uuid: "e1270a01a1c04e8c9013a17569afebf5"
from {username='slave'} at 127.0.0.1:54552
I20250625 03:32:11.499435 5004 raft_consensus.cc:491] T b21ac1fdf14d484daf2e5e657e2fdc6d P e1270a01a1c04e8c9013a17569afebf5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:32:11.499881 5004 raft_consensus.cc:3058] T b21ac1fdf14d484daf2e5e657e2fdc6d P e1270a01a1c04e8c9013a17569afebf5 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:11.503144 5263 raft_consensus.cc:991] T b7f4f7f28226468ea72e221eac6a1fdb P 21b63b7bf1b94396bf2ea6cc8359f4e5: : Instructing follower c37a035bb2d44c709a64f282940bdc6b to start an election
I20250625 03:32:11.503983 5262 raft_consensus.cc:1079] T b7f4f7f28226468ea72e221eac6a1fdb P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 1 LEADER]: Signalling peer c37a035bb2d44c709a64f282940bdc6b to start an election
I20250625 03:32:11.506372 5079 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "b7f4f7f28226468ea72e221eac6a1fdb"
dest_uuid: "c37a035bb2d44c709a64f282940bdc6b"
from {username='slave'} at 127.0.0.1:39602
I20250625 03:32:11.507795 5079 raft_consensus.cc:491] T b7f4f7f28226468ea72e221eac6a1fdb P c37a035bb2d44c709a64f282940bdc6b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:32:11.508205 5079 raft_consensus.cc:3058] T b7f4f7f28226468ea72e221eac6a1fdb P c37a035bb2d44c709a64f282940bdc6b [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:11.508086 5004 raft_consensus.cc:513] T b21ac1fdf14d484daf2e5e657e2fdc6d P e1270a01a1c04e8c9013a17569afebf5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:11.511291 5262 consensus_queue.cc:1035] T b7f4f7f28226468ea72e221eac6a1fdb P 21b63b7bf1b94396bf2ea6cc8359f4e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:32:11.511922 5004 leader_election.cc:290] T b21ac1fdf14d484daf2e5e657e2fdc6d P e1270a01a1c04e8c9013a17569afebf5 [CANDIDATE]: Term 2 election: Requested vote from peers 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373), c37a035bb2d44c709a64f282940bdc6b (127.0.106.131:35169)
I20250625 03:32:11.512214 5077 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b21ac1fdf14d484daf2e5e657e2fdc6d" candidate_uuid: "e1270a01a1c04e8c9013a17569afebf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c37a035bb2d44c709a64f282940bdc6b"
I20250625 03:32:11.512933 5077 raft_consensus.cc:3053] T b21ac1fdf14d484daf2e5e657e2fdc6d P c37a035bb2d44c709a64f282940bdc6b [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:32:11.513273 5077 raft_consensus.cc:738] T b21ac1fdf14d484daf2e5e657e2fdc6d P c37a035bb2d44c709a64f282940bdc6b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c37a035bb2d44c709a64f282940bdc6b, State: Running, Role: LEADER
I20250625 03:32:11.514062 5077 consensus_queue.cc:260] T b21ac1fdf14d484daf2e5e657e2fdc6d P c37a035bb2d44c709a64f282940bdc6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:11.515388 5077 raft_consensus.cc:3058] T b21ac1fdf14d484daf2e5e657e2fdc6d P c37a035bb2d44c709a64f282940bdc6b [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:11.517892 5079 raft_consensus.cc:513] T b7f4f7f28226468ea72e221eac6a1fdb P c37a035bb2d44c709a64f282940bdc6b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:11.518937 4929 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b21ac1fdf14d484daf2e5e657e2fdc6d" candidate_uuid: "e1270a01a1c04e8c9013a17569afebf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5"
I20250625 03:32:11.519608 4929 raft_consensus.cc:3058] T b21ac1fdf14d484daf2e5e657e2fdc6d P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:11.523921 5077 raft_consensus.cc:2466] T b21ac1fdf14d484daf2e5e657e2fdc6d P c37a035bb2d44c709a64f282940bdc6b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1270a01a1c04e8c9013a17569afebf5 in term 2.
I20250625 03:32:11.525234 4930 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b7f4f7f28226468ea72e221eac6a1fdb" candidate_uuid: "c37a035bb2d44c709a64f282940bdc6b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5"
I20250625 03:32:11.525898 4930 raft_consensus.cc:3053] T b7f4f7f28226468ea72e221eac6a1fdb P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:32:11.526230 4930 raft_consensus.cc:738] T b7f4f7f28226468ea72e221eac6a1fdb P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 21b63b7bf1b94396bf2ea6cc8359f4e5, State: Running, Role: LEADER
I20250625 03:32:11.526501 5005 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b7f4f7f28226468ea72e221eac6a1fdb" candidate_uuid: "c37a035bb2d44c709a64f282940bdc6b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e1270a01a1c04e8c9013a17569afebf5"
I20250625 03:32:11.527069 4929 raft_consensus.cc:2466] T b21ac1fdf14d484daf2e5e657e2fdc6d P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1270a01a1c04e8c9013a17569afebf5 in term 2.
I20250625 03:32:11.526976 4930 consensus_queue.cc:260] T b7f4f7f28226468ea72e221eac6a1fdb P 21b63b7bf1b94396bf2ea6cc8359f4e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:11.528142 4969 leader_election.cc:304] T b21ac1fdf14d484daf2e5e657e2fdc6d P e1270a01a1c04e8c9013a17569afebf5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b63b7bf1b94396bf2ea6cc8359f4e5, e1270a01a1c04e8c9013a17569afebf5; no voters:
I20250625 03:32:11.525298 5079 leader_election.cc:290] T b7f4f7f28226468ea72e221eac6a1fdb P c37a035bb2d44c709a64f282940bdc6b [CANDIDATE]: Term 2 election: Requested vote from peers 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373), e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130:41071)
I20250625 03:32:11.529021 5235 raft_consensus.cc:2802] T b21ac1fdf14d484daf2e5e657e2fdc6d P e1270a01a1c04e8c9013a17569afebf5 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:32:11.529554 5235 raft_consensus.cc:695] T b21ac1fdf14d484daf2e5e657e2fdc6d P e1270a01a1c04e8c9013a17569afebf5 [term 2 LEADER]: Becoming Leader. State: Replica: e1270a01a1c04e8c9013a17569afebf5, State: Running, Role: LEADER
I20250625 03:32:11.528566 4930 raft_consensus.cc:3058] T b7f4f7f28226468ea72e221eac6a1fdb P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:11.530617 5235 consensus_queue.cc:237] T b21ac1fdf14d484daf2e5e657e2fdc6d P e1270a01a1c04e8c9013a17569afebf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:11.539261 4930 raft_consensus.cc:2466] T b7f4f7f28226468ea72e221eac6a1fdb P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c37a035bb2d44c709a64f282940bdc6b in term 2.
I20250625 03:32:11.540509 5043 leader_election.cc:304] T b7f4f7f28226468ea72e221eac6a1fdb P c37a035bb2d44c709a64f282940bdc6b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21b63b7bf1b94396bf2ea6cc8359f4e5, c37a035bb2d44c709a64f282940bdc6b; no voters: e1270a01a1c04e8c9013a17569afebf5
I20250625 03:32:11.541420 5127 raft_consensus.cc:2802] T b7f4f7f28226468ea72e221eac6a1fdb P c37a035bb2d44c709a64f282940bdc6b [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:32:11.541828 5127 raft_consensus.cc:695] T b7f4f7f28226468ea72e221eac6a1fdb P c37a035bb2d44c709a64f282940bdc6b [term 2 LEADER]: Becoming Leader. State: Replica: c37a035bb2d44c709a64f282940bdc6b, State: Running, Role: LEADER
I20250625 03:32:11.542526 5127 consensus_queue.cc:237] T b7f4f7f28226468ea72e221eac6a1fdb P c37a035bb2d44c709a64f282940bdc6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:11.546561 4825 catalog_manager.cc:5582] T b21ac1fdf14d484daf2e5e657e2fdc6d P e1270a01a1c04e8c9013a17569afebf5 reported cstate change: term changed from 1 to 2, leader changed from c37a035bb2d44c709a64f282940bdc6b (127.0.106.131) to e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130). New cstate: current_term: 2 leader_uuid: "e1270a01a1c04e8c9013a17569afebf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } health_report { overall_health: UNKNOWN } } }
I20250625 03:32:11.555348 4828 catalog_manager.cc:5582] T b7f4f7f28226468ea72e221eac6a1fdb P c37a035bb2d44c709a64f282940bdc6b reported cstate change: term changed from 1 to 2, leader changed from 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129) to c37a035bb2d44c709a64f282940bdc6b (127.0.106.131). New cstate: current_term: 2 leader_uuid: "c37a035bb2d44c709a64f282940bdc6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } health_report { overall_health: HEALTHY } } }
I20250625 03:32:11.601131 5239 raft_consensus.cc:991] T 8177d088f97c4dd4b031a1c9e7eae427 P c37a035bb2d44c709a64f282940bdc6b: : Instructing follower 21b63b7bf1b94396bf2ea6cc8359f4e5 to start an election
I20250625 03:32:11.601612 5127 raft_consensus.cc:1079] T 8177d088f97c4dd4b031a1c9e7eae427 P c37a035bb2d44c709a64f282940bdc6b [term 1 LEADER]: Signalling peer 21b63b7bf1b94396bf2ea6cc8359f4e5 to start an election
I20250625 03:32:11.602991 4930 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "8177d088f97c4dd4b031a1c9e7eae427"
dest_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5"
from {username='slave'} at 127.0.0.1:51676
I20250625 03:32:11.603570 4930 raft_consensus.cc:491] T 8177d088f97c4dd4b031a1c9e7eae427 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:32:11.603967 4930 raft_consensus.cc:3058] T 8177d088f97c4dd4b031a1c9e7eae427 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:11.609386 4930 raft_consensus.cc:513] T 8177d088f97c4dd4b031a1c9e7eae427 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:11.610824 4930 leader_election.cc:290] T 8177d088f97c4dd4b031a1c9e7eae427 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [CANDIDATE]: Term 2 election: Requested vote from peers e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130:41071), c37a035bb2d44c709a64f282940bdc6b (127.0.106.131:35169)
I20250625 03:32:11.611824 5004 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8177d088f97c4dd4b031a1c9e7eae427" candidate_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e1270a01a1c04e8c9013a17569afebf5"
I20250625 03:32:11.612052 5079 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8177d088f97c4dd4b031a1c9e7eae427" candidate_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c37a035bb2d44c709a64f282940bdc6b"
I20250625 03:32:11.612634 5004 raft_consensus.cc:3058] T 8177d088f97c4dd4b031a1c9e7eae427 P e1270a01a1c04e8c9013a17569afebf5 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:11.612656 5079 raft_consensus.cc:3053] T 8177d088f97c4dd4b031a1c9e7eae427 P c37a035bb2d44c709a64f282940bdc6b [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:32:11.613176 5079 raft_consensus.cc:738] T 8177d088f97c4dd4b031a1c9e7eae427 P c37a035bb2d44c709a64f282940bdc6b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c37a035bb2d44c709a64f282940bdc6b, State: Running, Role: LEADER
I20250625 03:32:11.613929 5079 consensus_queue.cc:260] T 8177d088f97c4dd4b031a1c9e7eae427 P c37a035bb2d44c709a64f282940bdc6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:11.615064 5079 raft_consensus.cc:3058] T 8177d088f97c4dd4b031a1c9e7eae427 P c37a035bb2d44c709a64f282940bdc6b [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:11.615651 5127 consensus_queue.cc:1035] T 40422f6c986f41ae8c8067019d882fb2 P c37a035bb2d44c709a64f282940bdc6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:32:11.620110 5004 raft_consensus.cc:2466] T 8177d088f97c4dd4b031a1c9e7eae427 P e1270a01a1c04e8c9013a17569afebf5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21b63b7bf1b94396bf2ea6cc8359f4e5 in term 2.
I20250625 03:32:11.621682 4893 leader_election.cc:304] T 8177d088f97c4dd4b031a1c9e7eae427 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b63b7bf1b94396bf2ea6cc8359f4e5, e1270a01a1c04e8c9013a17569afebf5; no voters:
I20250625 03:32:11.622025 5079 raft_consensus.cc:2466] T 8177d088f97c4dd4b031a1c9e7eae427 P c37a035bb2d44c709a64f282940bdc6b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21b63b7bf1b94396bf2ea6cc8359f4e5 in term 2.
I20250625 03:32:11.622788 5286 raft_consensus.cc:2802] T 8177d088f97c4dd4b031a1c9e7eae427 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:32:11.623972 5286 raft_consensus.cc:695] T 8177d088f97c4dd4b031a1c9e7eae427 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 2 LEADER]: Becoming Leader. State: Replica: 21b63b7bf1b94396bf2ea6cc8359f4e5, State: Running, Role: LEADER
I20250625 03:32:11.624905 5286 consensus_queue.cc:237] T 8177d088f97c4dd4b031a1c9e7eae427 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:11.628746 5239 consensus_queue.cc:1035] T 40422f6c986f41ae8c8067019d882fb2 P c37a035bb2d44c709a64f282940bdc6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:32:11.636341 4828 catalog_manager.cc:5582] T 8177d088f97c4dd4b031a1c9e7eae427 P 21b63b7bf1b94396bf2ea6cc8359f4e5 reported cstate change: term changed from 1 to 2, leader changed from c37a035bb2d44c709a64f282940bdc6b (127.0.106.131) to 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129). New cstate: current_term: 2 leader_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } health_report { overall_health: UNKNOWN } } }
I20250625 03:32:11.638746 5238 raft_consensus.cc:991] T 40422f6c986f41ae8c8067019d882fb2 P c37a035bb2d44c709a64f282940bdc6b: : Instructing follower 21b63b7bf1b94396bf2ea6cc8359f4e5 to start an election
I20250625 03:32:11.639252 5239 raft_consensus.cc:1079] T 40422f6c986f41ae8c8067019d882fb2 P c37a035bb2d44c709a64f282940bdc6b [term 1 LEADER]: Signalling peer 21b63b7bf1b94396bf2ea6cc8359f4e5 to start an election
I20250625 03:32:11.640662 4930 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "40422f6c986f41ae8c8067019d882fb2"
dest_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5"
from {username='slave'} at 127.0.0.1:51676
I20250625 03:32:11.641125 4930 raft_consensus.cc:491] T 40422f6c986f41ae8c8067019d882fb2 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:32:11.641403 4930 raft_consensus.cc:3058] T 40422f6c986f41ae8c8067019d882fb2 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:11.647274 4930 raft_consensus.cc:513] T 40422f6c986f41ae8c8067019d882fb2 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:11.649521 5005 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "40422f6c986f41ae8c8067019d882fb2" candidate_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e1270a01a1c04e8c9013a17569afebf5"
I20250625 03:32:11.649641 4930 leader_election.cc:290] T 40422f6c986f41ae8c8067019d882fb2 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [CANDIDATE]: Term 2 election: Requested vote from peers e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130:41071), c37a035bb2d44c709a64f282940bdc6b (127.0.106.131:35169)
I20250625 03:32:11.649971 5005 raft_consensus.cc:3058] T 40422f6c986f41ae8c8067019d882fb2 P e1270a01a1c04e8c9013a17569afebf5 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:11.651110 5079 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "40422f6c986f41ae8c8067019d882fb2" candidate_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c37a035bb2d44c709a64f282940bdc6b"
I20250625 03:32:11.651547 5079 raft_consensus.cc:3053] T 40422f6c986f41ae8c8067019d882fb2 P c37a035bb2d44c709a64f282940bdc6b [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:32:11.651777 5079 raft_consensus.cc:738] T 40422f6c986f41ae8c8067019d882fb2 P c37a035bb2d44c709a64f282940bdc6b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c37a035bb2d44c709a64f282940bdc6b, State: Running, Role: LEADER
I20250625 03:32:11.652377 5079 consensus_queue.cc:260] T 40422f6c986f41ae8c8067019d882fb2 P c37a035bb2d44c709a64f282940bdc6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:11.653204 5079 raft_consensus.cc:3058] T 40422f6c986f41ae8c8067019d882fb2 P c37a035bb2d44c709a64f282940bdc6b [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:11.656260 5005 raft_consensus.cc:2466] T 40422f6c986f41ae8c8067019d882fb2 P e1270a01a1c04e8c9013a17569afebf5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21b63b7bf1b94396bf2ea6cc8359f4e5 in term 2.
I20250625 03:32:11.657194 4893 leader_election.cc:304] T 40422f6c986f41ae8c8067019d882fb2 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b63b7bf1b94396bf2ea6cc8359f4e5, e1270a01a1c04e8c9013a17569afebf5; no voters:
I20250625 03:32:11.657800 5286 raft_consensus.cc:2802] T 40422f6c986f41ae8c8067019d882fb2 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:32:11.658150 5079 raft_consensus.cc:2466] T 40422f6c986f41ae8c8067019d882fb2 P c37a035bb2d44c709a64f282940bdc6b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21b63b7bf1b94396bf2ea6cc8359f4e5 in term 2.
I20250625 03:32:11.658188 5286 raft_consensus.cc:695] T 40422f6c986f41ae8c8067019d882fb2 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 2 LEADER]: Becoming Leader. State: Replica: 21b63b7bf1b94396bf2ea6cc8359f4e5, State: Running, Role: LEADER
I20250625 03:32:11.659196 5286 consensus_queue.cc:237] T 40422f6c986f41ae8c8067019d882fb2 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:11.665321 4828 catalog_manager.cc:5582] T 40422f6c986f41ae8c8067019d882fb2 P 21b63b7bf1b94396bf2ea6cc8359f4e5 reported cstate change: term changed from 1 to 2, leader changed from c37a035bb2d44c709a64f282940bdc6b (127.0.106.131) to 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129). New cstate: current_term: 2 leader_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } health_report { overall_health: UNKNOWN } } }
I20250625 03:32:11.686750 5238 raft_consensus.cc:991] T 53747834cb32485eb3f79f699e401024 P c37a035bb2d44c709a64f282940bdc6b: : Instructing follower e1270a01a1c04e8c9013a17569afebf5 to start an election
I20250625 03:32:11.687211 5239 raft_consensus.cc:1079] T 53747834cb32485eb3f79f699e401024 P c37a035bb2d44c709a64f282940bdc6b [term 1 LEADER]: Signalling peer e1270a01a1c04e8c9013a17569afebf5 to start an election
I20250625 03:32:11.688539 5005 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "53747834cb32485eb3f79f699e401024"
dest_uuid: "e1270a01a1c04e8c9013a17569afebf5"
from {username='slave'} at 127.0.0.1:54552
I20250625 03:32:11.688973 5005 raft_consensus.cc:491] T 53747834cb32485eb3f79f699e401024 P e1270a01a1c04e8c9013a17569afebf5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:32:11.689229 5005 raft_consensus.cc:3058] T 53747834cb32485eb3f79f699e401024 P e1270a01a1c04e8c9013a17569afebf5 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:11.695675 5005 raft_consensus.cc:513] T 53747834cb32485eb3f79f699e401024 P e1270a01a1c04e8c9013a17569afebf5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:11.697314 5005 leader_election.cc:290] T 53747834cb32485eb3f79f699e401024 P e1270a01a1c04e8c9013a17569afebf5 [CANDIDATE]: Term 2 election: Requested vote from peers 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373), c37a035bb2d44c709a64f282940bdc6b (127.0.106.131:35169)
I20250625 03:32:11.698101 4930 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "53747834cb32485eb3f79f699e401024" candidate_uuid: "e1270a01a1c04e8c9013a17569afebf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5"
I20250625 03:32:11.698323 5079 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "53747834cb32485eb3f79f699e401024" candidate_uuid: "e1270a01a1c04e8c9013a17569afebf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c37a035bb2d44c709a64f282940bdc6b"
I20250625 03:32:11.698635 4930 raft_consensus.cc:3058] T 53747834cb32485eb3f79f699e401024 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:11.698848 5079 raft_consensus.cc:3053] T 53747834cb32485eb3f79f699e401024 P c37a035bb2d44c709a64f282940bdc6b [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:32:11.699149 5079 raft_consensus.cc:738] T 53747834cb32485eb3f79f699e401024 P c37a035bb2d44c709a64f282940bdc6b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c37a035bb2d44c709a64f282940bdc6b, State: Running, Role: LEADER
I20250625 03:32:11.699712 5079 consensus_queue.cc:260] T 53747834cb32485eb3f79f699e401024 P c37a035bb2d44c709a64f282940bdc6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:11.700626 5079 raft_consensus.cc:3058] T 53747834cb32485eb3f79f699e401024 P c37a035bb2d44c709a64f282940bdc6b [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:11.703320 4930 raft_consensus.cc:2466] T 53747834cb32485eb3f79f699e401024 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1270a01a1c04e8c9013a17569afebf5 in term 2.
I20250625 03:32:11.704322 4969 leader_election.cc:304] T 53747834cb32485eb3f79f699e401024 P e1270a01a1c04e8c9013a17569afebf5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b63b7bf1b94396bf2ea6cc8359f4e5, e1270a01a1c04e8c9013a17569afebf5; no voters:
I20250625 03:32:11.704968 5235 raft_consensus.cc:2802] T 53747834cb32485eb3f79f699e401024 P e1270a01a1c04e8c9013a17569afebf5 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:32:11.705188 5079 raft_consensus.cc:2466] T 53747834cb32485eb3f79f699e401024 P c37a035bb2d44c709a64f282940bdc6b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1270a01a1c04e8c9013a17569afebf5 in term 2.
I20250625 03:32:11.705495 5235 raft_consensus.cc:695] T 53747834cb32485eb3f79f699e401024 P e1270a01a1c04e8c9013a17569afebf5 [term 2 LEADER]: Becoming Leader. State: Replica: e1270a01a1c04e8c9013a17569afebf5, State: Running, Role: LEADER
I20250625 03:32:11.706403 5235 consensus_queue.cc:237] T 53747834cb32485eb3f79f699e401024 P e1270a01a1c04e8c9013a17569afebf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:11.713217 4828 catalog_manager.cc:5582] T 53747834cb32485eb3f79f699e401024 P e1270a01a1c04e8c9013a17569afebf5 reported cstate change: term changed from 1 to 2, leader changed from c37a035bb2d44c709a64f282940bdc6b (127.0.106.131) to e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130). New cstate: current_term: 2 leader_uuid: "e1270a01a1c04e8c9013a17569afebf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } health_report { overall_health: UNKNOWN } } }
I20250625 03:32:11.726354 5126 raft_consensus.cc:991] T 391a5defcbd64e7999b0dffb39848744 P e1270a01a1c04e8c9013a17569afebf5: : Instructing follower 21b63b7bf1b94396bf2ea6cc8359f4e5 to start an election
I20250625 03:32:11.726788 5235 raft_consensus.cc:1079] T 391a5defcbd64e7999b0dffb39848744 P e1270a01a1c04e8c9013a17569afebf5 [term 1 LEADER]: Signalling peer 21b63b7bf1b94396bf2ea6cc8359f4e5 to start an election
I20250625 03:32:11.728128 4930 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "391a5defcbd64e7999b0dffb39848744"
dest_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5"
from {username='slave'} at 127.0.0.1:51664
I20250625 03:32:11.728557 4930 raft_consensus.cc:491] T 391a5defcbd64e7999b0dffb39848744 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:32:11.728904 4930 raft_consensus.cc:3058] T 391a5defcbd64e7999b0dffb39848744 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:11.733573 4930 raft_consensus.cc:513] T 391a5defcbd64e7999b0dffb39848744 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:11.735189 4930 leader_election.cc:290] T 391a5defcbd64e7999b0dffb39848744 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [CANDIDATE]: Term 2 election: Requested vote from peers e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130:41071), c37a035bb2d44c709a64f282940bdc6b (127.0.106.131:35169)
I20250625 03:32:11.735949 5005 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "391a5defcbd64e7999b0dffb39848744" candidate_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e1270a01a1c04e8c9013a17569afebf5"
I20250625 03:32:11.736222 5079 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "391a5defcbd64e7999b0dffb39848744" candidate_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c37a035bb2d44c709a64f282940bdc6b"
I20250625 03:32:11.736634 5005 raft_consensus.cc:3053] T 391a5defcbd64e7999b0dffb39848744 P e1270a01a1c04e8c9013a17569afebf5 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:32:11.736697 5079 raft_consensus.cc:3058] T 391a5defcbd64e7999b0dffb39848744 P c37a035bb2d44c709a64f282940bdc6b [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:11.736991 5005 raft_consensus.cc:738] T 391a5defcbd64e7999b0dffb39848744 P e1270a01a1c04e8c9013a17569afebf5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e1270a01a1c04e8c9013a17569afebf5, State: Running, Role: LEADER
I20250625 03:32:11.737741 5005 consensus_queue.cc:260] T 391a5defcbd64e7999b0dffb39848744 P e1270a01a1c04e8c9013a17569afebf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:11.738899 5005 raft_consensus.cc:3058] T 391a5defcbd64e7999b0dffb39848744 P e1270a01a1c04e8c9013a17569afebf5 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:11.743506 5079 raft_consensus.cc:2466] T 391a5defcbd64e7999b0dffb39848744 P c37a035bb2d44c709a64f282940bdc6b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21b63b7bf1b94396bf2ea6cc8359f4e5 in term 2.
I20250625 03:32:11.744556 4893 leader_election.cc:304] T 391a5defcbd64e7999b0dffb39848744 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b63b7bf1b94396bf2ea6cc8359f4e5, c37a035bb2d44c709a64f282940bdc6b; no voters:
I20250625 03:32:11.745308 5005 raft_consensus.cc:2466] T 391a5defcbd64e7999b0dffb39848744 P e1270a01a1c04e8c9013a17569afebf5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21b63b7bf1b94396bf2ea6cc8359f4e5 in term 2.
I20250625 03:32:11.745334 5286 raft_consensus.cc:2802] T 391a5defcbd64e7999b0dffb39848744 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:32:11.746011 5286 raft_consensus.cc:695] T 391a5defcbd64e7999b0dffb39848744 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 2 LEADER]: Becoming Leader. State: Replica: 21b63b7bf1b94396bf2ea6cc8359f4e5, State: Running, Role: LEADER
I20250625 03:32:11.746886 5286 consensus_queue.cc:237] T 391a5defcbd64e7999b0dffb39848744 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:11.753039 4828 catalog_manager.cc:5582] T 391a5defcbd64e7999b0dffb39848744 P 21b63b7bf1b94396bf2ea6cc8359f4e5 reported cstate change: term changed from 1 to 2, leader changed from e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130) to 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129). New cstate: current_term: 2 leader_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } health_report { overall_health: UNKNOWN } } }
I20250625 03:32:11.783986 5238 raft_consensus.cc:991] T 05b3b289074d43638ab6ae336e13f3ef P c37a035bb2d44c709a64f282940bdc6b: : Instructing follower 21b63b7bf1b94396bf2ea6cc8359f4e5 to start an election
I20250625 03:32:11.784425 5239 raft_consensus.cc:1079] T 05b3b289074d43638ab6ae336e13f3ef P c37a035bb2d44c709a64f282940bdc6b [term 1 LEADER]: Signalling peer 21b63b7bf1b94396bf2ea6cc8359f4e5 to start an election
I20250625 03:32:11.786006 4930 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "05b3b289074d43638ab6ae336e13f3ef"
dest_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5"
from {username='slave'} at 127.0.0.1:51676
I20250625 03:32:11.786463 4930 raft_consensus.cc:491] T 05b3b289074d43638ab6ae336e13f3ef P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:32:11.786820 4930 raft_consensus.cc:3058] T 05b3b289074d43638ab6ae336e13f3ef P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:11.792699 4930 raft_consensus.cc:513] T 05b3b289074d43638ab6ae336e13f3ef P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:11.793975 4930 leader_election.cc:290] T 05b3b289074d43638ab6ae336e13f3ef P 21b63b7bf1b94396bf2ea6cc8359f4e5 [CANDIDATE]: Term 2 election: Requested vote from peers e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130:41071), c37a035bb2d44c709a64f282940bdc6b (127.0.106.131:35169)
I20250625 03:32:11.794801 5005 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "05b3b289074d43638ab6ae336e13f3ef" candidate_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e1270a01a1c04e8c9013a17569afebf5"
I20250625 03:32:11.795403 5005 raft_consensus.cc:3058] T 05b3b289074d43638ab6ae336e13f3ef P e1270a01a1c04e8c9013a17569afebf5 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:11.795279 5079 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "05b3b289074d43638ab6ae336e13f3ef" candidate_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c37a035bb2d44c709a64f282940bdc6b"
I20250625 03:32:11.795940 5079 raft_consensus.cc:3053] T 05b3b289074d43638ab6ae336e13f3ef P c37a035bb2d44c709a64f282940bdc6b [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:32:11.796275 5079 raft_consensus.cc:738] T 05b3b289074d43638ab6ae336e13f3ef P c37a035bb2d44c709a64f282940bdc6b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c37a035bb2d44c709a64f282940bdc6b, State: Running, Role: LEADER
I20250625 03:32:11.797049 5079 consensus_queue.cc:260] T 05b3b289074d43638ab6ae336e13f3ef P c37a035bb2d44c709a64f282940bdc6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:11.798166 5079 raft_consensus.cc:3058] T 05b3b289074d43638ab6ae336e13f3ef P c37a035bb2d44c709a64f282940bdc6b [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:11.802021 5005 raft_consensus.cc:2466] T 05b3b289074d43638ab6ae336e13f3ef P e1270a01a1c04e8c9013a17569afebf5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21b63b7bf1b94396bf2ea6cc8359f4e5 in term 2.
I20250625 03:32:11.803293 4893 leader_election.cc:304] T 05b3b289074d43638ab6ae336e13f3ef P 21b63b7bf1b94396bf2ea6cc8359f4e5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b63b7bf1b94396bf2ea6cc8359f4e5, e1270a01a1c04e8c9013a17569afebf5; no voters:
I20250625 03:32:11.803999 5286 raft_consensus.cc:2802] T 05b3b289074d43638ab6ae336e13f3ef P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:32:11.804728 5079 raft_consensus.cc:2466] T 05b3b289074d43638ab6ae336e13f3ef P c37a035bb2d44c709a64f282940bdc6b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21b63b7bf1b94396bf2ea6cc8359f4e5 in term 2.
I20250625 03:32:11.805078 5286 raft_consensus.cc:695] T 05b3b289074d43638ab6ae336e13f3ef P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 2 LEADER]: Becoming Leader. State: Replica: 21b63b7bf1b94396bf2ea6cc8359f4e5, State: Running, Role: LEADER
I20250625 03:32:11.805951 5286 consensus_queue.cc:237] T 05b3b289074d43638ab6ae336e13f3ef P 21b63b7bf1b94396bf2ea6cc8359f4e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:11.812479 4828 catalog_manager.cc:5582] T 05b3b289074d43638ab6ae336e13f3ef P 21b63b7bf1b94396bf2ea6cc8359f4e5 reported cstate change: term changed from 1 to 2, leader changed from c37a035bb2d44c709a64f282940bdc6b (127.0.106.131) to 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129). New cstate: current_term: 2 leader_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } health_report { overall_health: UNKNOWN } } }
I20250625 03:32:11.814796 5127 raft_consensus.cc:991] T 149bd3c081bc4cf0a4de280a4dd4fd1b P c37a035bb2d44c709a64f282940bdc6b: : Instructing follower e1270a01a1c04e8c9013a17569afebf5 to start an election
I20250625 03:32:11.815357 5127 raft_consensus.cc:1079] T 149bd3c081bc4cf0a4de280a4dd4fd1b P c37a035bb2d44c709a64f282940bdc6b [term 1 LEADER]: Signalling peer e1270a01a1c04e8c9013a17569afebf5 to start an election
I20250625 03:32:11.816666 5005 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "149bd3c081bc4cf0a4de280a4dd4fd1b"
dest_uuid: "e1270a01a1c04e8c9013a17569afebf5"
from {username='slave'} at 127.0.0.1:54552
I20250625 03:32:11.817109 5005 raft_consensus.cc:491] T 149bd3c081bc4cf0a4de280a4dd4fd1b P e1270a01a1c04e8c9013a17569afebf5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:32:11.817394 5005 raft_consensus.cc:3058] T 149bd3c081bc4cf0a4de280a4dd4fd1b P e1270a01a1c04e8c9013a17569afebf5 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:11.823122 5005 raft_consensus.cc:513] T 149bd3c081bc4cf0a4de280a4dd4fd1b P e1270a01a1c04e8c9013a17569afebf5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:11.824577 5005 leader_election.cc:290] T 149bd3c081bc4cf0a4de280a4dd4fd1b P e1270a01a1c04e8c9013a17569afebf5 [CANDIDATE]: Term 2 election: Requested vote from peers 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373), c37a035bb2d44c709a64f282940bdc6b (127.0.106.131:35169)
I20250625 03:32:11.825354 4930 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "149bd3c081bc4cf0a4de280a4dd4fd1b" candidate_uuid: "e1270a01a1c04e8c9013a17569afebf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5"
I20250625 03:32:11.825595 5079 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "149bd3c081bc4cf0a4de280a4dd4fd1b" candidate_uuid: "e1270a01a1c04e8c9013a17569afebf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c37a035bb2d44c709a64f282940bdc6b"
I20250625 03:32:11.825981 4930 raft_consensus.cc:3058] T 149bd3c081bc4cf0a4de280a4dd4fd1b P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:11.826102 5079 raft_consensus.cc:3053] T 149bd3c081bc4cf0a4de280a4dd4fd1b P c37a035bb2d44c709a64f282940bdc6b [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:32:11.826494 5079 raft_consensus.cc:738] T 149bd3c081bc4cf0a4de280a4dd4fd1b P c37a035bb2d44c709a64f282940bdc6b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c37a035bb2d44c709a64f282940bdc6b, State: Running, Role: LEADER
I20250625 03:32:11.827190 5079 consensus_queue.cc:260] T 149bd3c081bc4cf0a4de280a4dd4fd1b P c37a035bb2d44c709a64f282940bdc6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:11.828337 5079 raft_consensus.cc:3058] T 149bd3c081bc4cf0a4de280a4dd4fd1b P c37a035bb2d44c709a64f282940bdc6b [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:11.832887 4930 raft_consensus.cc:2466] T 149bd3c081bc4cf0a4de280a4dd4fd1b P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1270a01a1c04e8c9013a17569afebf5 in term 2.
I20250625 03:32:11.833956 4969 leader_election.cc:304] T 149bd3c081bc4cf0a4de280a4dd4fd1b P e1270a01a1c04e8c9013a17569afebf5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b63b7bf1b94396bf2ea6cc8359f4e5, e1270a01a1c04e8c9013a17569afebf5; no voters:
I20250625 03:32:11.834721 5235 raft_consensus.cc:2802] T 149bd3c081bc4cf0a4de280a4dd4fd1b P e1270a01a1c04e8c9013a17569afebf5 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:32:11.835206 5235 raft_consensus.cc:695] T 149bd3c081bc4cf0a4de280a4dd4fd1b P e1270a01a1c04e8c9013a17569afebf5 [term 2 LEADER]: Becoming Leader. State: Replica: e1270a01a1c04e8c9013a17569afebf5, State: Running, Role: LEADER
I20250625 03:32:11.835048 5079 raft_consensus.cc:2466] T 149bd3c081bc4cf0a4de280a4dd4fd1b P c37a035bb2d44c709a64f282940bdc6b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1270a01a1c04e8c9013a17569afebf5 in term 2.
I20250625 03:32:11.836148 5235 consensus_queue.cc:237] T 149bd3c081bc4cf0a4de280a4dd4fd1b P e1270a01a1c04e8c9013a17569afebf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:11.842725 4828 catalog_manager.cc:5582] T 149bd3c081bc4cf0a4de280a4dd4fd1b P e1270a01a1c04e8c9013a17569afebf5 reported cstate change: term changed from 1 to 2, leader changed from c37a035bb2d44c709a64f282940bdc6b (127.0.106.131) to e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130). New cstate: current_term: 2 leader_uuid: "e1270a01a1c04e8c9013a17569afebf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } health_report { overall_health: UNKNOWN } } }
I20250625 03:32:11.876209 5127 raft_consensus.cc:991] T 65572804041f4d5591d561279d92cd49 P c37a035bb2d44c709a64f282940bdc6b: : Instructing follower e1270a01a1c04e8c9013a17569afebf5 to start an election
I20250625 03:32:11.876649 5239 raft_consensus.cc:1079] T 65572804041f4d5591d561279d92cd49 P c37a035bb2d44c709a64f282940bdc6b [term 1 LEADER]: Signalling peer e1270a01a1c04e8c9013a17569afebf5 to start an election
I20250625 03:32:11.877956 5005 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "65572804041f4d5591d561279d92cd49"
dest_uuid: "e1270a01a1c04e8c9013a17569afebf5"
from {username='slave'} at 127.0.0.1:54552
I20250625 03:32:11.878405 5005 raft_consensus.cc:491] T 65572804041f4d5591d561279d92cd49 P e1270a01a1c04e8c9013a17569afebf5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:32:11.878655 5005 raft_consensus.cc:3058] T 65572804041f4d5591d561279d92cd49 P e1270a01a1c04e8c9013a17569afebf5 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:11.883090 5005 raft_consensus.cc:513] T 65572804041f4d5591d561279d92cd49 P e1270a01a1c04e8c9013a17569afebf5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:11.884462 5005 leader_election.cc:290] T 65572804041f4d5591d561279d92cd49 P e1270a01a1c04e8c9013a17569afebf5 [CANDIDATE]: Term 2 election: Requested vote from peers 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373), c37a035bb2d44c709a64f282940bdc6b (127.0.106.131:35169)
I20250625 03:32:11.885466 4930 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "65572804041f4d5591d561279d92cd49" candidate_uuid: "e1270a01a1c04e8c9013a17569afebf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5"
I20250625 03:32:11.885509 5079 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "65572804041f4d5591d561279d92cd49" candidate_uuid: "e1270a01a1c04e8c9013a17569afebf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c37a035bb2d44c709a64f282940bdc6b"
I20250625 03:32:11.886169 4930 raft_consensus.cc:3058] T 65572804041f4d5591d561279d92cd49 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:11.886229 5079 raft_consensus.cc:3053] T 65572804041f4d5591d561279d92cd49 P c37a035bb2d44c709a64f282940bdc6b [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:32:11.886608 5079 raft_consensus.cc:738] T 65572804041f4d5591d561279d92cd49 P c37a035bb2d44c709a64f282940bdc6b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c37a035bb2d44c709a64f282940bdc6b, State: Running, Role: LEADER
I20250625 03:32:11.887341 5079 consensus_queue.cc:260] T 65572804041f4d5591d561279d92cd49 P c37a035bb2d44c709a64f282940bdc6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:11.888494 5079 raft_consensus.cc:3058] T 65572804041f4d5591d561279d92cd49 P c37a035bb2d44c709a64f282940bdc6b [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:11.892679 4930 raft_consensus.cc:2466] T 65572804041f4d5591d561279d92cd49 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1270a01a1c04e8c9013a17569afebf5 in term 2.
I20250625 03:32:11.893797 4969 leader_election.cc:304] T 65572804041f4d5591d561279d92cd49 P e1270a01a1c04e8c9013a17569afebf5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b63b7bf1b94396bf2ea6cc8359f4e5, e1270a01a1c04e8c9013a17569afebf5; no voters:
I20250625 03:32:11.894596 5235 raft_consensus.cc:2802] T 65572804041f4d5591d561279d92cd49 P e1270a01a1c04e8c9013a17569afebf5 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:32:11.894935 5079 raft_consensus.cc:2466] T 65572804041f4d5591d561279d92cd49 P c37a035bb2d44c709a64f282940bdc6b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1270a01a1c04e8c9013a17569afebf5 in term 2.
I20250625 03:32:11.895021 5235 raft_consensus.cc:695] T 65572804041f4d5591d561279d92cd49 P e1270a01a1c04e8c9013a17569afebf5 [term 2 LEADER]: Becoming Leader. State: Replica: e1270a01a1c04e8c9013a17569afebf5, State: Running, Role: LEADER
I20250625 03:32:11.895941 5235 consensus_queue.cc:237] T 65572804041f4d5591d561279d92cd49 P e1270a01a1c04e8c9013a17569afebf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:11.902590 4828 catalog_manager.cc:5582] T 65572804041f4d5591d561279d92cd49 P e1270a01a1c04e8c9013a17569afebf5 reported cstate change: term changed from 1 to 2, leader changed from c37a035bb2d44c709a64f282940bdc6b (127.0.106.131) to e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130). New cstate: current_term: 2 leader_uuid: "e1270a01a1c04e8c9013a17569afebf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } health_report { overall_health: UNKNOWN } } }
I20250625 03:32:11.946594 5005 raft_consensus.cc:3058] T b7f4f7f28226468ea72e221eac6a1fdb P e1270a01a1c04e8c9013a17569afebf5 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:11.951710 5005 raft_consensus.cc:1273] T b7f4f7f28226468ea72e221eac6a1fdb P e1270a01a1c04e8c9013a17569afebf5 [term 2 FOLLOWER]: Refusing update from remote peer c37a035bb2d44c709a64f282940bdc6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:32:11.953058 5127 consensus_queue.cc:1035] T b7f4f7f28226468ea72e221eac6a1fdb P c37a035bb2d44c709a64f282940bdc6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:32:11.961151 4930 raft_consensus.cc:1273] T b7f4f7f28226468ea72e221eac6a1fdb P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 2 FOLLOWER]: Refusing update from remote peer c37a035bb2d44c709a64f282940bdc6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:32:11.963150 5127 consensus_queue.cc:1035] T b7f4f7f28226468ea72e221eac6a1fdb P c37a035bb2d44c709a64f282940bdc6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:32:12.109288 5079 raft_consensus.cc:1273] T b21ac1fdf14d484daf2e5e657e2fdc6d P c37a035bb2d44c709a64f282940bdc6b [term 2 FOLLOWER]: Refusing update from remote peer e1270a01a1c04e8c9013a17569afebf5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:32:12.110440 5235 consensus_queue.cc:1035] T b21ac1fdf14d484daf2e5e657e2fdc6d P e1270a01a1c04e8c9013a17569afebf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:32:12.120397 4930 raft_consensus.cc:1273] T b21ac1fdf14d484daf2e5e657e2fdc6d P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 2 FOLLOWER]: Refusing update from remote peer e1270a01a1c04e8c9013a17569afebf5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:32:12.121762 5126 consensus_queue.cc:1035] T b21ac1fdf14d484daf2e5e657e2fdc6d P e1270a01a1c04e8c9013a17569afebf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:32:12.129276 5005 raft_consensus.cc:1273] T 40422f6c986f41ae8c8067019d882fb2 P e1270a01a1c04e8c9013a17569afebf5 [term 2 FOLLOWER]: Refusing update from remote peer 21b63b7bf1b94396bf2ea6cc8359f4e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:32:12.130726 5262 consensus_queue.cc:1035] T 40422f6c986f41ae8c8067019d882fb2 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:32:12.138029 5079 raft_consensus.cc:1273] T 40422f6c986f41ae8c8067019d882fb2 P c37a035bb2d44c709a64f282940bdc6b [term 2 FOLLOWER]: Refusing update from remote peer 21b63b7bf1b94396bf2ea6cc8359f4e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:32:12.139509 5286 consensus_queue.cc:1035] T 40422f6c986f41ae8c8067019d882fb2 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:32:12.159040 5079 raft_consensus.cc:1273] T 391a5defcbd64e7999b0dffb39848744 P c37a035bb2d44c709a64f282940bdc6b [term 2 FOLLOWER]: Refusing update from remote peer 21b63b7bf1b94396bf2ea6cc8359f4e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:32:12.160209 5286 consensus_queue.cc:1035] T 391a5defcbd64e7999b0dffb39848744 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:32:12.167817 5005 raft_consensus.cc:1273] T 391a5defcbd64e7999b0dffb39848744 P e1270a01a1c04e8c9013a17569afebf5 [term 2 FOLLOWER]: Refusing update from remote peer 21b63b7bf1b94396bf2ea6cc8359f4e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:32:12.169960 5292 consensus_queue.cc:1035] T 391a5defcbd64e7999b0dffb39848744 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:32:12.188728 4930 raft_consensus.cc:1273] T 53747834cb32485eb3f79f699e401024 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 2 FOLLOWER]: Refusing update from remote peer e1270a01a1c04e8c9013a17569afebf5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:32:12.189841 5291 consensus_queue.cc:1035] T 53747834cb32485eb3f79f699e401024 P e1270a01a1c04e8c9013a17569afebf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:32:12.192307 5005 raft_consensus.cc:1273] T 8177d088f97c4dd4b031a1c9e7eae427 P e1270a01a1c04e8c9013a17569afebf5 [term 2 FOLLOWER]: Refusing update from remote peer 21b63b7bf1b94396bf2ea6cc8359f4e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:32:12.193524 5292 consensus_queue.cc:1035] T 8177d088f97c4dd4b031a1c9e7eae427 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:32:12.197396 5079 raft_consensus.cc:1273] T 53747834cb32485eb3f79f699e401024 P c37a035bb2d44c709a64f282940bdc6b [term 2 FOLLOWER]: Refusing update from remote peer e1270a01a1c04e8c9013a17569afebf5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:32:12.200345 5235 consensus_queue.cc:1035] T 53747834cb32485eb3f79f699e401024 P e1270a01a1c04e8c9013a17569afebf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:32:12.215983 5079 raft_consensus.cc:1273] T 8177d088f97c4dd4b031a1c9e7eae427 P c37a035bb2d44c709a64f282940bdc6b [term 2 FOLLOWER]: Refusing update from remote peer 21b63b7bf1b94396bf2ea6cc8359f4e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:32:12.217196 5262 consensus_queue.cc:1035] T 8177d088f97c4dd4b031a1c9e7eae427 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:32:12.274371 5005 raft_consensus.cc:1273] T 05b3b289074d43638ab6ae336e13f3ef P e1270a01a1c04e8c9013a17569afebf5 [term 2 FOLLOWER]: Refusing update from remote peer 21b63b7bf1b94396bf2ea6cc8359f4e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:32:12.275521 5262 consensus_queue.cc:1035] T 05b3b289074d43638ab6ae336e13f3ef P 21b63b7bf1b94396bf2ea6cc8359f4e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:32:12.283474 5079 raft_consensus.cc:1273] T 05b3b289074d43638ab6ae336e13f3ef P c37a035bb2d44c709a64f282940bdc6b [term 2 FOLLOWER]: Refusing update from remote peer 21b63b7bf1b94396bf2ea6cc8359f4e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:32:12.285694 5263 consensus_queue.cc:1035] T 05b3b289074d43638ab6ae336e13f3ef P 21b63b7bf1b94396bf2ea6cc8359f4e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:32:12.326912 5079 raft_consensus.cc:1273] T 149bd3c081bc4cf0a4de280a4dd4fd1b P c37a035bb2d44c709a64f282940bdc6b [term 2 FOLLOWER]: Refusing update from remote peer e1270a01a1c04e8c9013a17569afebf5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:32:12.327993 5235 consensus_queue.cc:1035] T 149bd3c081bc4cf0a4de280a4dd4fd1b P e1270a01a1c04e8c9013a17569afebf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:32:12.336169 4930 raft_consensus.cc:1273] T 149bd3c081bc4cf0a4de280a4dd4fd1b P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 2 FOLLOWER]: Refusing update from remote peer e1270a01a1c04e8c9013a17569afebf5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:32:12.337661 5126 consensus_queue.cc:1035] T 149bd3c081bc4cf0a4de280a4dd4fd1b P e1270a01a1c04e8c9013a17569afebf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:32:12.422487 4930 raft_consensus.cc:1273] T 65572804041f4d5591d561279d92cd49 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 2 FOLLOWER]: Refusing update from remote peer e1270a01a1c04e8c9013a17569afebf5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:32:12.423594 5126 consensus_queue.cc:1035] T 65572804041f4d5591d561279d92cd49 P e1270a01a1c04e8c9013a17569afebf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:32:12.431803 5079 raft_consensus.cc:1273] T 65572804041f4d5591d561279d92cd49 P c37a035bb2d44c709a64f282940bdc6b [term 2 FOLLOWER]: Refusing update from remote peer e1270a01a1c04e8c9013a17569afebf5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:32:12.433398 5235 consensus_queue.cc:1035] T 65572804041f4d5591d561279d92cd49 P e1270a01a1c04e8c9013a17569afebf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:32:14.378536 4828 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55926:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20250625 03:32:14.399639 4828 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:55926:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20250625 03:32:14.458351 426 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
W20250625 03:32:14.631255 5325 log.cc:927] Time spent T 40422f6c986f41ae8c8067019d882fb2 P 21b63b7bf1b94396bf2ea6cc8359f4e5: Append to log took a long time: real 0.087s user 0.000s sys 0.005s
W20250625 03:32:14.648849 5327 log.cc:927] Time spent T 65572804041f4d5591d561279d92cd49 P 21b63b7bf1b94396bf2ea6cc8359f4e5: Append to log took a long time: real 0.104s user 0.001s sys 0.000s
W20250625 03:32:14.661404 5324 log.cc:927] Time spent T b21ac1fdf14d484daf2e5e657e2fdc6d P e1270a01a1c04e8c9013a17569afebf5: Append to log took a long time: real 0.078s user 0.001s sys 0.000s
I20250625 03:32:14.665560 4930 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "40422f6c986f41ae8c8067019d882fb2"
dest_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5"
mode: GRACEFUL
new_leader_uuid: "c37a035bb2d44c709a64f282940bdc6b"
from {username='slave'} at 127.0.0.1:40640
I20250625 03:32:14.666491 4930 raft_consensus.cc:604] T 40422f6c986f41ae8c8067019d882fb2 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 2 LEADER]: Received request to transfer leadership to TS c37a035bb2d44c709a64f282940bdc6b
W20250625 03:32:14.682837 5322 log.cc:927] Time spent T 8177d088f97c4dd4b031a1c9e7eae427 P 21b63b7bf1b94396bf2ea6cc8359f4e5: Append to log took a long time: real 0.135s user 0.002s sys 0.000s
I20250625 03:32:14.684752 5263 raft_consensus.cc:991] T 40422f6c986f41ae8c8067019d882fb2 P 21b63b7bf1b94396bf2ea6cc8359f4e5: : Instructing follower c37a035bb2d44c709a64f282940bdc6b to start an election
I20250625 03:32:14.685269 5263 raft_consensus.cc:1079] T 40422f6c986f41ae8c8067019d882fb2 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 2 LEADER]: Signalling peer c37a035bb2d44c709a64f282940bdc6b to start an election
I20250625 03:32:14.706960 5077 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "40422f6c986f41ae8c8067019d882fb2"
dest_uuid: "c37a035bb2d44c709a64f282940bdc6b"
from {username='slave'} at 127.0.0.1:39602
I20250625 03:32:14.782846 5077 raft_consensus.cc:491] T 40422f6c986f41ae8c8067019d882fb2 P c37a035bb2d44c709a64f282940bdc6b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:32:14.783548 5077 raft_consensus.cc:3058] T 40422f6c986f41ae8c8067019d882fb2 P c37a035bb2d44c709a64f282940bdc6b [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:32:14.785135 5364 tablet.cc:1722] T 65572804041f4d5591d561279d92cd49 P c37a035bb2d44c709a64f282940bdc6b: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250625 03:32:14.816084 5359 tablet.cc:1722] T b7f4f7f28226468ea72e221eac6a1fdb P c37a035bb2d44c709a64f282940bdc6b: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
W20250625 03:32:14.706229 4969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:33373, user_credentials={real_user=slave}} blocked reactor thread for 80796.7us
I20250625 03:32:14.816845 5363 tablet.cc:1722] T b21ac1fdf14d484daf2e5e657e2fdc6d P c37a035bb2d44c709a64f282940bdc6b: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250625 03:32:14.781996 5353 tablet.cc:1722] T b21ac1fdf14d484daf2e5e657e2fdc6d P e1270a01a1c04e8c9013a17569afebf5: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250625 03:32:14.829885 5362 tablet.cc:1722] T 65572804041f4d5591d561279d92cd49 P e1270a01a1c04e8c9013a17569afebf5: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250625 03:32:14.783090 5355 tablet.cc:1722] T 40422f6c986f41ae8c8067019d882fb2 P c37a035bb2d44c709a64f282940bdc6b: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250625 03:32:14.853333 5357 tablet.cc:1722] T 05b3b289074d43638ab6ae336e13f3ef P 21b63b7bf1b94396bf2ea6cc8359f4e5: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250625 03:32:14.858453 5004 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "b21ac1fdf14d484daf2e5e657e2fdc6d"
dest_uuid: "e1270a01a1c04e8c9013a17569afebf5"
mode: GRACEFUL
new_leader_uuid: "c37a035bb2d44c709a64f282940bdc6b"
from {username='slave'} at 127.0.0.1:51598
I20250625 03:32:14.859160 5004 raft_consensus.cc:604] T b21ac1fdf14d484daf2e5e657e2fdc6d P e1270a01a1c04e8c9013a17569afebf5 [term 2 LEADER]: Received request to transfer leadership to TS c37a035bb2d44c709a64f282940bdc6b
I20250625 03:32:14.878263 426 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20250625 03:32:14.879134 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:32:14.895304 5004 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "06b41733ebac42daa85ec1c23c8588a7"
dest_uuid: "e1270a01a1c04e8c9013a17569afebf5"
mode: GRACEFUL
new_leader_uuid: "c37a035bb2d44c709a64f282940bdc6b"
from {username='slave'} at 127.0.0.1:51598
I20250625 03:32:14.895953 5004 raft_consensus.cc:604] T 06b41733ebac42daa85ec1c23c8588a7 P e1270a01a1c04e8c9013a17569afebf5 [term 1 LEADER]: Received request to transfer leadership to TS c37a035bb2d44c709a64f282940bdc6b
I20250625 03:32:14.909119 4927 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "ad39583185dd49dd860e678ad2e166ac"
dest_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5"
mode: GRACEFUL
new_leader_uuid: "c37a035bb2d44c709a64f282940bdc6b"
from {username='slave'} at 127.0.0.1:40640
I20250625 03:32:14.909765 4927 raft_consensus.cc:604] T ad39583185dd49dd860e678ad2e166ac P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 2 LEADER]: Received request to transfer leadership to TS c37a035bb2d44c709a64f282940bdc6b
I20250625 03:32:14.910174 5366 tablet.cc:1722] T 8177d088f97c4dd4b031a1c9e7eae427 P 21b63b7bf1b94396bf2ea6cc8359f4e5: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250625 03:32:14.912334 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20250625 03:32:14.914880 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:32:14.919107 5358 tablet.cc:1722] T 40422f6c986f41ae8c8067019d882fb2 P 21b63b7bf1b94396bf2ea6cc8359f4e5: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250625 03:32:14.921458 5371 tablet.cc:1722] T 391a5defcbd64e7999b0dffb39848744 P 21b63b7bf1b94396bf2ea6cc8359f4e5: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250625 03:32:14.925196 5077 raft_consensus.cc:513] T 40422f6c986f41ae8c8067019d882fb2 P c37a035bb2d44c709a64f282940bdc6b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:14.937997 5077 leader_election.cc:290] T 40422f6c986f41ae8c8067019d882fb2 P c37a035bb2d44c709a64f282940bdc6b [CANDIDATE]: Term 3 election: Requested vote from peers 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373), e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130:41071)
I20250625 03:32:14.938611 5353 tablet.cc:1722] T b7f4f7f28226468ea72e221eac6a1fdb P e1270a01a1c04e8c9013a17569afebf5: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250625 03:32:14.950134 4929 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "40422f6c986f41ae8c8067019d882fb2" candidate_uuid: "c37a035bb2d44c709a64f282940bdc6b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5"
I20250625 03:32:14.950835 4929 raft_consensus.cc:3053] T 40422f6c986f41ae8c8067019d882fb2 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 2 LEADER]: Stepping down as leader of term 2
I20250625 03:32:14.951112 4929 raft_consensus.cc:738] T 40422f6c986f41ae8c8067019d882fb2 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 21b63b7bf1b94396bf2ea6cc8359f4e5, State: Running, Role: LEADER
I20250625 03:32:14.951797 4929 consensus_queue.cc:260] T 40422f6c986f41ae8c8067019d882fb2 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:14.956734 4929 raft_consensus.cc:3058] T 40422f6c986f41ae8c8067019d882fb2 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:32:14.982777 4929 raft_consensus.cc:2466] T 40422f6c986f41ae8c8067019d882fb2 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c37a035bb2d44c709a64f282940bdc6b in term 3.
I20250625 03:32:14.984508 5043 leader_election.cc:304] T 40422f6c986f41ae8c8067019d882fb2 P c37a035bb2d44c709a64f282940bdc6b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b63b7bf1b94396bf2ea6cc8359f4e5, c37a035bb2d44c709a64f282940bdc6b; no voters:
I20250625 03:32:14.985548 5346 raft_consensus.cc:2802] T 40422f6c986f41ae8c8067019d882fb2 P c37a035bb2d44c709a64f282940bdc6b [term 3 FOLLOWER]: Leader election won for term 3
I20250625 03:32:14.986019 5346 raft_consensus.cc:695] T 40422f6c986f41ae8c8067019d882fb2 P c37a035bb2d44c709a64f282940bdc6b [term 3 LEADER]: Becoming Leader. State: Replica: c37a035bb2d44c709a64f282940bdc6b, State: Running, Role: LEADER
I20250625 03:32:14.986809 5346 consensus_queue.cc:237] T 40422f6c986f41ae8c8067019d882fb2 P c37a035bb2d44c709a64f282940bdc6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:14.995637 5000 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "40422f6c986f41ae8c8067019d882fb2" candidate_uuid: "c37a035bb2d44c709a64f282940bdc6b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "e1270a01a1c04e8c9013a17569afebf5"
I20250625 03:32:15.001502 5364 tablet.cc:1722] T 8177d088f97c4dd4b031a1c9e7eae427 P c37a035bb2d44c709a64f282940bdc6b: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250625 03:32:15.003391 4825 catalog_manager.cc:5582] T 40422f6c986f41ae8c8067019d882fb2 P c37a035bb2d44c709a64f282940bdc6b reported cstate change: term changed from 2 to 3, leader changed from 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129) to c37a035bb2d44c709a64f282940bdc6b (127.0.106.131). New cstate: current_term: 3 leader_uuid: "c37a035bb2d44c709a64f282940bdc6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } health_report { overall_health: HEALTHY } } }
I20250625 03:32:14.975625 5358 tablet.cc:1722] T 65572804041f4d5591d561279d92cd49 P 21b63b7bf1b94396bf2ea6cc8359f4e5: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250625 03:32:15.022891 5359 tablet.cc:1722] T 53747834cb32485eb3f79f699e401024 P c37a035bb2d44c709a64f282940bdc6b: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250625 03:32:15.037576 5292 raft_consensus.cc:991] T ad39583185dd49dd860e678ad2e166ac P 21b63b7bf1b94396bf2ea6cc8359f4e5: : Instructing follower c37a035bb2d44c709a64f282940bdc6b to start an election
I20250625 03:32:15.038925 5333 raft_consensus.cc:1079] T ad39583185dd49dd860e678ad2e166ac P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 2 LEADER]: Signalling peer c37a035bb2d44c709a64f282940bdc6b to start an election
I20250625 03:32:15.041971 5076 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "ad39583185dd49dd860e678ad2e166ac"
dest_uuid: "c37a035bb2d44c709a64f282940bdc6b"
from {username='slave'} at 127.0.0.1:39602
I20250625 03:32:15.042733 5076 raft_consensus.cc:491] T ad39583185dd49dd860e678ad2e166ac P c37a035bb2d44c709a64f282940bdc6b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:32:15.043246 5076 raft_consensus.cc:3058] T ad39583185dd49dd860e678ad2e166ac P c37a035bb2d44c709a64f282940bdc6b [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:32:15.044147 5369 tablet.cc:1722] T 05b3b289074d43638ab6ae336e13f3ef P e1270a01a1c04e8c9013a17569afebf5: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250625 03:32:15.054575 5358 tablet.cc:1722] T b21ac1fdf14d484daf2e5e657e2fdc6d P 21b63b7bf1b94396bf2ea6cc8359f4e5: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250625 03:32:15.055773 5076 raft_consensus.cc:513] T ad39583185dd49dd860e678ad2e166ac P c37a035bb2d44c709a64f282940bdc6b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:15.057960 5076 leader_election.cc:290] T ad39583185dd49dd860e678ad2e166ac P c37a035bb2d44c709a64f282940bdc6b [CANDIDATE]: Term 3 election: Requested vote from peers 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373), e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130:41071)
I20250625 03:32:15.059262 4930 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ad39583185dd49dd860e678ad2e166ac" candidate_uuid: "c37a035bb2d44c709a64f282940bdc6b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5"
I20250625 03:32:15.059476 5002 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ad39583185dd49dd860e678ad2e166ac" candidate_uuid: "c37a035bb2d44c709a64f282940bdc6b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e1270a01a1c04e8c9013a17569afebf5"
I20250625 03:32:15.059931 4930 raft_consensus.cc:3053] T ad39583185dd49dd860e678ad2e166ac P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 2 LEADER]: Stepping down as leader of term 2
I20250625 03:32:15.060199 5002 raft_consensus.cc:3058] T ad39583185dd49dd860e678ad2e166ac P e1270a01a1c04e8c9013a17569afebf5 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:32:15.060324 4930 raft_consensus.cc:738] T ad39583185dd49dd860e678ad2e166ac P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 21b63b7bf1b94396bf2ea6cc8359f4e5, State: Running, Role: LEADER
I20250625 03:32:15.061177 4930 consensus_queue.cc:260] T ad39583185dd49dd860e678ad2e166ac P 21b63b7bf1b94396bf2ea6cc8359f4e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:15.062413 4930 raft_consensus.cc:3058] T ad39583185dd49dd860e678ad2e166ac P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:32:15.064672 5357 tablet.cc:1722] T b7f4f7f28226468ea72e221eac6a1fdb P 21b63b7bf1b94396bf2ea6cc8359f4e5: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250625 03:32:15.061926 5363 tablet.cc:1722] T 05b3b289074d43638ab6ae336e13f3ef P c37a035bb2d44c709a64f282940bdc6b: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250625 03:32:15.071918 5002 raft_consensus.cc:2466] T ad39583185dd49dd860e678ad2e166ac P e1270a01a1c04e8c9013a17569afebf5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c37a035bb2d44c709a64f282940bdc6b in term 3.
I20250625 03:32:15.074787 5042 leader_election.cc:304] T ad39583185dd49dd860e678ad2e166ac P c37a035bb2d44c709a64f282940bdc6b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c37a035bb2d44c709a64f282940bdc6b, e1270a01a1c04e8c9013a17569afebf5; no voters:
I20250625 03:32:15.073683 5362 tablet.cc:1722] T 391a5defcbd64e7999b0dffb39848744 P e1270a01a1c04e8c9013a17569afebf5: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250625 03:32:15.076112 5346 raft_consensus.cc:2802] T ad39583185dd49dd860e678ad2e166ac P c37a035bb2d44c709a64f282940bdc6b [term 3 FOLLOWER]: Leader election won for term 3
I20250625 03:32:15.077723 5346 raft_consensus.cc:695] T ad39583185dd49dd860e678ad2e166ac P c37a035bb2d44c709a64f282940bdc6b [term 3 LEADER]: Becoming Leader. State: Replica: c37a035bb2d44c709a64f282940bdc6b, State: Running, Role: LEADER
I20250625 03:32:15.078647 5346 consensus_queue.cc:237] T ad39583185dd49dd860e678ad2e166ac P c37a035bb2d44c709a64f282940bdc6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:15.082011 5353 tablet.cc:1722] T 8177d088f97c4dd4b031a1c9e7eae427 P e1270a01a1c04e8c9013a17569afebf5: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250625 03:32:15.085008 5375 tablet.cc:1722] T 53747834cb32485eb3f79f699e401024 P e1270a01a1c04e8c9013a17569afebf5: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250625 03:32:15.087096 5366 tablet.cc:1722] T 53747834cb32485eb3f79f699e401024 P 21b63b7bf1b94396bf2ea6cc8359f4e5: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250625 03:32:15.091246 5355 tablet.cc:1722] T 391a5defcbd64e7999b0dffb39848744 P c37a035bb2d44c709a64f282940bdc6b: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250625 03:32:15.088577 5369 tablet.cc:1722] T 149bd3c081bc4cf0a4de280a4dd4fd1b P e1270a01a1c04e8c9013a17569afebf5: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250625 03:32:15.074859 4930 raft_consensus.cc:2466] T ad39583185dd49dd860e678ad2e166ac P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c37a035bb2d44c709a64f282940bdc6b in term 3.
I20250625 03:32:15.101380 5363 tablet.cc:1722] T 149bd3c081bc4cf0a4de280a4dd4fd1b P c37a035bb2d44c709a64f282940bdc6b: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250625 03:32:15.112375 5371 tablet.cc:1722] T 149bd3c081bc4cf0a4de280a4dd4fd1b P 21b63b7bf1b94396bf2ea6cc8359f4e5: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250625 03:32:15.159328 4827 catalog_manager.cc:5582] T ad39583185dd49dd860e678ad2e166ac P c37a035bb2d44c709a64f282940bdc6b reported cstate change: term changed from 2 to 3, leader changed from 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129) to c37a035bb2d44c709a64f282940bdc6b (127.0.106.131). New cstate: current_term: 3 leader_uuid: "c37a035bb2d44c709a64f282940bdc6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } health_report { overall_health: HEALTHY } } }
I20250625 03:32:15.168664 5302 raft_consensus.cc:991] T b21ac1fdf14d484daf2e5e657e2fdc6d P e1270a01a1c04e8c9013a17569afebf5: : Instructing follower c37a035bb2d44c709a64f282940bdc6b to start an election
I20250625 03:32:15.169389 5350 raft_consensus.cc:1079] T b21ac1fdf14d484daf2e5e657e2fdc6d P e1270a01a1c04e8c9013a17569afebf5 [term 2 LEADER]: Signalling peer c37a035bb2d44c709a64f282940bdc6b to start an election
I20250625 03:32:15.171090 5078 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "b21ac1fdf14d484daf2e5e657e2fdc6d"
dest_uuid: "c37a035bb2d44c709a64f282940bdc6b"
from {username='slave'} at 127.0.0.1:39592
I20250625 03:32:15.171749 5078 raft_consensus.cc:491] T b21ac1fdf14d484daf2e5e657e2fdc6d P c37a035bb2d44c709a64f282940bdc6b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:32:15.172144 5078 raft_consensus.cc:3058] T b21ac1fdf14d484daf2e5e657e2fdc6d P c37a035bb2d44c709a64f282940bdc6b [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:32:15.179040 5078 raft_consensus.cc:513] T b21ac1fdf14d484daf2e5e657e2fdc6d P c37a035bb2d44c709a64f282940bdc6b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:15.181044 5078 leader_election.cc:290] T b21ac1fdf14d484daf2e5e657e2fdc6d P c37a035bb2d44c709a64f282940bdc6b [CANDIDATE]: Term 3 election: Requested vote from peers 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373), e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130:41071)
I20250625 03:32:15.182821 5002 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b21ac1fdf14d484daf2e5e657e2fdc6d" candidate_uuid: "c37a035bb2d44c709a64f282940bdc6b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "e1270a01a1c04e8c9013a17569afebf5"
I20250625 03:32:15.183408 5002 raft_consensus.cc:3053] T b21ac1fdf14d484daf2e5e657e2fdc6d P e1270a01a1c04e8c9013a17569afebf5 [term 2 LEADER]: Stepping down as leader of term 2
I20250625 03:32:15.183678 5002 raft_consensus.cc:738] T b21ac1fdf14d484daf2e5e657e2fdc6d P e1270a01a1c04e8c9013a17569afebf5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e1270a01a1c04e8c9013a17569afebf5, State: Running, Role: LEADER
I20250625 03:32:15.184332 4930 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b21ac1fdf14d484daf2e5e657e2fdc6d" candidate_uuid: "c37a035bb2d44c709a64f282940bdc6b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5"
I20250625 03:32:15.184439 5002 consensus_queue.cc:260] T b21ac1fdf14d484daf2e5e657e2fdc6d P e1270a01a1c04e8c9013a17569afebf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:15.184923 4930 raft_consensus.cc:3058] T b21ac1fdf14d484daf2e5e657e2fdc6d P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:32:15.185429 5002 raft_consensus.cc:3058] T b21ac1fdf14d484daf2e5e657e2fdc6d P e1270a01a1c04e8c9013a17569afebf5 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:32:15.182317 4825 catalog_manager.cc:6127] T 00000000000000000000000000000000 P b6cda8ac6eb0436b82b28989710a9c7a: soft_deleted_table [id=b192f87db3e447aeb6757bef1a480a1c] alter complete (version 1)
I20250625 03:32:15.194185 4930 raft_consensus.cc:2466] T b21ac1fdf14d484daf2e5e657e2fdc6d P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c37a035bb2d44c709a64f282940bdc6b in term 3.
I20250625 03:32:15.194298 5002 raft_consensus.cc:2466] T b21ac1fdf14d484daf2e5e657e2fdc6d P e1270a01a1c04e8c9013a17569afebf5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c37a035bb2d44c709a64f282940bdc6b in term 3.
I20250625 03:32:15.195398 5043 leader_election.cc:304] T b21ac1fdf14d484daf2e5e657e2fdc6d P c37a035bb2d44c709a64f282940bdc6b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b63b7bf1b94396bf2ea6cc8359f4e5, c37a035bb2d44c709a64f282940bdc6b; no voters:
I20250625 03:32:15.196094 5346 raft_consensus.cc:2802] T b21ac1fdf14d484daf2e5e657e2fdc6d P c37a035bb2d44c709a64f282940bdc6b [term 3 FOLLOWER]: Leader election won for term 3
I20250625 03:32:15.196542 5346 raft_consensus.cc:695] T b21ac1fdf14d484daf2e5e657e2fdc6d P c37a035bb2d44c709a64f282940bdc6b [term 3 LEADER]: Becoming Leader. State: Replica: c37a035bb2d44c709a64f282940bdc6b, State: Running, Role: LEADER
I20250625 03:32:15.197275 5346 consensus_queue.cc:237] T b21ac1fdf14d484daf2e5e657e2fdc6d P c37a035bb2d44c709a64f282940bdc6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:15.203531 4827 catalog_manager.cc:5582] T b21ac1fdf14d484daf2e5e657e2fdc6d P c37a035bb2d44c709a64f282940bdc6b reported cstate change: term changed from 2 to 3, leader changed from e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130) to c37a035bb2d44c709a64f282940bdc6b (127.0.106.131). New cstate: current_term: 3 leader_uuid: "c37a035bb2d44c709a64f282940bdc6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } health_report { overall_health: HEALTHY } } }
I20250625 03:32:15.267692 5302 raft_consensus.cc:991] T 06b41733ebac42daa85ec1c23c8588a7 P e1270a01a1c04e8c9013a17569afebf5: : Instructing follower c37a035bb2d44c709a64f282940bdc6b to start an election
I20250625 03:32:15.268244 5350 raft_consensus.cc:1079] T 06b41733ebac42daa85ec1c23c8588a7 P e1270a01a1c04e8c9013a17569afebf5 [term 1 LEADER]: Signalling peer c37a035bb2d44c709a64f282940bdc6b to start an election
I20250625 03:32:15.269784 5078 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "06b41733ebac42daa85ec1c23c8588a7"
dest_uuid: "c37a035bb2d44c709a64f282940bdc6b"
from {username='slave'} at 127.0.0.1:39592
I20250625 03:32:15.270361 5078 raft_consensus.cc:491] T 06b41733ebac42daa85ec1c23c8588a7 P c37a035bb2d44c709a64f282940bdc6b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:32:15.270754 5078 raft_consensus.cc:3058] T 06b41733ebac42daa85ec1c23c8588a7 P c37a035bb2d44c709a64f282940bdc6b [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:15.276378 5078 raft_consensus.cc:513] T 06b41733ebac42daa85ec1c23c8588a7 P c37a035bb2d44c709a64f282940bdc6b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:15.277887 5078 leader_election.cc:290] T 06b41733ebac42daa85ec1c23c8588a7 P c37a035bb2d44c709a64f282940bdc6b [CANDIDATE]: Term 2 election: Requested vote from peers 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373), e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130:41071)
I20250625 03:32:15.279003 5002 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "06b41733ebac42daa85ec1c23c8588a7" candidate_uuid: "c37a035bb2d44c709a64f282940bdc6b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e1270a01a1c04e8c9013a17569afebf5"
I20250625 03:32:15.279367 4930 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "06b41733ebac42daa85ec1c23c8588a7" candidate_uuid: "c37a035bb2d44c709a64f282940bdc6b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5"
I20250625 03:32:15.279914 4930 raft_consensus.cc:3058] T 06b41733ebac42daa85ec1c23c8588a7 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:15.280332 5002 raft_consensus.cc:3053] T 06b41733ebac42daa85ec1c23c8588a7 P e1270a01a1c04e8c9013a17569afebf5 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:32:15.280753 5002 raft_consensus.cc:738] T 06b41733ebac42daa85ec1c23c8588a7 P e1270a01a1c04e8c9013a17569afebf5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e1270a01a1c04e8c9013a17569afebf5, State: Running, Role: LEADER
I20250625 03:32:15.281492 5002 consensus_queue.cc:260] T 06b41733ebac42daa85ec1c23c8588a7 P e1270a01a1c04e8c9013a17569afebf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:15.282733 5002 raft_consensus.cc:3058] T 06b41733ebac42daa85ec1c23c8588a7 P e1270a01a1c04e8c9013a17569afebf5 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:15.286984 4930 raft_consensus.cc:2466] T 06b41733ebac42daa85ec1c23c8588a7 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c37a035bb2d44c709a64f282940bdc6b in term 2.
I20250625 03:32:15.288398 5043 leader_election.cc:304] T 06b41733ebac42daa85ec1c23c8588a7 P c37a035bb2d44c709a64f282940bdc6b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b63b7bf1b94396bf2ea6cc8359f4e5, c37a035bb2d44c709a64f282940bdc6b; no voters:
I20250625 03:32:15.289602 5346 raft_consensus.cc:2802] T 06b41733ebac42daa85ec1c23c8588a7 P c37a035bb2d44c709a64f282940bdc6b [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:32:15.289940 5002 raft_consensus.cc:2466] T 06b41733ebac42daa85ec1c23c8588a7 P e1270a01a1c04e8c9013a17569afebf5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c37a035bb2d44c709a64f282940bdc6b in term 2.
I20250625 03:32:15.290766 5346 raft_consensus.cc:695] T 06b41733ebac42daa85ec1c23c8588a7 P c37a035bb2d44c709a64f282940bdc6b [term 2 LEADER]: Becoming Leader. State: Replica: c37a035bb2d44c709a64f282940bdc6b, State: Running, Role: LEADER
I20250625 03:32:15.292515 5346 consensus_queue.cc:237] T 06b41733ebac42daa85ec1c23c8588a7 P c37a035bb2d44c709a64f282940bdc6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } }
I20250625 03:32:15.301013 4827 catalog_manager.cc:5582] T 06b41733ebac42daa85ec1c23c8588a7 P c37a035bb2d44c709a64f282940bdc6b reported cstate change: term changed from 1 to 2, leader changed from e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130) to c37a035bb2d44c709a64f282940bdc6b (127.0.106.131). New cstate: current_term: 2 leader_uuid: "c37a035bb2d44c709a64f282940bdc6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c37a035bb2d44c709a64f282940bdc6b" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 35169 } health_report { overall_health: HEALTHY } } }
I20250625 03:32:15.390888 5002 raft_consensus.cc:3058] T 40422f6c986f41ae8c8067019d882fb2 P e1270a01a1c04e8c9013a17569afebf5 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:32:15.396302 5002 raft_consensus.cc:1273] T 40422f6c986f41ae8c8067019d882fb2 P e1270a01a1c04e8c9013a17569afebf5 [term 3 FOLLOWER]: Refusing update from remote peer c37a035bb2d44c709a64f282940bdc6b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20250625 03:32:15.397691 5346 consensus_queue.cc:1035] T 40422f6c986f41ae8c8067019d882fb2 P c37a035bb2d44c709a64f282940bdc6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:32:15.400532 5353 tablet.cc:1722] T 40422f6c986f41ae8c8067019d882fb2 P e1270a01a1c04e8c9013a17569afebf5: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250625 03:32:15.406531 4930 raft_consensus.cc:1273] T 40422f6c986f41ae8c8067019d882fb2 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 3 FOLLOWER]: Refusing update from remote peer c37a035bb2d44c709a64f282940bdc6b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20250625 03:32:15.408484 5382 consensus_queue.cc:1035] T 40422f6c986f41ae8c8067019d882fb2 P c37a035bb2d44c709a64f282940bdc6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20250625 03:32:15.406162 4827 catalog_manager.cc:5674] TS e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130:41071) does not have the latest schema for tablet 40422f6c986f41ae8c8067019d882fb2 (table soft_deleted_table [id=b192f87db3e447aeb6757bef1a480a1c]). Expected version 1 got 0
I20250625 03:32:15.573045 4928 raft_consensus.cc:1273] T ad39583185dd49dd860e678ad2e166ac P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 3 FOLLOWER]: Refusing update from remote peer c37a035bb2d44c709a64f282940bdc6b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250625 03:32:15.574375 5382 consensus_queue.cc:1035] T ad39583185dd49dd860e678ad2e166ac P c37a035bb2d44c709a64f282940bdc6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:32:15.582929 5002 raft_consensus.cc:1273] T ad39583185dd49dd860e678ad2e166ac P e1270a01a1c04e8c9013a17569afebf5 [term 3 FOLLOWER]: Refusing update from remote peer c37a035bb2d44c709a64f282940bdc6b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250625 03:32:15.586403 5382 consensus_queue.cc:1035] T ad39583185dd49dd860e678ad2e166ac P c37a035bb2d44c709a64f282940bdc6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20250625 03:32:15.624061 5002 raft_consensus.cc:1273] T b21ac1fdf14d484daf2e5e657e2fdc6d P e1270a01a1c04e8c9013a17569afebf5 [term 3 FOLLOWER]: Refusing update from remote peer c37a035bb2d44c709a64f282940bdc6b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20250625 03:32:15.625715 5382 consensus_queue.cc:1035] T b21ac1fdf14d484daf2e5e657e2fdc6d P c37a035bb2d44c709a64f282940bdc6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:32:15.633230 4928 raft_consensus.cc:1273] T b21ac1fdf14d484daf2e5e657e2fdc6d P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 3 FOLLOWER]: Refusing update from remote peer c37a035bb2d44c709a64f282940bdc6b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20250625 03:32:15.634397 5386 consensus_queue.cc:1035] T b21ac1fdf14d484daf2e5e657e2fdc6d P c37a035bb2d44c709a64f282940bdc6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250625 03:32:15.757911 5002 raft_consensus.cc:1273] T 06b41733ebac42daa85ec1c23c8588a7 P e1270a01a1c04e8c9013a17569afebf5 [term 2 FOLLOWER]: Refusing update from remote peer c37a035bb2d44c709a64f282940bdc6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:32:15.759055 5386 consensus_queue.cc:1035] T 06b41733ebac42daa85ec1c23c8588a7 P c37a035bb2d44c709a64f282940bdc6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1270a01a1c04e8c9013a17569afebf5" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 41071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:32:15.767894 4928 raft_consensus.cc:1273] T 06b41733ebac42daa85ec1c23c8588a7 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 2 FOLLOWER]: Refusing update from remote peer c37a035bb2d44c709a64f282940bdc6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:32:15.770148 5386 consensus_queue.cc:1035] T 06b41733ebac42daa85ec1c23c8588a7 P c37a035bb2d44c709a64f282940bdc6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b63b7bf1b94396bf2ea6cc8359f4e5" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 33373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:32:16.120932 426 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20250625 03:32:16.126935 426 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20250625 03:32:16.127348 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:32:16.132120 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250625 03:32:16.132464 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
W20250625 03:32:16.925562 5100 debug-util.cc:398] Leaking SignalData structure 0x7b08002b5440 after lost signal to thread 429
W20250625 03:32:16.926740 5100 debug-util.cc:398] Leaking SignalData structure 0x7b0800173520 after lost signal to thread 4862
W20250625 03:32:16.927758 5100 debug-util.cc:398] Leaking SignalData structure 0x7b0800282760 after lost signal to thread 4954
W20250625 03:32:16.928712 5100 debug-util.cc:398] Leaking SignalData structure 0x7b0800259140 after lost signal to thread 5029
W20250625 03:32:16.929559 5100 debug-util.cc:398] Leaking SignalData structure 0x7b080022c340 after lost signal to thread 5103
I20250625 03:32:17.133304 426 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20250625 03:32:17.138532 426 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20250625 03:32:17.138968 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:32:17.143600 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250625 03:32:17.143990 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:32:18.145038 426 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20250625 03:32:18.150224 426 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20250625 03:32:18.150671 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:32:18.155450 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250625 03:32:18.155877 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:32:19.157280 426 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20250625 03:32:19.168599 426 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20250625 03:32:19.169281 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:32:19.179538 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250625 03:32:19.180143 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:32:20.181448 426 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20250625 03:32:20.186270 426 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20250625 03:32:20.186668 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:32:20.191406 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250625 03:32:20.191788 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:32:21.192713 426 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20250625 03:32:21.198879 426 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20250625 03:32:21.199332 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:32:21.203740 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250625 03:32:21.204152 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:32:22.205073 426 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20250625 03:32:22.210124 426 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20250625 03:32:22.210583 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:32:22.215545 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250625 03:32:22.216089 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:32:23.217001 426 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20250625 03:32:23.222088 426 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20250625 03:32:23.222535 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:32:23.227195 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250625 03:32:23.227596 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:32:24.228530 426 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20250625 03:32:24.233460 426 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20250625 03:32:24.233856 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:32:24.238204 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250625 03:32:24.238556 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:32:25.295423 426 tablet_server.cc:178] TabletServer@127.0.106.129:0 shutting down...
I20250625 03:32:25.334563 426 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250625 03:32:25.335261 426 tablet_replica.cc:331] T 40422f6c986f41ae8c8067019d882fb2 P 21b63b7bf1b94396bf2ea6cc8359f4e5: stopping tablet replica
I20250625 03:32:25.336201 426 raft_consensus.cc:2241] T 40422f6c986f41ae8c8067019d882fb2 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:25.336876 426 raft_consensus.cc:2270] T 40422f6c986f41ae8c8067019d882fb2 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:25.339265 426 tablet_replica.cc:331] T 149bd3c081bc4cf0a4de280a4dd4fd1b P 21b63b7bf1b94396bf2ea6cc8359f4e5: stopping tablet replica
I20250625 03:32:25.339860 426 raft_consensus.cc:2241] T 149bd3c081bc4cf0a4de280a4dd4fd1b P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:25.340379 426 raft_consensus.cc:2270] T 149bd3c081bc4cf0a4de280a4dd4fd1b P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:25.344074 426 tablet_replica.cc:331] T b7f4f7f28226468ea72e221eac6a1fdb P 21b63b7bf1b94396bf2ea6cc8359f4e5: stopping tablet replica
I20250625 03:32:25.345084 426 raft_consensus.cc:2241] T b7f4f7f28226468ea72e221eac6a1fdb P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:25.345921 426 raft_consensus.cc:2270] T b7f4f7f28226468ea72e221eac6a1fdb P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:25.348238 426 tablet_replica.cc:331] T 65572804041f4d5591d561279d92cd49 P 21b63b7bf1b94396bf2ea6cc8359f4e5: stopping tablet replica
I20250625 03:32:25.348865 426 raft_consensus.cc:2241] T 65572804041f4d5591d561279d92cd49 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:25.349395 426 raft_consensus.cc:2270] T 65572804041f4d5591d561279d92cd49 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:25.351598 426 tablet_replica.cc:331] T 53747834cb32485eb3f79f699e401024 P 21b63b7bf1b94396bf2ea6cc8359f4e5: stopping tablet replica
I20250625 03:32:25.352149 426 raft_consensus.cc:2241] T 53747834cb32485eb3f79f699e401024 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:25.352687 426 raft_consensus.cc:2270] T 53747834cb32485eb3f79f699e401024 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:25.355008 426 tablet_replica.cc:331] T 8177d088f97c4dd4b031a1c9e7eae427 P 21b63b7bf1b94396bf2ea6cc8359f4e5: stopping tablet replica
I20250625 03:32:25.355607 426 raft_consensus.cc:2241] T 8177d088f97c4dd4b031a1c9e7eae427 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:32:25.356575 426 raft_consensus.cc:2270] T 8177d088f97c4dd4b031a1c9e7eae427 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:25.358877 426 tablet_replica.cc:331] T b21ac1fdf14d484daf2e5e657e2fdc6d P 21b63b7bf1b94396bf2ea6cc8359f4e5: stopping tablet replica
I20250625 03:32:25.359457 426 raft_consensus.cc:2241] T b21ac1fdf14d484daf2e5e657e2fdc6d P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:25.359879 426 raft_consensus.cc:2270] T b21ac1fdf14d484daf2e5e657e2fdc6d P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:25.361982 426 tablet_replica.cc:331] T ad39583185dd49dd860e678ad2e166ac P 21b63b7bf1b94396bf2ea6cc8359f4e5: stopping tablet replica
I20250625 03:32:25.362757 426 raft_consensus.cc:2241] T ad39583185dd49dd860e678ad2e166ac P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:25.363317 426 raft_consensus.cc:2270] T ad39583185dd49dd860e678ad2e166ac P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:25.366101 426 tablet_replica.cc:331] T 78d8c392f87643228ae9a6cd204f713b P 21b63b7bf1b94396bf2ea6cc8359f4e5: stopping tablet replica
I20250625 03:32:25.366639 426 raft_consensus.cc:2241] T 78d8c392f87643228ae9a6cd204f713b P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:25.367064 426 raft_consensus.cc:2270] T 78d8c392f87643228ae9a6cd204f713b P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:25.369167 426 tablet_replica.cc:331] T f5296bbece6b404387af92d2c22ab91e P 21b63b7bf1b94396bf2ea6cc8359f4e5: stopping tablet replica
I20250625 03:32:25.370332 426 raft_consensus.cc:2241] T f5296bbece6b404387af92d2c22ab91e P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:32:25.371165 426 raft_consensus.cc:2270] T f5296bbece6b404387af92d2c22ab91e P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:25.373983 426 tablet_replica.cc:331] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P 21b63b7bf1b94396bf2ea6cc8359f4e5: stopping tablet replica
I20250625 03:32:25.374821 426 raft_consensus.cc:2241] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:25.375664 426 raft_consensus.cc:2270] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20250625 03:32:25.376077 5043 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 204 similar messages]
I20250625 03:32:25.379930 426 tablet_replica.cc:331] T a592afb64620423cb8ef5ac5da6558f0 P 21b63b7bf1b94396bf2ea6cc8359f4e5: stopping tablet replica
W20250625 03:32:25.380904 5043 consensus_peers.cc:487] T b7f4f7f28226468ea72e221eac6a1fdb P c37a035bb2d44c709a64f282940bdc6b -> Peer 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373): Couldn't send request to peer 21b63b7bf1b94396bf2ea6cc8359f4e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:32:25.380998 426 raft_consensus.cc:2241] T a592afb64620423cb8ef5ac5da6558f0 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:25.381880 426 raft_consensus.cc:2270] T a592afb64620423cb8ef5ac5da6558f0 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:25.385016 426 tablet_replica.cc:331] T d6ccc7e94aa248ac9313c70ae601b6c5 P 21b63b7bf1b94396bf2ea6cc8359f4e5: stopping tablet replica
I20250625 03:32:25.386086 426 raft_consensus.cc:2241] T d6ccc7e94aa248ac9313c70ae601b6c5 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:32:25.387348 426 raft_consensus.cc:2270] T d6ccc7e94aa248ac9313c70ae601b6c5 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:25.391096 426 tablet_replica.cc:331] T 06b41733ebac42daa85ec1c23c8588a7 P 21b63b7bf1b94396bf2ea6cc8359f4e5: stopping tablet replica
W20250625 03:32:25.391294 4969 consensus_peers.cc:487] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P e1270a01a1c04e8c9013a17569afebf5 -> Peer 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373): Couldn't send request to peer 21b63b7bf1b94396bf2ea6cc8359f4e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:32:25.391916 426 raft_consensus.cc:2241] T 06b41733ebac42daa85ec1c23c8588a7 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:25.392715 426 raft_consensus.cc:2270] T 06b41733ebac42daa85ec1c23c8588a7 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:25.396178 426 tablet_replica.cc:331] T 391a5defcbd64e7999b0dffb39848744 P 21b63b7bf1b94396bf2ea6cc8359f4e5: stopping tablet replica
I20250625 03:32:25.396993 426 raft_consensus.cc:2241] T 391a5defcbd64e7999b0dffb39848744 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:32:25.398159 426 raft_consensus.cc:2270] T 391a5defcbd64e7999b0dffb39848744 P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:25.400759 426 tablet_replica.cc:331] T 05b3b289074d43638ab6ae336e13f3ef P 21b63b7bf1b94396bf2ea6cc8359f4e5: stopping tablet replica
I20250625 03:32:25.401428 426 raft_consensus.cc:2241] T 05b3b289074d43638ab6ae336e13f3ef P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:32:25.402604 426 raft_consensus.cc:2270] T 05b3b289074d43638ab6ae336e13f3ef P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20250625 03:32:25.405889 4969 consensus_peers.cc:487] T 8e6ebae6c4f34a34b8addf32082aa13c P e1270a01a1c04e8c9013a17569afebf5 -> Peer 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373): Couldn't send request to peer 21b63b7bf1b94396bf2ea6cc8359f4e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:32:25.406342 426 tablet_replica.cc:331] T 8e6ebae6c4f34a34b8addf32082aa13c P 21b63b7bf1b94396bf2ea6cc8359f4e5: stopping tablet replica
I20250625 03:32:25.407146 426 raft_consensus.cc:2241] T 8e6ebae6c4f34a34b8addf32082aa13c P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 2 FOLLOWER]: Raft consensus shutting down.
W20250625 03:32:25.407344 5043 consensus_peers.cc:487] T 06b41733ebac42daa85ec1c23c8588a7 P c37a035bb2d44c709a64f282940bdc6b -> Peer 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373): Couldn't send request to peer 21b63b7bf1b94396bf2ea6cc8359f4e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:32:25.407795 426 raft_consensus.cc:2270] T 8e6ebae6c4f34a34b8addf32082aa13c P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:25.410938 426 tablet_replica.cc:331] T 2e7642d019e54a80ad09b22cfa20119e P 21b63b7bf1b94396bf2ea6cc8359f4e5: stopping tablet replica
I20250625 03:32:25.411659 426 raft_consensus.cc:2241] T 2e7642d019e54a80ad09b22cfa20119e P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:32:25.412676 426 raft_consensus.cc:2270] T 2e7642d019e54a80ad09b22cfa20119e P 21b63b7bf1b94396bf2ea6cc8359f4e5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250625 03:32:25.427471 5043 consensus_peers.cc:487] T 78d8c392f87643228ae9a6cd204f713b P c37a035bb2d44c709a64f282940bdc6b -> Peer 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373): Couldn't send request to peer 21b63b7bf1b94396bf2ea6cc8359f4e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:32:25.460328 426 tablet_server.cc:195] TabletServer@127.0.106.129:0 shutdown complete.
W20250625 03:32:25.486140 4969 consensus_peers.cc:487] T 53747834cb32485eb3f79f699e401024 P e1270a01a1c04e8c9013a17569afebf5 -> Peer 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373): Couldn't send request to peer 21b63b7bf1b94396bf2ea6cc8359f4e5. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:33373: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250625 03:32:25.502657 426 tablet_server.cc:178] TabletServer@127.0.106.130:0 shutting down...
W20250625 03:32:25.507834 5043 consensus_peers.cc:487] T b21ac1fdf14d484daf2e5e657e2fdc6d P c37a035bb2d44c709a64f282940bdc6b -> Peer 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373): Couldn't send request to peer 21b63b7bf1b94396bf2ea6cc8359f4e5. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:33373: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250625 03:32:25.521967 4969 consensus_peers.cc:487] T 149bd3c081bc4cf0a4de280a4dd4fd1b P e1270a01a1c04e8c9013a17569afebf5 -> Peer 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373): Couldn't send request to peer 21b63b7bf1b94396bf2ea6cc8359f4e5. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:33373: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250625 03:32:25.529914 5043 consensus_peers.cc:487] T 40422f6c986f41ae8c8067019d882fb2 P c37a035bb2d44c709a64f282940bdc6b -> Peer 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373): Couldn't send request to peer 21b63b7bf1b94396bf2ea6cc8359f4e5. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:33373: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250625 03:32:25.540781 426 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250625 03:32:25.541579 426 tablet_replica.cc:331] T 8177d088f97c4dd4b031a1c9e7eae427 P e1270a01a1c04e8c9013a17569afebf5: stopping tablet replica
I20250625 03:32:25.542721 426 raft_consensus.cc:2241] T 8177d088f97c4dd4b031a1c9e7eae427 P e1270a01a1c04e8c9013a17569afebf5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:25.543238 426 raft_consensus.cc:2270] T 8177d088f97c4dd4b031a1c9e7eae427 P e1270a01a1c04e8c9013a17569afebf5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:25.545789 426 tablet_replica.cc:331] T b7f4f7f28226468ea72e221eac6a1fdb P e1270a01a1c04e8c9013a17569afebf5: stopping tablet replica
I20250625 03:32:25.546722 426 raft_consensus.cc:2241] T b7f4f7f28226468ea72e221eac6a1fdb P e1270a01a1c04e8c9013a17569afebf5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:25.547281 426 raft_consensus.cc:2270] T b7f4f7f28226468ea72e221eac6a1fdb P e1270a01a1c04e8c9013a17569afebf5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20250625 03:32:25.549278 4969 consensus_peers.cc:487] T 65572804041f4d5591d561279d92cd49 P e1270a01a1c04e8c9013a17569afebf5 -> Peer 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373): Couldn't send request to peer 21b63b7bf1b94396bf2ea6cc8359f4e5. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:33373: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250625 03:32:25.550236 426 tablet_replica.cc:331] T b21ac1fdf14d484daf2e5e657e2fdc6d P e1270a01a1c04e8c9013a17569afebf5: stopping tablet replica
I20250625 03:32:25.550855 426 raft_consensus.cc:2241] T b21ac1fdf14d484daf2e5e657e2fdc6d P e1270a01a1c04e8c9013a17569afebf5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:25.551285 426 raft_consensus.cc:2270] T b21ac1fdf14d484daf2e5e657e2fdc6d P e1270a01a1c04e8c9013a17569afebf5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:25.553422 426 tablet_replica.cc:331] T 53747834cb32485eb3f79f699e401024 P e1270a01a1c04e8c9013a17569afebf5: stopping tablet replica
I20250625 03:32:25.554184 426 raft_consensus.cc:2241] T 53747834cb32485eb3f79f699e401024 P e1270a01a1c04e8c9013a17569afebf5 [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:32:25.554965 426 raft_consensus.cc:2270] T 53747834cb32485eb3f79f699e401024 P e1270a01a1c04e8c9013a17569afebf5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:25.556917 426 tablet_replica.cc:331] T 65572804041f4d5591d561279d92cd49 P e1270a01a1c04e8c9013a17569afebf5: stopping tablet replica
I20250625 03:32:25.557442 426 raft_consensus.cc:2241] T 65572804041f4d5591d561279d92cd49 P e1270a01a1c04e8c9013a17569afebf5 [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:32:25.558185 426 raft_consensus.cc:2270] T 65572804041f4d5591d561279d92cd49 P e1270a01a1c04e8c9013a17569afebf5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:25.560910 426 tablet_replica.cc:331] T 05b3b289074d43638ab6ae336e13f3ef P e1270a01a1c04e8c9013a17569afebf5: stopping tablet replica
I20250625 03:32:25.561791 426 raft_consensus.cc:2241] T 05b3b289074d43638ab6ae336e13f3ef P e1270a01a1c04e8c9013a17569afebf5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:25.562397 426 raft_consensus.cc:2270] T 05b3b289074d43638ab6ae336e13f3ef P e1270a01a1c04e8c9013a17569afebf5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20250625 03:32:25.562839 5042 consensus_peers.cc:487] T 78d8c392f87643228ae9a6cd204f713b P c37a035bb2d44c709a64f282940bdc6b -> Peer e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130:41071): Couldn't send request to peer e1270a01a1c04e8c9013a17569afebf5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:32:25.564545 426 tablet_replica.cc:331] T 391a5defcbd64e7999b0dffb39848744 P e1270a01a1c04e8c9013a17569afebf5: stopping tablet replica
I20250625 03:32:25.565197 426 raft_consensus.cc:2241] T 391a5defcbd64e7999b0dffb39848744 P e1270a01a1c04e8c9013a17569afebf5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:25.565675 426 raft_consensus.cc:2270] T 391a5defcbd64e7999b0dffb39848744 P e1270a01a1c04e8c9013a17569afebf5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:25.567782 426 tablet_replica.cc:331] T 40422f6c986f41ae8c8067019d882fb2 P e1270a01a1c04e8c9013a17569afebf5: stopping tablet replica
I20250625 03:32:25.568344 426 raft_consensus.cc:2241] T 40422f6c986f41ae8c8067019d882fb2 P e1270a01a1c04e8c9013a17569afebf5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:25.568876 426 raft_consensus.cc:2270] T 40422f6c986f41ae8c8067019d882fb2 P e1270a01a1c04e8c9013a17569afebf5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:25.570860 426 tablet_replica.cc:331] T 149bd3c081bc4cf0a4de280a4dd4fd1b P e1270a01a1c04e8c9013a17569afebf5: stopping tablet replica
I20250625 03:32:25.571399 426 raft_consensus.cc:2241] T 149bd3c081bc4cf0a4de280a4dd4fd1b P e1270a01a1c04e8c9013a17569afebf5 [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:32:25.572261 426 raft_consensus.cc:2270] T 149bd3c081bc4cf0a4de280a4dd4fd1b P e1270a01a1c04e8c9013a17569afebf5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:25.574182 426 tablet_replica.cc:331] T ad39583185dd49dd860e678ad2e166ac P e1270a01a1c04e8c9013a17569afebf5: stopping tablet replica
I20250625 03:32:25.574681 426 raft_consensus.cc:2241] T ad39583185dd49dd860e678ad2e166ac P e1270a01a1c04e8c9013a17569afebf5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:25.575237 426 raft_consensus.cc:2270] T ad39583185dd49dd860e678ad2e166ac P e1270a01a1c04e8c9013a17569afebf5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:25.577488 426 tablet_replica.cc:331] T 78d8c392f87643228ae9a6cd204f713b P e1270a01a1c04e8c9013a17569afebf5: stopping tablet replica
I20250625 03:32:25.577986 426 raft_consensus.cc:2241] T 78d8c392f87643228ae9a6cd204f713b P e1270a01a1c04e8c9013a17569afebf5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:25.578500 426 raft_consensus.cc:2270] T 78d8c392f87643228ae9a6cd204f713b P e1270a01a1c04e8c9013a17569afebf5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20250625 03:32:25.579527 5043 consensus_peers.cc:487] T ad39583185dd49dd860e678ad2e166ac P c37a035bb2d44c709a64f282940bdc6b -> Peer 21b63b7bf1b94396bf2ea6cc8359f4e5 (127.0.106.129:33373): Couldn't send request to peer 21b63b7bf1b94396bf2ea6cc8359f4e5. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:33373: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250625 03:32:25.580720 426 tablet_replica.cc:331] T d6ccc7e94aa248ac9313c70ae601b6c5 P e1270a01a1c04e8c9013a17569afebf5: stopping tablet replica
I20250625 03:32:25.581300 426 raft_consensus.cc:2241] T d6ccc7e94aa248ac9313c70ae601b6c5 P e1270a01a1c04e8c9013a17569afebf5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:25.581756 426 raft_consensus.cc:2270] T d6ccc7e94aa248ac9313c70ae601b6c5 P e1270a01a1c04e8c9013a17569afebf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:25.583755 426 tablet_replica.cc:331] T 06b41733ebac42daa85ec1c23c8588a7 P e1270a01a1c04e8c9013a17569afebf5: stopping tablet replica
I20250625 03:32:25.584286 426 raft_consensus.cc:2241] T 06b41733ebac42daa85ec1c23c8588a7 P e1270a01a1c04e8c9013a17569afebf5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:25.584745 426 raft_consensus.cc:2270] T 06b41733ebac42daa85ec1c23c8588a7 P e1270a01a1c04e8c9013a17569afebf5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:25.586687 426 tablet_replica.cc:331] T a592afb64620423cb8ef5ac5da6558f0 P e1270a01a1c04e8c9013a17569afebf5: stopping tablet replica
I20250625 03:32:25.587210 426 raft_consensus.cc:2241] T a592afb64620423cb8ef5ac5da6558f0 P e1270a01a1c04e8c9013a17569afebf5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:32:25.587978 426 raft_consensus.cc:2270] T a592afb64620423cb8ef5ac5da6558f0 P e1270a01a1c04e8c9013a17569afebf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:25.589970 426 tablet_replica.cc:331] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P e1270a01a1c04e8c9013a17569afebf5: stopping tablet replica
I20250625 03:32:25.590453 426 raft_consensus.cc:2241] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P e1270a01a1c04e8c9013a17569afebf5 [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:32:25.591249 426 raft_consensus.cc:2270] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P e1270a01a1c04e8c9013a17569afebf5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:25.593134 426 tablet_replica.cc:331] T f5296bbece6b404387af92d2c22ab91e P e1270a01a1c04e8c9013a17569afebf5: stopping tablet replica
I20250625 03:32:25.593621 426 raft_consensus.cc:2241] T f5296bbece6b404387af92d2c22ab91e P e1270a01a1c04e8c9013a17569afebf5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:25.594094 426 raft_consensus.cc:2270] T f5296bbece6b404387af92d2c22ab91e P e1270a01a1c04e8c9013a17569afebf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:25.596102 426 tablet_replica.cc:331] T 2e7642d019e54a80ad09b22cfa20119e P e1270a01a1c04e8c9013a17569afebf5: stopping tablet replica
I20250625 03:32:25.596565 426 raft_consensus.cc:2241] T 2e7642d019e54a80ad09b22cfa20119e P e1270a01a1c04e8c9013a17569afebf5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:25.596968 426 raft_consensus.cc:2270] T 2e7642d019e54a80ad09b22cfa20119e P e1270a01a1c04e8c9013a17569afebf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:25.599373 426 tablet_replica.cc:331] T 8e6ebae6c4f34a34b8addf32082aa13c P e1270a01a1c04e8c9013a17569afebf5: stopping tablet replica
I20250625 03:32:25.599807 426 raft_consensus.cc:2241] T 8e6ebae6c4f34a34b8addf32082aa13c P e1270a01a1c04e8c9013a17569afebf5 [term 2 LEADER]: Raft consensus shutting down.
W20250625 03:32:25.600657 5042 consensus_peers.cc:487] T b21ac1fdf14d484daf2e5e657e2fdc6d P c37a035bb2d44c709a64f282940bdc6b -> Peer e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130:41071): Couldn't send request to peer e1270a01a1c04e8c9013a17569afebf5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:32:25.600767 426 raft_consensus.cc:2270] T 8e6ebae6c4f34a34b8addf32082aa13c P e1270a01a1c04e8c9013a17569afebf5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:25.642941 426 tablet_server.cc:195] TabletServer@127.0.106.130:0 shutdown complete.
W20250625 03:32:25.650899 5042 consensus_peers.cc:487] T 06b41733ebac42daa85ec1c23c8588a7 P c37a035bb2d44c709a64f282940bdc6b -> Peer e1270a01a1c04e8c9013a17569afebf5 (127.0.106.130:41071): Couldn't send request to peer e1270a01a1c04e8c9013a17569afebf5. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.130:41071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250625 03:32:25.680075 426 tablet_server.cc:178] TabletServer@127.0.106.131:0 shutting down...
I20250625 03:32:25.717252 426 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250625 03:32:25.718005 426 tablet_replica.cc:331] T b21ac1fdf14d484daf2e5e657e2fdc6d P c37a035bb2d44c709a64f282940bdc6b: stopping tablet replica
I20250625 03:32:25.718751 426 raft_consensus.cc:2241] T b21ac1fdf14d484daf2e5e657e2fdc6d P c37a035bb2d44c709a64f282940bdc6b [term 3 LEADER]: Raft consensus shutting down.
I20250625 03:32:25.719642 426 raft_consensus.cc:2270] T b21ac1fdf14d484daf2e5e657e2fdc6d P c37a035bb2d44c709a64f282940bdc6b [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:25.721766 426 tablet_replica.cc:331] T 40422f6c986f41ae8c8067019d882fb2 P c37a035bb2d44c709a64f282940bdc6b: stopping tablet replica
I20250625 03:32:25.722345 426 raft_consensus.cc:2241] T 40422f6c986f41ae8c8067019d882fb2 P c37a035bb2d44c709a64f282940bdc6b [term 3 LEADER]: Raft consensus shutting down.
I20250625 03:32:25.723184 426 raft_consensus.cc:2270] T 40422f6c986f41ae8c8067019d882fb2 P c37a035bb2d44c709a64f282940bdc6b [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:25.725296 426 tablet_replica.cc:331] T b7f4f7f28226468ea72e221eac6a1fdb P c37a035bb2d44c709a64f282940bdc6b: stopping tablet replica
I20250625 03:32:25.725868 426 raft_consensus.cc:2241] T b7f4f7f28226468ea72e221eac6a1fdb P c37a035bb2d44c709a64f282940bdc6b [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:32:25.726651 426 raft_consensus.cc:2270] T b7f4f7f28226468ea72e221eac6a1fdb P c37a035bb2d44c709a64f282940bdc6b [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:25.728708 426 tablet_replica.cc:331] T 65572804041f4d5591d561279d92cd49 P c37a035bb2d44c709a64f282940bdc6b: stopping tablet replica
I20250625 03:32:25.729249 426 raft_consensus.cc:2241] T 65572804041f4d5591d561279d92cd49 P c37a035bb2d44c709a64f282940bdc6b [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:25.729696 426 raft_consensus.cc:2270] T 65572804041f4d5591d561279d92cd49 P c37a035bb2d44c709a64f282940bdc6b [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:25.731570 426 tablet_replica.cc:331] T 53747834cb32485eb3f79f699e401024 P c37a035bb2d44c709a64f282940bdc6b: stopping tablet replica
I20250625 03:32:25.732174 426 raft_consensus.cc:2241] T 53747834cb32485eb3f79f699e401024 P c37a035bb2d44c709a64f282940bdc6b [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:25.732663 426 raft_consensus.cc:2270] T 53747834cb32485eb3f79f699e401024 P c37a035bb2d44c709a64f282940bdc6b [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:25.734568 426 tablet_replica.cc:331] T 391a5defcbd64e7999b0dffb39848744 P c37a035bb2d44c709a64f282940bdc6b: stopping tablet replica
I20250625 03:32:25.735066 426 raft_consensus.cc:2241] T 391a5defcbd64e7999b0dffb39848744 P c37a035bb2d44c709a64f282940bdc6b [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:25.735523 426 raft_consensus.cc:2270] T 391a5defcbd64e7999b0dffb39848744 P c37a035bb2d44c709a64f282940bdc6b [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:25.737514 426 tablet_replica.cc:331] T 05b3b289074d43638ab6ae336e13f3ef P c37a035bb2d44c709a64f282940bdc6b: stopping tablet replica
I20250625 03:32:25.738013 426 raft_consensus.cc:2241] T 05b3b289074d43638ab6ae336e13f3ef P c37a035bb2d44c709a64f282940bdc6b [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:25.738497 426 raft_consensus.cc:2270] T 05b3b289074d43638ab6ae336e13f3ef P c37a035bb2d44c709a64f282940bdc6b [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:25.740365 426 tablet_replica.cc:331] T 149bd3c081bc4cf0a4de280a4dd4fd1b P c37a035bb2d44c709a64f282940bdc6b: stopping tablet replica
I20250625 03:32:25.740911 426 raft_consensus.cc:2241] T 149bd3c081bc4cf0a4de280a4dd4fd1b P c37a035bb2d44c709a64f282940bdc6b [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:25.741369 426 raft_consensus.cc:2270] T 149bd3c081bc4cf0a4de280a4dd4fd1b P c37a035bb2d44c709a64f282940bdc6b [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:25.743225 426 tablet_replica.cc:331] T ad39583185dd49dd860e678ad2e166ac P c37a035bb2d44c709a64f282940bdc6b: stopping tablet replica
I20250625 03:32:25.743741 426 raft_consensus.cc:2241] T ad39583185dd49dd860e678ad2e166ac P c37a035bb2d44c709a64f282940bdc6b [term 3 LEADER]: Raft consensus shutting down.
I20250625 03:32:25.744582 426 raft_consensus.cc:2270] T ad39583185dd49dd860e678ad2e166ac P c37a035bb2d44c709a64f282940bdc6b [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:25.746505 426 tablet_replica.cc:331] T 78d8c392f87643228ae9a6cd204f713b P c37a035bb2d44c709a64f282940bdc6b: stopping tablet replica
I20250625 03:32:25.747010 426 raft_consensus.cc:2241] T 78d8c392f87643228ae9a6cd204f713b P c37a035bb2d44c709a64f282940bdc6b [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:32:25.747794 426 raft_consensus.cc:2270] T 78d8c392f87643228ae9a6cd204f713b P c37a035bb2d44c709a64f282940bdc6b [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:25.749811 426 tablet_replica.cc:331] T 8177d088f97c4dd4b031a1c9e7eae427 P c37a035bb2d44c709a64f282940bdc6b: stopping tablet replica
I20250625 03:32:25.750330 426 raft_consensus.cc:2241] T 8177d088f97c4dd4b031a1c9e7eae427 P c37a035bb2d44c709a64f282940bdc6b [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:25.750814 426 raft_consensus.cc:2270] T 8177d088f97c4dd4b031a1c9e7eae427 P c37a035bb2d44c709a64f282940bdc6b [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:25.752698 426 tablet_replica.cc:331] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P c37a035bb2d44c709a64f282940bdc6b: stopping tablet replica
I20250625 03:32:25.753170 426 raft_consensus.cc:2241] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P c37a035bb2d44c709a64f282940bdc6b [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:25.753587 426 raft_consensus.cc:2270] T 5e6f0a34fdec4f4f8d38ad88f6c88390 P c37a035bb2d44c709a64f282940bdc6b [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:25.755329 426 tablet_replica.cc:331] T a592afb64620423cb8ef5ac5da6558f0 P c37a035bb2d44c709a64f282940bdc6b: stopping tablet replica
I20250625 03:32:25.755846 426 raft_consensus.cc:2241] T a592afb64620423cb8ef5ac5da6558f0 P c37a035bb2d44c709a64f282940bdc6b [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:25.756249 426 raft_consensus.cc:2270] T a592afb64620423cb8ef5ac5da6558f0 P c37a035bb2d44c709a64f282940bdc6b [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:25.758118 426 tablet_replica.cc:331] T f5296bbece6b404387af92d2c22ab91e P c37a035bb2d44c709a64f282940bdc6b: stopping tablet replica
I20250625 03:32:25.758603 426 raft_consensus.cc:2241] T f5296bbece6b404387af92d2c22ab91e P c37a035bb2d44c709a64f282940bdc6b [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:25.758996 426 raft_consensus.cc:2270] T f5296bbece6b404387af92d2c22ab91e P c37a035bb2d44c709a64f282940bdc6b [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:25.760869 426 tablet_replica.cc:331] T 8e6ebae6c4f34a34b8addf32082aa13c P c37a035bb2d44c709a64f282940bdc6b: stopping tablet replica
I20250625 03:32:25.761312 426 raft_consensus.cc:2241] T 8e6ebae6c4f34a34b8addf32082aa13c P c37a035bb2d44c709a64f282940bdc6b [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:25.761744 426 raft_consensus.cc:2270] T 8e6ebae6c4f34a34b8addf32082aa13c P c37a035bb2d44c709a64f282940bdc6b [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:25.763427 426 tablet_replica.cc:331] T 2e7642d019e54a80ad09b22cfa20119e P c37a035bb2d44c709a64f282940bdc6b: stopping tablet replica
I20250625 03:32:25.763888 426 raft_consensus.cc:2241] T 2e7642d019e54a80ad09b22cfa20119e P c37a035bb2d44c709a64f282940bdc6b [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:25.764312 426 raft_consensus.cc:2270] T 2e7642d019e54a80ad09b22cfa20119e P c37a035bb2d44c709a64f282940bdc6b [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:25.766114 426 tablet_replica.cc:331] T d6ccc7e94aa248ac9313c70ae601b6c5 P c37a035bb2d44c709a64f282940bdc6b: stopping tablet replica
I20250625 03:32:25.766573 426 raft_consensus.cc:2241] T d6ccc7e94aa248ac9313c70ae601b6c5 P c37a035bb2d44c709a64f282940bdc6b [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:25.766964 426 raft_consensus.cc:2270] T d6ccc7e94aa248ac9313c70ae601b6c5 P c37a035bb2d44c709a64f282940bdc6b [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:25.768774 426 tablet_replica.cc:331] T 06b41733ebac42daa85ec1c23c8588a7 P c37a035bb2d44c709a64f282940bdc6b: stopping tablet replica
I20250625 03:32:25.769223 426 raft_consensus.cc:2241] T 06b41733ebac42daa85ec1c23c8588a7 P c37a035bb2d44c709a64f282940bdc6b [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:32:25.770031 426 raft_consensus.cc:2270] T 06b41733ebac42daa85ec1c23c8588a7 P c37a035bb2d44c709a64f282940bdc6b [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:25.826117 426 tablet_server.cc:195] TabletServer@127.0.106.131:0 shutdown complete.
I20250625 03:32:25.857606 426 master.cc:561] Master@127.0.106.190:33947 shutting down...
I20250625 03:32:25.882263 426 raft_consensus.cc:2241] T 00000000000000000000000000000000 P b6cda8ac6eb0436b82b28989710a9c7a [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:32:25.882879 426 raft_consensus.cc:2270] T 00000000000000000000000000000000 P b6cda8ac6eb0436b82b28989710a9c7a [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:25.883186 426 tablet_replica.cc:331] T 00000000000000000000000000000000 P b6cda8ac6eb0436b82b28989710a9c7a: stopping tablet replica
I20250625 03:32:25.903178 426 master.cc:583] Master@127.0.106.190:33947 shutdown complete.
[ OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (20790 ms)
[ RUN ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20250625 03:32:25.953457 426 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.106.190:39897
I20250625 03:32:25.954548 426 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250625 03:32:25.960397 5422 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250625 03:32:25.960474 5421 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250625 03:32:25.961048 5424 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250625 03:32:25.963202 426 server_base.cc:1048] running on GCE node
I20250625 03:32:25.964206 426 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250625 03:32:25.964385 426 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250625 03:32:25.964550 426 hybrid_clock.cc:648] HybridClock initialized: now 1750822345964530 us; error 0 us; skew 500 ppm
I20250625 03:32:25.965042 426 server_base.cc:848] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250625 03:32:25.967569 426 webserver.cc:469] Webserver started at http://127.0.106.190:37289/ using document root <none> and password file <none>
I20250625 03:32:25.968225 426 fs_manager.cc:362] Metadata directory not provided
I20250625 03:32:25.968421 426 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250625 03:32:25.968782 426 server_base.cc:896] This appears to be a new deployment of Kudu; creating new FS layout
I20250625 03:32:25.970083 426 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1750822166717217-426-0/minicluster-data/master-0-root/instance:
uuid: "789cd038419c47e9882fb6ffdbae958a"
format_stamp: "Formatted at 2025-06-25 03:32:25 on dist-test-slave-lj23"
I20250625 03:32:25.975323 426 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20250625 03:32:25.978968 5429 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250625 03:32:25.979722 426 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20250625 03:32:25.980046 426 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1750822166717217-426-0/minicluster-data/master-0-root
uuid: "789cd038419c47e9882fb6ffdbae958a"
format_stamp: "Formatted at 2025-06-25 03:32:25 on dist-test-slave-lj23"
I20250625 03:32:25.980322 426 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1750822166717217-426-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1750822166717217-426-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1750822166717217-426-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250625 03:32:25.999989 426 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250625 03:32:26.001295 426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250625 03:32:26.039861 426 rpc_server.cc:307] RPC server started. Bound to: 127.0.106.190:39897
I20250625 03:32:26.039954 5480 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.106.190:39897 every 8 connection(s)
I20250625 03:32:26.043648 5481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:26.054989 5481 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 789cd038419c47e9882fb6ffdbae958a: Bootstrap starting.
I20250625 03:32:26.059737 5481 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 789cd038419c47e9882fb6ffdbae958a: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:26.063987 5481 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 789cd038419c47e9882fb6ffdbae958a: No bootstrap required, opened a new log
I20250625 03:32:26.066161 5481 raft_consensus.cc:357] T 00000000000000000000000000000000 P 789cd038419c47e9882fb6ffdbae958a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "789cd038419c47e9882fb6ffdbae958a" member_type: VOTER }
I20250625 03:32:26.066591 5481 raft_consensus.cc:383] T 00000000000000000000000000000000 P 789cd038419c47e9882fb6ffdbae958a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:26.066848 5481 raft_consensus.cc:738] T 00000000000000000000000000000000 P 789cd038419c47e9882fb6ffdbae958a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 789cd038419c47e9882fb6ffdbae958a, State: Initialized, Role: FOLLOWER
I20250625 03:32:26.068130 5481 consensus_queue.cc:260] T 00000000000000000000000000000000 P 789cd038419c47e9882fb6ffdbae958a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "789cd038419c47e9882fb6ffdbae958a" member_type: VOTER }
I20250625 03:32:26.068652 5484 raft_consensus.cc:491] T 00000000000000000000000000000000 P 789cd038419c47e9882fb6ffdbae958a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:32:26.069188 5484 raft_consensus.cc:513] T 00000000000000000000000000000000 P 789cd038419c47e9882fb6ffdbae958a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "789cd038419c47e9882fb6ffdbae958a" member_type: VOTER }
I20250625 03:32:26.069692 5484 leader_election.cc:304] T 00000000000000000000000000000000 P 789cd038419c47e9882fb6ffdbae958a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 789cd038419c47e9882fb6ffdbae958a; no voters:
I20250625 03:32:26.071048 5484 leader_election.cc:290] T 00000000000000000000000000000000 P 789cd038419c47e9882fb6ffdbae958a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers
I20250625 03:32:26.071552 5485 raft_consensus.cc:2802] T 00000000000000000000000000000000 P 789cd038419c47e9882fb6ffdbae958a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:32:26.072134 5485 raft_consensus.cc:491] T 00000000000000000000000000000000 P 789cd038419c47e9882fb6ffdbae958a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:32:26.068624 5481 raft_consensus.cc:397] T 00000000000000000000000000000000 P 789cd038419c47e9882fb6ffdbae958a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250625 03:32:26.072546 5485 raft_consensus.cc:3058] T 00000000000000000000000000000000 P 789cd038419c47e9882fb6ffdbae958a [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:26.077926 5485 raft_consensus.cc:513] T 00000000000000000000000000000000 P 789cd038419c47e9882fb6ffdbae958a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "789cd038419c47e9882fb6ffdbae958a" member_type: VOTER }
I20250625 03:32:26.078495 5481 raft_consensus.cc:491] T 00000000000000000000000000000000 P 789cd038419c47e9882fb6ffdbae958a [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250625 03:32:26.078454 5485 leader_election.cc:304] T 00000000000000000000000000000000 P 789cd038419c47e9882fb6ffdbae958a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 789cd038419c47e9882fb6ffdbae958a; no voters:
I20250625 03:32:26.078992 5481 raft_consensus.cc:3058] T 00000000000000000000000000000000 P 789cd038419c47e9882fb6ffdbae958a [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:26.079229 5485 leader_election.cc:290] T 00000000000000000000000000000000 P 789cd038419c47e9882fb6ffdbae958a [CANDIDATE]: Term 1 election: Requested vote from peers
I20250625 03:32:26.084483 5481 raft_consensus.cc:513] T 00000000000000000000000000000000 P 789cd038419c47e9882fb6ffdbae958a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "789cd038419c47e9882fb6ffdbae958a" member_type: VOTER }
I20250625 03:32:26.085219 5484 raft_consensus.cc:2762] T 00000000000000000000000000000000 P 789cd038419c47e9882fb6ffdbae958a [term 2 FOLLOWER]: Leader election decision vote started in defunct term 1: won
I20250625 03:32:26.085886 5481 leader_election.cc:304] T 00000000000000000000000000000000 P 789cd038419c47e9882fb6ffdbae958a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 789cd038419c47e9882fb6ffdbae958a; no voters:
I20250625 03:32:26.086436 5481 leader_election.cc:290] T 00000000000000000000000000000000 P 789cd038419c47e9882fb6ffdbae958a [CANDIDATE]: Term 2 election: Requested vote from peers
I20250625 03:32:26.086542 5485 raft_consensus.cc:2802] T 00000000000000000000000000000000 P 789cd038419c47e9882fb6ffdbae958a [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:32:26.087852 5485 raft_consensus.cc:695] T 00000000000000000000000000000000 P 789cd038419c47e9882fb6ffdbae958a [term 2 LEADER]: Becoming Leader. State: Replica: 789cd038419c47e9882fb6ffdbae958a, State: Running, Role: LEADER
I20250625 03:32:26.088644 5485 consensus_queue.cc:237] T 00000000000000000000000000000000 P 789cd038419c47e9882fb6ffdbae958a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "789cd038419c47e9882fb6ffdbae958a" member_type: VOTER }
I20250625 03:32:26.089344 5481 sys_catalog.cc:564] T 00000000000000000000000000000000 P 789cd038419c47e9882fb6ffdbae958a [sys.catalog]: configured and running, proceeding with master startup.
I20250625 03:32:26.093238 5484 sys_catalog.cc:455] T 00000000000000000000000000000000 P 789cd038419c47e9882fb6ffdbae958a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "789cd038419c47e9882fb6ffdbae958a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "789cd038419c47e9882fb6ffdbae958a" member_type: VOTER } }
I20250625 03:32:26.095353 5486 sys_catalog.cc:455] T 00000000000000000000000000000000 P 789cd038419c47e9882fb6ffdbae958a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 789cd038419c47e9882fb6ffdbae958a. Latest consensus state: current_term: 2 leader_uuid: "789cd038419c47e9882fb6ffdbae958a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "789cd038419c47e9882fb6ffdbae958a" member_type: VOTER } }
I20250625 03:32:26.096314 5486 sys_catalog.cc:458] T 00000000000000000000000000000000 P 789cd038419c47e9882fb6ffdbae958a [sys.catalog]: This master's current role is: LEADER
I20250625 03:32:26.096330 5484 sys_catalog.cc:458] T 00000000000000000000000000000000 P 789cd038419c47e9882fb6ffdbae958a [sys.catalog]: This master's current role is: LEADER
I20250625 03:32:26.102193 5494 catalog_manager.cc:1477] Loading table and tablet metadata into memory...
I20250625 03:32:26.107003 5494 catalog_manager.cc:1486] Initializing Kudu cluster ID...
I20250625 03:32:26.108043 426 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20250625 03:32:26.115656 5494 catalog_manager.cc:1349] Generated new cluster ID: cf32a8b62a3a48a09eec3227c046d54f
I20250625 03:32:26.115978 5494 catalog_manager.cc:1497] Initializing Kudu internal certificate authority...
I20250625 03:32:26.129961 5494 catalog_manager.cc:1372] Generated new certificate authority record
I20250625 03:32:26.131254 5494 catalog_manager.cc:1506] Loading token signing keys...
I20250625 03:32:26.145253 5494 catalog_manager.cc:5955] T 00000000000000000000000000000000 P 789cd038419c47e9882fb6ffdbae958a: Generated new TSK 0
I20250625 03:32:26.145859 5494 catalog_manager.cc:1516] Initializing in-progress tserver states...
I20250625 03:32:26.175061 426 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250625 03:32:26.181058 5502 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250625 03:32:26.182242 5503 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250625 03:32:26.183712 5505 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250625 03:32:26.183930 426 server_base.cc:1048] running on GCE node
I20250625 03:32:26.185058 426 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250625 03:32:26.185310 426 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250625 03:32:26.185446 426 hybrid_clock.cc:648] HybridClock initialized: now 1750822346185435 us; error 0 us; skew 500 ppm
I20250625 03:32:26.185906 426 server_base.cc:848] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250625 03:32:26.188395 426 webserver.cc:469] Webserver started at http://127.0.106.129:35955/ using document root <none> and password file <none>
I20250625 03:32:26.188840 426 fs_manager.cc:362] Metadata directory not provided
I20250625 03:32:26.188992 426 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250625 03:32:26.189195 426 server_base.cc:896] This appears to be a new deployment of Kudu; creating new FS layout
I20250625 03:32:26.190392 426 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1750822166717217-426-0/minicluster-data/ts-0-root/instance:
uuid: "f0e7c9f6ec2c46eda889ff8f199bc969"
format_stamp: "Formatted at 2025-06-25 03:32:26 on dist-test-slave-lj23"
I20250625 03:32:26.194914 426 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20250625 03:32:26.198154 5510 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250625 03:32:26.198937 426 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20250625 03:32:26.199218 426 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1750822166717217-426-0/minicluster-data/ts-0-root
uuid: "f0e7c9f6ec2c46eda889ff8f199bc969"
format_stamp: "Formatted at 2025-06-25 03:32:26 on dist-test-slave-lj23"
I20250625 03:32:26.199530 426 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1750822166717217-426-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1750822166717217-426-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1750822166717217-426-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250625 03:32:26.212723 426 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250625 03:32:26.213902 426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250625 03:32:26.215276 426 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20250625 03:32:26.217519 426 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250625 03:32:26.217710 426 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250625 03:32:26.217968 426 ts_tablet_manager.cc:610] Registered 0 tablets
I20250625 03:32:26.218137 426 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250625 03:32:26.257946 426 rpc_server.cc:307] RPC server started. Bound to: 127.0.106.129:44743
I20250625 03:32:26.258044 5572 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.106.129:44743 every 8 connection(s)
I20250625 03:32:26.262647 426 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250625 03:32:26.270249 5577 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250625 03:32:26.273052 5578 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250625 03:32:26.277287 5573 heartbeater.cc:344] Connected to a master server at 127.0.106.190:39897
I20250625 03:32:26.277817 5573 heartbeater.cc:461] Registering TS with master...
I20250625 03:32:26.278239 426 server_base.cc:1048] running on GCE node
I20250625 03:32:26.278914 5573 heartbeater.cc:507] Master 127.0.106.190:39897 requested a full tablet report, sending...
W20250625 03:32:26.278959 5580 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250625 03:32:26.279989 426 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250625 03:32:26.280227 426 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250625 03:32:26.280402 426 hybrid_clock.cc:648] HybridClock initialized: now 1750822346280381 us; error 0 us; skew 500 ppm
I20250625 03:32:26.280933 426 server_base.cc:848] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250625 03:32:26.281041 5446 ts_manager.cc:194] Registered new tserver with Master: f0e7c9f6ec2c46eda889ff8f199bc969 (127.0.106.129:44743)
I20250625 03:32:26.283010 5446 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36144
I20250625 03:32:26.283808 426 webserver.cc:469] Webserver started at http://127.0.106.130:37345/ using document root <none> and password file <none>
I20250625 03:32:26.284379 426 fs_manager.cc:362] Metadata directory not provided
I20250625 03:32:26.284582 426 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250625 03:32:26.284838 426 server_base.cc:896] This appears to be a new deployment of Kudu; creating new FS layout
I20250625 03:32:26.286007 426 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1750822166717217-426-0/minicluster-data/ts-1-root/instance:
uuid: "ac714929b11c43d482b5920a2a5b9129"
format_stamp: "Formatted at 2025-06-25 03:32:26 on dist-test-slave-lj23"
I20250625 03:32:26.291733 426 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.004s sys 0.003s
I20250625 03:32:26.295104 5585 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250625 03:32:26.295959 426 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20250625 03:32:26.296325 426 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1750822166717217-426-0/minicluster-data/ts-1-root
uuid: "ac714929b11c43d482b5920a2a5b9129"
format_stamp: "Formatted at 2025-06-25 03:32:26 on dist-test-slave-lj23"
I20250625 03:32:26.296602 426 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1750822166717217-426-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1750822166717217-426-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1750822166717217-426-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250625 03:32:26.319154 426 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250625 03:32:26.320464 426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250625 03:32:26.321966 426 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20250625 03:32:26.324303 426 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250625 03:32:26.324512 426 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250625 03:32:26.324749 426 ts_tablet_manager.cc:610] Registered 0 tablets
I20250625 03:32:26.324901 426 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250625 03:32:26.365101 426 rpc_server.cc:307] RPC server started. Bound to: 127.0.106.130:39845
I20250625 03:32:26.365211 5647 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.106.130:39845 every 8 connection(s)
I20250625 03:32:26.369832 426 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250625 03:32:26.377307 5651 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250625 03:32:26.379266 5652 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250625 03:32:26.382131 426 server_base.cc:1048] running on GCE node
W20250625 03:32:26.382601 5654 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250625 03:32:26.383030 5648 heartbeater.cc:344] Connected to a master server at 127.0.106.190:39897
I20250625 03:32:26.383460 5648 heartbeater.cc:461] Registering TS with master...
I20250625 03:32:26.383644 426 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250625 03:32:26.383944 426 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250625 03:32:26.384156 426 hybrid_clock.cc:648] HybridClock initialized: now 1750822346384140 us; error 0 us; skew 500 ppm
I20250625 03:32:26.384450 5648 heartbeater.cc:507] Master 127.0.106.190:39897 requested a full tablet report, sending...
I20250625 03:32:26.384725 426 server_base.cc:848] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250625 03:32:26.386406 5446 ts_manager.cc:194] Registered new tserver with Master: ac714929b11c43d482b5920a2a5b9129 (127.0.106.130:39845)
I20250625 03:32:26.388082 5446 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36160
I20250625 03:32:26.388837 426 webserver.cc:469] Webserver started at http://127.0.106.131:35761/ using document root <none> and password file <none>
I20250625 03:32:26.389539 426 fs_manager.cc:362] Metadata directory not provided
I20250625 03:32:26.389794 426 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250625 03:32:26.390121 426 server_base.cc:896] This appears to be a new deployment of Kudu; creating new FS layout
I20250625 03:32:26.391572 426 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1750822166717217-426-0/minicluster-data/ts-2-root/instance:
uuid: "5a67f69245d14aa395dd7410912ee2d5"
format_stamp: "Formatted at 2025-06-25 03:32:26 on dist-test-slave-lj23"
I20250625 03:32:26.396202 426 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20250625 03:32:26.399593 5659 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250625 03:32:26.400410 426 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20250625 03:32:26.400710 426 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1750822166717217-426-0/minicluster-data/ts-2-root
uuid: "5a67f69245d14aa395dd7410912ee2d5"
format_stamp: "Formatted at 2025-06-25 03:32:26 on dist-test-slave-lj23"
I20250625 03:32:26.400983 426 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1750822166717217-426-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1750822166717217-426-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taska0nJ0Z/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1750822166717217-426-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250625 03:32:26.443744 426 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250625 03:32:26.444981 426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250625 03:32:26.446487 426 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20250625 03:32:26.448693 426 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250625 03:32:26.448879 426 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250625 03:32:26.449141 426 ts_tablet_manager.cc:610] Registered 0 tablets
I20250625 03:32:26.449285 426 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250625 03:32:26.489825 426 rpc_server.cc:307] RPC server started. Bound to: 127.0.106.131:38277
I20250625 03:32:26.489955 5721 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.106.131:38277 every 8 connection(s)
I20250625 03:32:26.504825 5722 heartbeater.cc:344] Connected to a master server at 127.0.106.190:39897
I20250625 03:32:26.505275 5722 heartbeater.cc:461] Registering TS with master...
I20250625 03:32:26.506106 5722 heartbeater.cc:507] Master 127.0.106.190:39897 requested a full tablet report, sending...
I20250625 03:32:26.507931 5446 ts_manager.cc:194] Registered new tserver with Master: 5a67f69245d14aa395dd7410912ee2d5 (127.0.106.131:38277)
I20250625 03:32:26.508183 426 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014645792s
I20250625 03:32:26.509778 5446 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36172
I20250625 03:32:26.511201 426 test_util.cc:276] Using random seed: 403133261
I20250625 03:32:26.533427 5446 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36188:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 03:32:26.536156 5446 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 03:32:26.615540 5538 tablet_service.cc:1468] Processing CreateTablet for tablet f586c1c904ee41f785ba350b68057810 (DEFAULT_TABLE table=test-workload [id=d7ecb67e57b94f09bc8215cd6ac27844]), partition=RANGE (key) PARTITION VALUES < 238609294
I20250625 03:32:26.616045 5537 tablet_service.cc:1468] Processing CreateTablet for tablet b01160bf577842c485d19170bfcb2946 (DEFAULT_TABLE table=test-workload [id=d7ecb67e57b94f09bc8215cd6ac27844]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20250625 03:32:26.617015 5538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f586c1c904ee41f785ba350b68057810. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:26.618060 5537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b01160bf577842c485d19170bfcb2946. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:26.618714 5532 tablet_service.cc:1468] Processing CreateTablet for tablet 9d744327c3714ed99169ee010b3a1eb7 (DEFAULT_TABLE table=test-workload [id=d7ecb67e57b94f09bc8215cd6ac27844]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20250625 03:32:26.619800 5532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d744327c3714ed99169ee010b3a1eb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:26.622874 5533 tablet_service.cc:1468] Processing CreateTablet for tablet dd40af6d9f9b4ae2ab31241b28f3b002 (DEFAULT_TABLE table=test-workload [id=d7ecb67e57b94f09bc8215cd6ac27844]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20250625 03:32:26.624130 5533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd40af6d9f9b4ae2ab31241b28f3b002. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:26.624753 5536 tablet_service.cc:1468] Processing CreateTablet for tablet 3857bc0f026242499856f49c07bccf36 (DEFAULT_TABLE table=test-workload [id=d7ecb67e57b94f09bc8215cd6ac27844]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20250625 03:32:26.626161 5536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3857bc0f026242499856f49c07bccf36. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:26.628535 5534 tablet_service.cc:1468] Processing CreateTablet for tablet 8014b6301211413cbbe6a34e60213b1f (DEFAULT_TABLE table=test-workload [id=d7ecb67e57b94f09bc8215cd6ac27844]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20250625 03:32:26.629968 5534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8014b6301211413cbbe6a34e60213b1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:26.633031 5535 tablet_service.cc:1468] Processing CreateTablet for tablet 95a70da0935d43aba7bf794c38763425 (DEFAULT_TABLE table=test-workload [id=d7ecb67e57b94f09bc8215cd6ac27844]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20250625 03:32:26.634415 5535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95a70da0935d43aba7bf794c38763425. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:26.664084 5737 tablet_bootstrap.cc:492] T b01160bf577842c485d19170bfcb2946 P f0e7c9f6ec2c46eda889ff8f199bc969: Bootstrap starting.
I20250625 03:32:26.671435 5737 tablet_bootstrap.cc:654] T b01160bf577842c485d19170bfcb2946 P f0e7c9f6ec2c46eda889ff8f199bc969: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:26.687618 5609 tablet_service.cc:1468] Processing CreateTablet for tablet 8014b6301211413cbbe6a34e60213b1f (DEFAULT_TABLE table=test-workload [id=d7ecb67e57b94f09bc8215cd6ac27844]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20250625 03:32:26.687949 5613 tablet_service.cc:1468] Processing CreateTablet for tablet f586c1c904ee41f785ba350b68057810 (DEFAULT_TABLE table=test-workload [id=d7ecb67e57b94f09bc8215cd6ac27844]), partition=RANGE (key) PARTITION VALUES < 238609294
I20250625 03:32:26.689220 5609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8014b6301211413cbbe6a34e60213b1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:26.690163 5737 tablet_bootstrap.cc:492] T b01160bf577842c485d19170bfcb2946 P f0e7c9f6ec2c46eda889ff8f199bc969: No bootstrap required, opened a new log
I20250625 03:32:26.690729 5737 ts_tablet_manager.cc:1397] T b01160bf577842c485d19170bfcb2946 P f0e7c9f6ec2c46eda889ff8f199bc969: Time spent bootstrapping tablet: real 0.027s user 0.011s sys 0.006s
I20250625 03:32:26.690356 5612 tablet_service.cc:1468] Processing CreateTablet for tablet b01160bf577842c485d19170bfcb2946 (DEFAULT_TABLE table=test-workload [id=d7ecb67e57b94f09bc8215cd6ac27844]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20250625 03:32:26.691778 5612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b01160bf577842c485d19170bfcb2946. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:26.693187 5611 tablet_service.cc:1468] Processing CreateTablet for tablet 3857bc0f026242499856f49c07bccf36 (DEFAULT_TABLE table=test-workload [id=d7ecb67e57b94f09bc8215cd6ac27844]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20250625 03:32:26.693897 5737 raft_consensus.cc:357] T b01160bf577842c485d19170bfcb2946 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:26.694712 5737 raft_consensus.cc:383] T b01160bf577842c485d19170bfcb2946 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:26.695008 5737 raft_consensus.cc:738] T b01160bf577842c485d19170bfcb2946 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0e7c9f6ec2c46eda889ff8f199bc969, State: Initialized, Role: FOLLOWER
I20250625 03:32:26.695446 5610 tablet_service.cc:1468] Processing CreateTablet for tablet 95a70da0935d43aba7bf794c38763425 (DEFAULT_TABLE table=test-workload [id=d7ecb67e57b94f09bc8215cd6ac27844]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20250625 03:32:26.695758 5737 consensus_queue.cc:260] T b01160bf577842c485d19170bfcb2946 P f0e7c9f6ec2c46eda889ff8f199bc969 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:26.697822 5608 tablet_service.cc:1468] Processing CreateTablet for tablet dd40af6d9f9b4ae2ab31241b28f3b002 (DEFAULT_TABLE table=test-workload [id=d7ecb67e57b94f09bc8215cd6ac27844]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20250625 03:32:26.700088 5607 tablet_service.cc:1468] Processing CreateTablet for tablet 9d744327c3714ed99169ee010b3a1eb7 (DEFAULT_TABLE table=test-workload [id=d7ecb67e57b94f09bc8215cd6ac27844]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20250625 03:32:26.708375 5607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d744327c3714ed99169ee010b3a1eb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:26.709699 5537 tablet_service.cc:1468] Processing CreateTablet for tablet ec327833dcb74b6b8679315df6d60ac5 (DEFAULT_TABLE table=test-workload [id=d7ecb67e57b94f09bc8215cd6ac27844]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20250625 03:32:26.711050 5537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec327833dcb74b6b8679315df6d60ac5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:26.712779 5610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95a70da0935d43aba7bf794c38763425. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:26.716935 5611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3857bc0f026242499856f49c07bccf36. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:26.720443 5608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd40af6d9f9b4ae2ab31241b28f3b002. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:26.722000 5613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f586c1c904ee41f785ba350b68057810. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:26.724947 5533 tablet_service.cc:1468] Processing CreateTablet for tablet 09262e1d4d2346d1b9610e857b693324 (DEFAULT_TABLE table=test-workload [id=d7ecb67e57b94f09bc8215cd6ac27844]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20250625 03:32:26.726423 5605 tablet_service.cc:1468] Processing CreateTablet for tablet ec327833dcb74b6b8679315df6d60ac5 (DEFAULT_TABLE table=test-workload [id=d7ecb67e57b94f09bc8215cd6ac27844]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20250625 03:32:26.737354 5605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec327833dcb74b6b8679315df6d60ac5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:26.724934 5606 tablet_service.cc:1468] Processing CreateTablet for tablet 09262e1d4d2346d1b9610e857b693324 (DEFAULT_TABLE table=test-workload [id=d7ecb67e57b94f09bc8215cd6ac27844]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20250625 03:32:26.741171 5606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09262e1d4d2346d1b9610e857b693324. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:26.753094 5533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09262e1d4d2346d1b9610e857b693324. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:26.781622 5687 tablet_service.cc:1468] Processing CreateTablet for tablet f586c1c904ee41f785ba350b68057810 (DEFAULT_TABLE table=test-workload [id=d7ecb67e57b94f09bc8215cd6ac27844]), partition=RANGE (key) PARTITION VALUES < 238609294
I20250625 03:32:26.783586 5687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f586c1c904ee41f785ba350b68057810. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:26.731195 5740 tablet_bootstrap.cc:492] T 8014b6301211413cbbe6a34e60213b1f P ac714929b11c43d482b5920a2a5b9129: Bootstrap starting.
I20250625 03:32:26.785651 5686 tablet_service.cc:1468] Processing CreateTablet for tablet b01160bf577842c485d19170bfcb2946 (DEFAULT_TABLE table=test-workload [id=d7ecb67e57b94f09bc8215cd6ac27844]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20250625 03:32:26.787406 5686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b01160bf577842c485d19170bfcb2946. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:26.787663 5573 heartbeater.cc:499] Master 127.0.106.190:39897 was elected leader, sending a full tablet report...
I20250625 03:32:26.789314 5685 tablet_service.cc:1468] Processing CreateTablet for tablet 3857bc0f026242499856f49c07bccf36 (DEFAULT_TABLE table=test-workload [id=d7ecb67e57b94f09bc8215cd6ac27844]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20250625 03:32:26.791170 5685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3857bc0f026242499856f49c07bccf36. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:26.793605 5684 tablet_service.cc:1468] Processing CreateTablet for tablet 95a70da0935d43aba7bf794c38763425 (DEFAULT_TABLE table=test-workload [id=d7ecb67e57b94f09bc8215cd6ac27844]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20250625 03:32:26.794643 5737 ts_tablet_manager.cc:1428] T b01160bf577842c485d19170bfcb2946 P f0e7c9f6ec2c46eda889ff8f199bc969: Time spent starting tablet: real 0.104s user 0.027s sys 0.050s
I20250625 03:32:26.795012 5684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95a70da0935d43aba7bf794c38763425. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:26.795769 5737 tablet_bootstrap.cc:492] T dd40af6d9f9b4ae2ab31241b28f3b002 P f0e7c9f6ec2c46eda889ff8f199bc969: Bootstrap starting.
I20250625 03:32:26.797178 5683 tablet_service.cc:1468] Processing CreateTablet for tablet 8014b6301211413cbbe6a34e60213b1f (DEFAULT_TABLE table=test-workload [id=d7ecb67e57b94f09bc8215cd6ac27844]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20250625 03:32:26.797693 5740 tablet_bootstrap.cc:654] T 8014b6301211413cbbe6a34e60213b1f P ac714929b11c43d482b5920a2a5b9129: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:26.800175 5682 tablet_service.cc:1468] Processing CreateTablet for tablet dd40af6d9f9b4ae2ab31241b28f3b002 (DEFAULT_TABLE table=test-workload [id=d7ecb67e57b94f09bc8215cd6ac27844]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20250625 03:32:26.801826 5681 tablet_service.cc:1468] Processing CreateTablet for tablet 9d744327c3714ed99169ee010b3a1eb7 (DEFAULT_TABLE table=test-workload [id=d7ecb67e57b94f09bc8215cd6ac27844]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20250625 03:32:26.808399 5683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8014b6301211413cbbe6a34e60213b1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:26.813664 5682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd40af6d9f9b4ae2ab31241b28f3b002. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:26.813313 5679 tablet_service.cc:1468] Processing CreateTablet for tablet ec327833dcb74b6b8679315df6d60ac5 (DEFAULT_TABLE table=test-workload [id=d7ecb67e57b94f09bc8215cd6ac27844]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20250625 03:32:26.814127 5740 tablet_bootstrap.cc:492] T 8014b6301211413cbbe6a34e60213b1f P ac714929b11c43d482b5920a2a5b9129: No bootstrap required, opened a new log
I20250625 03:32:26.814724 5740 ts_tablet_manager.cc:1397] T 8014b6301211413cbbe6a34e60213b1f P ac714929b11c43d482b5920a2a5b9129: Time spent bootstrapping tablet: real 0.084s user 0.021s sys 0.000s
I20250625 03:32:26.803414 5680 tablet_service.cc:1468] Processing CreateTablet for tablet 09262e1d4d2346d1b9610e857b693324 (DEFAULT_TABLE table=test-workload [id=d7ecb67e57b94f09bc8215cd6ac27844]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20250625 03:32:26.810446 5737 tablet_bootstrap.cc:654] T dd40af6d9f9b4ae2ab31241b28f3b002 P f0e7c9f6ec2c46eda889ff8f199bc969: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:26.818009 5740 raft_consensus.cc:357] T 8014b6301211413cbbe6a34e60213b1f P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:26.818867 5740 raft_consensus.cc:383] T 8014b6301211413cbbe6a34e60213b1f P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:26.819222 5740 raft_consensus.cc:738] T 8014b6301211413cbbe6a34e60213b1f P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac714929b11c43d482b5920a2a5b9129, State: Initialized, Role: FOLLOWER
I20250625 03:32:26.814787 5679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec327833dcb74b6b8679315df6d60ac5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:26.820194 5740 consensus_queue.cc:260] T 8014b6301211413cbbe6a34e60213b1f P ac714929b11c43d482b5920a2a5b9129 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:26.824379 5680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09262e1d4d2346d1b9610e857b693324. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:26.829843 5681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d744327c3714ed99169ee010b3a1eb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:26.831740 5737 tablet_bootstrap.cc:492] T dd40af6d9f9b4ae2ab31241b28f3b002 P f0e7c9f6ec2c46eda889ff8f199bc969: No bootstrap required, opened a new log
I20250625 03:32:26.832387 5737 ts_tablet_manager.cc:1397] T dd40af6d9f9b4ae2ab31241b28f3b002 P f0e7c9f6ec2c46eda889ff8f199bc969: Time spent bootstrapping tablet: real 0.037s user 0.012s sys 0.001s
I20250625 03:32:26.835223 5737 raft_consensus.cc:357] T dd40af6d9f9b4ae2ab31241b28f3b002 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:26.835947 5737 raft_consensus.cc:383] T dd40af6d9f9b4ae2ab31241b28f3b002 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:26.848381 5737 raft_consensus.cc:738] T dd40af6d9f9b4ae2ab31241b28f3b002 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0e7c9f6ec2c46eda889ff8f199bc969, State: Initialized, Role: FOLLOWER
I20250625 03:32:26.849205 5737 consensus_queue.cc:260] T dd40af6d9f9b4ae2ab31241b28f3b002 P f0e7c9f6ec2c46eda889ff8f199bc969 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:26.853459 5737 ts_tablet_manager.cc:1428] T dd40af6d9f9b4ae2ab31241b28f3b002 P f0e7c9f6ec2c46eda889ff8f199bc969: Time spent starting tablet: real 0.021s user 0.006s sys 0.000s
I20250625 03:32:26.854537 5737 tablet_bootstrap.cc:492] T 8014b6301211413cbbe6a34e60213b1f P f0e7c9f6ec2c46eda889ff8f199bc969: Bootstrap starting.
I20250625 03:32:26.860954 5737 tablet_bootstrap.cc:654] T 8014b6301211413cbbe6a34e60213b1f P f0e7c9f6ec2c46eda889ff8f199bc969: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:26.874673 5648 heartbeater.cc:499] Master 127.0.106.190:39897 was elected leader, sending a full tablet report...
I20250625 03:32:26.874945 5744 tablet_bootstrap.cc:492] T ec327833dcb74b6b8679315df6d60ac5 P 5a67f69245d14aa395dd7410912ee2d5: Bootstrap starting.
I20250625 03:32:26.881247 5740 ts_tablet_manager.cc:1428] T 8014b6301211413cbbe6a34e60213b1f P ac714929b11c43d482b5920a2a5b9129: Time spent starting tablet: real 0.066s user 0.027s sys 0.022s
I20250625 03:32:26.886642 5739 raft_consensus.cc:491] T b01160bf577842c485d19170bfcb2946 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:32:26.887239 5739 raft_consensus.cc:513] T b01160bf577842c485d19170bfcb2946 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:26.891271 5740 tablet_bootstrap.cc:492] T dd40af6d9f9b4ae2ab31241b28f3b002 P ac714929b11c43d482b5920a2a5b9129: Bootstrap starting.
I20250625 03:32:26.893380 5739 leader_election.cc:290] T b01160bf577842c485d19170bfcb2946 P f0e7c9f6ec2c46eda889ff8f199bc969 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac714929b11c43d482b5920a2a5b9129 (127.0.106.130:39845), 5a67f69245d14aa395dd7410912ee2d5 (127.0.106.131:38277)
I20250625 03:32:26.913259 5744 tablet_bootstrap.cc:654] T ec327833dcb74b6b8679315df6d60ac5 P 5a67f69245d14aa395dd7410912ee2d5: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:26.922821 5737 tablet_bootstrap.cc:492] T 8014b6301211413cbbe6a34e60213b1f P f0e7c9f6ec2c46eda889ff8f199bc969: No bootstrap required, opened a new log
I20250625 03:32:26.923360 5737 ts_tablet_manager.cc:1397] T 8014b6301211413cbbe6a34e60213b1f P f0e7c9f6ec2c46eda889ff8f199bc969: Time spent bootstrapping tablet: real 0.069s user 0.007s sys 0.020s
I20250625 03:32:26.926254 5737 raft_consensus.cc:357] T 8014b6301211413cbbe6a34e60213b1f P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:26.927011 5737 raft_consensus.cc:383] T 8014b6301211413cbbe6a34e60213b1f P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:26.927278 5737 raft_consensus.cc:738] T 8014b6301211413cbbe6a34e60213b1f P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0e7c9f6ec2c46eda889ff8f199bc969, State: Initialized, Role: FOLLOWER
I20250625 03:32:26.928130 5737 consensus_queue.cc:260] T 8014b6301211413cbbe6a34e60213b1f P f0e7c9f6ec2c46eda889ff8f199bc969 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:26.930797 5737 ts_tablet_manager.cc:1428] T 8014b6301211413cbbe6a34e60213b1f P f0e7c9f6ec2c46eda889ff8f199bc969: Time spent starting tablet: real 0.007s user 0.004s sys 0.004s
I20250625 03:32:26.931881 5737 tablet_bootstrap.cc:492] T f586c1c904ee41f785ba350b68057810 P f0e7c9f6ec2c46eda889ff8f199bc969: Bootstrap starting.
I20250625 03:32:26.931764 5697 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b01160bf577842c485d19170bfcb2946" candidate_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a67f69245d14aa395dd7410912ee2d5" is_pre_election: true
I20250625 03:32:26.932680 5744 tablet_bootstrap.cc:492] T ec327833dcb74b6b8679315df6d60ac5 P 5a67f69245d14aa395dd7410912ee2d5: No bootstrap required, opened a new log
I20250625 03:32:26.933193 5744 ts_tablet_manager.cc:1397] T ec327833dcb74b6b8679315df6d60ac5 P 5a67f69245d14aa395dd7410912ee2d5: Time spent bootstrapping tablet: real 0.059s user 0.004s sys 0.008s
W20250625 03:32:26.934199 5512 leader_election.cc:343] T b01160bf577842c485d19170bfcb2946 P f0e7c9f6ec2c46eda889ff8f199bc969 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a67f69245d14aa395dd7410912ee2d5 (127.0.106.131:38277): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:32:26.934585 5623 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b01160bf577842c485d19170bfcb2946" candidate_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac714929b11c43d482b5920a2a5b9129" is_pre_election: true
W20250625 03:32:26.935973 5513 leader_election.cc:343] T b01160bf577842c485d19170bfcb2946 P f0e7c9f6ec2c46eda889ff8f199bc969 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac714929b11c43d482b5920a2a5b9129 (127.0.106.130:39845): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:32:26.936450 5513 leader_election.cc:304] T b01160bf577842c485d19170bfcb2946 P f0e7c9f6ec2c46eda889ff8f199bc969 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0e7c9f6ec2c46eda889ff8f199bc969; no voters: 5a67f69245d14aa395dd7410912ee2d5, ac714929b11c43d482b5920a2a5b9129
I20250625 03:32:26.937631 5739 raft_consensus.cc:2747] T b01160bf577842c485d19170bfcb2946 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:32:26.937573 5740 tablet_bootstrap.cc:654] T dd40af6d9f9b4ae2ab31241b28f3b002 P ac714929b11c43d482b5920a2a5b9129: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:26.938467 5737 tablet_bootstrap.cc:654] T f586c1c904ee41f785ba350b68057810 P f0e7c9f6ec2c46eda889ff8f199bc969: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:26.942766 5744 raft_consensus.cc:357] T ec327833dcb74b6b8679315df6d60ac5 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:26.943996 5744 raft_consensus.cc:383] T ec327833dcb74b6b8679315df6d60ac5 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:26.944469 5744 raft_consensus.cc:738] T ec327833dcb74b6b8679315df6d60ac5 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a67f69245d14aa395dd7410912ee2d5, State: Initialized, Role: FOLLOWER
I20250625 03:32:26.945675 5744 consensus_queue.cc:260] T ec327833dcb74b6b8679315df6d60ac5 P 5a67f69245d14aa395dd7410912ee2d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:26.949939 5737 tablet_bootstrap.cc:492] T f586c1c904ee41f785ba350b68057810 P f0e7c9f6ec2c46eda889ff8f199bc969: No bootstrap required, opened a new log
I20250625 03:32:26.950155 5740 tablet_bootstrap.cc:492] T dd40af6d9f9b4ae2ab31241b28f3b002 P ac714929b11c43d482b5920a2a5b9129: No bootstrap required, opened a new log
I20250625 03:32:26.950402 5737 ts_tablet_manager.cc:1397] T f586c1c904ee41f785ba350b68057810 P f0e7c9f6ec2c46eda889ff8f199bc969: Time spent bootstrapping tablet: real 0.019s user 0.011s sys 0.006s
I20250625 03:32:26.950870 5740 ts_tablet_manager.cc:1397] T dd40af6d9f9b4ae2ab31241b28f3b002 P ac714929b11c43d482b5920a2a5b9129: Time spent bootstrapping tablet: real 0.060s user 0.016s sys 0.002s
I20250625 03:32:26.952924 5737 raft_consensus.cc:357] T f586c1c904ee41f785ba350b68057810 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:26.953194 5722 heartbeater.cc:499] Master 127.0.106.190:39897 was elected leader, sending a full tablet report...
I20250625 03:32:26.953547 5737 raft_consensus.cc:383] T f586c1c904ee41f785ba350b68057810 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:26.953819 5737 raft_consensus.cc:738] T f586c1c904ee41f785ba350b68057810 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0e7c9f6ec2c46eda889ff8f199bc969, State: Initialized, Role: FOLLOWER
I20250625 03:32:26.954056 5744 ts_tablet_manager.cc:1428] T ec327833dcb74b6b8679315df6d60ac5 P 5a67f69245d14aa395dd7410912ee2d5: Time spent starting tablet: real 0.021s user 0.011s sys 0.004s
I20250625 03:32:26.954402 5737 consensus_queue.cc:260] T f586c1c904ee41f785ba350b68057810 P f0e7c9f6ec2c46eda889ff8f199bc969 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:26.955267 5744 tablet_bootstrap.cc:492] T 09262e1d4d2346d1b9610e857b693324 P 5a67f69245d14aa395dd7410912ee2d5: Bootstrap starting.
I20250625 03:32:26.956612 5737 ts_tablet_manager.cc:1428] T f586c1c904ee41f785ba350b68057810 P f0e7c9f6ec2c46eda889ff8f199bc969: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20250625 03:32:26.957684 5737 tablet_bootstrap.cc:492] T 9d744327c3714ed99169ee010b3a1eb7 P f0e7c9f6ec2c46eda889ff8f199bc969: Bootstrap starting.
I20250625 03:32:26.961910 5744 tablet_bootstrap.cc:654] T 09262e1d4d2346d1b9610e857b693324 P 5a67f69245d14aa395dd7410912ee2d5: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:26.962761 5737 tablet_bootstrap.cc:654] T 9d744327c3714ed99169ee010b3a1eb7 P f0e7c9f6ec2c46eda889ff8f199bc969: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:26.964221 5740 raft_consensus.cc:357] T dd40af6d9f9b4ae2ab31241b28f3b002 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:26.965026 5740 raft_consensus.cc:383] T dd40af6d9f9b4ae2ab31241b28f3b002 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:26.965334 5740 raft_consensus.cc:738] T dd40af6d9f9b4ae2ab31241b28f3b002 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac714929b11c43d482b5920a2a5b9129, State: Initialized, Role: FOLLOWER
I20250625 03:32:26.966295 5740 consensus_queue.cc:260] T dd40af6d9f9b4ae2ab31241b28f3b002 P ac714929b11c43d482b5920a2a5b9129 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:26.969659 5740 ts_tablet_manager.cc:1428] T dd40af6d9f9b4ae2ab31241b28f3b002 P ac714929b11c43d482b5920a2a5b9129: Time spent starting tablet: real 0.018s user 0.003s sys 0.007s
I20250625 03:32:26.971122 5740 tablet_bootstrap.cc:492] T f586c1c904ee41f785ba350b68057810 P ac714929b11c43d482b5920a2a5b9129: Bootstrap starting.
I20250625 03:32:26.979629 5740 tablet_bootstrap.cc:654] T f586c1c904ee41f785ba350b68057810 P ac714929b11c43d482b5920a2a5b9129: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:26.981463 5737 tablet_bootstrap.cc:492] T 9d744327c3714ed99169ee010b3a1eb7 P f0e7c9f6ec2c46eda889ff8f199bc969: No bootstrap required, opened a new log
I20250625 03:32:26.982100 5737 ts_tablet_manager.cc:1397] T 9d744327c3714ed99169ee010b3a1eb7 P f0e7c9f6ec2c46eda889ff8f199bc969: Time spent bootstrapping tablet: real 0.025s user 0.009s sys 0.013s
I20250625 03:32:26.985769 5737 raft_consensus.cc:357] T 9d744327c3714ed99169ee010b3a1eb7 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:26.986315 5737 raft_consensus.cc:383] T 9d744327c3714ed99169ee010b3a1eb7 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:26.986498 5737 raft_consensus.cc:738] T 9d744327c3714ed99169ee010b3a1eb7 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0e7c9f6ec2c46eda889ff8f199bc969, State: Initialized, Role: FOLLOWER
I20250625 03:32:26.987424 5744 tablet_bootstrap.cc:492] T 09262e1d4d2346d1b9610e857b693324 P 5a67f69245d14aa395dd7410912ee2d5: No bootstrap required, opened a new log
I20250625 03:32:26.987025 5737 consensus_queue.cc:260] T 9d744327c3714ed99169ee010b3a1eb7 P f0e7c9f6ec2c46eda889ff8f199bc969 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:26.988042 5744 ts_tablet_manager.cc:1397] T 09262e1d4d2346d1b9610e857b693324 P 5a67f69245d14aa395dd7410912ee2d5: Time spent bootstrapping tablet: real 0.033s user 0.013s sys 0.005s
I20250625 03:32:26.988843 5740 tablet_bootstrap.cc:492] T f586c1c904ee41f785ba350b68057810 P ac714929b11c43d482b5920a2a5b9129: No bootstrap required, opened a new log
I20250625 03:32:26.989445 5740 ts_tablet_manager.cc:1397] T f586c1c904ee41f785ba350b68057810 P ac714929b11c43d482b5920a2a5b9129: Time spent bootstrapping tablet: real 0.019s user 0.007s sys 0.010s
I20250625 03:32:26.990954 5744 raft_consensus.cc:357] T 09262e1d4d2346d1b9610e857b693324 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:26.991737 5744 raft_consensus.cc:383] T 09262e1d4d2346d1b9610e857b693324 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:26.992076 5744 raft_consensus.cc:738] T 09262e1d4d2346d1b9610e857b693324 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a67f69245d14aa395dd7410912ee2d5, State: Initialized, Role: FOLLOWER
I20250625 03:32:26.992118 5737 ts_tablet_manager.cc:1428] T 9d744327c3714ed99169ee010b3a1eb7 P f0e7c9f6ec2c46eda889ff8f199bc969: Time spent starting tablet: real 0.010s user 0.010s sys 0.000s
I20250625 03:32:26.992556 5740 raft_consensus.cc:357] T f586c1c904ee41f785ba350b68057810 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:26.992864 5744 consensus_queue.cc:260] T 09262e1d4d2346d1b9610e857b693324 P 5a67f69245d14aa395dd7410912ee2d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:26.993355 5737 tablet_bootstrap.cc:492] T 3857bc0f026242499856f49c07bccf36 P f0e7c9f6ec2c46eda889ff8f199bc969: Bootstrap starting.
I20250625 03:32:26.993355 5740 raft_consensus.cc:383] T f586c1c904ee41f785ba350b68057810 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:26.994002 5740 raft_consensus.cc:738] T f586c1c904ee41f785ba350b68057810 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac714929b11c43d482b5920a2a5b9129, State: Initialized, Role: FOLLOWER
I20250625 03:32:26.994748 5740 consensus_queue.cc:260] T f586c1c904ee41f785ba350b68057810 P ac714929b11c43d482b5920a2a5b9129 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:26.995309 5744 ts_tablet_manager.cc:1428] T 09262e1d4d2346d1b9610e857b693324 P 5a67f69245d14aa395dd7410912ee2d5: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20250625 03:32:26.997255 5740 ts_tablet_manager.cc:1428] T f586c1c904ee41f785ba350b68057810 P ac714929b11c43d482b5920a2a5b9129: Time spent starting tablet: real 0.007s user 0.000s sys 0.006s
I20250625 03:32:26.998355 5740 tablet_bootstrap.cc:492] T 95a70da0935d43aba7bf794c38763425 P ac714929b11c43d482b5920a2a5b9129: Bootstrap starting.
I20250625 03:32:27.000785 5737 tablet_bootstrap.cc:654] T 3857bc0f026242499856f49c07bccf36 P f0e7c9f6ec2c46eda889ff8f199bc969: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:27.005187 5744 tablet_bootstrap.cc:492] T 9d744327c3714ed99169ee010b3a1eb7 P 5a67f69245d14aa395dd7410912ee2d5: Bootstrap starting.
I20250625 03:32:27.007933 5740 tablet_bootstrap.cc:654] T 95a70da0935d43aba7bf794c38763425 P ac714929b11c43d482b5920a2a5b9129: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:27.012954 5744 tablet_bootstrap.cc:654] T 9d744327c3714ed99169ee010b3a1eb7 P 5a67f69245d14aa395dd7410912ee2d5: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:27.016772 5737 tablet_bootstrap.cc:492] T 3857bc0f026242499856f49c07bccf36 P f0e7c9f6ec2c46eda889ff8f199bc969: No bootstrap required, opened a new log
I20250625 03:32:27.017567 5737 ts_tablet_manager.cc:1397] T 3857bc0f026242499856f49c07bccf36 P f0e7c9f6ec2c46eda889ff8f199bc969: Time spent bootstrapping tablet: real 0.024s user 0.018s sys 0.002s
I20250625 03:32:27.020850 5737 raft_consensus.cc:357] T 3857bc0f026242499856f49c07bccf36 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:27.021353 5740 tablet_bootstrap.cc:492] T 95a70da0935d43aba7bf794c38763425 P ac714929b11c43d482b5920a2a5b9129: No bootstrap required, opened a new log
I20250625 03:32:27.021741 5737 raft_consensus.cc:383] T 3857bc0f026242499856f49c07bccf36 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:27.022017 5740 ts_tablet_manager.cc:1397] T 95a70da0935d43aba7bf794c38763425 P ac714929b11c43d482b5920a2a5b9129: Time spent bootstrapping tablet: real 0.024s user 0.006s sys 0.012s
I20250625 03:32:27.022060 5737 raft_consensus.cc:738] T 3857bc0f026242499856f49c07bccf36 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0e7c9f6ec2c46eda889ff8f199bc969, State: Initialized, Role: FOLLOWER
I20250625 03:32:27.022797 5744 tablet_bootstrap.cc:492] T 9d744327c3714ed99169ee010b3a1eb7 P 5a67f69245d14aa395dd7410912ee2d5: No bootstrap required, opened a new log
I20250625 03:32:27.023252 5744 ts_tablet_manager.cc:1397] T 9d744327c3714ed99169ee010b3a1eb7 P 5a67f69245d14aa395dd7410912ee2d5: Time spent bootstrapping tablet: real 0.018s user 0.008s sys 0.008s
I20250625 03:32:27.023003 5737 consensus_queue.cc:260] T 3857bc0f026242499856f49c07bccf36 P f0e7c9f6ec2c46eda889ff8f199bc969 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:27.025038 5740 raft_consensus.cc:357] T 95a70da0935d43aba7bf794c38763425 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:27.025594 5737 ts_tablet_manager.cc:1428] T 3857bc0f026242499856f49c07bccf36 P f0e7c9f6ec2c46eda889ff8f199bc969: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20250625 03:32:27.025985 5744 raft_consensus.cc:357] T 9d744327c3714ed99169ee010b3a1eb7 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:27.026739 5737 tablet_bootstrap.cc:492] T ec327833dcb74b6b8679315df6d60ac5 P f0e7c9f6ec2c46eda889ff8f199bc969: Bootstrap starting.
I20250625 03:32:27.026849 5744 raft_consensus.cc:383] T 9d744327c3714ed99169ee010b3a1eb7 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:27.027196 5744 raft_consensus.cc:738] T 9d744327c3714ed99169ee010b3a1eb7 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a67f69245d14aa395dd7410912ee2d5, State: Initialized, Role: FOLLOWER
I20250625 03:32:27.025801 5740 raft_consensus.cc:383] T 95a70da0935d43aba7bf794c38763425 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:27.028369 5740 raft_consensus.cc:738] T 95a70da0935d43aba7bf794c38763425 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac714929b11c43d482b5920a2a5b9129, State: Initialized, Role: FOLLOWER
I20250625 03:32:27.027951 5744 consensus_queue.cc:260] T 9d744327c3714ed99169ee010b3a1eb7 P 5a67f69245d14aa395dd7410912ee2d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:27.028895 5740 consensus_queue.cc:260] T 95a70da0935d43aba7bf794c38763425 P ac714929b11c43d482b5920a2a5b9129 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:27.031122 5740 ts_tablet_manager.cc:1428] T 95a70da0935d43aba7bf794c38763425 P ac714929b11c43d482b5920a2a5b9129: Time spent starting tablet: real 0.009s user 0.004s sys 0.000s
I20250625 03:32:27.032392 5744 ts_tablet_manager.cc:1428] T 9d744327c3714ed99169ee010b3a1eb7 P 5a67f69245d14aa395dd7410912ee2d5: Time spent starting tablet: real 0.009s user 0.009s sys 0.000s
I20250625 03:32:27.033432 5744 tablet_bootstrap.cc:492] T b01160bf577842c485d19170bfcb2946 P 5a67f69245d14aa395dd7410912ee2d5: Bootstrap starting.
I20250625 03:32:27.035877 5737 tablet_bootstrap.cc:654] T ec327833dcb74b6b8679315df6d60ac5 P f0e7c9f6ec2c46eda889ff8f199bc969: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:27.038482 5751 raft_consensus.cc:491] T 9d744327c3714ed99169ee010b3a1eb7 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:32:27.039085 5751 raft_consensus.cc:513] T 9d744327c3714ed99169ee010b3a1eb7 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:27.040156 5744 tablet_bootstrap.cc:654] T b01160bf577842c485d19170bfcb2946 P 5a67f69245d14aa395dd7410912ee2d5: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:27.048027 5751 leader_election.cc:290] T 9d744327c3714ed99169ee010b3a1eb7 P 5a67f69245d14aa395dd7410912ee2d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0e7c9f6ec2c46eda889ff8f199bc969 (127.0.106.129:44743), ac714929b11c43d482b5920a2a5b9129 (127.0.106.130:39845)
I20250625 03:32:27.031931 5740 tablet_bootstrap.cc:492] T b01160bf577842c485d19170bfcb2946 P ac714929b11c43d482b5920a2a5b9129: Bootstrap starting.
I20250625 03:32:27.061861 5740 tablet_bootstrap.cc:654] T b01160bf577842c485d19170bfcb2946 P ac714929b11c43d482b5920a2a5b9129: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:27.063982 5744 tablet_bootstrap.cc:492] T b01160bf577842c485d19170bfcb2946 P 5a67f69245d14aa395dd7410912ee2d5: No bootstrap required, opened a new log
I20250625 03:32:27.064553 5744 ts_tablet_manager.cc:1397] T b01160bf577842c485d19170bfcb2946 P 5a67f69245d14aa395dd7410912ee2d5: Time spent bootstrapping tablet: real 0.031s user 0.009s sys 0.004s
I20250625 03:32:27.069551 5740 tablet_bootstrap.cc:492] T b01160bf577842c485d19170bfcb2946 P ac714929b11c43d482b5920a2a5b9129: No bootstrap required, opened a new log
I20250625 03:32:27.070199 5740 ts_tablet_manager.cc:1397] T b01160bf577842c485d19170bfcb2946 P ac714929b11c43d482b5920a2a5b9129: Time spent bootstrapping tablet: real 0.038s user 0.010s sys 0.002s
I20250625 03:32:27.067479 5744 raft_consensus.cc:357] T b01160bf577842c485d19170bfcb2946 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:27.072456 5744 raft_consensus.cc:383] T b01160bf577842c485d19170bfcb2946 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:27.072839 5744 raft_consensus.cc:738] T b01160bf577842c485d19170bfcb2946 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a67f69245d14aa395dd7410912ee2d5, State: Initialized, Role: FOLLOWER
I20250625 03:32:27.073124 5740 raft_consensus.cc:357] T b01160bf577842c485d19170bfcb2946 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:27.072073 5737 tablet_bootstrap.cc:492] T ec327833dcb74b6b8679315df6d60ac5 P f0e7c9f6ec2c46eda889ff8f199bc969: No bootstrap required, opened a new log
I20250625 03:32:27.074231 5740 raft_consensus.cc:383] T b01160bf577842c485d19170bfcb2946 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:27.074589 5740 raft_consensus.cc:738] T b01160bf577842c485d19170bfcb2946 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac714929b11c43d482b5920a2a5b9129, State: Initialized, Role: FOLLOWER
I20250625 03:32:27.075016 5737 ts_tablet_manager.cc:1397] T ec327833dcb74b6b8679315df6d60ac5 P f0e7c9f6ec2c46eda889ff8f199bc969: Time spent bootstrapping tablet: real 0.048s user 0.026s sys 0.015s
I20250625 03:32:27.075428 5740 consensus_queue.cc:260] T b01160bf577842c485d19170bfcb2946 P ac714929b11c43d482b5920a2a5b9129 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:27.073791 5744 consensus_queue.cc:260] T b01160bf577842c485d19170bfcb2946 P 5a67f69245d14aa395dd7410912ee2d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:27.078740 5744 ts_tablet_manager.cc:1428] T b01160bf577842c485d19170bfcb2946 P 5a67f69245d14aa395dd7410912ee2d5: Time spent starting tablet: real 0.014s user 0.006s sys 0.002s
I20250625 03:32:27.078787 5623 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9d744327c3714ed99169ee010b3a1eb7" candidate_uuid: "5a67f69245d14aa395dd7410912ee2d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac714929b11c43d482b5920a2a5b9129" is_pre_election: true
I20250625 03:32:27.079775 5744 tablet_bootstrap.cc:492] T 95a70da0935d43aba7bf794c38763425 P 5a67f69245d14aa395dd7410912ee2d5: Bootstrap starting.
W20250625 03:32:27.080627 5662 leader_election.cc:343] T 9d744327c3714ed99169ee010b3a1eb7 P 5a67f69245d14aa395dd7410912ee2d5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac714929b11c43d482b5920a2a5b9129 (127.0.106.130:39845): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:32:27.083959 5548 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9d744327c3714ed99169ee010b3a1eb7" candidate_uuid: "5a67f69245d14aa395dd7410912ee2d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" is_pre_election: true
I20250625 03:32:27.084801 5548 raft_consensus.cc:2466] T 9d744327c3714ed99169ee010b3a1eb7 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a67f69245d14aa395dd7410912ee2d5 in term 0.
I20250625 03:32:27.083840 5737 raft_consensus.cc:357] T ec327833dcb74b6b8679315df6d60ac5 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:27.085875 5737 raft_consensus.cc:383] T ec327833dcb74b6b8679315df6d60ac5 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:27.086179 5737 raft_consensus.cc:738] T ec327833dcb74b6b8679315df6d60ac5 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0e7c9f6ec2c46eda889ff8f199bc969, State: Initialized, Role: FOLLOWER
I20250625 03:32:27.086192 5663 leader_election.cc:304] T 9d744327c3714ed99169ee010b3a1eb7 P 5a67f69245d14aa395dd7410912ee2d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a67f69245d14aa395dd7410912ee2d5, f0e7c9f6ec2c46eda889ff8f199bc969; no voters: ac714929b11c43d482b5920a2a5b9129
I20250625 03:32:27.087105 5737 consensus_queue.cc:260] T ec327833dcb74b6b8679315df6d60ac5 P f0e7c9f6ec2c46eda889ff8f199bc969 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:27.087708 5751 raft_consensus.cc:2802] T 9d744327c3714ed99169ee010b3a1eb7 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:32:27.088148 5751 raft_consensus.cc:491] T 9d744327c3714ed99169ee010b3a1eb7 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:32:27.088481 5751 raft_consensus.cc:3058] T 9d744327c3714ed99169ee010b3a1eb7 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:27.088661 5744 tablet_bootstrap.cc:654] T 95a70da0935d43aba7bf794c38763425 P 5a67f69245d14aa395dd7410912ee2d5: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:27.090737 5740 ts_tablet_manager.cc:1428] T b01160bf577842c485d19170bfcb2946 P ac714929b11c43d482b5920a2a5b9129: Time spent starting tablet: real 0.020s user 0.007s sys 0.002s
I20250625 03:32:27.092911 5737 ts_tablet_manager.cc:1428] T ec327833dcb74b6b8679315df6d60ac5 P f0e7c9f6ec2c46eda889ff8f199bc969: Time spent starting tablet: real 0.017s user 0.008s sys 0.000s
I20250625 03:32:27.094051 5737 tablet_bootstrap.cc:492] T 95a70da0935d43aba7bf794c38763425 P f0e7c9f6ec2c46eda889ff8f199bc969: Bootstrap starting.
W20250625 03:32:27.100600 5493 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20250625 03:32:27.100572 5737 tablet_bootstrap.cc:654] T 95a70da0935d43aba7bf794c38763425 P f0e7c9f6ec2c46eda889ff8f199bc969: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:27.102098 5740 tablet_bootstrap.cc:492] T 3857bc0f026242499856f49c07bccf36 P ac714929b11c43d482b5920a2a5b9129: Bootstrap starting.
I20250625 03:32:27.117878 5739 raft_consensus.cc:491] T 8014b6301211413cbbe6a34e60213b1f P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:32:27.118674 5739 raft_consensus.cc:513] T 8014b6301211413cbbe6a34e60213b1f P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:27.114773 5751 raft_consensus.cc:513] T 9d744327c3714ed99169ee010b3a1eb7 P 5a67f69245d14aa395dd7410912ee2d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:27.122442 5623 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8014b6301211413cbbe6a34e60213b1f" candidate_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac714929b11c43d482b5920a2a5b9129" is_pre_election: true
I20250625 03:32:27.123332 5623 raft_consensus.cc:2466] T 8014b6301211413cbbe6a34e60213b1f P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0e7c9f6ec2c46eda889ff8f199bc969 in term 0.
I20250625 03:32:27.125010 5513 leader_election.cc:304] T 8014b6301211413cbbe6a34e60213b1f P f0e7c9f6ec2c46eda889ff8f199bc969 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac714929b11c43d482b5920a2a5b9129, f0e7c9f6ec2c46eda889ff8f199bc969; no voters:
I20250625 03:32:27.125722 5548 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9d744327c3714ed99169ee010b3a1eb7" candidate_uuid: "5a67f69245d14aa395dd7410912ee2d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969"
I20250625 03:32:27.126614 5548 raft_consensus.cc:3058] T 9d744327c3714ed99169ee010b3a1eb7 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:27.134286 5697 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8014b6301211413cbbe6a34e60213b1f" candidate_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a67f69245d14aa395dd7410912ee2d5" is_pre_election: true
I20250625 03:32:27.135846 5739 leader_election.cc:290] T 8014b6301211413cbbe6a34e60213b1f P f0e7c9f6ec2c46eda889ff8f199bc969 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac714929b11c43d482b5920a2a5b9129 (127.0.106.130:39845), 5a67f69245d14aa395dd7410912ee2d5 (127.0.106.131:38277)
I20250625 03:32:27.136794 5739 raft_consensus.cc:2802] T 8014b6301211413cbbe6a34e60213b1f P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:32:27.137282 5739 raft_consensus.cc:491] T 8014b6301211413cbbe6a34e60213b1f P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:32:27.137710 5739 raft_consensus.cc:3058] T 8014b6301211413cbbe6a34e60213b1f P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Advancing to term 1
W20250625 03:32:27.140892 5512 leader_election.cc:343] T 8014b6301211413cbbe6a34e60213b1f P f0e7c9f6ec2c46eda889ff8f199bc969 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a67f69245d14aa395dd7410912ee2d5 (127.0.106.131:38277): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:32:27.142346 5751 leader_election.cc:290] T 9d744327c3714ed99169ee010b3a1eb7 P 5a67f69245d14aa395dd7410912ee2d5 [CANDIDATE]: Term 1 election: Requested vote from peers f0e7c9f6ec2c46eda889ff8f199bc969 (127.0.106.129:44743), ac714929b11c43d482b5920a2a5b9129 (127.0.106.130:39845)
I20250625 03:32:27.143187 5751 raft_consensus.cc:491] T b01160bf577842c485d19170bfcb2946 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:32:27.143904 5623 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9d744327c3714ed99169ee010b3a1eb7" candidate_uuid: "5a67f69245d14aa395dd7410912ee2d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac714929b11c43d482b5920a2a5b9129"
I20250625 03:32:27.143787 5751 raft_consensus.cc:513] T b01160bf577842c485d19170bfcb2946 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
W20250625 03:32:27.145787 5662 leader_election.cc:343] T 9d744327c3714ed99169ee010b3a1eb7 P 5a67f69245d14aa395dd7410912ee2d5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ac714929b11c43d482b5920a2a5b9129 (127.0.106.130:39845): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:32:27.148039 5547 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b01160bf577842c485d19170bfcb2946" candidate_uuid: "5a67f69245d14aa395dd7410912ee2d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" is_pre_election: true
I20250625 03:32:27.149047 5547 raft_consensus.cc:2466] T b01160bf577842c485d19170bfcb2946 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a67f69245d14aa395dd7410912ee2d5 in term 0.
I20250625 03:32:27.150719 5663 leader_election.cc:304] T b01160bf577842c485d19170bfcb2946 P 5a67f69245d14aa395dd7410912ee2d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a67f69245d14aa395dd7410912ee2d5, f0e7c9f6ec2c46eda889ff8f199bc969; no voters:
I20250625 03:32:27.154079 5623 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b01160bf577842c485d19170bfcb2946" candidate_uuid: "5a67f69245d14aa395dd7410912ee2d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac714929b11c43d482b5920a2a5b9129" is_pre_election: true
I20250625 03:32:27.155016 5623 raft_consensus.cc:2466] T b01160bf577842c485d19170bfcb2946 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a67f69245d14aa395dd7410912ee2d5 in term 0.
I20250625 03:32:27.156754 5751 leader_election.cc:290] T b01160bf577842c485d19170bfcb2946 P 5a67f69245d14aa395dd7410912ee2d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0e7c9f6ec2c46eda889ff8f199bc969 (127.0.106.129:44743), ac714929b11c43d482b5920a2a5b9129 (127.0.106.130:39845)
I20250625 03:32:27.157822 5751 raft_consensus.cc:2802] T b01160bf577842c485d19170bfcb2946 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:32:27.158294 5751 raft_consensus.cc:491] T b01160bf577842c485d19170bfcb2946 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:32:27.158726 5751 raft_consensus.cc:3058] T b01160bf577842c485d19170bfcb2946 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:27.151710 5740 tablet_bootstrap.cc:654] T 3857bc0f026242499856f49c07bccf36 P ac714929b11c43d482b5920a2a5b9129: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:27.159765 5548 raft_consensus.cc:2466] T 9d744327c3714ed99169ee010b3a1eb7 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a67f69245d14aa395dd7410912ee2d5 in term 1.
I20250625 03:32:27.162333 5663 leader_election.cc:304] T 9d744327c3714ed99169ee010b3a1eb7 P 5a67f69245d14aa395dd7410912ee2d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a67f69245d14aa395dd7410912ee2d5, f0e7c9f6ec2c46eda889ff8f199bc969; no voters: ac714929b11c43d482b5920a2a5b9129
I20250625 03:32:27.165256 5765 raft_consensus.cc:2802] T 9d744327c3714ed99169ee010b3a1eb7 P 5a67f69245d14aa395dd7410912ee2d5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:32:27.166625 5737 tablet_bootstrap.cc:492] T 95a70da0935d43aba7bf794c38763425 P f0e7c9f6ec2c46eda889ff8f199bc969: No bootstrap required, opened a new log
I20250625 03:32:27.167142 5737 ts_tablet_manager.cc:1397] T 95a70da0935d43aba7bf794c38763425 P f0e7c9f6ec2c46eda889ff8f199bc969: Time spent bootstrapping tablet: real 0.073s user 0.024s sys 0.040s
I20250625 03:32:27.169765 5737 raft_consensus.cc:357] T 95a70da0935d43aba7bf794c38763425 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:27.170461 5737 raft_consensus.cc:383] T 95a70da0935d43aba7bf794c38763425 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:27.170722 5737 raft_consensus.cc:738] T 95a70da0935d43aba7bf794c38763425 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0e7c9f6ec2c46eda889ff8f199bc969, State: Initialized, Role: FOLLOWER
I20250625 03:32:27.171675 5744 tablet_bootstrap.cc:492] T 95a70da0935d43aba7bf794c38763425 P 5a67f69245d14aa395dd7410912ee2d5: No bootstrap required, opened a new log
I20250625 03:32:27.171432 5737 consensus_queue.cc:260] T 95a70da0935d43aba7bf794c38763425 P f0e7c9f6ec2c46eda889ff8f199bc969 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:27.172287 5751 raft_consensus.cc:513] T b01160bf577842c485d19170bfcb2946 P 5a67f69245d14aa395dd7410912ee2d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:27.174166 5737 ts_tablet_manager.cc:1428] T 95a70da0935d43aba7bf794c38763425 P f0e7c9f6ec2c46eda889ff8f199bc969: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20250625 03:32:27.175338 5737 tablet_bootstrap.cc:492] T 09262e1d4d2346d1b9610e857b693324 P f0e7c9f6ec2c46eda889ff8f199bc969: Bootstrap starting.
I20250625 03:32:27.175575 5548 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b01160bf577842c485d19170bfcb2946" candidate_uuid: "5a67f69245d14aa395dd7410912ee2d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969"
I20250625 03:32:27.176589 5548 raft_consensus.cc:3058] T b01160bf577842c485d19170bfcb2946 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:27.179584 5623 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b01160bf577842c485d19170bfcb2946" candidate_uuid: "5a67f69245d14aa395dd7410912ee2d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac714929b11c43d482b5920a2a5b9129"
I20250625 03:32:27.180253 5623 raft_consensus.cc:3058] T b01160bf577842c485d19170bfcb2946 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:27.181573 5737 tablet_bootstrap.cc:654] T 09262e1d4d2346d1b9610e857b693324 P f0e7c9f6ec2c46eda889ff8f199bc969: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:27.205917 5751 leader_election.cc:290] T b01160bf577842c485d19170bfcb2946 P 5a67f69245d14aa395dd7410912ee2d5 [CANDIDATE]: Term 1 election: Requested vote from peers f0e7c9f6ec2c46eda889ff8f199bc969 (127.0.106.129:44743), ac714929b11c43d482b5920a2a5b9129 (127.0.106.130:39845)
I20250625 03:32:27.206846 5751 raft_consensus.cc:491] T 09262e1d4d2346d1b9610e857b693324 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:32:27.207409 5751 raft_consensus.cc:513] T 09262e1d4d2346d1b9610e857b693324 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:27.208603 5766 raft_consensus.cc:491] T dd40af6d9f9b4ae2ab31241b28f3b002 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:32:27.210502 5766 raft_consensus.cc:513] T dd40af6d9f9b4ae2ab31241b28f3b002 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:27.212601 5622 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "09262e1d4d2346d1b9610e857b693324" candidate_uuid: "5a67f69245d14aa395dd7410912ee2d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac714929b11c43d482b5920a2a5b9129" is_pre_election: true
W20250625 03:32:27.215041 5662 leader_election.cc:343] T 09262e1d4d2346d1b9610e857b693324 P 5a67f69245d14aa395dd7410912ee2d5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac714929b11c43d482b5920a2a5b9129 (127.0.106.130:39845): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:32:27.216763 5622 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dd40af6d9f9b4ae2ab31241b28f3b002" candidate_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac714929b11c43d482b5920a2a5b9129" is_pre_election: true
I20250625 03:32:27.217608 5622 raft_consensus.cc:2466] T dd40af6d9f9b4ae2ab31241b28f3b002 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0e7c9f6ec2c46eda889ff8f199bc969 in term 0.
I20250625 03:32:27.217767 5744 ts_tablet_manager.cc:1397] T 95a70da0935d43aba7bf794c38763425 P 5a67f69245d14aa395dd7410912ee2d5: Time spent bootstrapping tablet: real 0.138s user 0.018s sys 0.033s
I20250625 03:32:27.218974 5513 leader_election.cc:304] T dd40af6d9f9b4ae2ab31241b28f3b002 P f0e7c9f6ec2c46eda889ff8f199bc969 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac714929b11c43d482b5920a2a5b9129, f0e7c9f6ec2c46eda889ff8f199bc969; no voters:
I20250625 03:32:27.221395 5739 raft_consensus.cc:513] T 8014b6301211413cbbe6a34e60213b1f P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:27.224550 5767 raft_consensus.cc:491] T ec327833dcb74b6b8679315df6d60ac5 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:32:27.225736 5739 leader_election.cc:290] T 8014b6301211413cbbe6a34e60213b1f P f0e7c9f6ec2c46eda889ff8f199bc969 [CANDIDATE]: Term 1 election: Requested vote from peers ac714929b11c43d482b5920a2a5b9129 (127.0.106.130:39845), 5a67f69245d14aa395dd7410912ee2d5 (127.0.106.131:38277)
I20250625 03:32:27.230298 5765 raft_consensus.cc:695] T 9d744327c3714ed99169ee010b3a1eb7 P 5a67f69245d14aa395dd7410912ee2d5 [term 1 LEADER]: Becoming Leader. State: Replica: 5a67f69245d14aa395dd7410912ee2d5, State: Running, Role: LEADER
I20250625 03:32:27.235543 5739 raft_consensus.cc:2802] T dd40af6d9f9b4ae2ab31241b28f3b002 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:32:27.236128 5739 raft_consensus.cc:491] T dd40af6d9f9b4ae2ab31241b28f3b002 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:32:27.225886 5622 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8014b6301211413cbbe6a34e60213b1f" candidate_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac714929b11c43d482b5920a2a5b9129"
I20250625 03:32:27.236603 5739 raft_consensus.cc:3058] T dd40af6d9f9b4ae2ab31241b28f3b002 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:27.227619 5744 raft_consensus.cc:357] T 95a70da0935d43aba7bf794c38763425 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:27.237340 5622 raft_consensus.cc:3058] T 8014b6301211413cbbe6a34e60213b1f P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:27.236577 5765 consensus_queue.cc:237] T 9d744327c3714ed99169ee010b3a1eb7 P 5a67f69245d14aa395dd7410912ee2d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:27.237623 5744 raft_consensus.cc:383] T 95a70da0935d43aba7bf794c38763425 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:27.239728 5744 raft_consensus.cc:738] T 95a70da0935d43aba7bf794c38763425 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a67f69245d14aa395dd7410912ee2d5, State: Initialized, Role: FOLLOWER
I20250625 03:32:27.224592 5766 leader_election.cc:290] T dd40af6d9f9b4ae2ab31241b28f3b002 P f0e7c9f6ec2c46eda889ff8f199bc969 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac714929b11c43d482b5920a2a5b9129 (127.0.106.130:39845), 5a67f69245d14aa395dd7410912ee2d5 (127.0.106.131:38277)
I20250625 03:32:27.191846 5623 raft_consensus.cc:2466] T b01160bf577842c485d19170bfcb2946 P ac714929b11c43d482b5920a2a5b9129 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a67f69245d14aa395dd7410912ee2d5 in term 1.
I20250625 03:32:27.224767 5548 raft_consensus.cc:2466] T b01160bf577842c485d19170bfcb2946 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a67f69245d14aa395dd7410912ee2d5 in term 1.
I20250625 03:32:27.240723 5744 consensus_queue.cc:260] T 95a70da0935d43aba7bf794c38763425 P 5a67f69245d14aa395dd7410912ee2d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:27.240713 5766 raft_consensus.cc:491] T 3857bc0f026242499856f49c07bccf36 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:32:27.250619 5766 raft_consensus.cc:513] T 3857bc0f026242499856f49c07bccf36 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:27.255163 5751 leader_election.cc:290] T 09262e1d4d2346d1b9610e857b693324 P 5a67f69245d14aa395dd7410912ee2d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0e7c9f6ec2c46eda889ff8f199bc969 (127.0.106.129:44743), ac714929b11c43d482b5920a2a5b9129 (127.0.106.130:39845)
I20250625 03:32:27.235385 5767 raft_consensus.cc:513] T ec327833dcb74b6b8679315df6d60ac5 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:27.261274 5770 raft_consensus.cc:491] T 95a70da0935d43aba7bf794c38763425 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:32:27.262217 5770 raft_consensus.cc:513] T 95a70da0935d43aba7bf794c38763425 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:27.269363 5744 ts_tablet_manager.cc:1428] T 95a70da0935d43aba7bf794c38763425 P 5a67f69245d14aa395dd7410912ee2d5: Time spent starting tablet: real 0.046s user 0.010s sys 0.008s
I20250625 03:32:27.270180 5739 raft_consensus.cc:513] T dd40af6d9f9b4ae2ab31241b28f3b002 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:27.242724 5662 leader_election.cc:304] T b01160bf577842c485d19170bfcb2946 P 5a67f69245d14aa395dd7410912ee2d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a67f69245d14aa395dd7410912ee2d5, ac714929b11c43d482b5920a2a5b9129; no voters:
I20250625 03:32:27.270812 5744 tablet_bootstrap.cc:492] T f586c1c904ee41f785ba350b68057810 P 5a67f69245d14aa395dd7410912ee2d5: Bootstrap starting.
I20250625 03:32:27.274612 5548 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "09262e1d4d2346d1b9610e857b693324" candidate_uuid: "5a67f69245d14aa395dd7410912ee2d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" is_pre_election: true
I20250625 03:32:27.274092 5739 leader_election.cc:290] T dd40af6d9f9b4ae2ab31241b28f3b002 P f0e7c9f6ec2c46eda889ff8f199bc969 [CANDIDATE]: Term 1 election: Requested vote from peers ac714929b11c43d482b5920a2a5b9129 (127.0.106.130:39845), 5a67f69245d14aa395dd7410912ee2d5 (127.0.106.131:38277)
I20250625 03:32:27.278808 5621 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3857bc0f026242499856f49c07bccf36" candidate_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac714929b11c43d482b5920a2a5b9129" is_pre_election: true
W20250625 03:32:27.281262 5513 leader_election.cc:343] T 3857bc0f026242499856f49c07bccf36 P f0e7c9f6ec2c46eda889ff8f199bc969 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac714929b11c43d482b5920a2a5b9129 (127.0.106.130:39845): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:32:27.281757 5697 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dd40af6d9f9b4ae2ab31241b28f3b002" candidate_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a67f69245d14aa395dd7410912ee2d5" is_pre_election: true
I20250625 03:32:27.276371 5772 raft_consensus.cc:2802] T b01160bf577842c485d19170bfcb2946 P 5a67f69245d14aa395dd7410912ee2d5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:32:27.283289 5772 raft_consensus.cc:695] T b01160bf577842c485d19170bfcb2946 P 5a67f69245d14aa395dd7410912ee2d5 [term 1 LEADER]: Becoming Leader. State: Replica: 5a67f69245d14aa395dd7410912ee2d5, State: Running, Role: LEADER
I20250625 03:32:27.283340 5621 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "95a70da0935d43aba7bf794c38763425" candidate_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac714929b11c43d482b5920a2a5b9129" is_pre_election: true
I20250625 03:32:27.284039 5621 raft_consensus.cc:2466] T 95a70da0935d43aba7bf794c38763425 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0e7c9f6ec2c46eda889ff8f199bc969 in term 0.
I20250625 03:32:27.284291 5772 consensus_queue.cc:237] T b01160bf577842c485d19170bfcb2946 P 5a67f69245d14aa395dd7410912ee2d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:27.285266 5513 leader_election.cc:304] T 95a70da0935d43aba7bf794c38763425 P f0e7c9f6ec2c46eda889ff8f199bc969 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac714929b11c43d482b5920a2a5b9129, f0e7c9f6ec2c46eda889ff8f199bc969; no voters:
I20250625 03:32:27.285672 5740 tablet_bootstrap.cc:492] T 3857bc0f026242499856f49c07bccf36 P ac714929b11c43d482b5920a2a5b9129: No bootstrap required, opened a new log
I20250625 03:32:27.275213 5623 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dd40af6d9f9b4ae2ab31241b28f3b002" candidate_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac714929b11c43d482b5920a2a5b9129"
I20250625 03:32:27.286448 5740 ts_tablet_manager.cc:1397] T 3857bc0f026242499856f49c07bccf36 P ac714929b11c43d482b5920a2a5b9129: Time spent bootstrapping tablet: real 0.185s user 0.016s sys 0.012s
I20250625 03:32:27.286809 5623 raft_consensus.cc:3058] T dd40af6d9f9b4ae2ab31241b28f3b002 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:27.287220 5770 leader_election.cc:290] T 95a70da0935d43aba7bf794c38763425 P f0e7c9f6ec2c46eda889ff8f199bc969 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac714929b11c43d482b5920a2a5b9129 (127.0.106.130:39845), 5a67f69245d14aa395dd7410912ee2d5 (127.0.106.131:38277)
I20250625 03:32:27.290802 5697 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8014b6301211413cbbe6a34e60213b1f" candidate_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a67f69245d14aa395dd7410912ee2d5"
I20250625 03:32:27.293079 5621 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ec327833dcb74b6b8679315df6d60ac5" candidate_uuid: "5a67f69245d14aa395dd7410912ee2d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac714929b11c43d482b5920a2a5b9129" is_pre_election: true
W20250625 03:32:27.294734 5662 leader_election.cc:343] T ec327833dcb74b6b8679315df6d60ac5 P 5a67f69245d14aa395dd7410912ee2d5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac714929b11c43d482b5920a2a5b9129 (127.0.106.130:39845): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:32:27.295519 5697 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dd40af6d9f9b4ae2ab31241b28f3b002" candidate_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a67f69245d14aa395dd7410912ee2d5"
I20250625 03:32:27.295763 5766 leader_election.cc:290] T 3857bc0f026242499856f49c07bccf36 P f0e7c9f6ec2c46eda889ff8f199bc969 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac714929b11c43d482b5920a2a5b9129 (127.0.106.130:39845), 5a67f69245d14aa395dd7410912ee2d5 (127.0.106.131:38277)
I20250625 03:32:27.287099 5739 raft_consensus.cc:2802] T 95a70da0935d43aba7bf794c38763425 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:32:27.296600 5739 raft_consensus.cc:491] T 95a70da0935d43aba7bf794c38763425 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:32:27.297056 5739 raft_consensus.cc:3058] T 95a70da0935d43aba7bf794c38763425 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:27.277781 5767 leader_election.cc:290] T ec327833dcb74b6b8679315df6d60ac5 P 5a67f69245d14aa395dd7410912ee2d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0e7c9f6ec2c46eda889ff8f199bc969 (127.0.106.129:44743), ac714929b11c43d482b5920a2a5b9129 (127.0.106.130:39845)
I20250625 03:32:27.299926 5744 tablet_bootstrap.cc:654] T f586c1c904ee41f785ba350b68057810 P 5a67f69245d14aa395dd7410912ee2d5: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:27.302191 5697 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "95a70da0935d43aba7bf794c38763425" candidate_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a67f69245d14aa395dd7410912ee2d5" is_pre_election: true
I20250625 03:32:27.303154 5697 raft_consensus.cc:2466] T 95a70da0935d43aba7bf794c38763425 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0e7c9f6ec2c46eda889ff8f199bc969 in term 0.
I20250625 03:32:27.307572 5622 raft_consensus.cc:2466] T 8014b6301211413cbbe6a34e60213b1f P ac714929b11c43d482b5920a2a5b9129 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0e7c9f6ec2c46eda889ff8f199bc969 in term 1.
I20250625 03:32:27.308606 5623 raft_consensus.cc:2466] T dd40af6d9f9b4ae2ab31241b28f3b002 P ac714929b11c43d482b5920a2a5b9129 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0e7c9f6ec2c46eda889ff8f199bc969 in term 1.
I20250625 03:32:27.308915 5737 tablet_bootstrap.cc:492] T 09262e1d4d2346d1b9610e857b693324 P f0e7c9f6ec2c46eda889ff8f199bc969: No bootstrap required, opened a new log
I20250625 03:32:27.309386 5737 ts_tablet_manager.cc:1397] T 09262e1d4d2346d1b9610e857b693324 P f0e7c9f6ec2c46eda889ff8f199bc969: Time spent bootstrapping tablet: real 0.134s user 0.056s sys 0.032s
I20250625 03:32:27.309101 5513 leader_election.cc:304] T 8014b6301211413cbbe6a34e60213b1f P f0e7c9f6ec2c46eda889ff8f199bc969 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac714929b11c43d482b5920a2a5b9129, f0e7c9f6ec2c46eda889ff8f199bc969; no voters:
I20250625 03:32:27.310266 5513 leader_election.cc:304] T dd40af6d9f9b4ae2ab31241b28f3b002 P f0e7c9f6ec2c46eda889ff8f199bc969 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac714929b11c43d482b5920a2a5b9129, f0e7c9f6ec2c46eda889ff8f199bc969; no voters:
I20250625 03:32:27.311257 5770 raft_consensus.cc:2802] T 8014b6301211413cbbe6a34e60213b1f P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:32:27.311640 5766 raft_consensus.cc:2802] T dd40af6d9f9b4ae2ab31241b28f3b002 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:32:27.319839 5737 raft_consensus.cc:357] T 09262e1d4d2346d1b9610e857b693324 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:27.320583 5697 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3857bc0f026242499856f49c07bccf36" candidate_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a67f69245d14aa395dd7410912ee2d5" is_pre_election: true
I20250625 03:32:27.320884 5737 raft_consensus.cc:383] T 09262e1d4d2346d1b9610e857b693324 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:27.321369 5737 raft_consensus.cc:738] T 09262e1d4d2346d1b9610e857b693324 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0e7c9f6ec2c46eda889ff8f199bc969, State: Initialized, Role: FOLLOWER
I20250625 03:32:27.322418 5737 consensus_queue.cc:260] T 09262e1d4d2346d1b9610e857b693324 P f0e7c9f6ec2c46eda889ff8f199bc969 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:27.328825 5446 catalog_manager.cc:5582] T 9d744327c3714ed99169ee010b3a1eb7 P 5a67f69245d14aa395dd7410912ee2d5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a67f69245d14aa395dd7410912ee2d5 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "5a67f69245d14aa395dd7410912ee2d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } health_report { overall_health: HEALTHY } } }
I20250625 03:32:27.332926 5740 raft_consensus.cc:357] T 3857bc0f026242499856f49c07bccf36 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:27.334043 5740 raft_consensus.cc:383] T 3857bc0f026242499856f49c07bccf36 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:27.334422 5740 raft_consensus.cc:738] T 3857bc0f026242499856f49c07bccf36 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac714929b11c43d482b5920a2a5b9129, State: Initialized, Role: FOLLOWER
W20250625 03:32:27.340487 5512 leader_election.cc:343] T dd40af6d9f9b4ae2ab31241b28f3b002 P f0e7c9f6ec2c46eda889ff8f199bc969 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a67f69245d14aa395dd7410912ee2d5 (127.0.106.131:38277): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:32:27.340512 5737 ts_tablet_manager.cc:1428] T 09262e1d4d2346d1b9610e857b693324 P f0e7c9f6ec2c46eda889ff8f199bc969: Time spent starting tablet: real 0.031s user 0.008s sys 0.012s
I20250625 03:32:27.341020 5548 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ec327833dcb74b6b8679315df6d60ac5" candidate_uuid: "5a67f69245d14aa395dd7410912ee2d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" is_pre_election: true
I20250625 03:32:27.341746 5548 raft_consensus.cc:2466] T ec327833dcb74b6b8679315df6d60ac5 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a67f69245d14aa395dd7410912ee2d5 in term 0.
W20250625 03:32:27.342217 5512 leader_election.cc:343] T 8014b6301211413cbbe6a34e60213b1f P f0e7c9f6ec2c46eda889ff8f199bc969 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5a67f69245d14aa395dd7410912ee2d5 (127.0.106.131:38277): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:32:27.343726 5739 raft_consensus.cc:513] T 95a70da0935d43aba7bf794c38763425 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
W20250625 03:32:27.346024 5512 leader_election.cc:343] T dd40af6d9f9b4ae2ab31241b28f3b002 P f0e7c9f6ec2c46eda889ff8f199bc969 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5a67f69245d14aa395dd7410912ee2d5 (127.0.106.131:38277): Illegal state: must be running to vote when last-logged opid is not known
W20250625 03:32:27.347599 5663 leader_election.cc:343] T 09262e1d4d2346d1b9610e857b693324 P 5a67f69245d14aa395dd7410912ee2d5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0e7c9f6ec2c46eda889ff8f199bc969 (127.0.106.129:44743): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:32:27.348153 5663 leader_election.cc:304] T 09262e1d4d2346d1b9610e857b693324 P 5a67f69245d14aa395dd7410912ee2d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a67f69245d14aa395dd7410912ee2d5; no voters: ac714929b11c43d482b5920a2a5b9129, f0e7c9f6ec2c46eda889ff8f199bc969
I20250625 03:32:27.338407 5770 raft_consensus.cc:695] T 8014b6301211413cbbe6a34e60213b1f P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 LEADER]: Becoming Leader. State: Replica: f0e7c9f6ec2c46eda889ff8f199bc969, State: Running, Role: LEADER
I20250625 03:32:27.349630 5772 raft_consensus.cc:2747] T 09262e1d4d2346d1b9610e857b693324 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:32:27.350358 5770 consensus_queue.cc:237] T 8014b6301211413cbbe6a34e60213b1f P f0e7c9f6ec2c46eda889ff8f199bc969 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:27.352496 5663 leader_election.cc:304] T ec327833dcb74b6b8679315df6d60ac5 P 5a67f69245d14aa395dd7410912ee2d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a67f69245d14aa395dd7410912ee2d5, f0e7c9f6ec2c46eda889ff8f199bc969; no voters: ac714929b11c43d482b5920a2a5b9129
I20250625 03:32:27.335376 5740 consensus_queue.cc:260] T 3857bc0f026242499856f49c07bccf36 P ac714929b11c43d482b5920a2a5b9129 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:27.356709 5743 raft_consensus.cc:491] T 3857bc0f026242499856f49c07bccf36 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:32:27.359057 5772 raft_consensus.cc:2802] T ec327833dcb74b6b8679315df6d60ac5 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:32:27.360972 5743 raft_consensus.cc:513] T 3857bc0f026242499856f49c07bccf36 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:27.362123 5772 raft_consensus.cc:491] T ec327833dcb74b6b8679315df6d60ac5 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:32:27.362214 5622 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "95a70da0935d43aba7bf794c38763425" candidate_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac714929b11c43d482b5920a2a5b9129"
I20250625 03:32:27.363160 5622 raft_consensus.cc:3058] T 95a70da0935d43aba7bf794c38763425 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:27.362564 5772 raft_consensus.cc:3058] T ec327833dcb74b6b8679315df6d60ac5 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Advancing to term 1
W20250625 03:32:27.368516 5512 leader_election.cc:343] T 3857bc0f026242499856f49c07bccf36 P f0e7c9f6ec2c46eda889ff8f199bc969 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a67f69245d14aa395dd7410912ee2d5 (127.0.106.131:38277): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:32:27.369414 5512 leader_election.cc:304] T 3857bc0f026242499856f49c07bccf36 P f0e7c9f6ec2c46eda889ff8f199bc969 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0e7c9f6ec2c46eda889ff8f199bc969; no voters: 5a67f69245d14aa395dd7410912ee2d5, ac714929b11c43d482b5920a2a5b9129
I20250625 03:32:27.374544 5743 leader_election.cc:290] T 3857bc0f026242499856f49c07bccf36 P ac714929b11c43d482b5920a2a5b9129 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0e7c9f6ec2c46eda889ff8f199bc969 (127.0.106.129:44743), 5a67f69245d14aa395dd7410912ee2d5 (127.0.106.131:38277)
I20250625 03:32:27.356871 5766 raft_consensus.cc:695] T dd40af6d9f9b4ae2ab31241b28f3b002 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 LEADER]: Becoming Leader. State: Replica: f0e7c9f6ec2c46eda889ff8f199bc969, State: Running, Role: LEADER
I20250625 03:32:27.357203 5739 leader_election.cc:290] T 95a70da0935d43aba7bf794c38763425 P f0e7c9f6ec2c46eda889ff8f199bc969 [CANDIDATE]: Term 1 election: Requested vote from peers ac714929b11c43d482b5920a2a5b9129 (127.0.106.130:39845), 5a67f69245d14aa395dd7410912ee2d5 (127.0.106.131:38277)
I20250625 03:32:27.375768 5775 raft_consensus.cc:491] T f586c1c904ee41f785ba350b68057810 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:32:27.385813 5775 raft_consensus.cc:513] T f586c1c904ee41f785ba350b68057810 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:27.386864 5697 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "95a70da0935d43aba7bf794c38763425" candidate_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a67f69245d14aa395dd7410912ee2d5"
I20250625 03:32:27.387547 5697 raft_consensus.cc:3058] T 95a70da0935d43aba7bf794c38763425 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:27.388211 5740 ts_tablet_manager.cc:1428] T 3857bc0f026242499856f49c07bccf36 P ac714929b11c43d482b5920a2a5b9129: Time spent starting tablet: real 0.101s user 0.009s sys 0.002s
I20250625 03:32:27.389405 5740 tablet_bootstrap.cc:492] T 09262e1d4d2346d1b9610e857b693324 P ac714929b11c43d482b5920a2a5b9129: Bootstrap starting.
I20250625 03:32:27.389225 5623 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f586c1c904ee41f785ba350b68057810" candidate_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac714929b11c43d482b5920a2a5b9129" is_pre_election: true
I20250625 03:32:27.391484 5623 raft_consensus.cc:2466] T f586c1c904ee41f785ba350b68057810 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0e7c9f6ec2c46eda889ff8f199bc969 in term 0.
I20250625 03:32:27.392871 5622 raft_consensus.cc:2466] T 95a70da0935d43aba7bf794c38763425 P ac714929b11c43d482b5920a2a5b9129 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0e7c9f6ec2c46eda889ff8f199bc969 in term 1.
I20250625 03:32:27.393023 5775 leader_election.cc:290] T f586c1c904ee41f785ba350b68057810 P f0e7c9f6ec2c46eda889ff8f199bc969 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac714929b11c43d482b5920a2a5b9129 (127.0.106.130:39845), 5a67f69245d14aa395dd7410912ee2d5 (127.0.106.131:38277)
I20250625 03:32:27.393110 5513 leader_election.cc:304] T f586c1c904ee41f785ba350b68057810 P f0e7c9f6ec2c46eda889ff8f199bc969 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac714929b11c43d482b5920a2a5b9129, f0e7c9f6ec2c46eda889ff8f199bc969; no voters:
I20250625 03:32:27.394814 5513 leader_election.cc:304] T 95a70da0935d43aba7bf794c38763425 P f0e7c9f6ec2c46eda889ff8f199bc969 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac714929b11c43d482b5920a2a5b9129, f0e7c9f6ec2c46eda889ff8f199bc969; no voters:
I20250625 03:32:27.395015 5775 raft_consensus.cc:2802] T f586c1c904ee41f785ba350b68057810 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:32:27.389999 5766 consensus_queue.cc:237] T dd40af6d9f9b4ae2ab31241b28f3b002 P f0e7c9f6ec2c46eda889ff8f199bc969 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:27.395421 5775 raft_consensus.cc:491] T f586c1c904ee41f785ba350b68057810 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:32:27.398588 5775 raft_consensus.cc:3058] T f586c1c904ee41f785ba350b68057810 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:27.395925 5772 raft_consensus.cc:513] T ec327833dcb74b6b8679315df6d60ac5 P 5a67f69245d14aa395dd7410912ee2d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:27.402627 5772 leader_election.cc:290] T ec327833dcb74b6b8679315df6d60ac5 P 5a67f69245d14aa395dd7410912ee2d5 [CANDIDATE]: Term 1 election: Requested vote from peers f0e7c9f6ec2c46eda889ff8f199bc969 (127.0.106.129:44743), ac714929b11c43d482b5920a2a5b9129 (127.0.106.130:39845)
I20250625 03:32:27.405819 5697 raft_consensus.cc:2466] T 95a70da0935d43aba7bf794c38763425 P 5a67f69245d14aa395dd7410912ee2d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0e7c9f6ec2c46eda889ff8f199bc969 in term 1.
I20250625 03:32:27.406360 5548 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ec327833dcb74b6b8679315df6d60ac5" candidate_uuid: "5a67f69245d14aa395dd7410912ee2d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969"
I20250625 03:32:27.405860 5696 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f586c1c904ee41f785ba350b68057810" candidate_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a67f69245d14aa395dd7410912ee2d5" is_pre_election: true
I20250625 03:32:27.406960 5548 raft_consensus.cc:3058] T ec327833dcb74b6b8679315df6d60ac5 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Advancing to term 1
W20250625 03:32:27.408375 5512 leader_election.cc:343] T f586c1c904ee41f785ba350b68057810 P f0e7c9f6ec2c46eda889ff8f199bc969 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a67f69245d14aa395dd7410912ee2d5 (127.0.106.131:38277): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:32:27.406404 5622 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ec327833dcb74b6b8679315df6d60ac5" candidate_uuid: "5a67f69245d14aa395dd7410912ee2d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac714929b11c43d482b5920a2a5b9129"
W20250625 03:32:27.411092 5662 leader_election.cc:343] T ec327833dcb74b6b8679315df6d60ac5 P 5a67f69245d14aa395dd7410912ee2d5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ac714929b11c43d482b5920a2a5b9129 (127.0.106.130:39845): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:32:27.403672 5770 raft_consensus.cc:2802] T 95a70da0935d43aba7bf794c38763425 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:32:27.396636 5777 raft_consensus.cc:2747] T 3857bc0f026242499856f49c07bccf36 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:32:27.416633 5744 tablet_bootstrap.cc:492] T f586c1c904ee41f785ba350b68057810 P 5a67f69245d14aa395dd7410912ee2d5: No bootstrap required, opened a new log
I20250625 03:32:27.422852 5744 ts_tablet_manager.cc:1397] T f586c1c904ee41f785ba350b68057810 P 5a67f69245d14aa395dd7410912ee2d5: Time spent bootstrapping tablet: real 0.152s user 0.015s sys 0.021s
I20250625 03:32:27.426751 5740 tablet_bootstrap.cc:654] T 09262e1d4d2346d1b9610e857b693324 P ac714929b11c43d482b5920a2a5b9129: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:27.426507 5744 raft_consensus.cc:357] T f586c1c904ee41f785ba350b68057810 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:27.427299 5744 raft_consensus.cc:383] T f586c1c904ee41f785ba350b68057810 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:27.427655 5744 raft_consensus.cc:738] T f586c1c904ee41f785ba350b68057810 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a67f69245d14aa395dd7410912ee2d5, State: Initialized, Role: FOLLOWER
I20250625 03:32:27.417647 5548 raft_consensus.cc:2466] T ec327833dcb74b6b8679315df6d60ac5 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a67f69245d14aa395dd7410912ee2d5 in term 1.
I20250625 03:32:27.428508 5744 consensus_queue.cc:260] T f586c1c904ee41f785ba350b68057810 P 5a67f69245d14aa395dd7410912ee2d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:27.422799 5775 raft_consensus.cc:513] T f586c1c904ee41f785ba350b68057810 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:27.429078 5663 leader_election.cc:304] T ec327833dcb74b6b8679315df6d60ac5 P 5a67f69245d14aa395dd7410912ee2d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5a67f69245d14aa395dd7410912ee2d5, f0e7c9f6ec2c46eda889ff8f199bc969; no voters: ac714929b11c43d482b5920a2a5b9129
I20250625 03:32:27.429960 5772 raft_consensus.cc:2802] T ec327833dcb74b6b8679315df6d60ac5 P 5a67f69245d14aa395dd7410912ee2d5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:32:27.430428 5772 raft_consensus.cc:695] T ec327833dcb74b6b8679315df6d60ac5 P 5a67f69245d14aa395dd7410912ee2d5 [term 1 LEADER]: Becoming Leader. State: Replica: 5a67f69245d14aa395dd7410912ee2d5, State: Running, Role: LEADER
I20250625 03:32:27.430912 5744 ts_tablet_manager.cc:1428] T f586c1c904ee41f785ba350b68057810 P 5a67f69245d14aa395dd7410912ee2d5: Time spent starting tablet: real 0.007s user 0.002s sys 0.003s
I20250625 03:32:27.431255 5772 consensus_queue.cc:237] T ec327833dcb74b6b8679315df6d60ac5 P 5a67f69245d14aa395dd7410912ee2d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:27.433454 5697 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f586c1c904ee41f785ba350b68057810" candidate_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a67f69245d14aa395dd7410912ee2d5"
I20250625 03:32:27.431804 5775 leader_election.cc:290] T f586c1c904ee41f785ba350b68057810 P f0e7c9f6ec2c46eda889ff8f199bc969 [CANDIDATE]: Term 1 election: Requested vote from peers ac714929b11c43d482b5920a2a5b9129 (127.0.106.130:39845), 5a67f69245d14aa395dd7410912ee2d5 (127.0.106.131:38277)
I20250625 03:32:27.434085 5697 raft_consensus.cc:3058] T f586c1c904ee41f785ba350b68057810 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:27.438292 5622 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f586c1c904ee41f785ba350b68057810" candidate_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac714929b11c43d482b5920a2a5b9129"
I20250625 03:32:27.439013 5622 raft_consensus.cc:3058] T f586c1c904ee41f785ba350b68057810 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:27.439327 5740 tablet_bootstrap.cc:492] T 09262e1d4d2346d1b9610e857b693324 P ac714929b11c43d482b5920a2a5b9129: No bootstrap required, opened a new log
I20250625 03:32:27.439858 5740 ts_tablet_manager.cc:1397] T 09262e1d4d2346d1b9610e857b693324 P ac714929b11c43d482b5920a2a5b9129: Time spent bootstrapping tablet: real 0.051s user 0.014s sys 0.000s
I20250625 03:32:27.442559 5740 raft_consensus.cc:357] T 09262e1d4d2346d1b9610e857b693324 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:27.443297 5740 raft_consensus.cc:383] T 09262e1d4d2346d1b9610e857b693324 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:27.443688 5740 raft_consensus.cc:738] T 09262e1d4d2346d1b9610e857b693324 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac714929b11c43d482b5920a2a5b9129, State: Initialized, Role: FOLLOWER
I20250625 03:32:27.432225 5770 raft_consensus.cc:695] T 95a70da0935d43aba7bf794c38763425 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 LEADER]: Becoming Leader. State: Replica: f0e7c9f6ec2c46eda889ff8f199bc969, State: Running, Role: LEADER
I20250625 03:32:27.432693 5696 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3857bc0f026242499856f49c07bccf36" candidate_uuid: "ac714929b11c43d482b5920a2a5b9129" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a67f69245d14aa395dd7410912ee2d5" is_pre_election: true
I20250625 03:32:27.432034 5744 tablet_bootstrap.cc:492] T 8014b6301211413cbbe6a34e60213b1f P 5a67f69245d14aa395dd7410912ee2d5: Bootstrap starting.
I20250625 03:32:27.444442 5740 consensus_queue.cc:260] T 09262e1d4d2346d1b9610e857b693324 P ac714929b11c43d482b5920a2a5b9129 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
W20250625 03:32:27.445547 5587 leader_election.cc:343] T 3857bc0f026242499856f49c07bccf36 P ac714929b11c43d482b5920a2a5b9129 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a67f69245d14aa395dd7410912ee2d5 (127.0.106.131:38277): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:32:27.447140 5740 ts_tablet_manager.cc:1428] T 09262e1d4d2346d1b9610e857b693324 P ac714929b11c43d482b5920a2a5b9129: Time spent starting tablet: real 0.007s user 0.004s sys 0.000s
I20250625 03:32:27.448570 5740 tablet_bootstrap.cc:492] T 9d744327c3714ed99169ee010b3a1eb7 P ac714929b11c43d482b5920a2a5b9129: Bootstrap starting.
I20250625 03:32:27.452973 5770 consensus_queue.cc:237] T 95a70da0935d43aba7bf794c38763425 P f0e7c9f6ec2c46eda889ff8f199bc969 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:27.455356 5740 tablet_bootstrap.cc:654] T 9d744327c3714ed99169ee010b3a1eb7 P ac714929b11c43d482b5920a2a5b9129: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:27.456703 5744 tablet_bootstrap.cc:654] T 8014b6301211413cbbe6a34e60213b1f P 5a67f69245d14aa395dd7410912ee2d5: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:27.463023 5697 raft_consensus.cc:2466] T f586c1c904ee41f785ba350b68057810 P 5a67f69245d14aa395dd7410912ee2d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0e7c9f6ec2c46eda889ff8f199bc969 in term 1.
I20250625 03:32:27.464718 5512 leader_election.cc:304] T f586c1c904ee41f785ba350b68057810 P f0e7c9f6ec2c46eda889ff8f199bc969 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a67f69245d14aa395dd7410912ee2d5, f0e7c9f6ec2c46eda889ff8f199bc969; no voters:
I20250625 03:32:27.465812 5775 raft_consensus.cc:2802] T f586c1c904ee41f785ba350b68057810 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:32:27.466297 5775 raft_consensus.cc:695] T f586c1c904ee41f785ba350b68057810 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 LEADER]: Becoming Leader. State: Replica: f0e7c9f6ec2c46eda889ff8f199bc969, State: Running, Role: LEADER
I20250625 03:32:27.467219 5775 consensus_queue.cc:237] T f586c1c904ee41f785ba350b68057810 P f0e7c9f6ec2c46eda889ff8f199bc969 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:27.471408 5622 raft_consensus.cc:2466] T f586c1c904ee41f785ba350b68057810 P ac714929b11c43d482b5920a2a5b9129 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0e7c9f6ec2c46eda889ff8f199bc969 in term 1.
I20250625 03:32:27.465022 5744 tablet_bootstrap.cc:492] T 8014b6301211413cbbe6a34e60213b1f P 5a67f69245d14aa395dd7410912ee2d5: No bootstrap required, opened a new log
I20250625 03:32:27.474197 5744 ts_tablet_manager.cc:1397] T 8014b6301211413cbbe6a34e60213b1f P 5a67f69245d14aa395dd7410912ee2d5: Time spent bootstrapping tablet: real 0.042s user 0.013s sys 0.001s
I20250625 03:32:27.478188 5744 raft_consensus.cc:357] T 8014b6301211413cbbe6a34e60213b1f P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:27.478968 5744 raft_consensus.cc:383] T 8014b6301211413cbbe6a34e60213b1f P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:27.479276 5744 raft_consensus.cc:738] T 8014b6301211413cbbe6a34e60213b1f P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a67f69245d14aa395dd7410912ee2d5, State: Initialized, Role: FOLLOWER
I20250625 03:32:27.480048 5744 consensus_queue.cc:260] T 8014b6301211413cbbe6a34e60213b1f P 5a67f69245d14aa395dd7410912ee2d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:27.483341 5744 ts_tablet_manager.cc:1428] T 8014b6301211413cbbe6a34e60213b1f P 5a67f69245d14aa395dd7410912ee2d5: Time spent starting tablet: real 0.009s user 0.006s sys 0.001s
I20250625 03:32:27.484534 5744 tablet_bootstrap.cc:492] T 3857bc0f026242499856f49c07bccf36 P 5a67f69245d14aa395dd7410912ee2d5: Bootstrap starting.
I20250625 03:32:27.486517 5444 catalog_manager.cc:5582] T b01160bf577842c485d19170bfcb2946 P 5a67f69245d14aa395dd7410912ee2d5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a67f69245d14aa395dd7410912ee2d5 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "5a67f69245d14aa395dd7410912ee2d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } health_report { overall_health: HEALTHY } } }
I20250625 03:32:27.488863 5444 catalog_manager.cc:5582] T ec327833dcb74b6b8679315df6d60ac5 P 5a67f69245d14aa395dd7410912ee2d5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a67f69245d14aa395dd7410912ee2d5 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "5a67f69245d14aa395dd7410912ee2d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } health_report { overall_health: HEALTHY } } }
I20250625 03:32:27.491429 5548 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3857bc0f026242499856f49c07bccf36" candidate_uuid: "ac714929b11c43d482b5920a2a5b9129" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" is_pre_election: true
I20250625 03:32:27.492225 5548 raft_consensus.cc:2466] T 3857bc0f026242499856f49c07bccf36 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac714929b11c43d482b5920a2a5b9129 in term 0.
I20250625 03:32:27.492668 5744 tablet_bootstrap.cc:654] T 3857bc0f026242499856f49c07bccf36 P 5a67f69245d14aa395dd7410912ee2d5: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:27.492257 5446 catalog_manager.cc:5582] T 8014b6301211413cbbe6a34e60213b1f P f0e7c9f6ec2c46eda889ff8f199bc969 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0e7c9f6ec2c46eda889ff8f199bc969 (127.0.106.129). New cstate: current_term: 1 leader_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } health_report { overall_health: UNKNOWN } } }
I20250625 03:32:27.493765 5589 leader_election.cc:304] T 3857bc0f026242499856f49c07bccf36 P ac714929b11c43d482b5920a2a5b9129 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac714929b11c43d482b5920a2a5b9129, f0e7c9f6ec2c46eda889ff8f199bc969; no voters: 5a67f69245d14aa395dd7410912ee2d5
I20250625 03:32:27.494266 5446 catalog_manager.cc:5582] T dd40af6d9f9b4ae2ab31241b28f3b002 P f0e7c9f6ec2c46eda889ff8f199bc969 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0e7c9f6ec2c46eda889ff8f199bc969 (127.0.106.129). New cstate: current_term: 1 leader_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } health_report { overall_health: UNKNOWN } } }
I20250625 03:32:27.495201 5781 raft_consensus.cc:2802] T 3857bc0f026242499856f49c07bccf36 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:32:27.495759 5781 raft_consensus.cc:491] T 3857bc0f026242499856f49c07bccf36 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:32:27.496218 5781 raft_consensus.cc:3058] T 3857bc0f026242499856f49c07bccf36 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:27.507588 5781 raft_consensus.cc:513] T 3857bc0f026242499856f49c07bccf36 P ac714929b11c43d482b5920a2a5b9129 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:27.512490 5548 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3857bc0f026242499856f49c07bccf36" candidate_uuid: "ac714929b11c43d482b5920a2a5b9129" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969"
I20250625 03:32:27.513384 5548 raft_consensus.cc:3058] T 3857bc0f026242499856f49c07bccf36 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:27.515551 5446 catalog_manager.cc:5582] T 95a70da0935d43aba7bf794c38763425 P f0e7c9f6ec2c46eda889ff8f199bc969 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0e7c9f6ec2c46eda889ff8f199bc969 (127.0.106.129). New cstate: current_term: 1 leader_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } health_report { overall_health: UNKNOWN } } }
I20250625 03:32:27.517656 5446 catalog_manager.cc:5582] T f586c1c904ee41f785ba350b68057810 P f0e7c9f6ec2c46eda889ff8f199bc969 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0e7c9f6ec2c46eda889ff8f199bc969 (127.0.106.129). New cstate: current_term: 1 leader_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } health_report { overall_health: UNKNOWN } } }
I20250625 03:32:27.518494 5781 leader_election.cc:290] T 3857bc0f026242499856f49c07bccf36 P ac714929b11c43d482b5920a2a5b9129 [CANDIDATE]: Term 1 election: Requested vote from peers f0e7c9f6ec2c46eda889ff8f199bc969 (127.0.106.129:44743), 5a67f69245d14aa395dd7410912ee2d5 (127.0.106.131:38277)
I20250625 03:32:27.522603 5697 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3857bc0f026242499856f49c07bccf36" candidate_uuid: "ac714929b11c43d482b5920a2a5b9129" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a67f69245d14aa395dd7410912ee2d5"
I20250625 03:32:27.522766 5548 raft_consensus.cc:2466] T 3857bc0f026242499856f49c07bccf36 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac714929b11c43d482b5920a2a5b9129 in term 1.
I20250625 03:32:27.522810 5740 tablet_bootstrap.cc:492] T 9d744327c3714ed99169ee010b3a1eb7 P ac714929b11c43d482b5920a2a5b9129: No bootstrap required, opened a new log
I20250625 03:32:27.523561 5740 ts_tablet_manager.cc:1397] T 9d744327c3714ed99169ee010b3a1eb7 P ac714929b11c43d482b5920a2a5b9129: Time spent bootstrapping tablet: real 0.075s user 0.015s sys 0.010s
I20250625 03:32:27.524042 5589 leader_election.cc:304] T 3857bc0f026242499856f49c07bccf36 P ac714929b11c43d482b5920a2a5b9129 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac714929b11c43d482b5920a2a5b9129, f0e7c9f6ec2c46eda889ff8f199bc969; no voters:
W20250625 03:32:27.525241 5587 leader_election.cc:343] T 3857bc0f026242499856f49c07bccf36 P ac714929b11c43d482b5920a2a5b9129 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5a67f69245d14aa395dd7410912ee2d5 (127.0.106.131:38277): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:32:27.526526 5740 raft_consensus.cc:357] T 9d744327c3714ed99169ee010b3a1eb7 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:27.527384 5740 raft_consensus.cc:383] T 9d744327c3714ed99169ee010b3a1eb7 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:27.528105 5740 raft_consensus.cc:738] T 9d744327c3714ed99169ee010b3a1eb7 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac714929b11c43d482b5920a2a5b9129, State: Initialized, Role: FOLLOWER
I20250625 03:32:27.528785 5740 consensus_queue.cc:260] T 9d744327c3714ed99169ee010b3a1eb7 P ac714929b11c43d482b5920a2a5b9129 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:27.529768 5743 raft_consensus.cc:2802] T 3857bc0f026242499856f49c07bccf36 P ac714929b11c43d482b5920a2a5b9129 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:32:27.530902 5740 ts_tablet_manager.cc:1428] T 9d744327c3714ed99169ee010b3a1eb7 P ac714929b11c43d482b5920a2a5b9129: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20250625 03:32:27.532217 5740 tablet_bootstrap.cc:492] T ec327833dcb74b6b8679315df6d60ac5 P ac714929b11c43d482b5920a2a5b9129: Bootstrap starting.
I20250625 03:32:27.533778 5744 tablet_bootstrap.cc:492] T 3857bc0f026242499856f49c07bccf36 P 5a67f69245d14aa395dd7410912ee2d5: No bootstrap required, opened a new log
I20250625 03:32:27.534288 5744 ts_tablet_manager.cc:1397] T 3857bc0f026242499856f49c07bccf36 P 5a67f69245d14aa395dd7410912ee2d5: Time spent bootstrapping tablet: real 0.050s user 0.019s sys 0.016s
I20250625 03:32:27.536991 5744 raft_consensus.cc:357] T 3857bc0f026242499856f49c07bccf36 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:27.537617 5744 raft_consensus.cc:383] T 3857bc0f026242499856f49c07bccf36 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:27.537917 5744 raft_consensus.cc:738] T 3857bc0f026242499856f49c07bccf36 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a67f69245d14aa395dd7410912ee2d5, State: Initialized, Role: FOLLOWER
I20250625 03:32:27.538024 5740 tablet_bootstrap.cc:654] T ec327833dcb74b6b8679315df6d60ac5 P ac714929b11c43d482b5920a2a5b9129: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:27.538725 5744 consensus_queue.cc:260] T 3857bc0f026242499856f49c07bccf36 P 5a67f69245d14aa395dd7410912ee2d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:27.541100 5744 ts_tablet_manager.cc:1428] T 3857bc0f026242499856f49c07bccf36 P 5a67f69245d14aa395dd7410912ee2d5: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20250625 03:32:27.541941 5743 raft_consensus.cc:695] T 3857bc0f026242499856f49c07bccf36 P ac714929b11c43d482b5920a2a5b9129 [term 1 LEADER]: Becoming Leader. State: Replica: ac714929b11c43d482b5920a2a5b9129, State: Running, Role: LEADER
I20250625 03:32:27.542853 5743 consensus_queue.cc:237] T 3857bc0f026242499856f49c07bccf36 P ac714929b11c43d482b5920a2a5b9129 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:27.543929 5744 tablet_bootstrap.cc:492] T dd40af6d9f9b4ae2ab31241b28f3b002 P 5a67f69245d14aa395dd7410912ee2d5: Bootstrap starting.
I20250625 03:32:27.551178 5744 tablet_bootstrap.cc:654] T dd40af6d9f9b4ae2ab31241b28f3b002 P 5a67f69245d14aa395dd7410912ee2d5: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:27.551282 5740 tablet_bootstrap.cc:492] T ec327833dcb74b6b8679315df6d60ac5 P ac714929b11c43d482b5920a2a5b9129: No bootstrap required, opened a new log
I20250625 03:32:27.551905 5740 ts_tablet_manager.cc:1397] T ec327833dcb74b6b8679315df6d60ac5 P ac714929b11c43d482b5920a2a5b9129: Time spent bootstrapping tablet: real 0.020s user 0.012s sys 0.004s
I20250625 03:32:27.555056 5740 raft_consensus.cc:357] T ec327833dcb74b6b8679315df6d60ac5 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:27.556028 5740 raft_consensus.cc:383] T ec327833dcb74b6b8679315df6d60ac5 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:27.556373 5740 raft_consensus.cc:738] T ec327833dcb74b6b8679315df6d60ac5 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac714929b11c43d482b5920a2a5b9129, State: Initialized, Role: FOLLOWER
I20250625 03:32:27.556942 5740 consensus_queue.cc:260] T ec327833dcb74b6b8679315df6d60ac5 P ac714929b11c43d482b5920a2a5b9129 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:27.558063 5446 catalog_manager.cc:5582] T 3857bc0f026242499856f49c07bccf36 P ac714929b11c43d482b5920a2a5b9129 reported cstate change: term changed from 0 to 1, leader changed from <none> to ac714929b11c43d482b5920a2a5b9129 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "ac714929b11c43d482b5920a2a5b9129" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } health_report { overall_health: UNKNOWN } } }
I20250625 03:32:27.558490 5744 tablet_bootstrap.cc:492] T dd40af6d9f9b4ae2ab31241b28f3b002 P 5a67f69245d14aa395dd7410912ee2d5: No bootstrap required, opened a new log
I20250625 03:32:27.558955 5740 ts_tablet_manager.cc:1428] T ec327833dcb74b6b8679315df6d60ac5 P ac714929b11c43d482b5920a2a5b9129: Time spent starting tablet: real 0.007s user 0.004s sys 0.000s
I20250625 03:32:27.559165 5744 ts_tablet_manager.cc:1397] T dd40af6d9f9b4ae2ab31241b28f3b002 P 5a67f69245d14aa395dd7410912ee2d5: Time spent bootstrapping tablet: real 0.016s user 0.008s sys 0.006s
I20250625 03:32:27.561609 5744 raft_consensus.cc:357] T dd40af6d9f9b4ae2ab31241b28f3b002 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:27.562258 5744 raft_consensus.cc:383] T dd40af6d9f9b4ae2ab31241b28f3b002 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:27.562539 5744 raft_consensus.cc:738] T dd40af6d9f9b4ae2ab31241b28f3b002 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a67f69245d14aa395dd7410912ee2d5, State: Initialized, Role: FOLLOWER
I20250625 03:32:27.563033 5744 consensus_queue.cc:260] T dd40af6d9f9b4ae2ab31241b28f3b002 P 5a67f69245d14aa395dd7410912ee2d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:27.564601 5744 ts_tablet_manager.cc:1428] T dd40af6d9f9b4ae2ab31241b28f3b002 P 5a67f69245d14aa395dd7410912ee2d5: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20250625 03:32:27.585414 5772 raft_consensus.cc:491] T 8014b6301211413cbbe6a34e60213b1f P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:32:27.585942 5772 raft_consensus.cc:513] T 8014b6301211413cbbe6a34e60213b1f P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:27.587548 5772 leader_election.cc:290] T 8014b6301211413cbbe6a34e60213b1f P 5a67f69245d14aa395dd7410912ee2d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0e7c9f6ec2c46eda889ff8f199bc969 (127.0.106.129:44743), ac714929b11c43d482b5920a2a5b9129 (127.0.106.130:39845)
I20250625 03:32:27.588375 5548 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8014b6301211413cbbe6a34e60213b1f" candidate_uuid: "5a67f69245d14aa395dd7410912ee2d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" is_pre_election: true
I20250625 03:32:27.588507 5622 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8014b6301211413cbbe6a34e60213b1f" candidate_uuid: "5a67f69245d14aa395dd7410912ee2d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac714929b11c43d482b5920a2a5b9129" is_pre_election: true
I20250625 03:32:27.589249 5622 raft_consensus.cc:2391] T 8014b6301211413cbbe6a34e60213b1f P ac714929b11c43d482b5920a2a5b9129 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a67f69245d14aa395dd7410912ee2d5 in current term 1: Already voted for candidate f0e7c9f6ec2c46eda889ff8f199bc969 in this term.
I20250625 03:32:27.590102 5662 leader_election.cc:304] T 8014b6301211413cbbe6a34e60213b1f P 5a67f69245d14aa395dd7410912ee2d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a67f69245d14aa395dd7410912ee2d5; no voters: ac714929b11c43d482b5920a2a5b9129, f0e7c9f6ec2c46eda889ff8f199bc969
I20250625 03:32:27.590723 5772 raft_consensus.cc:3058] T 8014b6301211413cbbe6a34e60213b1f P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:27.595734 5772 raft_consensus.cc:2747] T 8014b6301211413cbbe6a34e60213b1f P 5a67f69245d14aa395dd7410912ee2d5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:32:27.600448 5743 raft_consensus.cc:491] T 09262e1d4d2346d1b9610e857b693324 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:32:27.600997 5743 raft_consensus.cc:513] T 09262e1d4d2346d1b9610e857b693324 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:27.602728 5743 leader_election.cc:290] T 09262e1d4d2346d1b9610e857b693324 P ac714929b11c43d482b5920a2a5b9129 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0e7c9f6ec2c46eda889ff8f199bc969 (127.0.106.129:44743), 5a67f69245d14aa395dd7410912ee2d5 (127.0.106.131:38277)
I20250625 03:32:27.603533 5548 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "09262e1d4d2346d1b9610e857b693324" candidate_uuid: "ac714929b11c43d482b5920a2a5b9129" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" is_pre_election: true
I20250625 03:32:27.603727 5697 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "09262e1d4d2346d1b9610e857b693324" candidate_uuid: "ac714929b11c43d482b5920a2a5b9129" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a67f69245d14aa395dd7410912ee2d5" is_pre_election: true
I20250625 03:32:27.604162 5548 raft_consensus.cc:2466] T 09262e1d4d2346d1b9610e857b693324 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac714929b11c43d482b5920a2a5b9129 in term 0.
I20250625 03:32:27.604338 5697 raft_consensus.cc:2466] T 09262e1d4d2346d1b9610e857b693324 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac714929b11c43d482b5920a2a5b9129 in term 0.
I20250625 03:32:27.605046 5589 leader_election.cc:304] T 09262e1d4d2346d1b9610e857b693324 P ac714929b11c43d482b5920a2a5b9129 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac714929b11c43d482b5920a2a5b9129, f0e7c9f6ec2c46eda889ff8f199bc969; no voters:
I20250625 03:32:27.605667 5743 raft_consensus.cc:2802] T 09262e1d4d2346d1b9610e857b693324 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:32:27.606019 5743 raft_consensus.cc:491] T 09262e1d4d2346d1b9610e857b693324 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:32:27.606285 5743 raft_consensus.cc:3058] T 09262e1d4d2346d1b9610e857b693324 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:27.611341 5743 raft_consensus.cc:513] T 09262e1d4d2346d1b9610e857b693324 P ac714929b11c43d482b5920a2a5b9129 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:27.611600 5772 raft_consensus.cc:491] T dd40af6d9f9b4ae2ab31241b28f3b002 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:32:27.612242 5772 raft_consensus.cc:513] T dd40af6d9f9b4ae2ab31241b28f3b002 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:27.613082 5743 leader_election.cc:290] T 09262e1d4d2346d1b9610e857b693324 P ac714929b11c43d482b5920a2a5b9129 [CANDIDATE]: Term 1 election: Requested vote from peers f0e7c9f6ec2c46eda889ff8f199bc969 (127.0.106.129:44743), 5a67f69245d14aa395dd7410912ee2d5 (127.0.106.131:38277)
I20250625 03:32:27.614042 5772 leader_election.cc:290] T dd40af6d9f9b4ae2ab31241b28f3b002 P 5a67f69245d14aa395dd7410912ee2d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0e7c9f6ec2c46eda889ff8f199bc969 (127.0.106.129:44743), ac714929b11c43d482b5920a2a5b9129 (127.0.106.130:39845)
I20250625 03:32:27.613890 5548 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "09262e1d4d2346d1b9610e857b693324" candidate_uuid: "ac714929b11c43d482b5920a2a5b9129" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969"
I20250625 03:32:27.614660 5697 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "09262e1d4d2346d1b9610e857b693324" candidate_uuid: "ac714929b11c43d482b5920a2a5b9129" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a67f69245d14aa395dd7410912ee2d5"
I20250625 03:32:27.614660 5547 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dd40af6d9f9b4ae2ab31241b28f3b002" candidate_uuid: "5a67f69245d14aa395dd7410912ee2d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" is_pre_election: true
I20250625 03:32:27.615192 5548 raft_consensus.cc:3058] T 09262e1d4d2346d1b9610e857b693324 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:27.615425 5697 raft_consensus.cc:3058] T 09262e1d4d2346d1b9610e857b693324 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:27.615494 5622 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dd40af6d9f9b4ae2ab31241b28f3b002" candidate_uuid: "5a67f69245d14aa395dd7410912ee2d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac714929b11c43d482b5920a2a5b9129" is_pre_election: true
I20250625 03:32:27.616441 5622 raft_consensus.cc:2391] T dd40af6d9f9b4ae2ab31241b28f3b002 P ac714929b11c43d482b5920a2a5b9129 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a67f69245d14aa395dd7410912ee2d5 in current term 1: Already voted for candidate f0e7c9f6ec2c46eda889ff8f199bc969 in this term.
I20250625 03:32:27.617444 5662 leader_election.cc:304] T dd40af6d9f9b4ae2ab31241b28f3b002 P 5a67f69245d14aa395dd7410912ee2d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a67f69245d14aa395dd7410912ee2d5; no voters: ac714929b11c43d482b5920a2a5b9129, f0e7c9f6ec2c46eda889ff8f199bc969
I20250625 03:32:27.618269 5772 raft_consensus.cc:3058] T dd40af6d9f9b4ae2ab31241b28f3b002 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:27.621469 5548 raft_consensus.cc:2466] T 09262e1d4d2346d1b9610e857b693324 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac714929b11c43d482b5920a2a5b9129 in term 1.
I20250625 03:32:27.622496 5697 raft_consensus.cc:2466] T 09262e1d4d2346d1b9610e857b693324 P 5a67f69245d14aa395dd7410912ee2d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac714929b11c43d482b5920a2a5b9129 in term 1.
I20250625 03:32:27.622668 5589 leader_election.cc:304] T 09262e1d4d2346d1b9610e857b693324 P ac714929b11c43d482b5920a2a5b9129 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac714929b11c43d482b5920a2a5b9129, f0e7c9f6ec2c46eda889ff8f199bc969; no voters:
I20250625 03:32:27.623668 5743 raft_consensus.cc:2802] T 09262e1d4d2346d1b9610e857b693324 P ac714929b11c43d482b5920a2a5b9129 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:32:27.624097 5743 raft_consensus.cc:695] T 09262e1d4d2346d1b9610e857b693324 P ac714929b11c43d482b5920a2a5b9129 [term 1 LEADER]: Becoming Leader. State: Replica: ac714929b11c43d482b5920a2a5b9129, State: Running, Role: LEADER
I20250625 03:32:27.624863 5743 consensus_queue.cc:237] T 09262e1d4d2346d1b9610e857b693324 P ac714929b11c43d482b5920a2a5b9129 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:27.625444 5772 raft_consensus.cc:2747] T dd40af6d9f9b4ae2ab31241b28f3b002 P 5a67f69245d14aa395dd7410912ee2d5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:32:27.632656 5446 catalog_manager.cc:5582] T 09262e1d4d2346d1b9610e857b693324 P ac714929b11c43d482b5920a2a5b9129 reported cstate change: term changed from 0 to 1, leader changed from <none> to ac714929b11c43d482b5920a2a5b9129 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "ac714929b11c43d482b5920a2a5b9129" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } health_report { overall_health: UNKNOWN } } }
I20250625 03:32:27.674451 5772 consensus_queue.cc:1035] T b01160bf577842c485d19170bfcb2946 P 5a67f69245d14aa395dd7410912ee2d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:32:27.685092 5772 consensus_queue.cc:1035] T b01160bf577842c485d19170bfcb2946 P 5a67f69245d14aa395dd7410912ee2d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:32:27.708215 5622 raft_consensus.cc:3058] T 9d744327c3714ed99169ee010b3a1eb7 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:27.714574 5772 consensus_queue.cc:1035] T 9d744327c3714ed99169ee010b3a1eb7 P 5a67f69245d14aa395dd7410912ee2d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:32:27.725366 5772 consensus_queue.cc:1035] T 9d744327c3714ed99169ee010b3a1eb7 P 5a67f69245d14aa395dd7410912ee2d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:32:27.781423 5766 consensus_queue.cc:1035] T dd40af6d9f9b4ae2ab31241b28f3b002 P f0e7c9f6ec2c46eda889ff8f199bc969 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:32:27.792461 5766 consensus_queue.cc:1035] T dd40af6d9f9b4ae2ab31241b28f3b002 P f0e7c9f6ec2c46eda889ff8f199bc969 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:32:27.795876 5766 consensus_queue.cc:1035] T 8014b6301211413cbbe6a34e60213b1f P f0e7c9f6ec2c46eda889ff8f199bc969 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:32:27.807255 5777 consensus_queue.cc:1035] T 8014b6301211413cbbe6a34e60213b1f P f0e7c9f6ec2c46eda889ff8f199bc969 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:32:27.827123 5696 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "b01160bf577842c485d19170bfcb2946"
dest_uuid: "5a67f69245d14aa395dd7410912ee2d5"
mode: GRACEFUL
new_leader_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969"
from {username='slave'} at 127.0.0.1:52270
I20250625 03:32:27.827703 5696 raft_consensus.cc:604] T b01160bf577842c485d19170bfcb2946 P 5a67f69245d14aa395dd7410912ee2d5 [term 1 LEADER]: Received request to transfer leadership to TS f0e7c9f6ec2c46eda889ff8f199bc969
I20250625 03:32:27.836269 5777 consensus_queue.cc:1035] T 95a70da0935d43aba7bf794c38763425 P f0e7c9f6ec2c46eda889ff8f199bc969 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:32:27.843173 5622 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "3857bc0f026242499856f49c07bccf36"
dest_uuid: "ac714929b11c43d482b5920a2a5b9129"
mode: GRACEFUL
new_leader_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969"
from {username='slave'} at 127.0.0.1:51104
I20250625 03:32:27.843849 5622 raft_consensus.cc:604] T 3857bc0f026242499856f49c07bccf36 P ac714929b11c43d482b5920a2a5b9129 [term 1 LEADER]: Received request to transfer leadership to TS f0e7c9f6ec2c46eda889ff8f199bc969
I20250625 03:32:27.849268 5770 consensus_queue.cc:1035] T 95a70da0935d43aba7bf794c38763425 P f0e7c9f6ec2c46eda889ff8f199bc969 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:32:27.868960 5743 raft_consensus.cc:491] T ec327833dcb74b6b8679315df6d60ac5 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:32:27.869545 5743 raft_consensus.cc:513] T ec327833dcb74b6b8679315df6d60ac5 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:27.871713 5743 leader_election.cc:290] T ec327833dcb74b6b8679315df6d60ac5 P ac714929b11c43d482b5920a2a5b9129 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0e7c9f6ec2c46eda889ff8f199bc969 (127.0.106.129:44743), 5a67f69245d14aa395dd7410912ee2d5 (127.0.106.131:38277)
I20250625 03:32:27.872987 5696 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ec327833dcb74b6b8679315df6d60ac5" candidate_uuid: "ac714929b11c43d482b5920a2a5b9129" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a67f69245d14aa395dd7410912ee2d5" is_pre_election: true
I20250625 03:32:27.914733 5772 consensus_queue.cc:1035] T ec327833dcb74b6b8679315df6d60ac5 P 5a67f69245d14aa395dd7410912ee2d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:32:27.918241 5622 raft_consensus.cc:3058] T ec327833dcb74b6b8679315df6d60ac5 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Advancing to term 1
W20250625 03:32:28.675683 5622 consensus_meta.cc:287] T ec327833dcb74b6b8679315df6d60ac5 P ac714929b11c43d482b5920a2a5b9129: Time spent flushing consensus metadata: real 0.757s user 0.015s sys 0.009s
I20250625 03:32:28.680799 5775 consensus_queue.cc:1035] T f586c1c904ee41f785ba350b68057810 P f0e7c9f6ec2c46eda889ff8f199bc969 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:32:28.690979 5548 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ec327833dcb74b6b8679315df6d60ac5" candidate_uuid: "ac714929b11c43d482b5920a2a5b9129" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" is_pre_election: true
I20250625 03:32:28.692727 5589 leader_election.cc:304] T ec327833dcb74b6b8679315df6d60ac5 P ac714929b11c43d482b5920a2a5b9129 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac714929b11c43d482b5920a2a5b9129; no voters: 5a67f69245d14aa395dd7410912ee2d5, f0e7c9f6ec2c46eda889ff8f199bc969
I20250625 03:32:28.693989 5817 raft_consensus.cc:2747] T ec327833dcb74b6b8679315df6d60ac5 P ac714929b11c43d482b5920a2a5b9129 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:32:28.695379 5817 consensus_queue.cc:1035] T 09262e1d4d2346d1b9610e857b693324 P ac714929b11c43d482b5920a2a5b9129 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:32:28.705400 5817 consensus_queue.cc:1035] T 3857bc0f026242499856f49c07bccf36 P ac714929b11c43d482b5920a2a5b9129 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:32:28.714931 5817 raft_consensus.cc:991] T 3857bc0f026242499856f49c07bccf36 P ac714929b11c43d482b5920a2a5b9129: : Instructing follower f0e7c9f6ec2c46eda889ff8f199bc969 to start an election
I20250625 03:32:28.715360 5817 raft_consensus.cc:1079] T 3857bc0f026242499856f49c07bccf36 P ac714929b11c43d482b5920a2a5b9129 [term 1 LEADER]: Signalling peer f0e7c9f6ec2c46eda889ff8f199bc969 to start an election
I20250625 03:32:28.717676 5546 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "3857bc0f026242499856f49c07bccf36"
dest_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969"
from {username='slave'} at 127.0.0.1:48220
I20250625 03:32:28.719290 5546 raft_consensus.cc:491] T 3857bc0f026242499856f49c07bccf36 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:32:28.719702 5546 raft_consensus.cc:3058] T 3857bc0f026242499856f49c07bccf36 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:28.723403 5772 raft_consensus.cc:491] T 3857bc0f026242499856f49c07bccf36 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:32:28.724202 5772 raft_consensus.cc:513] T 3857bc0f026242499856f49c07bccf36 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:28.726469 5772 leader_election.cc:290] T 3857bc0f026242499856f49c07bccf36 P 5a67f69245d14aa395dd7410912ee2d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0e7c9f6ec2c46eda889ff8f199bc969 (127.0.106.129:44743), ac714929b11c43d482b5920a2a5b9129 (127.0.106.130:39845)
I20250625 03:32:28.726668 5546 raft_consensus.cc:513] T 3857bc0f026242499856f49c07bccf36 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:28.737459 5623 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3857bc0f026242499856f49c07bccf36" candidate_uuid: "5a67f69245d14aa395dd7410912ee2d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac714929b11c43d482b5920a2a5b9129" is_pre_election: true
I20250625 03:32:28.740317 5772 consensus_queue.cc:1035] T ec327833dcb74b6b8679315df6d60ac5 P 5a67f69245d14aa395dd7410912ee2d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:32:28.754303 5622 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3857bc0f026242499856f49c07bccf36" candidate_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ac714929b11c43d482b5920a2a5b9129"
I20250625 03:32:28.755195 5622 raft_consensus.cc:3053] T 3857bc0f026242499856f49c07bccf36 P ac714929b11c43d482b5920a2a5b9129 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:32:28.755640 5622 raft_consensus.cc:738] T 3857bc0f026242499856f49c07bccf36 P ac714929b11c43d482b5920a2a5b9129 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ac714929b11c43d482b5920a2a5b9129, State: Running, Role: LEADER
I20250625 03:32:28.756847 5622 consensus_queue.cc:260] T 3857bc0f026242499856f49c07bccf36 P ac714929b11c43d482b5920a2a5b9129 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:28.758145 5622 raft_consensus.cc:3058] T 3857bc0f026242499856f49c07bccf36 P ac714929b11c43d482b5920a2a5b9129 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:28.766273 5546 leader_election.cc:290] T 3857bc0f026242499856f49c07bccf36 P f0e7c9f6ec2c46eda889ff8f199bc969 [CANDIDATE]: Term 2 election: Requested vote from peers ac714929b11c43d482b5920a2a5b9129 (127.0.106.130:39845), 5a67f69245d14aa395dd7410912ee2d5 (127.0.106.131:38277)
I20250625 03:32:28.770571 5548 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3857bc0f026242499856f49c07bccf36" candidate_uuid: "5a67f69245d14aa395dd7410912ee2d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" is_pre_election: true
I20250625 03:32:28.801911 5772 raft_consensus.cc:991] T b01160bf577842c485d19170bfcb2946 P 5a67f69245d14aa395dd7410912ee2d5: : Instructing follower f0e7c9f6ec2c46eda889ff8f199bc969 to start an election
I20250625 03:32:28.802696 5825 raft_consensus.cc:1079] T b01160bf577842c485d19170bfcb2946 P 5a67f69245d14aa395dd7410912ee2d5 [term 1 LEADER]: Signalling peer f0e7c9f6ec2c46eda889ff8f199bc969 to start an election
I20250625 03:32:28.805855 5663 leader_election.cc:304] T 3857bc0f026242499856f49c07bccf36 P 5a67f69245d14aa395dd7410912ee2d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a67f69245d14aa395dd7410912ee2d5; no voters: ac714929b11c43d482b5920a2a5b9129, f0e7c9f6ec2c46eda889ff8f199bc969
I20250625 03:32:28.813856 5822 raft_consensus.cc:2747] T 3857bc0f026242499856f49c07bccf36 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:32:28.817238 5697 raft_consensus.cc:3058] T 3857bc0f026242499856f49c07bccf36 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:28.822186 5622 raft_consensus.cc:2466] T 3857bc0f026242499856f49c07bccf36 P ac714929b11c43d482b5920a2a5b9129 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0e7c9f6ec2c46eda889ff8f199bc969 in term 2.
I20250625 03:32:28.824767 5513 leader_election.cc:304] T 3857bc0f026242499856f49c07bccf36 P f0e7c9f6ec2c46eda889ff8f199bc969 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac714929b11c43d482b5920a2a5b9129, f0e7c9f6ec2c46eda889ff8f199bc969; no voters:
I20250625 03:32:28.825690 5775 raft_consensus.cc:2802] T 3857bc0f026242499856f49c07bccf36 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:32:28.826184 5775 raft_consensus.cc:695] T 3857bc0f026242499856f49c07bccf36 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 2 LEADER]: Becoming Leader. State: Replica: f0e7c9f6ec2c46eda889ff8f199bc969, State: Running, Role: LEADER
I20250625 03:32:28.827037 5775 consensus_queue.cc:237] T 3857bc0f026242499856f49c07bccf36 P f0e7c9f6ec2c46eda889ff8f199bc969 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:28.832584 5694 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3857bc0f026242499856f49c07bccf36" candidate_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5a67f69245d14aa395dd7410912ee2d5"
I20250625 03:32:28.833477 5694 raft_consensus.cc:3058] T 3857bc0f026242499856f49c07bccf36 P 5a67f69245d14aa395dd7410912ee2d5 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:28.837234 5547 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "b01160bf577842c485d19170bfcb2946"
dest_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969"
from {username='slave'} at 127.0.0.1:48214
I20250625 03:32:28.837958 5547 raft_consensus.cc:491] T b01160bf577842c485d19170bfcb2946 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:32:28.838344 5547 raft_consensus.cc:3058] T b01160bf577842c485d19170bfcb2946 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:28.842867 5694 raft_consensus.cc:2466] T 3857bc0f026242499856f49c07bccf36 P 5a67f69245d14aa395dd7410912ee2d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0e7c9f6ec2c46eda889ff8f199bc969 in term 2.
I20250625 03:32:28.842777 5766 consensus_queue.cc:1035] T f586c1c904ee41f785ba350b68057810 P f0e7c9f6ec2c46eda889ff8f199bc969 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:32:28.844863 5795 consensus_queue.cc:1035] T 09262e1d4d2346d1b9610e857b693324 P ac714929b11c43d482b5920a2a5b9129 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:32:28.847954 5547 raft_consensus.cc:513] T b01160bf577842c485d19170bfcb2946 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:28.850499 5547 leader_election.cc:290] T b01160bf577842c485d19170bfcb2946 P f0e7c9f6ec2c46eda889ff8f199bc969 [CANDIDATE]: Term 2 election: Requested vote from peers ac714929b11c43d482b5920a2a5b9129 (127.0.106.130:39845), 5a67f69245d14aa395dd7410912ee2d5 (127.0.106.131:38277)
I20250625 03:32:28.850769 5622 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b01160bf577842c485d19170bfcb2946" candidate_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ac714929b11c43d482b5920a2a5b9129"
I20250625 03:32:28.851804 5622 raft_consensus.cc:3058] T b01160bf577842c485d19170bfcb2946 P ac714929b11c43d482b5920a2a5b9129 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:28.896371 5547 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "8014b6301211413cbbe6a34e60213b1f"
dest_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969"
mode: GRACEFUL
new_leader_uuid: "ac714929b11c43d482b5920a2a5b9129"
from {username='slave'} at 127.0.0.1:48224
I20250625 03:32:28.898712 5547 raft_consensus.cc:604] T 8014b6301211413cbbe6a34e60213b1f P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 LEADER]: Received request to transfer leadership to TS ac714929b11c43d482b5920a2a5b9129
I20250625 03:32:28.907047 5696 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b01160bf577842c485d19170bfcb2946" candidate_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5a67f69245d14aa395dd7410912ee2d5"
I20250625 03:32:28.908692 5696 raft_consensus.cc:3053] T b01160bf577842c485d19170bfcb2946 P 5a67f69245d14aa395dd7410912ee2d5 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:32:28.909216 5696 raft_consensus.cc:738] T b01160bf577842c485d19170bfcb2946 P 5a67f69245d14aa395dd7410912ee2d5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a67f69245d14aa395dd7410912ee2d5, State: Running, Role: LEADER
I20250625 03:32:28.918530 5547 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "dd40af6d9f9b4ae2ab31241b28f3b002"
dest_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969"
mode: GRACEFUL
new_leader_uuid: "ac714929b11c43d482b5920a2a5b9129"
from {username='slave'} at 127.0.0.1:48224
I20250625 03:32:28.919675 5547 raft_consensus.cc:604] T dd40af6d9f9b4ae2ab31241b28f3b002 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 LEADER]: Received request to transfer leadership to TS ac714929b11c43d482b5920a2a5b9129
I20250625 03:32:28.911687 5696 consensus_queue.cc:260] T b01160bf577842c485d19170bfcb2946 P 5a67f69245d14aa395dd7410912ee2d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:28.925145 5622 raft_consensus.cc:2466] T b01160bf577842c485d19170bfcb2946 P ac714929b11c43d482b5920a2a5b9129 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0e7c9f6ec2c46eda889ff8f199bc969 in term 2.
I20250625 03:32:28.930761 5696 raft_consensus.cc:3058] T b01160bf577842c485d19170bfcb2946 P 5a67f69245d14aa395dd7410912ee2d5 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:28.930676 5513 leader_election.cc:304] T b01160bf577842c485d19170bfcb2946 P f0e7c9f6ec2c46eda889ff8f199bc969 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac714929b11c43d482b5920a2a5b9129, f0e7c9f6ec2c46eda889ff8f199bc969; no voters:
I20250625 03:32:28.932642 5766 raft_consensus.cc:2802] T b01160bf577842c485d19170bfcb2946 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:32:28.933521 5766 raft_consensus.cc:695] T b01160bf577842c485d19170bfcb2946 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 2 LEADER]: Becoming Leader. State: Replica: f0e7c9f6ec2c46eda889ff8f199bc969, State: Running, Role: LEADER
I20250625 03:32:28.936551 5766 consensus_queue.cc:237] T b01160bf577842c485d19170bfcb2946 P f0e7c9f6ec2c46eda889ff8f199bc969 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:28.944808 5696 raft_consensus.cc:2466] T b01160bf577842c485d19170bfcb2946 P 5a67f69245d14aa395dd7410912ee2d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0e7c9f6ec2c46eda889ff8f199bc969 in term 2.
I20250625 03:32:28.945209 5444 catalog_manager.cc:5582] T 3857bc0f026242499856f49c07bccf36 P f0e7c9f6ec2c46eda889ff8f199bc969 reported cstate change: term changed from 1 to 2, leader changed from ac714929b11c43d482b5920a2a5b9129 (127.0.106.130) to f0e7c9f6ec2c46eda889ff8f199bc969 (127.0.106.129). New cstate: current_term: 2 leader_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } health_report { overall_health: UNKNOWN } } }
W20250625 03:32:28.951931 5569 debug-util.cc:398] Leaking SignalData structure 0x7b08000484e0 after lost signal to thread 429
W20250625 03:32:28.954625 5569 debug-util.cc:398] Leaking SignalData structure 0x7b080014cfe0 after lost signal to thread 5480
W20250625 03:32:28.964320 5569 debug-util.cc:398] Leaking SignalData structure 0x7b0800356820 after lost signal to thread 5647
I20250625 03:32:28.965044 5696 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "9d744327c3714ed99169ee010b3a1eb7"
dest_uuid: "5a67f69245d14aa395dd7410912ee2d5"
mode: GRACEFUL
new_leader_uuid: "ac714929b11c43d482b5920a2a5b9129"
from {username='slave'} at 127.0.0.1:52270
I20250625 03:32:28.966028 5696 raft_consensus.cc:604] T 9d744327c3714ed99169ee010b3a1eb7 P 5a67f69245d14aa395dd7410912ee2d5 [term 1 LEADER]: Received request to transfer leadership to TS ac714929b11c43d482b5920a2a5b9129
W20250625 03:32:28.966261 5569 debug-util.cc:398] Leaking SignalData structure 0x7b0800358980 after lost signal to thread 5721
I20250625 03:32:28.989758 5444 catalog_manager.cc:5582] T b01160bf577842c485d19170bfcb2946 P f0e7c9f6ec2c46eda889ff8f199bc969 reported cstate change: term changed from 1 to 2, leader changed from 5a67f69245d14aa395dd7410912ee2d5 (127.0.106.131) to f0e7c9f6ec2c46eda889ff8f199bc969 (127.0.106.129). New cstate: current_term: 2 leader_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } health_report { overall_health: UNKNOWN } } }
I20250625 03:32:29.145793 5775 raft_consensus.cc:991] T 8014b6301211413cbbe6a34e60213b1f P f0e7c9f6ec2c46eda889ff8f199bc969: : Instructing follower ac714929b11c43d482b5920a2a5b9129 to start an election
I20250625 03:32:29.146306 5766 raft_consensus.cc:1079] T 8014b6301211413cbbe6a34e60213b1f P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 LEADER]: Signalling peer ac714929b11c43d482b5920a2a5b9129 to start an election
I20250625 03:32:29.147946 5622 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "8014b6301211413cbbe6a34e60213b1f"
dest_uuid: "ac714929b11c43d482b5920a2a5b9129"
from {username='slave'} at 127.0.0.1:51094
I20250625 03:32:29.148447 5622 raft_consensus.cc:491] T 8014b6301211413cbbe6a34e60213b1f P ac714929b11c43d482b5920a2a5b9129 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:32:29.148736 5622 raft_consensus.cc:3058] T 8014b6301211413cbbe6a34e60213b1f P ac714929b11c43d482b5920a2a5b9129 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:29.154479 5622 raft_consensus.cc:513] T 8014b6301211413cbbe6a34e60213b1f P ac714929b11c43d482b5920a2a5b9129 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:29.156234 5622 leader_election.cc:290] T 8014b6301211413cbbe6a34e60213b1f P ac714929b11c43d482b5920a2a5b9129 [CANDIDATE]: Term 2 election: Requested vote from peers f0e7c9f6ec2c46eda889ff8f199bc969 (127.0.106.129:44743), 5a67f69245d14aa395dd7410912ee2d5 (127.0.106.131:38277)
I20250625 03:32:29.157467 5696 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8014b6301211413cbbe6a34e60213b1f" candidate_uuid: "ac714929b11c43d482b5920a2a5b9129" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5a67f69245d14aa395dd7410912ee2d5"
I20250625 03:32:29.157545 5547 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8014b6301211413cbbe6a34e60213b1f" candidate_uuid: "ac714929b11c43d482b5920a2a5b9129" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969"
I20250625 03:32:29.158301 5696 raft_consensus.cc:3058] T 8014b6301211413cbbe6a34e60213b1f P 5a67f69245d14aa395dd7410912ee2d5 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:29.158399 5547 raft_consensus.cc:3053] T 8014b6301211413cbbe6a34e60213b1f P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:32:29.158882 5547 raft_consensus.cc:738] T 8014b6301211413cbbe6a34e60213b1f P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f0e7c9f6ec2c46eda889ff8f199bc969, State: Running, Role: LEADER
I20250625 03:32:29.160161 5547 consensus_queue.cc:260] T 8014b6301211413cbbe6a34e60213b1f P f0e7c9f6ec2c46eda889ff8f199bc969 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:29.163265 5547 raft_consensus.cc:3058] T 8014b6301211413cbbe6a34e60213b1f P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:29.166587 5696 raft_consensus.cc:2466] T 8014b6301211413cbbe6a34e60213b1f P 5a67f69245d14aa395dd7410912ee2d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac714929b11c43d482b5920a2a5b9129 in term 2.
I20250625 03:32:29.167894 5587 leader_election.cc:304] T 8014b6301211413cbbe6a34e60213b1f P ac714929b11c43d482b5920a2a5b9129 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a67f69245d14aa395dd7410912ee2d5, ac714929b11c43d482b5920a2a5b9129; no voters:
I20250625 03:32:29.169109 5795 raft_consensus.cc:2802] T 8014b6301211413cbbe6a34e60213b1f P ac714929b11c43d482b5920a2a5b9129 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:32:29.169648 5795 raft_consensus.cc:695] T 8014b6301211413cbbe6a34e60213b1f P ac714929b11c43d482b5920a2a5b9129 [term 2 LEADER]: Becoming Leader. State: Replica: ac714929b11c43d482b5920a2a5b9129, State: Running, Role: LEADER
I20250625 03:32:29.170903 5795 consensus_queue.cc:237] T 8014b6301211413cbbe6a34e60213b1f P ac714929b11c43d482b5920a2a5b9129 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:29.177551 5547 raft_consensus.cc:2466] T 8014b6301211413cbbe6a34e60213b1f P f0e7c9f6ec2c46eda889ff8f199bc969 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac714929b11c43d482b5920a2a5b9129 in term 2.
I20250625 03:32:29.188650 5444 catalog_manager.cc:5582] T 8014b6301211413cbbe6a34e60213b1f P ac714929b11c43d482b5920a2a5b9129 reported cstate change: term changed from 1 to 2, leader changed from f0e7c9f6ec2c46eda889ff8f199bc969 (127.0.106.129) to ac714929b11c43d482b5920a2a5b9129 (127.0.106.130). New cstate: current_term: 2 leader_uuid: "ac714929b11c43d482b5920a2a5b9129" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } health_report { overall_health: UNKNOWN } } }
I20250625 03:32:29.203826 5772 raft_consensus.cc:991] T 9d744327c3714ed99169ee010b3a1eb7 P 5a67f69245d14aa395dd7410912ee2d5: : Instructing follower ac714929b11c43d482b5920a2a5b9129 to start an election
I20250625 03:32:29.204457 5825 raft_consensus.cc:1079] T 9d744327c3714ed99169ee010b3a1eb7 P 5a67f69245d14aa395dd7410912ee2d5 [term 1 LEADER]: Signalling peer ac714929b11c43d482b5920a2a5b9129 to start an election
I20250625 03:32:29.205905 5622 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "9d744327c3714ed99169ee010b3a1eb7"
dest_uuid: "ac714929b11c43d482b5920a2a5b9129"
from {username='slave'} at 127.0.0.1:51096
I20250625 03:32:29.206550 5622 raft_consensus.cc:491] T 9d744327c3714ed99169ee010b3a1eb7 P ac714929b11c43d482b5920a2a5b9129 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:32:29.206920 5622 raft_consensus.cc:3058] T 9d744327c3714ed99169ee010b3a1eb7 P ac714929b11c43d482b5920a2a5b9129 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:29.216192 5622 raft_consensus.cc:513] T 9d744327c3714ed99169ee010b3a1eb7 P ac714929b11c43d482b5920a2a5b9129 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:29.219296 5548 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9d744327c3714ed99169ee010b3a1eb7" candidate_uuid: "ac714929b11c43d482b5920a2a5b9129" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969"
I20250625 03:32:29.219573 5696 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9d744327c3714ed99169ee010b3a1eb7" candidate_uuid: "ac714929b11c43d482b5920a2a5b9129" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5a67f69245d14aa395dd7410912ee2d5"
I20250625 03:32:29.220068 5548 raft_consensus.cc:3058] T 9d744327c3714ed99169ee010b3a1eb7 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:29.220288 5696 raft_consensus.cc:3053] T 9d744327c3714ed99169ee010b3a1eb7 P 5a67f69245d14aa395dd7410912ee2d5 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:32:29.220731 5696 raft_consensus.cc:738] T 9d744327c3714ed99169ee010b3a1eb7 P 5a67f69245d14aa395dd7410912ee2d5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a67f69245d14aa395dd7410912ee2d5, State: Running, Role: LEADER
I20250625 03:32:29.221634 5622 leader_election.cc:290] T 9d744327c3714ed99169ee010b3a1eb7 P ac714929b11c43d482b5920a2a5b9129 [CANDIDATE]: Term 2 election: Requested vote from peers f0e7c9f6ec2c46eda889ff8f199bc969 (127.0.106.129:44743), 5a67f69245d14aa395dd7410912ee2d5 (127.0.106.131:38277)
I20250625 03:32:29.221962 5696 consensus_queue.cc:260] T 9d744327c3714ed99169ee010b3a1eb7 P 5a67f69245d14aa395dd7410912ee2d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:29.223376 5696 raft_consensus.cc:3058] T 9d744327c3714ed99169ee010b3a1eb7 P 5a67f69245d14aa395dd7410912ee2d5 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:29.229247 5696 raft_consensus.cc:2466] T 9d744327c3714ed99169ee010b3a1eb7 P 5a67f69245d14aa395dd7410912ee2d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac714929b11c43d482b5920a2a5b9129 in term 2.
I20250625 03:32:29.230440 5622 raft_consensus.cc:1273] T 3857bc0f026242499856f49c07bccf36 P ac714929b11c43d482b5920a2a5b9129 [term 2 FOLLOWER]: Refusing update from remote peer f0e7c9f6ec2c46eda889ff8f199bc969: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:32:29.230335 5587 leader_election.cc:304] T 9d744327c3714ed99169ee010b3a1eb7 P ac714929b11c43d482b5920a2a5b9129 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a67f69245d14aa395dd7410912ee2d5, ac714929b11c43d482b5920a2a5b9129; no voters:
I20250625 03:32:29.231400 5795 raft_consensus.cc:2802] T 9d744327c3714ed99169ee010b3a1eb7 P ac714929b11c43d482b5920a2a5b9129 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:32:29.231844 5766 consensus_queue.cc:1035] T 3857bc0f026242499856f49c07bccf36 P f0e7c9f6ec2c46eda889ff8f199bc969 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20250625 03:32:29.232738 5795 raft_consensus.cc:695] T 9d744327c3714ed99169ee010b3a1eb7 P ac714929b11c43d482b5920a2a5b9129 [term 2 LEADER]: Becoming Leader. State: Replica: ac714929b11c43d482b5920a2a5b9129, State: Running, Role: LEADER
I20250625 03:32:29.232628 5548 raft_consensus.cc:2466] T 9d744327c3714ed99169ee010b3a1eb7 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac714929b11c43d482b5920a2a5b9129 in term 2.
I20250625 03:32:29.233971 5795 consensus_queue.cc:237] T 9d744327c3714ed99169ee010b3a1eb7 P ac714929b11c43d482b5920a2a5b9129 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:29.244724 5696 raft_consensus.cc:1273] T 3857bc0f026242499856f49c07bccf36 P 5a67f69245d14aa395dd7410912ee2d5 [term 2 FOLLOWER]: Refusing update from remote peer f0e7c9f6ec2c46eda889ff8f199bc969: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:32:29.250103 5766 consensus_queue.cc:1035] T 3857bc0f026242499856f49c07bccf36 P f0e7c9f6ec2c46eda889ff8f199bc969 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:32:29.251488 5444 catalog_manager.cc:5582] T 9d744327c3714ed99169ee010b3a1eb7 P ac714929b11c43d482b5920a2a5b9129 reported cstate change: term changed from 1 to 2, leader changed from 5a67f69245d14aa395dd7410912ee2d5 (127.0.106.131) to ac714929b11c43d482b5920a2a5b9129 (127.0.106.130). New cstate: current_term: 2 leader_uuid: "ac714929b11c43d482b5920a2a5b9129" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } health_report { overall_health: UNKNOWN } } }
I20250625 03:32:29.270364 5775 raft_consensus.cc:991] T dd40af6d9f9b4ae2ab31241b28f3b002 P f0e7c9f6ec2c46eda889ff8f199bc969: : Instructing follower ac714929b11c43d482b5920a2a5b9129 to start an election
I20250625 03:32:29.270902 5775 raft_consensus.cc:1079] T dd40af6d9f9b4ae2ab31241b28f3b002 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 LEADER]: Signalling peer ac714929b11c43d482b5920a2a5b9129 to start an election
I20250625 03:32:29.272513 5622 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "dd40af6d9f9b4ae2ab31241b28f3b002"
dest_uuid: "ac714929b11c43d482b5920a2a5b9129"
from {username='slave'} at 127.0.0.1:51094
I20250625 03:32:29.272989 5622 raft_consensus.cc:491] T dd40af6d9f9b4ae2ab31241b28f3b002 P ac714929b11c43d482b5920a2a5b9129 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:32:29.273286 5622 raft_consensus.cc:3058] T dd40af6d9f9b4ae2ab31241b28f3b002 P ac714929b11c43d482b5920a2a5b9129 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:29.278949 5622 raft_consensus.cc:513] T dd40af6d9f9b4ae2ab31241b28f3b002 P ac714929b11c43d482b5920a2a5b9129 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:29.280616 5622 leader_election.cc:290] T dd40af6d9f9b4ae2ab31241b28f3b002 P ac714929b11c43d482b5920a2a5b9129 [CANDIDATE]: Term 2 election: Requested vote from peers f0e7c9f6ec2c46eda889ff8f199bc969 (127.0.106.129:44743), 5a67f69245d14aa395dd7410912ee2d5 (127.0.106.131:38277)
I20250625 03:32:29.281858 5696 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dd40af6d9f9b4ae2ab31241b28f3b002" candidate_uuid: "ac714929b11c43d482b5920a2a5b9129" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5a67f69245d14aa395dd7410912ee2d5"
I20250625 03:32:29.281816 5548 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dd40af6d9f9b4ae2ab31241b28f3b002" candidate_uuid: "ac714929b11c43d482b5920a2a5b9129" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969"
I20250625 03:32:29.282689 5696 raft_consensus.cc:3058] T dd40af6d9f9b4ae2ab31241b28f3b002 P 5a67f69245d14aa395dd7410912ee2d5 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:29.282766 5548 raft_consensus.cc:3053] T dd40af6d9f9b4ae2ab31241b28f3b002 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:32:29.283272 5548 raft_consensus.cc:738] T dd40af6d9f9b4ae2ab31241b28f3b002 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f0e7c9f6ec2c46eda889ff8f199bc969, State: Running, Role: LEADER
I20250625 03:32:29.284374 5548 consensus_queue.cc:260] T dd40af6d9f9b4ae2ab31241b28f3b002 P f0e7c9f6ec2c46eda889ff8f199bc969 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:29.286103 5548 raft_consensus.cc:3058] T dd40af6d9f9b4ae2ab31241b28f3b002 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:29.289698 5696 raft_consensus.cc:2466] T dd40af6d9f9b4ae2ab31241b28f3b002 P 5a67f69245d14aa395dd7410912ee2d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac714929b11c43d482b5920a2a5b9129 in term 2.
I20250625 03:32:29.291386 5587 leader_election.cc:304] T dd40af6d9f9b4ae2ab31241b28f3b002 P ac714929b11c43d482b5920a2a5b9129 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a67f69245d14aa395dd7410912ee2d5, ac714929b11c43d482b5920a2a5b9129; no voters:
I20250625 03:32:29.292578 5817 raft_consensus.cc:2802] T dd40af6d9f9b4ae2ab31241b28f3b002 P ac714929b11c43d482b5920a2a5b9129 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:32:29.293089 5817 raft_consensus.cc:695] T dd40af6d9f9b4ae2ab31241b28f3b002 P ac714929b11c43d482b5920a2a5b9129 [term 2 LEADER]: Becoming Leader. State: Replica: ac714929b11c43d482b5920a2a5b9129, State: Running, Role: LEADER
I20250625 03:32:29.294752 5817 consensus_queue.cc:237] T dd40af6d9f9b4ae2ab31241b28f3b002 P ac714929b11c43d482b5920a2a5b9129 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:29.296708 5548 raft_consensus.cc:2466] T dd40af6d9f9b4ae2ab31241b28f3b002 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac714929b11c43d482b5920a2a5b9129 in term 2.
I20250625 03:32:29.302759 5444 catalog_manager.cc:5582] T dd40af6d9f9b4ae2ab31241b28f3b002 P ac714929b11c43d482b5920a2a5b9129 reported cstate change: term changed from 1 to 2, leader changed from f0e7c9f6ec2c46eda889ff8f199bc969 (127.0.106.129) to ac714929b11c43d482b5920a2a5b9129 (127.0.106.130). New cstate: current_term: 2 leader_uuid: "ac714929b11c43d482b5920a2a5b9129" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } health_report { overall_health: UNKNOWN } } }
I20250625 03:32:29.436659 5696 raft_consensus.cc:1273] T b01160bf577842c485d19170bfcb2946 P 5a67f69245d14aa395dd7410912ee2d5 [term 2 FOLLOWER]: Refusing update from remote peer f0e7c9f6ec2c46eda889ff8f199bc969: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:32:29.438066 5775 consensus_queue.cc:1035] T b01160bf577842c485d19170bfcb2946 P f0e7c9f6ec2c46eda889ff8f199bc969 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:32:29.447540 5622 raft_consensus.cc:1273] T b01160bf577842c485d19170bfcb2946 P ac714929b11c43d482b5920a2a5b9129 [term 2 FOLLOWER]: Refusing update from remote peer f0e7c9f6ec2c46eda889ff8f199bc969: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:32:29.449334 5841 consensus_queue.cc:1035] T b01160bf577842c485d19170bfcb2946 P f0e7c9f6ec2c46eda889ff8f199bc969 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20250625 03:32:29.623589 5696 raft_consensus.cc:1273] T 9d744327c3714ed99169ee010b3a1eb7 P 5a67f69245d14aa395dd7410912ee2d5 [term 2 FOLLOWER]: Refusing update from remote peer ac714929b11c43d482b5920a2a5b9129: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:32:29.624902 5795 consensus_queue.cc:1035] T 9d744327c3714ed99169ee010b3a1eb7 P ac714929b11c43d482b5920a2a5b9129 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:32:29.635191 5548 raft_consensus.cc:1273] T 9d744327c3714ed99169ee010b3a1eb7 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 2 FOLLOWER]: Refusing update from remote peer ac714929b11c43d482b5920a2a5b9129: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:32:29.639761 5795 consensus_queue.cc:1035] T 9d744327c3714ed99169ee010b3a1eb7 P ac714929b11c43d482b5920a2a5b9129 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:32:29.690945 5696 raft_consensus.cc:1273] T 8014b6301211413cbbe6a34e60213b1f P 5a67f69245d14aa395dd7410912ee2d5 [term 2 FOLLOWER]: Refusing update from remote peer ac714929b11c43d482b5920a2a5b9129: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:32:29.692354 5844 consensus_queue.cc:1035] T 8014b6301211413cbbe6a34e60213b1f P ac714929b11c43d482b5920a2a5b9129 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20250625 03:32:29.703770 5548 raft_consensus.cc:1273] T 8014b6301211413cbbe6a34e60213b1f P f0e7c9f6ec2c46eda889ff8f199bc969 [term 2 FOLLOWER]: Refusing update from remote peer ac714929b11c43d482b5920a2a5b9129: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:32:29.705547 5795 consensus_queue.cc:1035] T 8014b6301211413cbbe6a34e60213b1f P ac714929b11c43d482b5920a2a5b9129 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:32:29.715574 5696 raft_consensus.cc:1273] T dd40af6d9f9b4ae2ab31241b28f3b002 P 5a67f69245d14aa395dd7410912ee2d5 [term 2 FOLLOWER]: Refusing update from remote peer ac714929b11c43d482b5920a2a5b9129: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:32:29.717454 5795 consensus_queue.cc:1035] T dd40af6d9f9b4ae2ab31241b28f3b002 P ac714929b11c43d482b5920a2a5b9129 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:32:29.736701 5547 raft_consensus.cc:1273] T dd40af6d9f9b4ae2ab31241b28f3b002 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 2 FOLLOWER]: Refusing update from remote peer ac714929b11c43d482b5920a2a5b9129: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:32:29.740917 5817 consensus_queue.cc:1035] T dd40af6d9f9b4ae2ab31241b28f3b002 P ac714929b11c43d482b5920a2a5b9129 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:32:31.978416 426 test_util.cc:276] Using random seed: 408600389
I20250625 03:32:32.022454 5444 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36198:
name: "soft_deleted_table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 03:32:32.025497 5444 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 03:32:32.086367 5533 tablet_service.cc:1468] Processing CreateTablet for tablet 267de6f0358a4e9f894a10a091cd8efc (DEFAULT_TABLE table=soft_deleted_table [id=86492e2cc9db4924a45643c097013b3e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20250625 03:32:32.087357 5682 tablet_service.cc:1468] Processing CreateTablet for tablet 267de6f0358a4e9f894a10a091cd8efc (DEFAULT_TABLE table=soft_deleted_table [id=86492e2cc9db4924a45643c097013b3e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20250625 03:32:32.088734 5533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 267de6f0358a4e9f894a10a091cd8efc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:32.088940 5682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 267de6f0358a4e9f894a10a091cd8efc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:32.093845 5687 tablet_service.cc:1468] Processing CreateTablet for tablet 786290ddcf094479800ece947612d482 (DEFAULT_TABLE table=soft_deleted_table [id=86492e2cc9db4924a45643c097013b3e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20250625 03:32:32.095016 5607 tablet_service.cc:1468] Processing CreateTablet for tablet 786290ddcf094479800ece947612d482 (DEFAULT_TABLE table=soft_deleted_table [id=86492e2cc9db4924a45643c097013b3e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20250625 03:32:32.096758 5607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 786290ddcf094479800ece947612d482. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:32.096447 5685 tablet_service.cc:1468] Processing CreateTablet for tablet c7d0e4d719d3491199afddf8ff1204e0 (DEFAULT_TABLE table=soft_deleted_table [id=86492e2cc9db4924a45643c097013b3e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20250625 03:32:32.097785 5535 tablet_service.cc:1468] Processing CreateTablet for tablet c7d0e4d719d3491199afddf8ff1204e0 (DEFAULT_TABLE table=soft_deleted_table [id=86492e2cc9db4924a45643c097013b3e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20250625 03:32:32.098987 5605 tablet_service.cc:1468] Processing CreateTablet for tablet 267de6f0358a4e9f894a10a091cd8efc (DEFAULT_TABLE table=soft_deleted_table [id=86492e2cc9db4924a45643c097013b3e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20250625 03:32:32.099687 5535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7d0e4d719d3491199afddf8ff1204e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:32.100425 5605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 267de6f0358a4e9f894a10a091cd8efc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:32.104372 5685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7d0e4d719d3491199afddf8ff1204e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:32.105945 5687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 786290ddcf094479800ece947612d482. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:32.101715 5537 tablet_service.cc:1468] Processing CreateTablet for tablet 6026baaaf75a465aab3b95d3ada761c2 (DEFAULT_TABLE table=soft_deleted_table [id=86492e2cc9db4924a45643c097013b3e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20250625 03:32:32.109004 5537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6026baaaf75a465aab3b95d3ada761c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:32.109175 5606 tablet_service.cc:1468] Processing CreateTablet for tablet c7d0e4d719d3491199afddf8ff1204e0 (DEFAULT_TABLE table=soft_deleted_table [id=86492e2cc9db4924a45643c097013b3e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20250625 03:32:32.110713 5606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7d0e4d719d3491199afddf8ff1204e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:32.095837 5534 tablet_service.cc:1468] Processing CreateTablet for tablet 786290ddcf094479800ece947612d482 (DEFAULT_TABLE table=soft_deleted_table [id=86492e2cc9db4924a45643c097013b3e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20250625 03:32:32.112947 5534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 786290ddcf094479800ece947612d482. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:32.126091 5611 tablet_service.cc:1468] Processing CreateTablet for tablet 6026baaaf75a465aab3b95d3ada761c2 (DEFAULT_TABLE table=soft_deleted_table [id=86492e2cc9db4924a45643c097013b3e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20250625 03:32:32.127692 5611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6026baaaf75a465aab3b95d3ada761c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:32.135756 5683 tablet_service.cc:1468] Processing CreateTablet for tablet 6026baaaf75a465aab3b95d3ada761c2 (DEFAULT_TABLE table=soft_deleted_table [id=86492e2cc9db4924a45643c097013b3e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20250625 03:32:32.137297 5683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6026baaaf75a465aab3b95d3ada761c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:32.157382 5868 tablet_bootstrap.cc:492] T c7d0e4d719d3491199afddf8ff1204e0 P f0e7c9f6ec2c46eda889ff8f199bc969: Bootstrap starting.
I20250625 03:32:32.161006 5535 tablet_service.cc:1468] Processing CreateTablet for tablet bbf810309eb949ff880839714444d55f (DEFAULT_TABLE table=soft_deleted_table [id=86492e2cc9db4924a45643c097013b3e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20250625 03:32:32.158329 5869 tablet_bootstrap.cc:492] T 786290ddcf094479800ece947612d482 P 5a67f69245d14aa395dd7410912ee2d5: Bootstrap starting.
I20250625 03:32:32.162657 5535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbf810309eb949ff880839714444d55f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:32.169445 5606 tablet_service.cc:1468] Processing CreateTablet for tablet bbf810309eb949ff880839714444d55f (DEFAULT_TABLE table=soft_deleted_table [id=86492e2cc9db4924a45643c097013b3e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20250625 03:32:32.171074 5606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbf810309eb949ff880839714444d55f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:32.163643 5870 tablet_bootstrap.cc:492] T c7d0e4d719d3491199afddf8ff1204e0 P ac714929b11c43d482b5920a2a5b9129: Bootstrap starting.
I20250625 03:32:32.176744 5687 tablet_service.cc:1468] Processing CreateTablet for tablet bbf810309eb949ff880839714444d55f (DEFAULT_TABLE table=soft_deleted_table [id=86492e2cc9db4924a45643c097013b3e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20250625 03:32:32.178174 5687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbf810309eb949ff880839714444d55f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:32.181551 5868 tablet_bootstrap.cc:654] T c7d0e4d719d3491199afddf8ff1204e0 P f0e7c9f6ec2c46eda889ff8f199bc969: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:32.184314 5536 tablet_service.cc:1468] Processing CreateTablet for tablet 70076edadb434d5a8d584361780928bc (DEFAULT_TABLE table=soft_deleted_table [id=86492e2cc9db4924a45643c097013b3e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20250625 03:32:32.187338 5536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70076edadb434d5a8d584361780928bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:32.193046 5533 tablet_service.cc:1468] Processing CreateTablet for tablet 33bf1d07080f4096a5aa2b5daef743a6 (DEFAULT_TABLE table=soft_deleted_table [id=86492e2cc9db4924a45643c097013b3e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20250625 03:32:32.194614 5533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33bf1d07080f4096a5aa2b5daef743a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:32.194912 5870 tablet_bootstrap.cc:654] T c7d0e4d719d3491199afddf8ff1204e0 P ac714929b11c43d482b5920a2a5b9129: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:32.200372 5611 tablet_service.cc:1468] Processing CreateTablet for tablet 33bf1d07080f4096a5aa2b5daef743a6 (DEFAULT_TABLE table=soft_deleted_table [id=86492e2cc9db4924a45643c097013b3e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20250625 03:32:32.201902 5611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33bf1d07080f4096a5aa2b5daef743a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:32.204242 5684 tablet_service.cc:1468] Processing CreateTablet for tablet 33bf1d07080f4096a5aa2b5daef743a6 (DEFAULT_TABLE table=soft_deleted_table [id=86492e2cc9db4924a45643c097013b3e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20250625 03:32:32.205716 5684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33bf1d07080f4096a5aa2b5daef743a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:32.209172 5607 tablet_service.cc:1468] Processing CreateTablet for tablet 70076edadb434d5a8d584361780928bc (DEFAULT_TABLE table=soft_deleted_table [id=86492e2cc9db4924a45643c097013b3e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20250625 03:32:32.210642 5607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70076edadb434d5a8d584361780928bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:32.213075 5685 tablet_service.cc:1468] Processing CreateTablet for tablet 70076edadb434d5a8d584361780928bc (DEFAULT_TABLE table=soft_deleted_table [id=86492e2cc9db4924a45643c097013b3e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20250625 03:32:32.214500 5685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70076edadb434d5a8d584361780928bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:32.222627 5869 tablet_bootstrap.cc:654] T 786290ddcf094479800ece947612d482 P 5a67f69245d14aa395dd7410912ee2d5: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:32.250011 5683 tablet_service.cc:1468] Processing CreateTablet for tablet aaeeb3012a8c4a77a8359268c32d1abc (DEFAULT_TABLE table=soft_deleted_table [id=86492e2cc9db4924a45643c097013b3e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20250625 03:32:32.251626 5683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaeeb3012a8c4a77a8359268c32d1abc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:32.255286 5682 tablet_service.cc:1468] Processing CreateTablet for tablet bd204f74bbbf45218051c05c8d3a32c1 (DEFAULT_TABLE table=soft_deleted_table [id=86492e2cc9db4924a45643c097013b3e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20250625 03:32:32.256911 5682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd204f74bbbf45218051c05c8d3a32c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:32.261247 5537 tablet_service.cc:1468] Processing CreateTablet for tablet bd204f74bbbf45218051c05c8d3a32c1 (DEFAULT_TABLE table=soft_deleted_table [id=86492e2cc9db4924a45643c097013b3e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20250625 03:32:32.271045 5537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd204f74bbbf45218051c05c8d3a32c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:32.261247 5535 tablet_service.cc:1468] Processing CreateTablet for tablet aaeeb3012a8c4a77a8359268c32d1abc (DEFAULT_TABLE table=soft_deleted_table [id=86492e2cc9db4924a45643c097013b3e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20250625 03:32:32.275430 5605 tablet_service.cc:1468] Processing CreateTablet for tablet bd204f74bbbf45218051c05c8d3a32c1 (DEFAULT_TABLE table=soft_deleted_table [id=86492e2cc9db4924a45643c097013b3e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20250625 03:32:32.275208 5611 tablet_service.cc:1468] Processing CreateTablet for tablet aaeeb3012a8c4a77a8359268c32d1abc (DEFAULT_TABLE table=soft_deleted_table [id=86492e2cc9db4924a45643c097013b3e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20250625 03:32:32.276785 5605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd204f74bbbf45218051c05c8d3a32c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:32.277457 5611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaeeb3012a8c4a77a8359268c32d1abc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:32.279872 5868 tablet_bootstrap.cc:492] T c7d0e4d719d3491199afddf8ff1204e0 P f0e7c9f6ec2c46eda889ff8f199bc969: No bootstrap required, opened a new log
I20250625 03:32:32.280517 5868 ts_tablet_manager.cc:1397] T c7d0e4d719d3491199afddf8ff1204e0 P f0e7c9f6ec2c46eda889ff8f199bc969: Time spent bootstrapping tablet: real 0.123s user 0.005s sys 0.012s
I20250625 03:32:32.284617 5868 raft_consensus.cc:357] T c7d0e4d719d3491199afddf8ff1204e0 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.285414 5868 raft_consensus.cc:383] T c7d0e4d719d3491199afddf8ff1204e0 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:32.285753 5868 raft_consensus.cc:738] T c7d0e4d719d3491199afddf8ff1204e0 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0e7c9f6ec2c46eda889ff8f199bc969, State: Initialized, Role: FOLLOWER
I20250625 03:32:32.286780 5868 consensus_queue.cc:260] T c7d0e4d719d3491199afddf8ff1204e0 P f0e7c9f6ec2c46eda889ff8f199bc969 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.290802 5535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaeeb3012a8c4a77a8359268c32d1abc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 03:32:32.293131 5868 ts_tablet_manager.cc:1428] T c7d0e4d719d3491199afddf8ff1204e0 P f0e7c9f6ec2c46eda889ff8f199bc969: Time spent starting tablet: real 0.012s user 0.005s sys 0.003s
I20250625 03:32:32.295284 5868 tablet_bootstrap.cc:492] T 786290ddcf094479800ece947612d482 P f0e7c9f6ec2c46eda889ff8f199bc969: Bootstrap starting.
I20250625 03:32:32.302350 5868 tablet_bootstrap.cc:654] T 786290ddcf094479800ece947612d482 P f0e7c9f6ec2c46eda889ff8f199bc969: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:32.315771 5870 tablet_bootstrap.cc:492] T c7d0e4d719d3491199afddf8ff1204e0 P ac714929b11c43d482b5920a2a5b9129: No bootstrap required, opened a new log
I20250625 03:32:32.316342 5870 ts_tablet_manager.cc:1397] T c7d0e4d719d3491199afddf8ff1204e0 P ac714929b11c43d482b5920a2a5b9129: Time spent bootstrapping tablet: real 0.153s user 0.015s sys 0.003s
I20250625 03:32:32.319293 5870 raft_consensus.cc:357] T c7d0e4d719d3491199afddf8ff1204e0 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.319965 5870 raft_consensus.cc:383] T c7d0e4d719d3491199afddf8ff1204e0 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:32.320528 5870 raft_consensus.cc:738] T c7d0e4d719d3491199afddf8ff1204e0 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac714929b11c43d482b5920a2a5b9129, State: Initialized, Role: FOLLOWER
I20250625 03:32:32.321233 5870 consensus_queue.cc:260] T c7d0e4d719d3491199afddf8ff1204e0 P ac714929b11c43d482b5920a2a5b9129 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.326041 5869 tablet_bootstrap.cc:492] T 786290ddcf094479800ece947612d482 P 5a67f69245d14aa395dd7410912ee2d5: No bootstrap required, opened a new log
I20250625 03:32:32.328999 5869 ts_tablet_manager.cc:1397] T 786290ddcf094479800ece947612d482 P 5a67f69245d14aa395dd7410912ee2d5: Time spent bootstrapping tablet: real 0.171s user 0.008s sys 0.021s
I20250625 03:32:32.332055 5869 raft_consensus.cc:357] T 786290ddcf094479800ece947612d482 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.332847 5869 raft_consensus.cc:383] T 786290ddcf094479800ece947612d482 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:32.333168 5869 raft_consensus.cc:738] T 786290ddcf094479800ece947612d482 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a67f69245d14aa395dd7410912ee2d5, State: Initialized, Role: FOLLOWER
I20250625 03:32:32.333988 5869 consensus_queue.cc:260] T 786290ddcf094479800ece947612d482 P 5a67f69245d14aa395dd7410912ee2d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.338037 5869 ts_tablet_manager.cc:1428] T 786290ddcf094479800ece947612d482 P 5a67f69245d14aa395dd7410912ee2d5: Time spent starting tablet: real 0.009s user 0.006s sys 0.002s
I20250625 03:32:32.339285 5869 tablet_bootstrap.cc:492] T c7d0e4d719d3491199afddf8ff1204e0 P 5a67f69245d14aa395dd7410912ee2d5: Bootstrap starting.
I20250625 03:32:32.332861 5870 ts_tablet_manager.cc:1428] T c7d0e4d719d3491199afddf8ff1204e0 P ac714929b11c43d482b5920a2a5b9129: Time spent starting tablet: real 0.016s user 0.007s sys 0.000s
I20250625 03:32:32.346159 5869 tablet_bootstrap.cc:654] T c7d0e4d719d3491199afddf8ff1204e0 P 5a67f69245d14aa395dd7410912ee2d5: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:32.348266 5870 tablet_bootstrap.cc:492] T 267de6f0358a4e9f894a10a091cd8efc P ac714929b11c43d482b5920a2a5b9129: Bootstrap starting.
I20250625 03:32:32.355681 5870 tablet_bootstrap.cc:654] T 267de6f0358a4e9f894a10a091cd8efc P ac714929b11c43d482b5920a2a5b9129: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:32.359403 5868 tablet_bootstrap.cc:492] T 786290ddcf094479800ece947612d482 P f0e7c9f6ec2c46eda889ff8f199bc969: No bootstrap required, opened a new log
I20250625 03:32:32.359998 5868 ts_tablet_manager.cc:1397] T 786290ddcf094479800ece947612d482 P f0e7c9f6ec2c46eda889ff8f199bc969: Time spent bootstrapping tablet: real 0.065s user 0.013s sys 0.003s
I20250625 03:32:32.361820 5869 tablet_bootstrap.cc:492] T c7d0e4d719d3491199afddf8ff1204e0 P 5a67f69245d14aa395dd7410912ee2d5: No bootstrap required, opened a new log
I20250625 03:32:32.362377 5869 ts_tablet_manager.cc:1397] T c7d0e4d719d3491199afddf8ff1204e0 P 5a67f69245d14aa395dd7410912ee2d5: Time spent bootstrapping tablet: real 0.023s user 0.015s sys 0.002s
I20250625 03:32:32.363113 5868 raft_consensus.cc:357] T 786290ddcf094479800ece947612d482 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.363782 5868 raft_consensus.cc:383] T 786290ddcf094479800ece947612d482 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:32.364053 5868 raft_consensus.cc:738] T 786290ddcf094479800ece947612d482 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0e7c9f6ec2c46eda889ff8f199bc969, State: Initialized, Role: FOLLOWER
I20250625 03:32:32.364691 5868 consensus_queue.cc:260] T 786290ddcf094479800ece947612d482 P f0e7c9f6ec2c46eda889ff8f199bc969 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.365412 5869 raft_consensus.cc:357] T c7d0e4d719d3491199afddf8ff1204e0 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.366310 5869 raft_consensus.cc:383] T c7d0e4d719d3491199afddf8ff1204e0 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:32.366621 5869 raft_consensus.cc:738] T c7d0e4d719d3491199afddf8ff1204e0 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a67f69245d14aa395dd7410912ee2d5, State: Initialized, Role: FOLLOWER
I20250625 03:32:32.367141 5868 ts_tablet_manager.cc:1428] T 786290ddcf094479800ece947612d482 P f0e7c9f6ec2c46eda889ff8f199bc969: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20250625 03:32:32.367393 5869 consensus_queue.cc:260] T c7d0e4d719d3491199afddf8ff1204e0 P 5a67f69245d14aa395dd7410912ee2d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.368341 5868 tablet_bootstrap.cc:492] T 267de6f0358a4e9f894a10a091cd8efc P f0e7c9f6ec2c46eda889ff8f199bc969: Bootstrap starting.
I20250625 03:32:32.376139 5868 tablet_bootstrap.cc:654] T 267de6f0358a4e9f894a10a091cd8efc P f0e7c9f6ec2c46eda889ff8f199bc969: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:32.381156 5869 ts_tablet_manager.cc:1428] T c7d0e4d719d3491199afddf8ff1204e0 P 5a67f69245d14aa395dd7410912ee2d5: Time spent starting tablet: real 0.018s user 0.009s sys 0.000s
I20250625 03:32:32.387985 5869 tablet_bootstrap.cc:492] T 267de6f0358a4e9f894a10a091cd8efc P 5a67f69245d14aa395dd7410912ee2d5: Bootstrap starting.
I20250625 03:32:32.397971 5869 tablet_bootstrap.cc:654] T 267de6f0358a4e9f894a10a091cd8efc P 5a67f69245d14aa395dd7410912ee2d5: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:32.401328 5868 tablet_bootstrap.cc:492] T 267de6f0358a4e9f894a10a091cd8efc P f0e7c9f6ec2c46eda889ff8f199bc969: No bootstrap required, opened a new log
I20250625 03:32:32.401842 5868 ts_tablet_manager.cc:1397] T 267de6f0358a4e9f894a10a091cd8efc P f0e7c9f6ec2c46eda889ff8f199bc969: Time spent bootstrapping tablet: real 0.034s user 0.025s sys 0.006s
I20250625 03:32:32.402504 5870 tablet_bootstrap.cc:492] T 267de6f0358a4e9f894a10a091cd8efc P ac714929b11c43d482b5920a2a5b9129: No bootstrap required, opened a new log
I20250625 03:32:32.403128 5870 ts_tablet_manager.cc:1397] T 267de6f0358a4e9f894a10a091cd8efc P ac714929b11c43d482b5920a2a5b9129: Time spent bootstrapping tablet: real 0.055s user 0.020s sys 0.022s
I20250625 03:32:32.404871 5868 raft_consensus.cc:357] T 267de6f0358a4e9f894a10a091cd8efc P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.405270 5854 raft_consensus.cc:491] T 786290ddcf094479800ece947612d482 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:32:32.405714 5868 raft_consensus.cc:383] T 267de6f0358a4e9f894a10a091cd8efc P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:32.406075 5868 raft_consensus.cc:738] T 267de6f0358a4e9f894a10a091cd8efc P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0e7c9f6ec2c46eda889ff8f199bc969, State: Initialized, Role: FOLLOWER
I20250625 03:32:32.405890 5854 raft_consensus.cc:513] T 786290ddcf094479800ece947612d482 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.406388 5870 raft_consensus.cc:357] T 267de6f0358a4e9f894a10a091cd8efc P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.407495 5870 raft_consensus.cc:383] T 267de6f0358a4e9f894a10a091cd8efc P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:32.407029 5868 consensus_queue.cc:260] T 267de6f0358a4e9f894a10a091cd8efc P f0e7c9f6ec2c46eda889ff8f199bc969 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.407876 5870 raft_consensus.cc:738] T 267de6f0358a4e9f894a10a091cd8efc P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac714929b11c43d482b5920a2a5b9129, State: Initialized, Role: FOLLOWER
I20250625 03:32:32.408875 5870 consensus_queue.cc:260] T 267de6f0358a4e9f894a10a091cd8efc P ac714929b11c43d482b5920a2a5b9129 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.410607 5622 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "786290ddcf094479800ece947612d482" candidate_uuid: "5a67f69245d14aa395dd7410912ee2d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac714929b11c43d482b5920a2a5b9129" is_pre_election: true
I20250625 03:32:32.412029 5547 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "786290ddcf094479800ece947612d482" candidate_uuid: "5a67f69245d14aa395dd7410912ee2d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" is_pre_election: true
I20250625 03:32:32.412793 5547 raft_consensus.cc:2466] T 786290ddcf094479800ece947612d482 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a67f69245d14aa395dd7410912ee2d5 in term 0.
I20250625 03:32:32.414366 5870 ts_tablet_manager.cc:1428] T 267de6f0358a4e9f894a10a091cd8efc P ac714929b11c43d482b5920a2a5b9129: Time spent starting tablet: real 0.011s user 0.006s sys 0.000s
I20250625 03:32:32.415649 5870 tablet_bootstrap.cc:492] T 786290ddcf094479800ece947612d482 P ac714929b11c43d482b5920a2a5b9129: Bootstrap starting.
I20250625 03:32:32.417896 5868 ts_tablet_manager.cc:1428] T 267de6f0358a4e9f894a10a091cd8efc P f0e7c9f6ec2c46eda889ff8f199bc969: Time spent starting tablet: real 0.016s user 0.007s sys 0.001s
I20250625 03:32:32.422699 5870 tablet_bootstrap.cc:654] T 786290ddcf094479800ece947612d482 P ac714929b11c43d482b5920a2a5b9129: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:32.423465 5663 leader_election.cc:304] T 786290ddcf094479800ece947612d482 P 5a67f69245d14aa395dd7410912ee2d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a67f69245d14aa395dd7410912ee2d5, f0e7c9f6ec2c46eda889ff8f199bc969; no voters:
I20250625 03:32:32.425311 5855 raft_consensus.cc:491] T c7d0e4d719d3491199afddf8ff1204e0 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:32:32.425931 5855 raft_consensus.cc:513] T c7d0e4d719d3491199afddf8ff1204e0 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.427706 5868 tablet_bootstrap.cc:492] T bbf810309eb949ff880839714444d55f P f0e7c9f6ec2c46eda889ff8f199bc969: Bootstrap starting.
W20250625 03:32:32.429441 5662 leader_election.cc:343] T 786290ddcf094479800ece947612d482 P 5a67f69245d14aa395dd7410912ee2d5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac714929b11c43d482b5920a2a5b9129 (127.0.106.130:39845): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:32:32.431915 5547 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c7d0e4d719d3491199afddf8ff1204e0" candidate_uuid: "ac714929b11c43d482b5920a2a5b9129" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" is_pre_election: true
I20250625 03:32:32.432900 5547 raft_consensus.cc:2466] T c7d0e4d719d3491199afddf8ff1204e0 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac714929b11c43d482b5920a2a5b9129 in term 0.
I20250625 03:32:32.434337 5589 leader_election.cc:304] T c7d0e4d719d3491199afddf8ff1204e0 P ac714929b11c43d482b5920a2a5b9129 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac714929b11c43d482b5920a2a5b9129, f0e7c9f6ec2c46eda889ff8f199bc969; no voters:
I20250625 03:32:32.435369 5872 raft_consensus.cc:2802] T c7d0e4d719d3491199afddf8ff1204e0 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:32:32.435758 5872 raft_consensus.cc:491] T c7d0e4d719d3491199afddf8ff1204e0 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:32:32.436120 5872 raft_consensus.cc:3058] T c7d0e4d719d3491199afddf8ff1204e0 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:32.440658 5855 leader_election.cc:290] T c7d0e4d719d3491199afddf8ff1204e0 P ac714929b11c43d482b5920a2a5b9129 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0e7c9f6ec2c46eda889ff8f199bc969 (127.0.106.129:44743), 5a67f69245d14aa395dd7410912ee2d5 (127.0.106.131:38277)
I20250625 03:32:32.441931 5854 leader_election.cc:290] T 786290ddcf094479800ece947612d482 P 5a67f69245d14aa395dd7410912ee2d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0e7c9f6ec2c46eda889ff8f199bc969 (127.0.106.129:44743), ac714929b11c43d482b5920a2a5b9129 (127.0.106.130:39845)
I20250625 03:32:32.442699 5854 raft_consensus.cc:2802] T 786290ddcf094479800ece947612d482 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:32:32.443127 5854 raft_consensus.cc:491] T 786290ddcf094479800ece947612d482 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:32:32.443523 5870 tablet_bootstrap.cc:492] T 786290ddcf094479800ece947612d482 P ac714929b11c43d482b5920a2a5b9129: No bootstrap required, opened a new log
I20250625 03:32:32.443559 5854 raft_consensus.cc:3058] T 786290ddcf094479800ece947612d482 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:32.444270 5870 ts_tablet_manager.cc:1397] T 786290ddcf094479800ece947612d482 P ac714929b11c43d482b5920a2a5b9129: Time spent bootstrapping tablet: real 0.029s user 0.010s sys 0.018s
I20250625 03:32:32.447561 5870 raft_consensus.cc:357] T 786290ddcf094479800ece947612d482 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.448331 5870 raft_consensus.cc:383] T 786290ddcf094479800ece947612d482 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:32.448630 5870 raft_consensus.cc:738] T 786290ddcf094479800ece947612d482 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac714929b11c43d482b5920a2a5b9129, State: Initialized, Role: FOLLOWER
I20250625 03:32:32.449420 5870 consensus_queue.cc:260] T 786290ddcf094479800ece947612d482 P ac714929b11c43d482b5920a2a5b9129 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.443593 5868 tablet_bootstrap.cc:654] T bbf810309eb949ff880839714444d55f P f0e7c9f6ec2c46eda889ff8f199bc969: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:32.454978 5870 ts_tablet_manager.cc:1428] T 786290ddcf094479800ece947612d482 P ac714929b11c43d482b5920a2a5b9129: Time spent starting tablet: real 0.010s user 0.006s sys 0.001s
I20250625 03:32:32.455976 5854 raft_consensus.cc:513] T 786290ddcf094479800ece947612d482 P 5a67f69245d14aa395dd7410912ee2d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.457823 5870 tablet_bootstrap.cc:492] T 6026baaaf75a465aab3b95d3ada761c2 P ac714929b11c43d482b5920a2a5b9129: Bootstrap starting.
I20250625 03:32:32.463413 5622 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "786290ddcf094479800ece947612d482" candidate_uuid: "5a67f69245d14aa395dd7410912ee2d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac714929b11c43d482b5920a2a5b9129"
I20250625 03:32:32.464130 5622 raft_consensus.cc:3058] T 786290ddcf094479800ece947612d482 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:32.468660 5870 tablet_bootstrap.cc:654] T 6026baaaf75a465aab3b95d3ada761c2 P ac714929b11c43d482b5920a2a5b9129: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:32.471246 5872 raft_consensus.cc:513] T c7d0e4d719d3491199afddf8ff1204e0 P ac714929b11c43d482b5920a2a5b9129 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.471858 5622 raft_consensus.cc:2466] T 786290ddcf094479800ece947612d482 P ac714929b11c43d482b5920a2a5b9129 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a67f69245d14aa395dd7410912ee2d5 in term 1.
I20250625 03:32:32.476928 5662 leader_election.cc:304] T 786290ddcf094479800ece947612d482 P 5a67f69245d14aa395dd7410912ee2d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a67f69245d14aa395dd7410912ee2d5, ac714929b11c43d482b5920a2a5b9129; no voters:
I20250625 03:32:32.477988 5547 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c7d0e4d719d3491199afddf8ff1204e0" candidate_uuid: "ac714929b11c43d482b5920a2a5b9129" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969"
I20250625 03:32:32.478585 5880 raft_consensus.cc:2802] T 786290ddcf094479800ece947612d482 P 5a67f69245d14aa395dd7410912ee2d5 [term 1 FOLLOWER]: Leader election won for term 1
W20250625 03:32:32.474859 5663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.106.129:44743, user_credentials={real_user=slave}} blocked reactor thread for 51601.3us
I20250625 03:32:32.478704 5547 raft_consensus.cc:3058] T c7d0e4d719d3491199afddf8ff1204e0 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:32.473127 5854 leader_election.cc:290] T 786290ddcf094479800ece947612d482 P 5a67f69245d14aa395dd7410912ee2d5 [CANDIDATE]: Term 1 election: Requested vote from peers f0e7c9f6ec2c46eda889ff8f199bc969 (127.0.106.129:44743), ac714929b11c43d482b5920a2a5b9129 (127.0.106.130:39845)
I20250625 03:32:32.480755 5870 tablet_bootstrap.cc:492] T 6026baaaf75a465aab3b95d3ada761c2 P ac714929b11c43d482b5920a2a5b9129: No bootstrap required, opened a new log
I20250625 03:32:32.481395 5870 ts_tablet_manager.cc:1397] T 6026baaaf75a465aab3b95d3ada761c2 P ac714929b11c43d482b5920a2a5b9129: Time spent bootstrapping tablet: real 0.024s user 0.013s sys 0.004s
I20250625 03:32:32.485231 5870 raft_consensus.cc:357] T 6026baaaf75a465aab3b95d3ada761c2 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.486017 5870 raft_consensus.cc:383] T 6026baaaf75a465aab3b95d3ada761c2 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:32.486312 5870 raft_consensus.cc:738] T 6026baaaf75a465aab3b95d3ada761c2 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac714929b11c43d482b5920a2a5b9129, State: Initialized, Role: FOLLOWER
I20250625 03:32:32.487378 5868 tablet_bootstrap.cc:492] T bbf810309eb949ff880839714444d55f P f0e7c9f6ec2c46eda889ff8f199bc969: No bootstrap required, opened a new log
I20250625 03:32:32.487118 5870 consensus_queue.cc:260] T 6026baaaf75a465aab3b95d3ada761c2 P ac714929b11c43d482b5920a2a5b9129 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.487843 5548 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "786290ddcf094479800ece947612d482" candidate_uuid: "5a67f69245d14aa395dd7410912ee2d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969"
I20250625 03:32:32.488727 5548 raft_consensus.cc:3058] T 786290ddcf094479800ece947612d482 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:32.488086 5868 ts_tablet_manager.cc:1397] T bbf810309eb949ff880839714444d55f P f0e7c9f6ec2c46eda889ff8f199bc969: Time spent bootstrapping tablet: real 0.061s user 0.016s sys 0.005s
I20250625 03:32:32.490276 5547 raft_consensus.cc:2466] T c7d0e4d719d3491199afddf8ff1204e0 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac714929b11c43d482b5920a2a5b9129 in term 1.
I20250625 03:32:32.496402 5880 raft_consensus.cc:695] T 786290ddcf094479800ece947612d482 P 5a67f69245d14aa395dd7410912ee2d5 [term 1 LEADER]: Becoming Leader. State: Replica: 5a67f69245d14aa395dd7410912ee2d5, State: Running, Role: LEADER
I20250625 03:32:32.499141 5880 consensus_queue.cc:237] T 786290ddcf094479800ece947612d482 P 5a67f69245d14aa395dd7410912ee2d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.504230 5589 leader_election.cc:304] T c7d0e4d719d3491199afddf8ff1204e0 P ac714929b11c43d482b5920a2a5b9129 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac714929b11c43d482b5920a2a5b9129, f0e7c9f6ec2c46eda889ff8f199bc969; no voters:
I20250625 03:32:32.505173 5855 raft_consensus.cc:2802] T c7d0e4d719d3491199afddf8ff1204e0 P ac714929b11c43d482b5920a2a5b9129 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:32:32.507443 5696 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c7d0e4d719d3491199afddf8ff1204e0" candidate_uuid: "ac714929b11c43d482b5920a2a5b9129" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a67f69245d14aa395dd7410912ee2d5" is_pre_election: true
I20250625 03:32:32.508201 5696 raft_consensus.cc:2466] T c7d0e4d719d3491199afddf8ff1204e0 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac714929b11c43d482b5920a2a5b9129 in term 0.
I20250625 03:32:32.506268 5872 leader_election.cc:290] T c7d0e4d719d3491199afddf8ff1204e0 P ac714929b11c43d482b5920a2a5b9129 [CANDIDATE]: Term 1 election: Requested vote from peers f0e7c9f6ec2c46eda889ff8f199bc969 (127.0.106.129:44743), 5a67f69245d14aa395dd7410912ee2d5 (127.0.106.131:38277)
I20250625 03:32:32.522498 5855 raft_consensus.cc:695] T c7d0e4d719d3491199afddf8ff1204e0 P ac714929b11c43d482b5920a2a5b9129 [term 1 LEADER]: Becoming Leader. State: Replica: ac714929b11c43d482b5920a2a5b9129, State: Running, Role: LEADER
I20250625 03:32:32.527640 5855 consensus_queue.cc:237] T c7d0e4d719d3491199afddf8ff1204e0 P ac714929b11c43d482b5920a2a5b9129 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.532639 5696 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c7d0e4d719d3491199afddf8ff1204e0" candidate_uuid: "ac714929b11c43d482b5920a2a5b9129" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a67f69245d14aa395dd7410912ee2d5"
I20250625 03:32:32.529187 5868 raft_consensus.cc:357] T bbf810309eb949ff880839714444d55f P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.533881 5696 raft_consensus.cc:3058] T c7d0e4d719d3491199afddf8ff1204e0 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:32.534061 5868 raft_consensus.cc:383] T bbf810309eb949ff880839714444d55f P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:32.534780 5868 raft_consensus.cc:738] T bbf810309eb949ff880839714444d55f P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0e7c9f6ec2c46eda889ff8f199bc969, State: Initialized, Role: FOLLOWER
I20250625 03:32:32.531694 5548 raft_consensus.cc:2466] T 786290ddcf094479800ece947612d482 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a67f69245d14aa395dd7410912ee2d5 in term 1.
I20250625 03:32:32.531071 5869 tablet_bootstrap.cc:492] T 267de6f0358a4e9f894a10a091cd8efc P 5a67f69245d14aa395dd7410912ee2d5: No bootstrap required, opened a new log
I20250625 03:32:32.532378 5445 catalog_manager.cc:5582] T 786290ddcf094479800ece947612d482 P 5a67f69245d14aa395dd7410912ee2d5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a67f69245d14aa395dd7410912ee2d5 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "5a67f69245d14aa395dd7410912ee2d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } health_report { overall_health: HEALTHY } } }
I20250625 03:32:32.539584 5869 ts_tablet_manager.cc:1397] T 267de6f0358a4e9f894a10a091cd8efc P 5a67f69245d14aa395dd7410912ee2d5: Time spent bootstrapping tablet: real 0.152s user 0.021s sys 0.012s
I20250625 03:32:32.539395 5868 consensus_queue.cc:260] T bbf810309eb949ff880839714444d55f P f0e7c9f6ec2c46eda889ff8f199bc969 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.555879 5868 ts_tablet_manager.cc:1428] T bbf810309eb949ff880839714444d55f P f0e7c9f6ec2c46eda889ff8f199bc969: Time spent starting tablet: real 0.059s user 0.010s sys 0.000s
I20250625 03:32:32.556217 5869 raft_consensus.cc:357] T 267de6f0358a4e9f894a10a091cd8efc P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.543033 5870 ts_tablet_manager.cc:1428] T 6026baaaf75a465aab3b95d3ada761c2 P ac714929b11c43d482b5920a2a5b9129: Time spent starting tablet: real 0.061s user 0.010s sys 0.000s
I20250625 03:32:32.557386 5869 raft_consensus.cc:383] T 267de6f0358a4e9f894a10a091cd8efc P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:32.557905 5869 raft_consensus.cc:738] T 267de6f0358a4e9f894a10a091cd8efc P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a67f69245d14aa395dd7410912ee2d5, State: Initialized, Role: FOLLOWER
I20250625 03:32:32.559890 5870 tablet_bootstrap.cc:492] T 33bf1d07080f4096a5aa2b5daef743a6 P ac714929b11c43d482b5920a2a5b9129: Bootstrap starting.
I20250625 03:32:32.559507 5869 consensus_queue.cc:260] T 267de6f0358a4e9f894a10a091cd8efc P 5a67f69245d14aa395dd7410912ee2d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.557109 5868 tablet_bootstrap.cc:492] T 6026baaaf75a465aab3b95d3ada761c2 P f0e7c9f6ec2c46eda889ff8f199bc969: Bootstrap starting.
I20250625 03:32:32.567662 5445 catalog_manager.cc:5582] T c7d0e4d719d3491199afddf8ff1204e0 P ac714929b11c43d482b5920a2a5b9129 reported cstate change: term changed from 0 to 1, leader changed from <none> to ac714929b11c43d482b5920a2a5b9129 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "ac714929b11c43d482b5920a2a5b9129" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } health_report { overall_health: UNKNOWN } } }
I20250625 03:32:32.564824 5869 ts_tablet_manager.cc:1428] T 267de6f0358a4e9f894a10a091cd8efc P 5a67f69245d14aa395dd7410912ee2d5: Time spent starting tablet: real 0.018s user 0.009s sys 0.000s
I20250625 03:32:32.569906 5869 tablet_bootstrap.cc:492] T 6026baaaf75a465aab3b95d3ada761c2 P 5a67f69245d14aa395dd7410912ee2d5: Bootstrap starting.
I20250625 03:32:32.573926 5696 raft_consensus.cc:2466] T c7d0e4d719d3491199afddf8ff1204e0 P 5a67f69245d14aa395dd7410912ee2d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac714929b11c43d482b5920a2a5b9129 in term 1.
I20250625 03:32:32.585798 5868 tablet_bootstrap.cc:654] T 6026baaaf75a465aab3b95d3ada761c2 P f0e7c9f6ec2c46eda889ff8f199bc969: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:32.590695 5869 tablet_bootstrap.cc:654] T 6026baaaf75a465aab3b95d3ada761c2 P 5a67f69245d14aa395dd7410912ee2d5: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:32.588085 5870 tablet_bootstrap.cc:654] T 33bf1d07080f4096a5aa2b5daef743a6 P ac714929b11c43d482b5920a2a5b9129: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:32.604682 5868 tablet_bootstrap.cc:492] T 6026baaaf75a465aab3b95d3ada761c2 P f0e7c9f6ec2c46eda889ff8f199bc969: No bootstrap required, opened a new log
I20250625 03:32:32.605252 5868 ts_tablet_manager.cc:1397] T 6026baaaf75a465aab3b95d3ada761c2 P f0e7c9f6ec2c46eda889ff8f199bc969: Time spent bootstrapping tablet: real 0.048s user 0.008s sys 0.008s
I20250625 03:32:32.608112 5869 tablet_bootstrap.cc:492] T 6026baaaf75a465aab3b95d3ada761c2 P 5a67f69245d14aa395dd7410912ee2d5: No bootstrap required, opened a new log
I20250625 03:32:32.608747 5869 ts_tablet_manager.cc:1397] T 6026baaaf75a465aab3b95d3ada761c2 P 5a67f69245d14aa395dd7410912ee2d5: Time spent bootstrapping tablet: real 0.039s user 0.014s sys 0.005s
I20250625 03:32:32.609340 5870 tablet_bootstrap.cc:492] T 33bf1d07080f4096a5aa2b5daef743a6 P ac714929b11c43d482b5920a2a5b9129: No bootstrap required, opened a new log
I20250625 03:32:32.609978 5870 ts_tablet_manager.cc:1397] T 33bf1d07080f4096a5aa2b5daef743a6 P ac714929b11c43d482b5920a2a5b9129: Time spent bootstrapping tablet: real 0.052s user 0.016s sys 0.000s
I20250625 03:32:32.609508 5868 raft_consensus.cc:357] T 6026baaaf75a465aab3b95d3ada761c2 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.610535 5868 raft_consensus.cc:383] T 6026baaaf75a465aab3b95d3ada761c2 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:32.610895 5868 raft_consensus.cc:738] T 6026baaaf75a465aab3b95d3ada761c2 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0e7c9f6ec2c46eda889ff8f199bc969, State: Initialized, Role: FOLLOWER
I20250625 03:32:32.611809 5868 consensus_queue.cc:260] T 6026baaaf75a465aab3b95d3ada761c2 P f0e7c9f6ec2c46eda889ff8f199bc969 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.611874 5869 raft_consensus.cc:357] T 6026baaaf75a465aab3b95d3ada761c2 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.612854 5869 raft_consensus.cc:383] T 6026baaaf75a465aab3b95d3ada761c2 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:32.613175 5869 raft_consensus.cc:738] T 6026baaaf75a465aab3b95d3ada761c2 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a67f69245d14aa395dd7410912ee2d5, State: Initialized, Role: FOLLOWER
I20250625 03:32:32.613811 5870 raft_consensus.cc:357] T 33bf1d07080f4096a5aa2b5daef743a6 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.614068 5869 consensus_queue.cc:260] T 6026baaaf75a465aab3b95d3ada761c2 P 5a67f69245d14aa395dd7410912ee2d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.614707 5870 raft_consensus.cc:383] T 33bf1d07080f4096a5aa2b5daef743a6 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:32.615120 5870 raft_consensus.cc:738] T 33bf1d07080f4096a5aa2b5daef743a6 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac714929b11c43d482b5920a2a5b9129, State: Initialized, Role: FOLLOWER
I20250625 03:32:32.615876 5870 consensus_queue.cc:260] T 33bf1d07080f4096a5aa2b5daef743a6 P ac714929b11c43d482b5920a2a5b9129 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.618542 5870 ts_tablet_manager.cc:1428] T 33bf1d07080f4096a5aa2b5daef743a6 P ac714929b11c43d482b5920a2a5b9129: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20250625 03:32:32.622638 5869 ts_tablet_manager.cc:1428] T 6026baaaf75a465aab3b95d3ada761c2 P 5a67f69245d14aa395dd7410912ee2d5: Time spent starting tablet: real 0.014s user 0.007s sys 0.000s
I20250625 03:32:32.623682 5869 tablet_bootstrap.cc:492] T bbf810309eb949ff880839714444d55f P 5a67f69245d14aa395dd7410912ee2d5: Bootstrap starting.
I20250625 03:32:32.630359 5869 tablet_bootstrap.cc:654] T bbf810309eb949ff880839714444d55f P 5a67f69245d14aa395dd7410912ee2d5: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:32.635525 5857 raft_consensus.cc:491] T 6026baaaf75a465aab3b95d3ada761c2 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:32:32.635620 5870 tablet_bootstrap.cc:492] T bbf810309eb949ff880839714444d55f P ac714929b11c43d482b5920a2a5b9129: Bootstrap starting.
I20250625 03:32:32.636245 5857 raft_consensus.cc:513] T 6026baaaf75a465aab3b95d3ada761c2 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.640149 5696 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6026baaaf75a465aab3b95d3ada761c2" candidate_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a67f69245d14aa395dd7410912ee2d5" is_pre_election: true
I20250625 03:32:32.641160 5696 raft_consensus.cc:2466] T 6026baaaf75a465aab3b95d3ada761c2 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0e7c9f6ec2c46eda889ff8f199bc969 in term 0.
I20250625 03:32:32.643643 5512 leader_election.cc:304] T 6026baaaf75a465aab3b95d3ada761c2 P f0e7c9f6ec2c46eda889ff8f199bc969 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a67f69245d14aa395dd7410912ee2d5, f0e7c9f6ec2c46eda889ff8f199bc969; no voters:
I20250625 03:32:32.645613 5886 raft_consensus.cc:491] T 33bf1d07080f4096a5aa2b5daef743a6 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:32:32.646261 5886 raft_consensus.cc:513] T 33bf1d07080f4096a5aa2b5daef743a6 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.648659 5886 leader_election.cc:290] T 33bf1d07080f4096a5aa2b5daef743a6 P ac714929b11c43d482b5920a2a5b9129 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0e7c9f6ec2c46eda889ff8f199bc969 (127.0.106.129:44743), 5a67f69245d14aa395dd7410912ee2d5 (127.0.106.131:38277)
I20250625 03:32:32.650611 5548 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "33bf1d07080f4096a5aa2b5daef743a6" candidate_uuid: "ac714929b11c43d482b5920a2a5b9129" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" is_pre_election: true
W20250625 03:32:32.652294 5589 leader_election.cc:343] T 33bf1d07080f4096a5aa2b5daef743a6 P ac714929b11c43d482b5920a2a5b9129 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0e7c9f6ec2c46eda889ff8f199bc969 (127.0.106.129:44743): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:32:32.653411 5857 leader_election.cc:290] T 6026baaaf75a465aab3b95d3ada761c2 P f0e7c9f6ec2c46eda889ff8f199bc969 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac714929b11c43d482b5920a2a5b9129 (127.0.106.130:39845), 5a67f69245d14aa395dd7410912ee2d5 (127.0.106.131:38277)
I20250625 03:32:32.654539 5696 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "33bf1d07080f4096a5aa2b5daef743a6" candidate_uuid: "ac714929b11c43d482b5920a2a5b9129" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a67f69245d14aa395dd7410912ee2d5" is_pre_election: true
W20250625 03:32:32.656754 5587 leader_election.cc:343] T 33bf1d07080f4096a5aa2b5daef743a6 P ac714929b11c43d482b5920a2a5b9129 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a67f69245d14aa395dd7410912ee2d5 (127.0.106.131:38277): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:32:32.657402 5587 leader_election.cc:304] T 33bf1d07080f4096a5aa2b5daef743a6 P ac714929b11c43d482b5920a2a5b9129 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac714929b11c43d482b5920a2a5b9129; no voters: 5a67f69245d14aa395dd7410912ee2d5, f0e7c9f6ec2c46eda889ff8f199bc969
I20250625 03:32:32.663269 5868 ts_tablet_manager.cc:1428] T 6026baaaf75a465aab3b95d3ada761c2 P f0e7c9f6ec2c46eda889ff8f199bc969: Time spent starting tablet: real 0.058s user 0.006s sys 0.004s
I20250625 03:32:32.664139 5886 raft_consensus.cc:2747] T 33bf1d07080f4096a5aa2b5daef743a6 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:32:32.668905 5868 tablet_bootstrap.cc:492] T 70076edadb434d5a8d584361780928bc P f0e7c9f6ec2c46eda889ff8f199bc969: Bootstrap starting.
I20250625 03:32:32.674494 5892 raft_consensus.cc:2802] T 6026baaaf75a465aab3b95d3ada761c2 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:32:32.675042 5892 raft_consensus.cc:491] T 6026baaaf75a465aab3b95d3ada761c2 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:32:32.675420 5892 raft_consensus.cc:3058] T 6026baaaf75a465aab3b95d3ada761c2 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:32.675933 5622 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6026baaaf75a465aab3b95d3ada761c2" candidate_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac714929b11c43d482b5920a2a5b9129" is_pre_election: true
I20250625 03:32:32.676667 5622 raft_consensus.cc:2466] T 6026baaaf75a465aab3b95d3ada761c2 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0e7c9f6ec2c46eda889ff8f199bc969 in term 0.
I20250625 03:32:32.680565 5870 tablet_bootstrap.cc:654] T bbf810309eb949ff880839714444d55f P ac714929b11c43d482b5920a2a5b9129: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:32.682196 5857 raft_consensus.cc:491] T 267de6f0358a4e9f894a10a091cd8efc P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:32:32.682821 5857 raft_consensus.cc:513] T 267de6f0358a4e9f894a10a091cd8efc P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.684926 5857 leader_election.cc:290] T 267de6f0358a4e9f894a10a091cd8efc P f0e7c9f6ec2c46eda889ff8f199bc969 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac714929b11c43d482b5920a2a5b9129 (127.0.106.130:39845), 5a67f69245d14aa395dd7410912ee2d5 (127.0.106.131:38277)
I20250625 03:32:32.687897 5880 raft_consensus.cc:491] T 267de6f0358a4e9f894a10a091cd8efc P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:32:32.688704 5880 raft_consensus.cc:513] T 267de6f0358a4e9f894a10a091cd8efc P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.691629 5880 leader_election.cc:290] T 267de6f0358a4e9f894a10a091cd8efc P 5a67f69245d14aa395dd7410912ee2d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0e7c9f6ec2c46eda889ff8f199bc969 (127.0.106.129:44743), ac714929b11c43d482b5920a2a5b9129 (127.0.106.130:39845)
I20250625 03:32:32.692736 5622 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "267de6f0358a4e9f894a10a091cd8efc" candidate_uuid: "5a67f69245d14aa395dd7410912ee2d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac714929b11c43d482b5920a2a5b9129" is_pre_election: true
I20250625 03:32:32.693447 5622 raft_consensus.cc:2466] T 267de6f0358a4e9f894a10a091cd8efc P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a67f69245d14aa395dd7410912ee2d5 in term 0.
I20250625 03:32:32.693847 5548 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "267de6f0358a4e9f894a10a091cd8efc" candidate_uuid: "5a67f69245d14aa395dd7410912ee2d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" is_pre_election: true
I20250625 03:32:32.694486 5623 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "267de6f0358a4e9f894a10a091cd8efc" candidate_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac714929b11c43d482b5920a2a5b9129" is_pre_election: true
I20250625 03:32:32.695147 5623 raft_consensus.cc:2466] T 267de6f0358a4e9f894a10a091cd8efc P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0e7c9f6ec2c46eda889ff8f199bc969 in term 0.
I20250625 03:32:32.696424 5662 leader_election.cc:304] T 267de6f0358a4e9f894a10a091cd8efc P 5a67f69245d14aa395dd7410912ee2d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a67f69245d14aa395dd7410912ee2d5, ac714929b11c43d482b5920a2a5b9129; no voters:
I20250625 03:32:32.694540 5548 raft_consensus.cc:2466] T 267de6f0358a4e9f894a10a091cd8efc P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a67f69245d14aa395dd7410912ee2d5 in term 0.
I20250625 03:32:32.697355 5880 raft_consensus.cc:2802] T 267de6f0358a4e9f894a10a091cd8efc P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:32:32.701325 5513 leader_election.cc:304] T 267de6f0358a4e9f894a10a091cd8efc P f0e7c9f6ec2c46eda889ff8f199bc969 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac714929b11c43d482b5920a2a5b9129, f0e7c9f6ec2c46eda889ff8f199bc969; no voters:
I20250625 03:32:32.701823 5868 tablet_bootstrap.cc:654] T 70076edadb434d5a8d584361780928bc P f0e7c9f6ec2c46eda889ff8f199bc969: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:32.701941 5880 raft_consensus.cc:491] T 267de6f0358a4e9f894a10a091cd8efc P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:32:32.702494 5880 raft_consensus.cc:3058] T 267de6f0358a4e9f894a10a091cd8efc P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:32.702507 5893 raft_consensus.cc:2802] T 267de6f0358a4e9f894a10a091cd8efc P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:32:32.702989 5893 raft_consensus.cc:491] T 267de6f0358a4e9f894a10a091cd8efc P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:32:32.703323 5893 raft_consensus.cc:3058] T 267de6f0358a4e9f894a10a091cd8efc P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:32.697361 5696 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "267de6f0358a4e9f894a10a091cd8efc" candidate_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a67f69245d14aa395dd7410912ee2d5" is_pre_election: true
I20250625 03:32:32.707080 5869 tablet_bootstrap.cc:492] T bbf810309eb949ff880839714444d55f P 5a67f69245d14aa395dd7410912ee2d5: No bootstrap required, opened a new log
I20250625 03:32:32.707703 5869 ts_tablet_manager.cc:1397] T bbf810309eb949ff880839714444d55f P 5a67f69245d14aa395dd7410912ee2d5: Time spent bootstrapping tablet: real 0.084s user 0.022s sys 0.055s
I20250625 03:32:32.710942 5869 raft_consensus.cc:357] T bbf810309eb949ff880839714444d55f P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.711733 5869 raft_consensus.cc:383] T bbf810309eb949ff880839714444d55f P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:32.712082 5869 raft_consensus.cc:738] T bbf810309eb949ff880839714444d55f P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a67f69245d14aa395dd7410912ee2d5, State: Initialized, Role: FOLLOWER
I20250625 03:32:32.712936 5869 consensus_queue.cc:260] T bbf810309eb949ff880839714444d55f P 5a67f69245d14aa395dd7410912ee2d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.714792 5880 raft_consensus.cc:513] T 267de6f0358a4e9f894a10a091cd8efc P 5a67f69245d14aa395dd7410912ee2d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.720727 5696 raft_consensus.cc:2391] T 267de6f0358a4e9f894a10a091cd8efc P 5a67f69245d14aa395dd7410912ee2d5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f0e7c9f6ec2c46eda889ff8f199bc969 in current term 1: Already voted for candidate 5a67f69245d14aa395dd7410912ee2d5 in this term.
I20250625 03:32:32.721839 5880 leader_election.cc:290] T 267de6f0358a4e9f894a10a091cd8efc P 5a67f69245d14aa395dd7410912ee2d5 [CANDIDATE]: Term 1 election: Requested vote from peers f0e7c9f6ec2c46eda889ff8f199bc969 (127.0.106.129:44743), ac714929b11c43d482b5920a2a5b9129 (127.0.106.130:39845)
I20250625 03:32:32.722908 5622 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "267de6f0358a4e9f894a10a091cd8efc" candidate_uuid: "5a67f69245d14aa395dd7410912ee2d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac714929b11c43d482b5920a2a5b9129"
I20250625 03:32:32.723538 5622 raft_consensus.cc:3058] T 267de6f0358a4e9f894a10a091cd8efc P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:32.716456 5892 raft_consensus.cc:513] T 6026baaaf75a465aab3b95d3ada761c2 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.717384 5868 tablet_bootstrap.cc:492] T 70076edadb434d5a8d584361780928bc P f0e7c9f6ec2c46eda889ff8f199bc969: No bootstrap required, opened a new log
I20250625 03:32:32.725814 5868 ts_tablet_manager.cc:1397] T 70076edadb434d5a8d584361780928bc P f0e7c9f6ec2c46eda889ff8f199bc969: Time spent bootstrapping tablet: real 0.057s user 0.013s sys 0.002s
I20250625 03:32:32.729007 5868 raft_consensus.cc:357] T 70076edadb434d5a8d584361780928bc P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.730020 5868 raft_consensus.cc:383] T 70076edadb434d5a8d584361780928bc P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:32.730389 5868 raft_consensus.cc:738] T 70076edadb434d5a8d584361780928bc P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0e7c9f6ec2c46eda889ff8f199bc969, State: Initialized, Role: FOLLOWER
I20250625 03:32:32.719645 5870 tablet_bootstrap.cc:492] T bbf810309eb949ff880839714444d55f P ac714929b11c43d482b5920a2a5b9129: No bootstrap required, opened a new log
I20250625 03:32:32.730896 5548 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "267de6f0358a4e9f894a10a091cd8efc" candidate_uuid: "5a67f69245d14aa395dd7410912ee2d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969"
I20250625 03:32:32.731151 5870 ts_tablet_manager.cc:1397] T bbf810309eb949ff880839714444d55f P ac714929b11c43d482b5920a2a5b9129: Time spent bootstrapping tablet: real 0.096s user 0.018s sys 0.002s
I20250625 03:32:32.732434 5622 raft_consensus.cc:2466] T 267de6f0358a4e9f894a10a091cd8efc P ac714929b11c43d482b5920a2a5b9129 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a67f69245d14aa395dd7410912ee2d5 in term 1.
I20250625 03:32:32.719542 5869 ts_tablet_manager.cc:1428] T bbf810309eb949ff880839714444d55f P 5a67f69245d14aa395dd7410912ee2d5: Time spent starting tablet: real 0.012s user 0.008s sys 0.000s
I20250625 03:32:32.733687 5662 leader_election.cc:304] T 267de6f0358a4e9f894a10a091cd8efc P 5a67f69245d14aa395dd7410912ee2d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a67f69245d14aa395dd7410912ee2d5, ac714929b11c43d482b5920a2a5b9129; no voters:
I20250625 03:32:32.734683 5880 raft_consensus.cc:2802] T 267de6f0358a4e9f894a10a091cd8efc P 5a67f69245d14aa395dd7410912ee2d5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:32:32.735472 5880 raft_consensus.cc:695] T 267de6f0358a4e9f894a10a091cd8efc P 5a67f69245d14aa395dd7410912ee2d5 [term 1 LEADER]: Becoming Leader. State: Replica: 5a67f69245d14aa395dd7410912ee2d5, State: Running, Role: LEADER
I20250625 03:32:32.735613 5696 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6026baaaf75a465aab3b95d3ada761c2" candidate_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a67f69245d14aa395dd7410912ee2d5"
I20250625 03:32:32.736565 5880 consensus_queue.cc:237] T 267de6f0358a4e9f894a10a091cd8efc P 5a67f69245d14aa395dd7410912ee2d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.737699 5696 raft_consensus.cc:3058] T 6026baaaf75a465aab3b95d3ada761c2 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:32.738657 5893 raft_consensus.cc:513] T 267de6f0358a4e9f894a10a091cd8efc P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.739966 5548 raft_consensus.cc:2391] T 267de6f0358a4e9f894a10a091cd8efc P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a67f69245d14aa395dd7410912ee2d5 in current term 1: Already voted for candidate f0e7c9f6ec2c46eda889ff8f199bc969 in this term.
I20250625 03:32:32.740394 5869 tablet_bootstrap.cc:492] T 33bf1d07080f4096a5aa2b5daef743a6 P 5a67f69245d14aa395dd7410912ee2d5: Bootstrap starting.
I20250625 03:32:32.734138 5892 leader_election.cc:290] T 6026baaaf75a465aab3b95d3ada761c2 P f0e7c9f6ec2c46eda889ff8f199bc969 [CANDIDATE]: Term 1 election: Requested vote from peers ac714929b11c43d482b5920a2a5b9129 (127.0.106.130:39845), 5a67f69245d14aa395dd7410912ee2d5 (127.0.106.131:38277)
I20250625 03:32:32.731164 5868 consensus_queue.cc:260] T 70076edadb434d5a8d584361780928bc P f0e7c9f6ec2c46eda889ff8f199bc969 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.745371 5868 ts_tablet_manager.cc:1428] T 70076edadb434d5a8d584361780928bc P f0e7c9f6ec2c46eda889ff8f199bc969: Time spent starting tablet: real 0.019s user 0.007s sys 0.000s
I20250625 03:32:32.747831 5694 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "267de6f0358a4e9f894a10a091cd8efc" candidate_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a67f69245d14aa395dd7410912ee2d5"
I20250625 03:32:32.749753 5893 leader_election.cc:290] T 267de6f0358a4e9f894a10a091cd8efc P f0e7c9f6ec2c46eda889ff8f199bc969 [CANDIDATE]: Term 1 election: Requested vote from peers ac714929b11c43d482b5920a2a5b9129 (127.0.106.130:39845), 5a67f69245d14aa395dd7410912ee2d5 (127.0.106.131:38277)
I20250625 03:32:32.750358 5870 raft_consensus.cc:357] T bbf810309eb949ff880839714444d55f P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.751191 5870 raft_consensus.cc:383] T bbf810309eb949ff880839714444d55f P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:32.751549 5870 raft_consensus.cc:738] T bbf810309eb949ff880839714444d55f P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac714929b11c43d482b5920a2a5b9129, State: Initialized, Role: FOLLOWER
I20250625 03:32:32.749835 5696 raft_consensus.cc:2466] T 6026baaaf75a465aab3b95d3ada761c2 P 5a67f69245d14aa395dd7410912ee2d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0e7c9f6ec2c46eda889ff8f199bc969 in term 1.
I20250625 03:32:32.753141 5512 leader_election.cc:304] T 6026baaaf75a465aab3b95d3ada761c2 P f0e7c9f6ec2c46eda889ff8f199bc969 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a67f69245d14aa395dd7410912ee2d5, f0e7c9f6ec2c46eda889ff8f199bc969; no voters:
I20250625 03:32:32.754436 5622 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6026baaaf75a465aab3b95d3ada761c2" candidate_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac714929b11c43d482b5920a2a5b9129"
I20250625 03:32:32.754769 5857 raft_consensus.cc:2802] T 6026baaaf75a465aab3b95d3ada761c2 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:32:32.755127 5622 raft_consensus.cc:3058] T 6026baaaf75a465aab3b95d3ada761c2 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:32.755257 5857 raft_consensus.cc:695] T 6026baaaf75a465aab3b95d3ada761c2 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 LEADER]: Becoming Leader. State: Replica: f0e7c9f6ec2c46eda889ff8f199bc969, State: Running, Role: LEADER
I20250625 03:32:32.755755 5868 tablet_bootstrap.cc:492] T 33bf1d07080f4096a5aa2b5daef743a6 P f0e7c9f6ec2c46eda889ff8f199bc969: Bootstrap starting.
I20250625 03:32:32.756198 5857 consensus_queue.cc:237] T 6026baaaf75a465aab3b95d3ada761c2 P f0e7c9f6ec2c46eda889ff8f199bc969 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.758215 5623 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "267de6f0358a4e9f894a10a091cd8efc" candidate_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac714929b11c43d482b5920a2a5b9129"
I20250625 03:32:32.759073 5623 raft_consensus.cc:2391] T 267de6f0358a4e9f894a10a091cd8efc P ac714929b11c43d482b5920a2a5b9129 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f0e7c9f6ec2c46eda889ff8f199bc969 in current term 1: Already voted for candidate 5a67f69245d14aa395dd7410912ee2d5 in this term.
I20250625 03:32:32.761907 5513 leader_election.cc:304] T 267de6f0358a4e9f894a10a091cd8efc P f0e7c9f6ec2c46eda889ff8f199bc969 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0e7c9f6ec2c46eda889ff8f199bc969; no voters: 5a67f69245d14aa395dd7410912ee2d5, ac714929b11c43d482b5920a2a5b9129
I20250625 03:32:32.770015 5622 raft_consensus.cc:2466] T 6026baaaf75a465aab3b95d3ada761c2 P ac714929b11c43d482b5920a2a5b9129 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0e7c9f6ec2c46eda889ff8f199bc969 in term 1.
I20250625 03:32:32.768689 5870 consensus_queue.cc:260] T bbf810309eb949ff880839714444d55f P ac714929b11c43d482b5920a2a5b9129 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.770264 5896 raft_consensus.cc:2747] T 267de6f0358a4e9f894a10a091cd8efc P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20250625 03:32:32.774313 5869 tablet_bootstrap.cc:654] T 33bf1d07080f4096a5aa2b5daef743a6 P 5a67f69245d14aa395dd7410912ee2d5: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:32.793387 5445 catalog_manager.cc:5582] T 6026baaaf75a465aab3b95d3ada761c2 P f0e7c9f6ec2c46eda889ff8f199bc969 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0e7c9f6ec2c46eda889ff8f199bc969 (127.0.106.129). New cstate: current_term: 1 leader_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } health_report { overall_health: UNKNOWN } } }
I20250625 03:32:32.795913 5870 ts_tablet_manager.cc:1428] T bbf810309eb949ff880839714444d55f P ac714929b11c43d482b5920a2a5b9129: Time spent starting tablet: real 0.063s user 0.003s sys 0.003s
I20250625 03:32:32.797060 5870 tablet_bootstrap.cc:492] T 70076edadb434d5a8d584361780928bc P ac714929b11c43d482b5920a2a5b9129: Bootstrap starting.
I20250625 03:32:32.808360 5870 tablet_bootstrap.cc:654] T 70076edadb434d5a8d584361780928bc P ac714929b11c43d482b5920a2a5b9129: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:32.816761 5886 raft_consensus.cc:491] T bbf810309eb949ff880839714444d55f P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:32:32.817030 5868 tablet_bootstrap.cc:654] T 33bf1d07080f4096a5aa2b5daef743a6 P f0e7c9f6ec2c46eda889ff8f199bc969: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:32.817379 5886 raft_consensus.cc:513] T bbf810309eb949ff880839714444d55f P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.798216 5444 catalog_manager.cc:5582] T 267de6f0358a4e9f894a10a091cd8efc P 5a67f69245d14aa395dd7410912ee2d5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a67f69245d14aa395dd7410912ee2d5 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "5a67f69245d14aa395dd7410912ee2d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } health_report { overall_health: HEALTHY } } }
I20250625 03:32:32.819394 5886 leader_election.cc:290] T bbf810309eb949ff880839714444d55f P ac714929b11c43d482b5920a2a5b9129 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0e7c9f6ec2c46eda889ff8f199bc969 (127.0.106.129:44743), 5a67f69245d14aa395dd7410912ee2d5 (127.0.106.131:38277)
I20250625 03:32:32.821125 5548 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bbf810309eb949ff880839714444d55f" candidate_uuid: "ac714929b11c43d482b5920a2a5b9129" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" is_pre_election: true
I20250625 03:32:32.821856 5548 raft_consensus.cc:2466] T bbf810309eb949ff880839714444d55f P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac714929b11c43d482b5920a2a5b9129 in term 0.
I20250625 03:32:32.823161 5589 leader_election.cc:304] T bbf810309eb949ff880839714444d55f P ac714929b11c43d482b5920a2a5b9129 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac714929b11c43d482b5920a2a5b9129, f0e7c9f6ec2c46eda889ff8f199bc969; no voters:
I20250625 03:32:32.824177 5886 raft_consensus.cc:2802] T bbf810309eb949ff880839714444d55f P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:32:32.827222 5886 raft_consensus.cc:491] T bbf810309eb949ff880839714444d55f P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:32:32.827710 5886 raft_consensus.cc:3058] T bbf810309eb949ff880839714444d55f P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:32.834174 5696 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bbf810309eb949ff880839714444d55f" candidate_uuid: "ac714929b11c43d482b5920a2a5b9129" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a67f69245d14aa395dd7410912ee2d5" is_pre_election: true
I20250625 03:32:32.834954 5696 raft_consensus.cc:2466] T bbf810309eb949ff880839714444d55f P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac714929b11c43d482b5920a2a5b9129 in term 0.
I20250625 03:32:32.839094 5869 tablet_bootstrap.cc:492] T 33bf1d07080f4096a5aa2b5daef743a6 P 5a67f69245d14aa395dd7410912ee2d5: No bootstrap required, opened a new log
I20250625 03:32:32.839622 5869 ts_tablet_manager.cc:1397] T 33bf1d07080f4096a5aa2b5daef743a6 P 5a67f69245d14aa395dd7410912ee2d5: Time spent bootstrapping tablet: real 0.099s user 0.008s sys 0.030s
I20250625 03:32:32.841689 5870 tablet_bootstrap.cc:492] T 70076edadb434d5a8d584361780928bc P ac714929b11c43d482b5920a2a5b9129: No bootstrap required, opened a new log
I20250625 03:32:32.842327 5870 ts_tablet_manager.cc:1397] T 70076edadb434d5a8d584361780928bc P ac714929b11c43d482b5920a2a5b9129: Time spent bootstrapping tablet: real 0.045s user 0.011s sys 0.017s
I20250625 03:32:32.842767 5886 raft_consensus.cc:513] T bbf810309eb949ff880839714444d55f P ac714929b11c43d482b5920a2a5b9129 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.842761 5869 raft_consensus.cc:357] T 33bf1d07080f4096a5aa2b5daef743a6 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.843818 5869 raft_consensus.cc:383] T 33bf1d07080f4096a5aa2b5daef743a6 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:32.844184 5869 raft_consensus.cc:738] T 33bf1d07080f4096a5aa2b5daef743a6 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a67f69245d14aa395dd7410912ee2d5, State: Initialized, Role: FOLLOWER
I20250625 03:32:32.845036 5869 consensus_queue.cc:260] T 33bf1d07080f4096a5aa2b5daef743a6 P 5a67f69245d14aa395dd7410912ee2d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.845954 5548 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bbf810309eb949ff880839714444d55f" candidate_uuid: "ac714929b11c43d482b5920a2a5b9129" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969"
I20250625 03:32:32.845726 5870 raft_consensus.cc:357] T 70076edadb434d5a8d584361780928bc P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.846676 5548 raft_consensus.cc:3058] T bbf810309eb949ff880839714444d55f P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:32.846716 5870 raft_consensus.cc:383] T 70076edadb434d5a8d584361780928bc P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:32.847263 5870 raft_consensus.cc:738] T 70076edadb434d5a8d584361780928bc P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac714929b11c43d482b5920a2a5b9129, State: Initialized, Role: FOLLOWER
I20250625 03:32:32.848053 5870 consensus_queue.cc:260] T 70076edadb434d5a8d584361780928bc P ac714929b11c43d482b5920a2a5b9129 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.850687 5870 ts_tablet_manager.cc:1428] T 70076edadb434d5a8d584361780928bc P ac714929b11c43d482b5920a2a5b9129: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20250625 03:32:32.851744 5870 tablet_bootstrap.cc:492] T aaeeb3012a8c4a77a8359268c32d1abc P ac714929b11c43d482b5920a2a5b9129: Bootstrap starting.
I20250625 03:32:32.855491 5869 ts_tablet_manager.cc:1428] T 33bf1d07080f4096a5aa2b5daef743a6 P 5a67f69245d14aa395dd7410912ee2d5: Time spent starting tablet: real 0.015s user 0.006s sys 0.000s
I20250625 03:32:32.858764 5870 tablet_bootstrap.cc:654] T aaeeb3012a8c4a77a8359268c32d1abc P ac714929b11c43d482b5920a2a5b9129: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:32.866341 5869 tablet_bootstrap.cc:492] T bd204f74bbbf45218051c05c8d3a32c1 P 5a67f69245d14aa395dd7410912ee2d5: Bootstrap starting.
I20250625 03:32:32.870317 5548 raft_consensus.cc:2466] T bbf810309eb949ff880839714444d55f P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac714929b11c43d482b5920a2a5b9129 in term 1.
I20250625 03:32:32.871713 5589 leader_election.cc:304] T bbf810309eb949ff880839714444d55f P ac714929b11c43d482b5920a2a5b9129 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac714929b11c43d482b5920a2a5b9129, f0e7c9f6ec2c46eda889ff8f199bc969; no voters:
I20250625 03:32:32.872753 5855 raft_consensus.cc:2802] T bbf810309eb949ff880839714444d55f P ac714929b11c43d482b5920a2a5b9129 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:32:32.873292 5855 raft_consensus.cc:695] T bbf810309eb949ff880839714444d55f P ac714929b11c43d482b5920a2a5b9129 [term 1 LEADER]: Becoming Leader. State: Replica: ac714929b11c43d482b5920a2a5b9129, State: Running, Role: LEADER
I20250625 03:32:32.874786 5869 tablet_bootstrap.cc:654] T bd204f74bbbf45218051c05c8d3a32c1 P 5a67f69245d14aa395dd7410912ee2d5: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:32.874271 5855 consensus_queue.cc:237] T bbf810309eb949ff880839714444d55f P ac714929b11c43d482b5920a2a5b9129 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.877027 5870 tablet_bootstrap.cc:492] T aaeeb3012a8c4a77a8359268c32d1abc P ac714929b11c43d482b5920a2a5b9129: No bootstrap required, opened a new log
I20250625 03:32:32.877599 5870 ts_tablet_manager.cc:1397] T aaeeb3012a8c4a77a8359268c32d1abc P ac714929b11c43d482b5920a2a5b9129: Time spent bootstrapping tablet: real 0.026s user 0.009s sys 0.009s
I20250625 03:32:32.881191 5870 raft_consensus.cc:357] T aaeeb3012a8c4a77a8359268c32d1abc P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.882513 5870 raft_consensus.cc:383] T aaeeb3012a8c4a77a8359268c32d1abc P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:32.882933 5870 raft_consensus.cc:738] T aaeeb3012a8c4a77a8359268c32d1abc P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac714929b11c43d482b5920a2a5b9129, State: Initialized, Role: FOLLOWER
I20250625 03:32:32.884403 5870 consensus_queue.cc:260] T aaeeb3012a8c4a77a8359268c32d1abc P ac714929b11c43d482b5920a2a5b9129 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.886107 5868 tablet_bootstrap.cc:492] T 33bf1d07080f4096a5aa2b5daef743a6 P f0e7c9f6ec2c46eda889ff8f199bc969: No bootstrap required, opened a new log
I20250625 03:32:32.886718 5868 ts_tablet_manager.cc:1397] T 33bf1d07080f4096a5aa2b5daef743a6 P f0e7c9f6ec2c46eda889ff8f199bc969: Time spent bootstrapping tablet: real 0.131s user 0.015s sys 0.014s
I20250625 03:32:32.887733 5870 ts_tablet_manager.cc:1428] T aaeeb3012a8c4a77a8359268c32d1abc P ac714929b11c43d482b5920a2a5b9129: Time spent starting tablet: real 0.010s user 0.008s sys 0.000s
I20250625 03:32:32.889262 5870 tablet_bootstrap.cc:492] T bd204f74bbbf45218051c05c8d3a32c1 P ac714929b11c43d482b5920a2a5b9129: Bootstrap starting.
I20250625 03:32:32.897414 5445 catalog_manager.cc:5582] T bbf810309eb949ff880839714444d55f P ac714929b11c43d482b5920a2a5b9129 reported cstate change: term changed from 0 to 1, leader changed from <none> to ac714929b11c43d482b5920a2a5b9129 (127.0.106.130). New cstate: current_term: 1 leader_uuid: "ac714929b11c43d482b5920a2a5b9129" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } health_report { overall_health: UNKNOWN } } }
I20250625 03:32:32.898413 5870 tablet_bootstrap.cc:654] T bd204f74bbbf45218051c05c8d3a32c1 P ac714929b11c43d482b5920a2a5b9129: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:32.903090 5696 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bbf810309eb949ff880839714444d55f" candidate_uuid: "ac714929b11c43d482b5920a2a5b9129" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a67f69245d14aa395dd7410912ee2d5"
I20250625 03:32:32.903841 5696 raft_consensus.cc:3058] T bbf810309eb949ff880839714444d55f P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:32.921331 5880 raft_consensus.cc:491] T 33bf1d07080f4096a5aa2b5daef743a6 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:32:32.922358 5696 raft_consensus.cc:2466] T bbf810309eb949ff880839714444d55f P 5a67f69245d14aa395dd7410912ee2d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac714929b11c43d482b5920a2a5b9129 in term 1.
I20250625 03:32:32.922204 5880 raft_consensus.cc:513] T 33bf1d07080f4096a5aa2b5daef743a6 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.926503 5886 leader_election.cc:290] T bbf810309eb949ff880839714444d55f P ac714929b11c43d482b5920a2a5b9129 [CANDIDATE]: Term 1 election: Requested vote from peers f0e7c9f6ec2c46eda889ff8f199bc969 (127.0.106.129:44743), 5a67f69245d14aa395dd7410912ee2d5 (127.0.106.131:38277)
I20250625 03:32:32.926503 5622 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "33bf1d07080f4096a5aa2b5daef743a6" candidate_uuid: "5a67f69245d14aa395dd7410912ee2d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac714929b11c43d482b5920a2a5b9129" is_pre_election: true
I20250625 03:32:32.927323 5622 raft_consensus.cc:2466] T 33bf1d07080f4096a5aa2b5daef743a6 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a67f69245d14aa395dd7410912ee2d5 in term 0.
I20250625 03:32:32.927832 5868 raft_consensus.cc:357] T 33bf1d07080f4096a5aa2b5daef743a6 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.928651 5868 raft_consensus.cc:383] T 33bf1d07080f4096a5aa2b5daef743a6 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:32.928656 5662 leader_election.cc:304] T 33bf1d07080f4096a5aa2b5daef743a6 P 5a67f69245d14aa395dd7410912ee2d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a67f69245d14aa395dd7410912ee2d5, ac714929b11c43d482b5920a2a5b9129; no voters:
I20250625 03:32:32.928982 5868 raft_consensus.cc:738] T 33bf1d07080f4096a5aa2b5daef743a6 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0e7c9f6ec2c46eda889ff8f199bc969, State: Initialized, Role: FOLLOWER
I20250625 03:32:32.929921 5884 raft_consensus.cc:2802] T 33bf1d07080f4096a5aa2b5daef743a6 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:32:32.930285 5884 raft_consensus.cc:491] T 33bf1d07080f4096a5aa2b5daef743a6 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:32:32.930613 5884 raft_consensus.cc:3058] T 33bf1d07080f4096a5aa2b5daef743a6 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:32.930543 5868 consensus_queue.cc:260] T 33bf1d07080f4096a5aa2b5daef743a6 P f0e7c9f6ec2c46eda889ff8f199bc969 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.933997 5880 leader_election.cc:290] T 33bf1d07080f4096a5aa2b5daef743a6 P 5a67f69245d14aa395dd7410912ee2d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0e7c9f6ec2c46eda889ff8f199bc969 (127.0.106.129:44743), ac714929b11c43d482b5920a2a5b9129 (127.0.106.130:39845)
I20250625 03:32:32.935184 5548 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "33bf1d07080f4096a5aa2b5daef743a6" candidate_uuid: "5a67f69245d14aa395dd7410912ee2d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" is_pre_election: true
I20250625 03:32:32.921438 5855 raft_consensus.cc:491] T aaeeb3012a8c4a77a8359268c32d1abc P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:32:32.938925 5855 raft_consensus.cc:513] T aaeeb3012a8c4a77a8359268c32d1abc P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.942510 5548 raft_consensus.cc:2466] T 33bf1d07080f4096a5aa2b5daef743a6 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a67f69245d14aa395dd7410912ee2d5 in term 0.
I20250625 03:32:32.939355 5884 raft_consensus.cc:513] T 33bf1d07080f4096a5aa2b5daef743a6 P 5a67f69245d14aa395dd7410912ee2d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.946266 5622 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "33bf1d07080f4096a5aa2b5daef743a6" candidate_uuid: "5a67f69245d14aa395dd7410912ee2d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac714929b11c43d482b5920a2a5b9129"
W20250625 03:32:32.946820 5493 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20250625 03:32:32.946864 5622 raft_consensus.cc:3058] T 33bf1d07080f4096a5aa2b5daef743a6 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:32.949427 5855 leader_election.cc:290] T aaeeb3012a8c4a77a8359268c32d1abc P ac714929b11c43d482b5920a2a5b9129 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0e7c9f6ec2c46eda889ff8f199bc969 (127.0.106.129:44743), 5a67f69245d14aa395dd7410912ee2d5 (127.0.106.131:38277)
I20250625 03:32:32.950933 5547 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "aaeeb3012a8c4a77a8359268c32d1abc" candidate_uuid: "ac714929b11c43d482b5920a2a5b9129" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" is_pre_election: true
W20250625 03:32:32.952348 5589 leader_election.cc:343] T aaeeb3012a8c4a77a8359268c32d1abc P ac714929b11c43d482b5920a2a5b9129 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0e7c9f6ec2c46eda889ff8f199bc969 (127.0.106.129:44743): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:32:32.953056 5869 tablet_bootstrap.cc:492] T bd204f74bbbf45218051c05c8d3a32c1 P 5a67f69245d14aa395dd7410912ee2d5: No bootstrap required, opened a new log
I20250625 03:32:32.953826 5869 ts_tablet_manager.cc:1397] T bd204f74bbbf45218051c05c8d3a32c1 P 5a67f69245d14aa395dd7410912ee2d5: Time spent bootstrapping tablet: real 0.088s user 0.030s sys 0.026s
I20250625 03:32:32.958338 5868 ts_tablet_manager.cc:1428] T 33bf1d07080f4096a5aa2b5daef743a6 P f0e7c9f6ec2c46eda889ff8f199bc969: Time spent starting tablet: real 0.071s user 0.007s sys 0.000s
I20250625 03:32:32.956470 5622 raft_consensus.cc:2466] T 33bf1d07080f4096a5aa2b5daef743a6 P ac714929b11c43d482b5920a2a5b9129 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a67f69245d14aa395dd7410912ee2d5 in term 1.
I20250625 03:32:32.956423 5697 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "aaeeb3012a8c4a77a8359268c32d1abc" candidate_uuid: "ac714929b11c43d482b5920a2a5b9129" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a67f69245d14aa395dd7410912ee2d5" is_pre_election: true
I20250625 03:32:32.959152 5880 consensus_queue.cc:1035] T 786290ddcf094479800ece947612d482 P 5a67f69245d14aa395dd7410912ee2d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20250625 03:32:32.961341 5870 tablet_bootstrap.cc:492] T bd204f74bbbf45218051c05c8d3a32c1 P ac714929b11c43d482b5920a2a5b9129: No bootstrap required, opened a new log
I20250625 03:32:32.961295 5662 leader_election.cc:304] T 33bf1d07080f4096a5aa2b5daef743a6 P 5a67f69245d14aa395dd7410912ee2d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a67f69245d14aa395dd7410912ee2d5, ac714929b11c43d482b5920a2a5b9129; no voters:
I20250625 03:32:32.961898 5870 ts_tablet_manager.cc:1397] T bd204f74bbbf45218051c05c8d3a32c1 P ac714929b11c43d482b5920a2a5b9129: Time spent bootstrapping tablet: real 0.073s user 0.035s sys 0.023s
I20250625 03:32:32.962229 5854 raft_consensus.cc:2802] T 33bf1d07080f4096a5aa2b5daef743a6 P 5a67f69245d14aa395dd7410912ee2d5 [term 1 FOLLOWER]: Leader election won for term 1
W20250625 03:32:32.962704 5587 leader_election.cc:343] T aaeeb3012a8c4a77a8359268c32d1abc P ac714929b11c43d482b5920a2a5b9129 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a67f69245d14aa395dd7410912ee2d5 (127.0.106.131:38277): Illegal state: must be running to vote when last-logged opid is not known
I20250625 03:32:32.963217 5587 leader_election.cc:304] T aaeeb3012a8c4a77a8359268c32d1abc P ac714929b11c43d482b5920a2a5b9129 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac714929b11c43d482b5920a2a5b9129; no voters: 5a67f69245d14aa395dd7410912ee2d5, f0e7c9f6ec2c46eda889ff8f199bc969
I20250625 03:32:32.962769 5854 raft_consensus.cc:695] T 33bf1d07080f4096a5aa2b5daef743a6 P 5a67f69245d14aa395dd7410912ee2d5 [term 1 LEADER]: Becoming Leader. State: Replica: 5a67f69245d14aa395dd7410912ee2d5, State: Running, Role: LEADER
I20250625 03:32:32.956544 5884 leader_election.cc:290] T 33bf1d07080f4096a5aa2b5daef743a6 P 5a67f69245d14aa395dd7410912ee2d5 [CANDIDATE]: Term 1 election: Requested vote from peers f0e7c9f6ec2c46eda889ff8f199bc969 (127.0.106.129:44743), ac714929b11c43d482b5920a2a5b9129 (127.0.106.130:39845)
I20250625 03:32:32.964704 5870 raft_consensus.cc:357] T bd204f74bbbf45218051c05c8d3a32c1 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.965400 5870 raft_consensus.cc:383] T bd204f74bbbf45218051c05c8d3a32c1 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:32.965163 5854 consensus_queue.cc:237] T 33bf1d07080f4096a5aa2b5daef743a6 P 5a67f69245d14aa395dd7410912ee2d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.965855 5870 raft_consensus.cc:738] T bd204f74bbbf45218051c05c8d3a32c1 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac714929b11c43d482b5920a2a5b9129, State: Initialized, Role: FOLLOWER
I20250625 03:32:32.966607 5870 consensus_queue.cc:260] T bd204f74bbbf45218051c05c8d3a32c1 P ac714929b11c43d482b5920a2a5b9129 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.965876 5855 raft_consensus.cc:2747] T aaeeb3012a8c4a77a8359268c32d1abc P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 03:32:32.968871 5870 ts_tablet_manager.cc:1428] T bd204f74bbbf45218051c05c8d3a32c1 P ac714929b11c43d482b5920a2a5b9129: Time spent starting tablet: real 0.007s user 0.006s sys 0.002s
I20250625 03:32:32.971158 5869 raft_consensus.cc:357] T bd204f74bbbf45218051c05c8d3a32c1 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.971982 5869 raft_consensus.cc:383] T bd204f74bbbf45218051c05c8d3a32c1 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:32.972311 5869 raft_consensus.cc:738] T bd204f74bbbf45218051c05c8d3a32c1 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a67f69245d14aa395dd7410912ee2d5, State: Initialized, Role: FOLLOWER
I20250625 03:32:32.973049 5869 consensus_queue.cc:260] T bd204f74bbbf45218051c05c8d3a32c1 P 5a67f69245d14aa395dd7410912ee2d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.974978 5869 ts_tablet_manager.cc:1428] T bd204f74bbbf45218051c05c8d3a32c1 P 5a67f69245d14aa395dd7410912ee2d5: Time spent starting tablet: real 0.009s user 0.000s sys 0.004s
I20250625 03:32:32.975798 5869 tablet_bootstrap.cc:492] T 70076edadb434d5a8d584361780928bc P 5a67f69245d14aa395dd7410912ee2d5: Bootstrap starting.
I20250625 03:32:32.958712 5548 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "33bf1d07080f4096a5aa2b5daef743a6" candidate_uuid: "5a67f69245d14aa395dd7410912ee2d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969"
I20250625 03:32:32.976500 5548 raft_consensus.cc:3058] T 33bf1d07080f4096a5aa2b5daef743a6 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:32.977566 5868 tablet_bootstrap.cc:492] T bd204f74bbbf45218051c05c8d3a32c1 P f0e7c9f6ec2c46eda889ff8f199bc969: Bootstrap starting.
I20250625 03:32:32.983282 5869 tablet_bootstrap.cc:654] T 70076edadb434d5a8d584361780928bc P 5a67f69245d14aa395dd7410912ee2d5: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:32.994916 5869 tablet_bootstrap.cc:492] T 70076edadb434d5a8d584361780928bc P 5a67f69245d14aa395dd7410912ee2d5: No bootstrap required, opened a new log
I20250625 03:32:32.995533 5869 ts_tablet_manager.cc:1397] T 70076edadb434d5a8d584361780928bc P 5a67f69245d14aa395dd7410912ee2d5: Time spent bootstrapping tablet: real 0.020s user 0.011s sys 0.003s
I20250625 03:32:32.998201 5869 raft_consensus.cc:357] T 70076edadb434d5a8d584361780928bc P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:32.998908 5869 raft_consensus.cc:383] T 70076edadb434d5a8d584361780928bc P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:32.999342 5869 raft_consensus.cc:738] T 70076edadb434d5a8d584361780928bc P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a67f69245d14aa395dd7410912ee2d5, State: Initialized, Role: FOLLOWER
I20250625 03:32:32.998803 5445 catalog_manager.cc:5582] T 33bf1d07080f4096a5aa2b5daef743a6 P 5a67f69245d14aa395dd7410912ee2d5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a67f69245d14aa395dd7410912ee2d5 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "5a67f69245d14aa395dd7410912ee2d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } health_report { overall_health: HEALTHY } } }
I20250625 03:32:33.000140 5869 consensus_queue.cc:260] T 70076edadb434d5a8d584361780928bc P 5a67f69245d14aa395dd7410912ee2d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:33.002807 5869 ts_tablet_manager.cc:1428] T 70076edadb434d5a8d584361780928bc P 5a67f69245d14aa395dd7410912ee2d5: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20250625 03:32:33.003203 5868 tablet_bootstrap.cc:654] T bd204f74bbbf45218051c05c8d3a32c1 P f0e7c9f6ec2c46eda889ff8f199bc969: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:33.003820 5869 tablet_bootstrap.cc:492] T aaeeb3012a8c4a77a8359268c32d1abc P 5a67f69245d14aa395dd7410912ee2d5: Bootstrap starting.
I20250625 03:32:33.008522 5548 raft_consensus.cc:2466] T 33bf1d07080f4096a5aa2b5daef743a6 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a67f69245d14aa395dd7410912ee2d5 in term 1.
I20250625 03:32:33.022037 5854 consensus_queue.cc:1035] T 786290ddcf094479800ece947612d482 P 5a67f69245d14aa395dd7410912ee2d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:32:33.013428 5869 tablet_bootstrap.cc:654] T aaeeb3012a8c4a77a8359268c32d1abc P 5a67f69245d14aa395dd7410912ee2d5: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:33.040992 5869 tablet_bootstrap.cc:492] T aaeeb3012a8c4a77a8359268c32d1abc P 5a67f69245d14aa395dd7410912ee2d5: No bootstrap required, opened a new log
I20250625 03:32:33.041491 5869 ts_tablet_manager.cc:1397] T aaeeb3012a8c4a77a8359268c32d1abc P 5a67f69245d14aa395dd7410912ee2d5: Time spent bootstrapping tablet: real 0.038s user 0.011s sys 0.003s
I20250625 03:32:33.044117 5869 raft_consensus.cc:357] T aaeeb3012a8c4a77a8359268c32d1abc P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:33.044847 5869 raft_consensus.cc:383] T aaeeb3012a8c4a77a8359268c32d1abc P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:33.045123 5869 raft_consensus.cc:738] T aaeeb3012a8c4a77a8359268c32d1abc P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a67f69245d14aa395dd7410912ee2d5, State: Initialized, Role: FOLLOWER
I20250625 03:32:33.045895 5869 consensus_queue.cc:260] T aaeeb3012a8c4a77a8359268c32d1abc P 5a67f69245d14aa395dd7410912ee2d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:33.048230 5869 ts_tablet_manager.cc:1428] T aaeeb3012a8c4a77a8359268c32d1abc P 5a67f69245d14aa395dd7410912ee2d5: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20250625 03:32:33.053378 5855 consensus_queue.cc:1035] T c7d0e4d719d3491199afddf8ff1204e0 P ac714929b11c43d482b5920a2a5b9129 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:32:33.069844 5868 tablet_bootstrap.cc:492] T bd204f74bbbf45218051c05c8d3a32c1 P f0e7c9f6ec2c46eda889ff8f199bc969: No bootstrap required, opened a new log
I20250625 03:32:33.070542 5868 ts_tablet_manager.cc:1397] T bd204f74bbbf45218051c05c8d3a32c1 P f0e7c9f6ec2c46eda889ff8f199bc969: Time spent bootstrapping tablet: real 0.093s user 0.023s sys 0.006s
I20250625 03:32:33.071723 5886 consensus_queue.cc:1035] T c7d0e4d719d3491199afddf8ff1204e0 P ac714929b11c43d482b5920a2a5b9129 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:32:33.074164 5868 raft_consensus.cc:357] T bd204f74bbbf45218051c05c8d3a32c1 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:33.074954 5868 raft_consensus.cc:383] T bd204f74bbbf45218051c05c8d3a32c1 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:33.075214 5868 raft_consensus.cc:738] T bd204f74bbbf45218051c05c8d3a32c1 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0e7c9f6ec2c46eda889ff8f199bc969, State: Initialized, Role: FOLLOWER
I20250625 03:32:33.075970 5868 consensus_queue.cc:260] T bd204f74bbbf45218051c05c8d3a32c1 P f0e7c9f6ec2c46eda889ff8f199bc969 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:33.078759 5884 raft_consensus.cc:491] T bd204f74bbbf45218051c05c8d3a32c1 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:32:33.079041 5868 ts_tablet_manager.cc:1428] T bd204f74bbbf45218051c05c8d3a32c1 P f0e7c9f6ec2c46eda889ff8f199bc969: Time spent starting tablet: real 0.008s user 0.003s sys 0.003s
I20250625 03:32:33.079597 5884 raft_consensus.cc:513] T bd204f74bbbf45218051c05c8d3a32c1 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:33.081110 5868 tablet_bootstrap.cc:492] T aaeeb3012a8c4a77a8359268c32d1abc P f0e7c9f6ec2c46eda889ff8f199bc969: Bootstrap starting.
I20250625 03:32:33.083775 5623 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bd204f74bbbf45218051c05c8d3a32c1" candidate_uuid: "5a67f69245d14aa395dd7410912ee2d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac714929b11c43d482b5920a2a5b9129" is_pre_election: true
I20250625 03:32:33.084371 5884 leader_election.cc:290] T bd204f74bbbf45218051c05c8d3a32c1 P 5a67f69245d14aa395dd7410912ee2d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0e7c9f6ec2c46eda889ff8f199bc969 (127.0.106.129:44743), ac714929b11c43d482b5920a2a5b9129 (127.0.106.130:39845)
I20250625 03:32:33.084549 5623 raft_consensus.cc:2466] T bd204f74bbbf45218051c05c8d3a32c1 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a67f69245d14aa395dd7410912ee2d5 in term 0.
I20250625 03:32:33.085204 5548 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bd204f74bbbf45218051c05c8d3a32c1" candidate_uuid: "5a67f69245d14aa395dd7410912ee2d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" is_pre_election: true
I20250625 03:32:33.085897 5548 raft_consensus.cc:2466] T bd204f74bbbf45218051c05c8d3a32c1 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a67f69245d14aa395dd7410912ee2d5 in term 0.
I20250625 03:32:33.086638 5662 leader_election.cc:304] T bd204f74bbbf45218051c05c8d3a32c1 P 5a67f69245d14aa395dd7410912ee2d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a67f69245d14aa395dd7410912ee2d5, ac714929b11c43d482b5920a2a5b9129; no voters:
I20250625 03:32:33.087668 5868 tablet_bootstrap.cc:654] T aaeeb3012a8c4a77a8359268c32d1abc P f0e7c9f6ec2c46eda889ff8f199bc969: Neither blocks nor log segments found. Creating new log.
I20250625 03:32:33.088053 5884 raft_consensus.cc:2802] T bd204f74bbbf45218051c05c8d3a32c1 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:32:33.088528 5884 raft_consensus.cc:491] T bd204f74bbbf45218051c05c8d3a32c1 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:32:33.088866 5884 raft_consensus.cc:3058] T bd204f74bbbf45218051c05c8d3a32c1 P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:33.103142 5884 raft_consensus.cc:513] T bd204f74bbbf45218051c05c8d3a32c1 P 5a67f69245d14aa395dd7410912ee2d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:33.106977 5548 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bd204f74bbbf45218051c05c8d3a32c1" candidate_uuid: "5a67f69245d14aa395dd7410912ee2d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969"
I20250625 03:32:33.107666 5548 raft_consensus.cc:3058] T bd204f74bbbf45218051c05c8d3a32c1 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:33.108358 5623 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bd204f74bbbf45218051c05c8d3a32c1" candidate_uuid: "5a67f69245d14aa395dd7410912ee2d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac714929b11c43d482b5920a2a5b9129"
I20250625 03:32:33.109040 5623 raft_consensus.cc:3058] T bd204f74bbbf45218051c05c8d3a32c1 P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:33.118506 5868 tablet_bootstrap.cc:492] T aaeeb3012a8c4a77a8359268c32d1abc P f0e7c9f6ec2c46eda889ff8f199bc969: No bootstrap required, opened a new log
I20250625 03:32:33.119130 5868 ts_tablet_manager.cc:1397] T aaeeb3012a8c4a77a8359268c32d1abc P f0e7c9f6ec2c46eda889ff8f199bc969: Time spent bootstrapping tablet: real 0.038s user 0.011s sys 0.022s
I20250625 03:32:33.115808 5548 raft_consensus.cc:2466] T bd204f74bbbf45218051c05c8d3a32c1 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a67f69245d14aa395dd7410912ee2d5 in term 1.
I20250625 03:32:33.121724 5663 leader_election.cc:304] T bd204f74bbbf45218051c05c8d3a32c1 P 5a67f69245d14aa395dd7410912ee2d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a67f69245d14aa395dd7410912ee2d5, f0e7c9f6ec2c46eda889ff8f199bc969; no voters:
I20250625 03:32:33.121857 5868 raft_consensus.cc:357] T aaeeb3012a8c4a77a8359268c32d1abc P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:33.122702 5868 raft_consensus.cc:383] T aaeeb3012a8c4a77a8359268c32d1abc P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 03:32:33.122987 5868 raft_consensus.cc:738] T aaeeb3012a8c4a77a8359268c32d1abc P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0e7c9f6ec2c46eda889ff8f199bc969, State: Initialized, Role: FOLLOWER
I20250625 03:32:33.123030 5854 raft_consensus.cc:2802] T bd204f74bbbf45218051c05c8d3a32c1 P 5a67f69245d14aa395dd7410912ee2d5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:32:33.123978 5880 consensus_queue.cc:1035] T 267de6f0358a4e9f894a10a091cd8efc P 5a67f69245d14aa395dd7410912ee2d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:32:33.126034 5868 consensus_queue.cc:260] T aaeeb3012a8c4a77a8359268c32d1abc P f0e7c9f6ec2c46eda889ff8f199bc969 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:33.128631 5868 ts_tablet_manager.cc:1428] T aaeeb3012a8c4a77a8359268c32d1abc P f0e7c9f6ec2c46eda889ff8f199bc969: Time spent starting tablet: real 0.009s user 0.008s sys 0.001s
I20250625 03:32:33.133162 5623 raft_consensus.cc:2466] T bd204f74bbbf45218051c05c8d3a32c1 P ac714929b11c43d482b5920a2a5b9129 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a67f69245d14aa395dd7410912ee2d5 in term 1.
I20250625 03:32:33.136129 5884 leader_election.cc:290] T bd204f74bbbf45218051c05c8d3a32c1 P 5a67f69245d14aa395dd7410912ee2d5 [CANDIDATE]: Term 1 election: Requested vote from peers f0e7c9f6ec2c46eda889ff8f199bc969 (127.0.106.129:44743), ac714929b11c43d482b5920a2a5b9129 (127.0.106.130:39845)
I20250625 03:32:33.139359 5854 raft_consensus.cc:695] T bd204f74bbbf45218051c05c8d3a32c1 P 5a67f69245d14aa395dd7410912ee2d5 [term 1 LEADER]: Becoming Leader. State: Replica: 5a67f69245d14aa395dd7410912ee2d5, State: Running, Role: LEADER
I20250625 03:32:33.140551 5854 consensus_queue.cc:237] T bd204f74bbbf45218051c05c8d3a32c1 P 5a67f69245d14aa395dd7410912ee2d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:33.150736 5444 catalog_manager.cc:5582] T bd204f74bbbf45218051c05c8d3a32c1 P 5a67f69245d14aa395dd7410912ee2d5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a67f69245d14aa395dd7410912ee2d5 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "5a67f69245d14aa395dd7410912ee2d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } health_report { overall_health: HEALTHY } } }
I20250625 03:32:33.155611 5918 consensus_queue.cc:1035] T 267de6f0358a4e9f894a10a091cd8efc P 5a67f69245d14aa395dd7410912ee2d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:32:33.172080 5896 raft_consensus.cc:491] T 70076edadb434d5a8d584361780928bc P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:32:33.172622 5896 raft_consensus.cc:513] T 70076edadb434d5a8d584361780928bc P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:33.174714 5896 leader_election.cc:290] T 70076edadb434d5a8d584361780928bc P f0e7c9f6ec2c46eda889ff8f199bc969 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac714929b11c43d482b5920a2a5b9129 (127.0.106.130:39845), 5a67f69245d14aa395dd7410912ee2d5 (127.0.106.131:38277)
I20250625 03:32:33.176203 5696 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "70076edadb434d5a8d584361780928bc" candidate_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a67f69245d14aa395dd7410912ee2d5" is_pre_election: true
I20250625 03:32:33.176985 5696 raft_consensus.cc:2466] T 70076edadb434d5a8d584361780928bc P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0e7c9f6ec2c46eda889ff8f199bc969 in term 0.
I20250625 03:32:33.176200 5622 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "70076edadb434d5a8d584361780928bc" candidate_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac714929b11c43d482b5920a2a5b9129" is_pre_election: true
I20250625 03:32:33.177767 5622 raft_consensus.cc:2466] T 70076edadb434d5a8d584361780928bc P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0e7c9f6ec2c46eda889ff8f199bc969 in term 0.
I20250625 03:32:33.178488 5512 leader_election.cc:304] T 70076edadb434d5a8d584361780928bc P f0e7c9f6ec2c46eda889ff8f199bc969 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a67f69245d14aa395dd7410912ee2d5, f0e7c9f6ec2c46eda889ff8f199bc969; no voters:
I20250625 03:32:33.180173 5896 raft_consensus.cc:2802] T 70076edadb434d5a8d584361780928bc P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:32:33.180593 5896 raft_consensus.cc:491] T 70076edadb434d5a8d584361780928bc P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:32:33.180941 5896 raft_consensus.cc:3058] T 70076edadb434d5a8d584361780928bc P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:33.190171 5896 raft_consensus.cc:513] T 70076edadb434d5a8d584361780928bc P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:33.193197 5896 leader_election.cc:290] T 70076edadb434d5a8d584361780928bc P f0e7c9f6ec2c46eda889ff8f199bc969 [CANDIDATE]: Term 1 election: Requested vote from peers ac714929b11c43d482b5920a2a5b9129 (127.0.106.130:39845), 5a67f69245d14aa395dd7410912ee2d5 (127.0.106.131:38277)
I20250625 03:32:33.193835 5696 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "70076edadb434d5a8d584361780928bc" candidate_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a67f69245d14aa395dd7410912ee2d5"
I20250625 03:32:33.194233 5622 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "70076edadb434d5a8d584361780928bc" candidate_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac714929b11c43d482b5920a2a5b9129"
I20250625 03:32:33.194633 5696 raft_consensus.cc:3058] T 70076edadb434d5a8d584361780928bc P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:33.194888 5622 raft_consensus.cc:3058] T 70076edadb434d5a8d584361780928bc P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:33.201735 5696 raft_consensus.cc:2466] T 70076edadb434d5a8d584361780928bc P 5a67f69245d14aa395dd7410912ee2d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0e7c9f6ec2c46eda889ff8f199bc969 in term 1.
I20250625 03:32:33.202704 5622 raft_consensus.cc:2466] T 70076edadb434d5a8d584361780928bc P ac714929b11c43d482b5920a2a5b9129 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0e7c9f6ec2c46eda889ff8f199bc969 in term 1.
I20250625 03:32:33.202733 5512 leader_election.cc:304] T 70076edadb434d5a8d584361780928bc P f0e7c9f6ec2c46eda889ff8f199bc969 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a67f69245d14aa395dd7410912ee2d5, f0e7c9f6ec2c46eda889ff8f199bc969; no voters:
I20250625 03:32:33.203787 5896 raft_consensus.cc:2802] T 70076edadb434d5a8d584361780928bc P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:32:33.204309 5896 raft_consensus.cc:695] T 70076edadb434d5a8d584361780928bc P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 LEADER]: Becoming Leader. State: Replica: f0e7c9f6ec2c46eda889ff8f199bc969, State: Running, Role: LEADER
I20250625 03:32:33.205185 5896 consensus_queue.cc:237] T 70076edadb434d5a8d584361780928bc P f0e7c9f6ec2c46eda889ff8f199bc969 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:33.214224 5443 catalog_manager.cc:5582] T 70076edadb434d5a8d584361780928bc P f0e7c9f6ec2c46eda889ff8f199bc969 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0e7c9f6ec2c46eda889ff8f199bc969 (127.0.106.129). New cstate: current_term: 1 leader_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } health_report { overall_health: UNKNOWN } } }
I20250625 03:32:33.220481 5854 raft_consensus.cc:491] T aaeeb3012a8c4a77a8359268c32d1abc P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 03:32:33.221060 5854 raft_consensus.cc:513] T aaeeb3012a8c4a77a8359268c32d1abc P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:33.223114 5854 leader_election.cc:290] T aaeeb3012a8c4a77a8359268c32d1abc P 5a67f69245d14aa395dd7410912ee2d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0e7c9f6ec2c46eda889ff8f199bc969 (127.0.106.129:44743), ac714929b11c43d482b5920a2a5b9129 (127.0.106.130:39845)
I20250625 03:32:33.224119 5547 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "aaeeb3012a8c4a77a8359268c32d1abc" candidate_uuid: "5a67f69245d14aa395dd7410912ee2d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" is_pre_election: true
I20250625 03:32:33.224885 5547 raft_consensus.cc:2466] T aaeeb3012a8c4a77a8359268c32d1abc P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a67f69245d14aa395dd7410912ee2d5 in term 0.
I20250625 03:32:33.224874 5622 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "aaeeb3012a8c4a77a8359268c32d1abc" candidate_uuid: "5a67f69245d14aa395dd7410912ee2d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac714929b11c43d482b5920a2a5b9129" is_pre_election: true
I20250625 03:32:33.225724 5622 raft_consensus.cc:2466] T aaeeb3012a8c4a77a8359268c32d1abc P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a67f69245d14aa395dd7410912ee2d5 in term 0.
I20250625 03:32:33.226020 5663 leader_election.cc:304] T aaeeb3012a8c4a77a8359268c32d1abc P 5a67f69245d14aa395dd7410912ee2d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a67f69245d14aa395dd7410912ee2d5, f0e7c9f6ec2c46eda889ff8f199bc969; no voters:
I20250625 03:32:33.226810 5854 raft_consensus.cc:2802] T aaeeb3012a8c4a77a8359268c32d1abc P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 03:32:33.227104 5854 raft_consensus.cc:491] T aaeeb3012a8c4a77a8359268c32d1abc P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 03:32:33.227358 5854 raft_consensus.cc:3058] T aaeeb3012a8c4a77a8359268c32d1abc P 5a67f69245d14aa395dd7410912ee2d5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:33.233163 5854 raft_consensus.cc:513] T aaeeb3012a8c4a77a8359268c32d1abc P 5a67f69245d14aa395dd7410912ee2d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:33.234979 5854 leader_election.cc:290] T aaeeb3012a8c4a77a8359268c32d1abc P 5a67f69245d14aa395dd7410912ee2d5 [CANDIDATE]: Term 1 election: Requested vote from peers f0e7c9f6ec2c46eda889ff8f199bc969 (127.0.106.129:44743), ac714929b11c43d482b5920a2a5b9129 (127.0.106.130:39845)
I20250625 03:32:33.235713 5547 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "aaeeb3012a8c4a77a8359268c32d1abc" candidate_uuid: "5a67f69245d14aa395dd7410912ee2d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969"
I20250625 03:32:33.236372 5547 raft_consensus.cc:3058] T aaeeb3012a8c4a77a8359268c32d1abc P f0e7c9f6ec2c46eda889ff8f199bc969 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:33.236546 5622 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "aaeeb3012a8c4a77a8359268c32d1abc" candidate_uuid: "5a67f69245d14aa395dd7410912ee2d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac714929b11c43d482b5920a2a5b9129"
I20250625 03:32:33.237188 5622 raft_consensus.cc:3058] T aaeeb3012a8c4a77a8359268c32d1abc P ac714929b11c43d482b5920a2a5b9129 [term 0 FOLLOWER]: Advancing to term 1
I20250625 03:32:33.241556 5547 raft_consensus.cc:2466] T aaeeb3012a8c4a77a8359268c32d1abc P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a67f69245d14aa395dd7410912ee2d5 in term 1.
I20250625 03:32:33.242638 5663 leader_election.cc:304] T aaeeb3012a8c4a77a8359268c32d1abc P 5a67f69245d14aa395dd7410912ee2d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a67f69245d14aa395dd7410912ee2d5, f0e7c9f6ec2c46eda889ff8f199bc969; no voters:
I20250625 03:32:33.243302 5854 raft_consensus.cc:2802] T aaeeb3012a8c4a77a8359268c32d1abc P 5a67f69245d14aa395dd7410912ee2d5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 03:32:33.243705 5854 raft_consensus.cc:695] T aaeeb3012a8c4a77a8359268c32d1abc P 5a67f69245d14aa395dd7410912ee2d5 [term 1 LEADER]: Becoming Leader. State: Replica: 5a67f69245d14aa395dd7410912ee2d5, State: Running, Role: LEADER
I20250625 03:32:33.244560 5854 consensus_queue.cc:237] T aaeeb3012a8c4a77a8359268c32d1abc P 5a67f69245d14aa395dd7410912ee2d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:33.244709 5622 raft_consensus.cc:2466] T aaeeb3012a8c4a77a8359268c32d1abc P ac714929b11c43d482b5920a2a5b9129 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a67f69245d14aa395dd7410912ee2d5 in term 1.
I20250625 03:32:33.253978 5443 catalog_manager.cc:5582] T aaeeb3012a8c4a77a8359268c32d1abc P 5a67f69245d14aa395dd7410912ee2d5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a67f69245d14aa395dd7410912ee2d5 (127.0.106.131). New cstate: current_term: 1 leader_uuid: "5a67f69245d14aa395dd7410912ee2d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } health_report { overall_health: HEALTHY } } }
I20250625 03:32:33.271473 5855 consensus_queue.cc:1035] T bbf810309eb949ff880839714444d55f P ac714929b11c43d482b5920a2a5b9129 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:32:33.273712 5696 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "267de6f0358a4e9f894a10a091cd8efc"
dest_uuid: "5a67f69245d14aa395dd7410912ee2d5"
mode: GRACEFUL
new_leader_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969"
from {username='slave'} at 127.0.0.1:52270
I20250625 03:32:33.274263 5696 raft_consensus.cc:604] T 267de6f0358a4e9f894a10a091cd8efc P 5a67f69245d14aa395dd7410912ee2d5 [term 1 LEADER]: Received request to transfer leadership to TS f0e7c9f6ec2c46eda889ff8f199bc969
I20250625 03:32:33.280179 5696 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "786290ddcf094479800ece947612d482"
dest_uuid: "5a67f69245d14aa395dd7410912ee2d5"
mode: GRACEFUL
new_leader_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969"
from {username='slave'} at 127.0.0.1:52270
I20250625 03:32:33.280674 5696 raft_consensus.cc:604] T 786290ddcf094479800ece947612d482 P 5a67f69245d14aa395dd7410912ee2d5 [term 1 LEADER]: Received request to transfer leadership to TS f0e7c9f6ec2c46eda889ff8f199bc969
I20250625 03:32:33.290390 5886 consensus_queue.cc:1035] T bbf810309eb949ff880839714444d55f P ac714929b11c43d482b5920a2a5b9129 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:32:33.293748 5622 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "c7d0e4d719d3491199afddf8ff1204e0"
dest_uuid: "ac714929b11c43d482b5920a2a5b9129"
mode: GRACEFUL
new_leader_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969"
from {username='slave'} at 127.0.0.1:51104
I20250625 03:32:33.294384 5622 raft_consensus.cc:604] T c7d0e4d719d3491199afddf8ff1204e0 P ac714929b11c43d482b5920a2a5b9129 [term 1 LEADER]: Received request to transfer leadership to TS f0e7c9f6ec2c46eda889ff8f199bc969
I20250625 03:32:33.306300 5896 consensus_queue.cc:1035] T 6026baaaf75a465aab3b95d3ada761c2 P f0e7c9f6ec2c46eda889ff8f199bc969 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:32:33.317680 5547 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "70076edadb434d5a8d584361780928bc"
dest_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969"
mode: GRACEFUL
new_leader_uuid: "ac714929b11c43d482b5920a2a5b9129"
from {username='slave'} at 127.0.0.1:48224
I20250625 03:32:33.318336 5547 raft_consensus.cc:604] T 70076edadb434d5a8d584361780928bc P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 LEADER]: Received request to transfer leadership to TS ac714929b11c43d482b5920a2a5b9129
I20250625 03:32:33.324771 5896 consensus_queue.cc:1035] T 6026baaaf75a465aab3b95d3ada761c2 P f0e7c9f6ec2c46eda889ff8f199bc969 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:32:33.325163 5697 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "33bf1d07080f4096a5aa2b5daef743a6"
dest_uuid: "5a67f69245d14aa395dd7410912ee2d5"
mode: GRACEFUL
new_leader_uuid: "ac714929b11c43d482b5920a2a5b9129"
from {username='slave'} at 127.0.0.1:52270
I20250625 03:32:33.325889 5697 raft_consensus.cc:604] T 33bf1d07080f4096a5aa2b5daef743a6 P 5a67f69245d14aa395dd7410912ee2d5 [term 1 LEADER]: Received request to transfer leadership to TS ac714929b11c43d482b5920a2a5b9129
I20250625 03:32:33.334328 5697 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "aaeeb3012a8c4a77a8359268c32d1abc"
dest_uuid: "5a67f69245d14aa395dd7410912ee2d5"
mode: GRACEFUL
new_leader_uuid: "ac714929b11c43d482b5920a2a5b9129"
from {username='slave'} at 127.0.0.1:52270
I20250625 03:32:33.334968 5697 raft_consensus.cc:604] T aaeeb3012a8c4a77a8359268c32d1abc P 5a67f69245d14aa395dd7410912ee2d5 [term 1 LEADER]: Received request to transfer leadership to TS ac714929b11c43d482b5920a2a5b9129
I20250625 03:32:33.420678 5854 consensus_queue.cc:1035] T 33bf1d07080f4096a5aa2b5daef743a6 P 5a67f69245d14aa395dd7410912ee2d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:32:33.430519 5854 consensus_queue.cc:1035] T 33bf1d07080f4096a5aa2b5daef743a6 P 5a67f69245d14aa395dd7410912ee2d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:32:33.437984 5854 raft_consensus.cc:991] T 33bf1d07080f4096a5aa2b5daef743a6 P 5a67f69245d14aa395dd7410912ee2d5: : Instructing follower ac714929b11c43d482b5920a2a5b9129 to start an election
I20250625 03:32:33.438611 5918 raft_consensus.cc:1079] T 33bf1d07080f4096a5aa2b5daef743a6 P 5a67f69245d14aa395dd7410912ee2d5 [term 1 LEADER]: Signalling peer ac714929b11c43d482b5920a2a5b9129 to start an election
I20250625 03:32:33.440213 5622 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "33bf1d07080f4096a5aa2b5daef743a6"
dest_uuid: "ac714929b11c43d482b5920a2a5b9129"
from {username='slave'} at 127.0.0.1:51096
I20250625 03:32:33.440745 5622 raft_consensus.cc:491] T 33bf1d07080f4096a5aa2b5daef743a6 P ac714929b11c43d482b5920a2a5b9129 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:32:33.441072 5622 raft_consensus.cc:3058] T 33bf1d07080f4096a5aa2b5daef743a6 P ac714929b11c43d482b5920a2a5b9129 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:33.442540 5918 raft_consensus.cc:991] T 786290ddcf094479800ece947612d482 P 5a67f69245d14aa395dd7410912ee2d5: : Instructing follower f0e7c9f6ec2c46eda889ff8f199bc969 to start an election
I20250625 03:32:33.443063 5884 raft_consensus.cc:1079] T 786290ddcf094479800ece947612d482 P 5a67f69245d14aa395dd7410912ee2d5 [term 1 LEADER]: Signalling peer f0e7c9f6ec2c46eda889ff8f199bc969 to start an election
I20250625 03:32:33.444875 5547 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "786290ddcf094479800ece947612d482"
dest_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969"
from {username='slave'} at 127.0.0.1:48214
I20250625 03:32:33.445429 5547 raft_consensus.cc:491] T 786290ddcf094479800ece947612d482 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:32:33.445735 5547 raft_consensus.cc:3058] T 786290ddcf094479800ece947612d482 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:33.447891 5622 raft_consensus.cc:513] T 33bf1d07080f4096a5aa2b5daef743a6 P ac714929b11c43d482b5920a2a5b9129 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:33.449498 5622 leader_election.cc:290] T 33bf1d07080f4096a5aa2b5daef743a6 P ac714929b11c43d482b5920a2a5b9129 [CANDIDATE]: Term 2 election: Requested vote from peers f0e7c9f6ec2c46eda889ff8f199bc969 (127.0.106.129:44743), 5a67f69245d14aa395dd7410912ee2d5 (127.0.106.131:38277)
I20250625 03:32:33.450446 5546 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "33bf1d07080f4096a5aa2b5daef743a6" candidate_uuid: "ac714929b11c43d482b5920a2a5b9129" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969"
I20250625 03:32:33.451136 5546 raft_consensus.cc:3058] T 33bf1d07080f4096a5aa2b5daef743a6 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:33.452584 5697 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "33bf1d07080f4096a5aa2b5daef743a6" candidate_uuid: "ac714929b11c43d482b5920a2a5b9129" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5a67f69245d14aa395dd7410912ee2d5"
I20250625 03:32:33.452502 5547 raft_consensus.cc:513] T 786290ddcf094479800ece947612d482 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:33.453378 5697 raft_consensus.cc:3053] T 33bf1d07080f4096a5aa2b5daef743a6 P 5a67f69245d14aa395dd7410912ee2d5 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:32:33.453750 5697 raft_consensus.cc:738] T 33bf1d07080f4096a5aa2b5daef743a6 P 5a67f69245d14aa395dd7410912ee2d5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a67f69245d14aa395dd7410912ee2d5, State: Running, Role: LEADER
I20250625 03:32:33.454806 5547 leader_election.cc:290] T 786290ddcf094479800ece947612d482 P f0e7c9f6ec2c46eda889ff8f199bc969 [CANDIDATE]: Term 2 election: Requested vote from peers ac714929b11c43d482b5920a2a5b9129 (127.0.106.130:39845), 5a67f69245d14aa395dd7410912ee2d5 (127.0.106.131:38277)
I20250625 03:32:33.454563 5697 consensus_queue.cc:260] T 33bf1d07080f4096a5aa2b5daef743a6 P 5a67f69245d14aa395dd7410912ee2d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:33.455962 5696 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "786290ddcf094479800ece947612d482" candidate_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5a67f69245d14aa395dd7410912ee2d5"
I20250625 03:32:33.456604 5696 raft_consensus.cc:3053] T 786290ddcf094479800ece947612d482 P 5a67f69245d14aa395dd7410912ee2d5 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:32:33.455940 5697 raft_consensus.cc:3058] T 33bf1d07080f4096a5aa2b5daef743a6 P 5a67f69245d14aa395dd7410912ee2d5 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:33.456952 5696 raft_consensus.cc:738] T 786290ddcf094479800ece947612d482 P 5a67f69245d14aa395dd7410912ee2d5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a67f69245d14aa395dd7410912ee2d5, State: Running, Role: LEADER
I20250625 03:32:33.457120 5622 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "786290ddcf094479800ece947612d482" candidate_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ac714929b11c43d482b5920a2a5b9129"
I20250625 03:32:33.457832 5622 raft_consensus.cc:3058] T 786290ddcf094479800ece947612d482 P ac714929b11c43d482b5920a2a5b9129 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:33.458066 5546 raft_consensus.cc:2466] T 33bf1d07080f4096a5aa2b5daef743a6 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac714929b11c43d482b5920a2a5b9129 in term 2.
I20250625 03:32:33.457765 5696 consensus_queue.cc:260] T 786290ddcf094479800ece947612d482 P 5a67f69245d14aa395dd7410912ee2d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:33.459089 5696 raft_consensus.cc:3058] T 786290ddcf094479800ece947612d482 P 5a67f69245d14aa395dd7410912ee2d5 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:33.462965 5697 raft_consensus.cc:2466] T 33bf1d07080f4096a5aa2b5daef743a6 P 5a67f69245d14aa395dd7410912ee2d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac714929b11c43d482b5920a2a5b9129 in term 2.
I20250625 03:32:33.464192 5589 leader_election.cc:304] T 33bf1d07080f4096a5aa2b5daef743a6 P ac714929b11c43d482b5920a2a5b9129 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac714929b11c43d482b5920a2a5b9129, f0e7c9f6ec2c46eda889ff8f199bc969; no voters:
I20250625 03:32:33.465353 5886 raft_consensus.cc:2802] T 33bf1d07080f4096a5aa2b5daef743a6 P ac714929b11c43d482b5920a2a5b9129 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:32:33.465866 5886 raft_consensus.cc:695] T 33bf1d07080f4096a5aa2b5daef743a6 P ac714929b11c43d482b5920a2a5b9129 [term 2 LEADER]: Becoming Leader. State: Replica: ac714929b11c43d482b5920a2a5b9129, State: Running, Role: LEADER
I20250625 03:32:33.465917 5622 raft_consensus.cc:2466] T 786290ddcf094479800ece947612d482 P ac714929b11c43d482b5920a2a5b9129 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0e7c9f6ec2c46eda889ff8f199bc969 in term 2.
I20250625 03:32:33.466384 5696 raft_consensus.cc:2466] T 786290ddcf094479800ece947612d482 P 5a67f69245d14aa395dd7410912ee2d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0e7c9f6ec2c46eda889ff8f199bc969 in term 2.
I20250625 03:32:33.466703 5886 consensus_queue.cc:237] T 33bf1d07080f4096a5aa2b5daef743a6 P ac714929b11c43d482b5920a2a5b9129 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:33.467337 5513 leader_election.cc:304] T 786290ddcf094479800ece947612d482 P f0e7c9f6ec2c46eda889ff8f199bc969 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac714929b11c43d482b5920a2a5b9129, f0e7c9f6ec2c46eda889ff8f199bc969; no voters:
I20250625 03:32:33.468220 5857 raft_consensus.cc:2802] T 786290ddcf094479800ece947612d482 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:32:33.468665 5857 raft_consensus.cc:695] T 786290ddcf094479800ece947612d482 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 2 LEADER]: Becoming Leader. State: Replica: f0e7c9f6ec2c46eda889ff8f199bc969, State: Running, Role: LEADER
I20250625 03:32:33.469516 5857 consensus_queue.cc:237] T 786290ddcf094479800ece947612d482 P f0e7c9f6ec2c46eda889ff8f199bc969 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:33.477273 5445 catalog_manager.cc:5582] T 33bf1d07080f4096a5aa2b5daef743a6 P ac714929b11c43d482b5920a2a5b9129 reported cstate change: term changed from 1 to 2, leader changed from 5a67f69245d14aa395dd7410912ee2d5 (127.0.106.131) to ac714929b11c43d482b5920a2a5b9129 (127.0.106.130). New cstate: current_term: 2 leader_uuid: "ac714929b11c43d482b5920a2a5b9129" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } health_report { overall_health: UNKNOWN } } }
I20250625 03:32:33.478814 5443 catalog_manager.cc:5582] T 786290ddcf094479800ece947612d482 P f0e7c9f6ec2c46eda889ff8f199bc969 reported cstate change: term changed from 1 to 2, leader changed from 5a67f69245d14aa395dd7410912ee2d5 (127.0.106.131) to f0e7c9f6ec2c46eda889ff8f199bc969 (127.0.106.129). New cstate: current_term: 2 leader_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } health_report { overall_health: UNKNOWN } } }
I20250625 03:32:33.549136 5884 consensus_queue.cc:1035] T bd204f74bbbf45218051c05c8d3a32c1 P 5a67f69245d14aa395dd7410912ee2d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:32:33.561129 5884 consensus_queue.cc:1035] T bd204f74bbbf45218051c05c8d3a32c1 P 5a67f69245d14aa395dd7410912ee2d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:32:33.627434 5918 raft_consensus.cc:991] T 267de6f0358a4e9f894a10a091cd8efc P 5a67f69245d14aa395dd7410912ee2d5: : Instructing follower f0e7c9f6ec2c46eda889ff8f199bc969 to start an election
I20250625 03:32:33.627848 5918 raft_consensus.cc:1079] T 267de6f0358a4e9f894a10a091cd8efc P 5a67f69245d14aa395dd7410912ee2d5 [term 1 LEADER]: Signalling peer f0e7c9f6ec2c46eda889ff8f199bc969 to start an election
I20250625 03:32:33.629248 5546 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "267de6f0358a4e9f894a10a091cd8efc"
dest_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969"
from {username='slave'} at 127.0.0.1:48214
I20250625 03:32:33.629772 5546 raft_consensus.cc:491] T 267de6f0358a4e9f894a10a091cd8efc P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:32:33.630062 5546 raft_consensus.cc:3058] T 267de6f0358a4e9f894a10a091cd8efc P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:33.635195 5546 raft_consensus.cc:513] T 267de6f0358a4e9f894a10a091cd8efc P f0e7c9f6ec2c46eda889ff8f199bc969 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:33.636912 5546 leader_election.cc:290] T 267de6f0358a4e9f894a10a091cd8efc P f0e7c9f6ec2c46eda889ff8f199bc969 [CANDIDATE]: Term 2 election: Requested vote from peers ac714929b11c43d482b5920a2a5b9129 (127.0.106.130:39845), 5a67f69245d14aa395dd7410912ee2d5 (127.0.106.131:38277)
I20250625 03:32:33.637706 5622 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "267de6f0358a4e9f894a10a091cd8efc" candidate_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ac714929b11c43d482b5920a2a5b9129"
I20250625 03:32:33.637946 5696 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "267de6f0358a4e9f894a10a091cd8efc" candidate_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5a67f69245d14aa395dd7410912ee2d5"
I20250625 03:32:33.638339 5622 raft_consensus.cc:3058] T 267de6f0358a4e9f894a10a091cd8efc P ac714929b11c43d482b5920a2a5b9129 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:33.638480 5696 raft_consensus.cc:3053] T 267de6f0358a4e9f894a10a091cd8efc P 5a67f69245d14aa395dd7410912ee2d5 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:32:33.638830 5696 raft_consensus.cc:738] T 267de6f0358a4e9f894a10a091cd8efc P 5a67f69245d14aa395dd7410912ee2d5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a67f69245d14aa395dd7410912ee2d5, State: Running, Role: LEADER
I20250625 03:32:33.639537 5696 consensus_queue.cc:260] T 267de6f0358a4e9f894a10a091cd8efc P 5a67f69245d14aa395dd7410912ee2d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:33.640736 5696 raft_consensus.cc:3058] T 267de6f0358a4e9f894a10a091cd8efc P 5a67f69245d14aa395dd7410912ee2d5 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:33.645304 5622 raft_consensus.cc:2466] T 267de6f0358a4e9f894a10a091cd8efc P ac714929b11c43d482b5920a2a5b9129 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0e7c9f6ec2c46eda889ff8f199bc969 in term 2.
I20250625 03:32:33.646584 5513 leader_election.cc:304] T 267de6f0358a4e9f894a10a091cd8efc P f0e7c9f6ec2c46eda889ff8f199bc969 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac714929b11c43d482b5920a2a5b9129, f0e7c9f6ec2c46eda889ff8f199bc969; no voters:
I20250625 03:32:33.647379 5857 raft_consensus.cc:2802] T 267de6f0358a4e9f894a10a091cd8efc P f0e7c9f6ec2c46eda889ff8f199bc969 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:32:33.647750 5696 raft_consensus.cc:2466] T 267de6f0358a4e9f894a10a091cd8efc P 5a67f69245d14aa395dd7410912ee2d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0e7c9f6ec2c46eda889ff8f199bc969 in term 2.
I20250625 03:32:33.647938 5857 raft_consensus.cc:695] T 267de6f0358a4e9f894a10a091cd8efc P f0e7c9f6ec2c46eda889ff8f199bc969 [term 2 LEADER]: Becoming Leader. State: Replica: f0e7c9f6ec2c46eda889ff8f199bc969, State: Running, Role: LEADER
I20250625 03:32:33.647794 5927 consensus_queue.cc:1035] T 70076edadb434d5a8d584361780928bc P f0e7c9f6ec2c46eda889ff8f199bc969 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:32:33.649020 5857 consensus_queue.cc:237] T 267de6f0358a4e9f894a10a091cd8efc P f0e7c9f6ec2c46eda889ff8f199bc969 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:33.655278 5927 raft_consensus.cc:991] T 70076edadb434d5a8d584361780928bc P f0e7c9f6ec2c46eda889ff8f199bc969: : Instructing follower ac714929b11c43d482b5920a2a5b9129 to start an election
I20250625 03:32:33.655725 5927 raft_consensus.cc:1079] T 70076edadb434d5a8d584361780928bc P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 LEADER]: Signalling peer ac714929b11c43d482b5920a2a5b9129 to start an election
I20250625 03:32:33.657225 5622 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "70076edadb434d5a8d584361780928bc"
dest_uuid: "ac714929b11c43d482b5920a2a5b9129"
from {username='slave'} at 127.0.0.1:51094
I20250625 03:32:33.657763 5622 raft_consensus.cc:491] T 70076edadb434d5a8d584361780928bc P ac714929b11c43d482b5920a2a5b9129 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:32:33.658124 5622 raft_consensus.cc:3058] T 70076edadb434d5a8d584361780928bc P ac714929b11c43d482b5920a2a5b9129 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:33.658982 5443 catalog_manager.cc:5582] T 267de6f0358a4e9f894a10a091cd8efc P f0e7c9f6ec2c46eda889ff8f199bc969 reported cstate change: term changed from 1 to 2, leader changed from 5a67f69245d14aa395dd7410912ee2d5 (127.0.106.131) to f0e7c9f6ec2c46eda889ff8f199bc969 (127.0.106.129). New cstate: current_term: 2 leader_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } health_report { overall_health: UNKNOWN } } }
I20250625 03:32:33.662318 5886 raft_consensus.cc:991] T c7d0e4d719d3491199afddf8ff1204e0 P ac714929b11c43d482b5920a2a5b9129: : Instructing follower f0e7c9f6ec2c46eda889ff8f199bc969 to start an election
I20250625 03:32:33.662861 5886 raft_consensus.cc:1079] T c7d0e4d719d3491199afddf8ff1204e0 P ac714929b11c43d482b5920a2a5b9129 [term 1 LEADER]: Signalling peer f0e7c9f6ec2c46eda889ff8f199bc969 to start an election
I20250625 03:32:33.664549 5547 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "c7d0e4d719d3491199afddf8ff1204e0"
dest_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969"
from {username='slave'} at 127.0.0.1:48220
I20250625 03:32:33.665091 5547 raft_consensus.cc:491] T c7d0e4d719d3491199afddf8ff1204e0 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:32:33.665460 5547 raft_consensus.cc:3058] T c7d0e4d719d3491199afddf8ff1204e0 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:33.665309 5622 raft_consensus.cc:513] T 70076edadb434d5a8d584361780928bc P ac714929b11c43d482b5920a2a5b9129 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:33.666352 5623 raft_consensus.cc:1238] T 70076edadb434d5a8d584361780928bc P ac714929b11c43d482b5920a2a5b9129 [term 2 FOLLOWER]: Rejecting Update request from peer f0e7c9f6ec2c46eda889ff8f199bc969 for earlier term 1. Current term is 2. Ops: []
I20250625 03:32:33.667287 5622 leader_election.cc:290] T 70076edadb434d5a8d584361780928bc P ac714929b11c43d482b5920a2a5b9129 [CANDIDATE]: Term 2 election: Requested vote from peers f0e7c9f6ec2c46eda889ff8f199bc969 (127.0.106.129:44743), 5a67f69245d14aa395dd7410912ee2d5 (127.0.106.131:38277)
I20250625 03:32:33.669226 5548 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "70076edadb434d5a8d584361780928bc" candidate_uuid: "ac714929b11c43d482b5920a2a5b9129" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969"
I20250625 03:32:33.669818 5548 raft_consensus.cc:3053] T 70076edadb434d5a8d584361780928bc P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:32:33.670125 5548 raft_consensus.cc:738] T 70076edadb434d5a8d584361780928bc P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f0e7c9f6ec2c46eda889ff8f199bc969, State: Running, Role: LEADER
I20250625 03:32:33.670243 5896 consensus_queue.cc:1046] T 70076edadb434d5a8d584361780928bc P f0e7c9f6ec2c46eda889ff8f199bc969 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:32:33.671123 5697 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "70076edadb434d5a8d584361780928bc" candidate_uuid: "ac714929b11c43d482b5920a2a5b9129" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5a67f69245d14aa395dd7410912ee2d5"
I20250625 03:32:33.671680 5697 raft_consensus.cc:3058] T 70076edadb434d5a8d584361780928bc P 5a67f69245d14aa395dd7410912ee2d5 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:33.677284 5547 raft_consensus.cc:513] T c7d0e4d719d3491199afddf8ff1204e0 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:33.678540 5697 raft_consensus.cc:2466] T 70076edadb434d5a8d584361780928bc P 5a67f69245d14aa395dd7410912ee2d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac714929b11c43d482b5920a2a5b9129 in term 2.
I20250625 03:32:33.679042 5927 consensus_queue.cc:1035] T 70076edadb434d5a8d584361780928bc P f0e7c9f6ec2c46eda889ff8f199bc969 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 03:32:33.680577 5587 leader_election.cc:304] T 70076edadb434d5a8d584361780928bc P ac714929b11c43d482b5920a2a5b9129 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a67f69245d14aa395dd7410912ee2d5, ac714929b11c43d482b5920a2a5b9129; no voters:
I20250625 03:32:33.680987 5623 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c7d0e4d719d3491199afddf8ff1204e0" candidate_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ac714929b11c43d482b5920a2a5b9129"
I20250625 03:32:33.681174 5547 leader_election.cc:290] T c7d0e4d719d3491199afddf8ff1204e0 P f0e7c9f6ec2c46eda889ff8f199bc969 [CANDIDATE]: Term 2 election: Requested vote from peers ac714929b11c43d482b5920a2a5b9129 (127.0.106.130:39845), 5a67f69245d14aa395dd7410912ee2d5 (127.0.106.131:38277)
I20250625 03:32:33.681551 5855 raft_consensus.cc:2802] T 70076edadb434d5a8d584361780928bc P ac714929b11c43d482b5920a2a5b9129 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:32:33.681691 5623 raft_consensus.cc:3053] T c7d0e4d719d3491199afddf8ff1204e0 P ac714929b11c43d482b5920a2a5b9129 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:32:33.682216 5855 raft_consensus.cc:695] T 70076edadb434d5a8d584361780928bc P ac714929b11c43d482b5920a2a5b9129 [term 2 LEADER]: Becoming Leader. State: Replica: ac714929b11c43d482b5920a2a5b9129, State: Running, Role: LEADER
I20250625 03:32:33.682279 5623 raft_consensus.cc:738] T c7d0e4d719d3491199afddf8ff1204e0 P ac714929b11c43d482b5920a2a5b9129 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ac714929b11c43d482b5920a2a5b9129, State: Running, Role: LEADER
I20250625 03:32:33.683172 5855 consensus_queue.cc:237] T 70076edadb434d5a8d584361780928bc P ac714929b11c43d482b5920a2a5b9129 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:33.683233 5623 consensus_queue.cc:260] T c7d0e4d719d3491199afddf8ff1204e0 P ac714929b11c43d482b5920a2a5b9129 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:33.686177 5697 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c7d0e4d719d3491199afddf8ff1204e0" candidate_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5a67f69245d14aa395dd7410912ee2d5"
I20250625 03:32:33.686825 5697 raft_consensus.cc:3058] T c7d0e4d719d3491199afddf8ff1204e0 P 5a67f69245d14aa395dd7410912ee2d5 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:33.686892 5696 raft_consensus.cc:1238] T 70076edadb434d5a8d584361780928bc P 5a67f69245d14aa395dd7410912ee2d5 [term 2 FOLLOWER]: Rejecting Update request from peer f0e7c9f6ec2c46eda889ff8f199bc969 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20250625 03:32:33.683400 5548 consensus_queue.cc:260] T 70076edadb434d5a8d584361780928bc P f0e7c9f6ec2c46eda889ff8f199bc969 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:33.688755 5548 raft_consensus.cc:3058] T 70076edadb434d5a8d584361780928bc P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:33.686331 5623 raft_consensus.cc:3058] T c7d0e4d719d3491199afddf8ff1204e0 P ac714929b11c43d482b5920a2a5b9129 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:33.694037 5548 raft_consensus.cc:2466] T 70076edadb434d5a8d584361780928bc P f0e7c9f6ec2c46eda889ff8f199bc969 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac714929b11c43d482b5920a2a5b9129 in term 2.
W20250625 03:32:33.694471 5896 raft_consensus.cc:934] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20250625 03:32:33.696466 5623 raft_consensus.cc:2466] T c7d0e4d719d3491199afddf8ff1204e0 P ac714929b11c43d482b5920a2a5b9129 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0e7c9f6ec2c46eda889ff8f199bc969 in term 2.
I20250625 03:32:33.697700 5513 leader_election.cc:304] T c7d0e4d719d3491199afddf8ff1204e0 P f0e7c9f6ec2c46eda889ff8f199bc969 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac714929b11c43d482b5920a2a5b9129, f0e7c9f6ec2c46eda889ff8f199bc969; no voters:
I20250625 03:32:33.698176 5697 raft_consensus.cc:2466] T c7d0e4d719d3491199afddf8ff1204e0 P 5a67f69245d14aa395dd7410912ee2d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0e7c9f6ec2c46eda889ff8f199bc969 in term 2.
I20250625 03:32:33.698617 5896 raft_consensus.cc:2802] T c7d0e4d719d3491199afddf8ff1204e0 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:32:33.699129 5896 raft_consensus.cc:695] T c7d0e4d719d3491199afddf8ff1204e0 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 2 LEADER]: Becoming Leader. State: Replica: f0e7c9f6ec2c46eda889ff8f199bc969, State: Running, Role: LEADER
I20250625 03:32:33.700047 5896 consensus_queue.cc:237] T c7d0e4d719d3491199afddf8ff1204e0 P f0e7c9f6ec2c46eda889ff8f199bc969 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:33.704609 5443 catalog_manager.cc:5582] T 70076edadb434d5a8d584361780928bc P ac714929b11c43d482b5920a2a5b9129 reported cstate change: term changed from 1 to 2, leader changed from f0e7c9f6ec2c46eda889ff8f199bc969 (127.0.106.129) to ac714929b11c43d482b5920a2a5b9129 (127.0.106.130). New cstate: current_term: 2 leader_uuid: "ac714929b11c43d482b5920a2a5b9129" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } health_report { overall_health: UNKNOWN } } }
I20250625 03:32:33.720223 5445 catalog_manager.cc:5582] T c7d0e4d719d3491199afddf8ff1204e0 P f0e7c9f6ec2c46eda889ff8f199bc969 reported cstate change: term changed from 1 to 2, leader changed from ac714929b11c43d482b5920a2a5b9129 (127.0.106.130) to f0e7c9f6ec2c46eda889ff8f199bc969 (127.0.106.129). New cstate: current_term: 2 leader_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } health_report { overall_health: UNKNOWN } } }
I20250625 03:32:33.724722 5918 consensus_queue.cc:1035] T aaeeb3012a8c4a77a8359268c32d1abc P 5a67f69245d14aa395dd7410912ee2d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:32:33.734916 5884 consensus_queue.cc:1035] T aaeeb3012a8c4a77a8359268c32d1abc P 5a67f69245d14aa395dd7410912ee2d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:32:33.743273 5884 raft_consensus.cc:991] T aaeeb3012a8c4a77a8359268c32d1abc P 5a67f69245d14aa395dd7410912ee2d5: : Instructing follower ac714929b11c43d482b5920a2a5b9129 to start an election
I20250625 03:32:33.743781 5854 raft_consensus.cc:1079] T aaeeb3012a8c4a77a8359268c32d1abc P 5a67f69245d14aa395dd7410912ee2d5 [term 1 LEADER]: Signalling peer ac714929b11c43d482b5920a2a5b9129 to start an election
I20250625 03:32:33.745477 5622 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "aaeeb3012a8c4a77a8359268c32d1abc"
dest_uuid: "ac714929b11c43d482b5920a2a5b9129"
from {username='slave'} at 127.0.0.1:51096
I20250625 03:32:33.746013 5622 raft_consensus.cc:491] T aaeeb3012a8c4a77a8359268c32d1abc P ac714929b11c43d482b5920a2a5b9129 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:32:33.746289 5622 raft_consensus.cc:3058] T aaeeb3012a8c4a77a8359268c32d1abc P ac714929b11c43d482b5920a2a5b9129 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:33.751367 5622 raft_consensus.cc:513] T aaeeb3012a8c4a77a8359268c32d1abc P ac714929b11c43d482b5920a2a5b9129 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:33.753212 5622 leader_election.cc:290] T aaeeb3012a8c4a77a8359268c32d1abc P ac714929b11c43d482b5920a2a5b9129 [CANDIDATE]: Term 2 election: Requested vote from peers f0e7c9f6ec2c46eda889ff8f199bc969 (127.0.106.129:44743), 5a67f69245d14aa395dd7410912ee2d5 (127.0.106.131:38277)
I20250625 03:32:33.754611 5548 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "aaeeb3012a8c4a77a8359268c32d1abc" candidate_uuid: "ac714929b11c43d482b5920a2a5b9129" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969"
I20250625 03:32:33.754804 5697 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "aaeeb3012a8c4a77a8359268c32d1abc" candidate_uuid: "ac714929b11c43d482b5920a2a5b9129" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5a67f69245d14aa395dd7410912ee2d5"
I20250625 03:32:33.755396 5548 raft_consensus.cc:3058] T aaeeb3012a8c4a77a8359268c32d1abc P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:33.755477 5697 raft_consensus.cc:3053] T aaeeb3012a8c4a77a8359268c32d1abc P 5a67f69245d14aa395dd7410912ee2d5 [term 1 LEADER]: Stepping down as leader of term 1
I20250625 03:32:33.755942 5697 raft_consensus.cc:738] T aaeeb3012a8c4a77a8359268c32d1abc P 5a67f69245d14aa395dd7410912ee2d5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a67f69245d14aa395dd7410912ee2d5, State: Running, Role: LEADER
I20250625 03:32:33.756780 5697 consensus_queue.cc:260] T aaeeb3012a8c4a77a8359268c32d1abc P 5a67f69245d14aa395dd7410912ee2d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:33.757793 5697 raft_consensus.cc:3058] T aaeeb3012a8c4a77a8359268c32d1abc P 5a67f69245d14aa395dd7410912ee2d5 [term 1 FOLLOWER]: Advancing to term 2
I20250625 03:32:33.762668 5548 raft_consensus.cc:2466] T aaeeb3012a8c4a77a8359268c32d1abc P f0e7c9f6ec2c46eda889ff8f199bc969 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac714929b11c43d482b5920a2a5b9129 in term 2.
I20250625 03:32:33.764104 5589 leader_election.cc:304] T aaeeb3012a8c4a77a8359268c32d1abc P ac714929b11c43d482b5920a2a5b9129 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac714929b11c43d482b5920a2a5b9129, f0e7c9f6ec2c46eda889ff8f199bc969; no voters:
I20250625 03:32:33.764942 5886 raft_consensus.cc:2802] T aaeeb3012a8c4a77a8359268c32d1abc P ac714929b11c43d482b5920a2a5b9129 [term 2 FOLLOWER]: Leader election won for term 2
I20250625 03:32:33.765420 5697 raft_consensus.cc:2466] T aaeeb3012a8c4a77a8359268c32d1abc P 5a67f69245d14aa395dd7410912ee2d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac714929b11c43d482b5920a2a5b9129 in term 2.
I20250625 03:32:33.765442 5886 raft_consensus.cc:695] T aaeeb3012a8c4a77a8359268c32d1abc P ac714929b11c43d482b5920a2a5b9129 [term 2 LEADER]: Becoming Leader. State: Replica: ac714929b11c43d482b5920a2a5b9129, State: Running, Role: LEADER
I20250625 03:32:33.766542 5886 consensus_queue.cc:237] T aaeeb3012a8c4a77a8359268c32d1abc P ac714929b11c43d482b5920a2a5b9129 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:33.772717 5445 catalog_manager.cc:5582] T aaeeb3012a8c4a77a8359268c32d1abc P ac714929b11c43d482b5920a2a5b9129 reported cstate change: term changed from 1 to 2, leader changed from 5a67f69245d14aa395dd7410912ee2d5 (127.0.106.131) to ac714929b11c43d482b5920a2a5b9129 (127.0.106.130). New cstate: current_term: 2 leader_uuid: "ac714929b11c43d482b5920a2a5b9129" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } health_report { overall_health: UNKNOWN } } }
I20250625 03:32:33.857152 5697 raft_consensus.cc:1273] T 786290ddcf094479800ece947612d482 P 5a67f69245d14aa395dd7410912ee2d5 [term 2 FOLLOWER]: Refusing update from remote peer f0e7c9f6ec2c46eda889ff8f199bc969: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:32:33.858736 5936 consensus_queue.cc:1035] T 786290ddcf094479800ece947612d482 P f0e7c9f6ec2c46eda889ff8f199bc969 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20250625 03:32:33.867316 5622 raft_consensus.cc:1273] T 786290ddcf094479800ece947612d482 P ac714929b11c43d482b5920a2a5b9129 [term 2 FOLLOWER]: Refusing update from remote peer f0e7c9f6ec2c46eda889ff8f199bc969: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:32:33.868866 5927 consensus_queue.cc:1035] T 786290ddcf094479800ece947612d482 P f0e7c9f6ec2c46eda889ff8f199bc969 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:32:34.051719 5623 raft_consensus.cc:1273] T 267de6f0358a4e9f894a10a091cd8efc P ac714929b11c43d482b5920a2a5b9129 [term 2 FOLLOWER]: Refusing update from remote peer f0e7c9f6ec2c46eda889ff8f199bc969: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:32:34.051726 5697 raft_consensus.cc:1273] T 33bf1d07080f4096a5aa2b5daef743a6 P 5a67f69245d14aa395dd7410912ee2d5 [term 2 FOLLOWER]: Refusing update from remote peer ac714929b11c43d482b5920a2a5b9129: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:32:34.053380 5886 consensus_queue.cc:1035] T 33bf1d07080f4096a5aa2b5daef743a6 P ac714929b11c43d482b5920a2a5b9129 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:32:34.053334 5927 consensus_queue.cc:1035] T 267de6f0358a4e9f894a10a091cd8efc P f0e7c9f6ec2c46eda889ff8f199bc969 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20250625 03:32:34.070170 5697 raft_consensus.cc:1273] T 267de6f0358a4e9f894a10a091cd8efc P 5a67f69245d14aa395dd7410912ee2d5 [term 2 FOLLOWER]: Refusing update from remote peer f0e7c9f6ec2c46eda889ff8f199bc969: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:32:34.070806 5548 raft_consensus.cc:1273] T 33bf1d07080f4096a5aa2b5daef743a6 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 2 FOLLOWER]: Refusing update from remote peer ac714929b11c43d482b5920a2a5b9129: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:32:34.071607 5927 consensus_queue.cc:1035] T 267de6f0358a4e9f894a10a091cd8efc P f0e7c9f6ec2c46eda889ff8f199bc969 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:32:34.072980 5886 consensus_queue.cc:1035] T 33bf1d07080f4096a5aa2b5daef743a6 P ac714929b11c43d482b5920a2a5b9129 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:32:34.197819 5548 raft_consensus.cc:1273] T aaeeb3012a8c4a77a8359268c32d1abc P f0e7c9f6ec2c46eda889ff8f199bc969 [term 2 FOLLOWER]: Refusing update from remote peer ac714929b11c43d482b5920a2a5b9129: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:32:34.198961 5872 consensus_queue.cc:1035] T aaeeb3012a8c4a77a8359268c32d1abc P ac714929b11c43d482b5920a2a5b9129 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:32:34.207134 5697 raft_consensus.cc:1273] T aaeeb3012a8c4a77a8359268c32d1abc P 5a67f69245d14aa395dd7410912ee2d5 [term 2 FOLLOWER]: Refusing update from remote peer ac714929b11c43d482b5920a2a5b9129: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:32:34.209054 5872 consensus_queue.cc:1035] T aaeeb3012a8c4a77a8359268c32d1abc P ac714929b11c43d482b5920a2a5b9129 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:32:34.244181 5696 raft_consensus.cc:1273] T c7d0e4d719d3491199afddf8ff1204e0 P 5a67f69245d14aa395dd7410912ee2d5 [term 2 FOLLOWER]: Refusing update from remote peer f0e7c9f6ec2c46eda889ff8f199bc969: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:32:34.245407 5927 consensus_queue.cc:1035] T c7d0e4d719d3491199afddf8ff1204e0 P f0e7c9f6ec2c46eda889ff8f199bc969 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:32:34.253693 5623 raft_consensus.cc:1273] T c7d0e4d719d3491199afddf8ff1204e0 P ac714929b11c43d482b5920a2a5b9129 [term 2 FOLLOWER]: Refusing update from remote peer f0e7c9f6ec2c46eda889ff8f199bc969: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:32:34.255621 5927 consensus_queue.cc:1035] T c7d0e4d719d3491199afddf8ff1204e0 P f0e7c9f6ec2c46eda889ff8f199bc969 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:32:34.267068 5696 raft_consensus.cc:1273] T 70076edadb434d5a8d584361780928bc P 5a67f69245d14aa395dd7410912ee2d5 [term 2 FOLLOWER]: Refusing update from remote peer ac714929b11c43d482b5920a2a5b9129: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:32:34.268327 5937 consensus_queue.cc:1035] T 70076edadb434d5a8d584361780928bc P ac714929b11c43d482b5920a2a5b9129 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 03:32:34.279497 5548 raft_consensus.cc:1273] T 70076edadb434d5a8d584361780928bc P f0e7c9f6ec2c46eda889ff8f199bc969 [term 2 FOLLOWER]: Refusing update from remote peer ac714929b11c43d482b5920a2a5b9129: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250625 03:32:34.281739 5886 consensus_queue.cc:1035] T 70076edadb434d5a8d584361780928bc P ac714929b11c43d482b5920a2a5b9129 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250625 03:32:36.341943 5445 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36198:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20250625 03:32:36.361374 5445 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:36198:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20250625 03:32:36.375605 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:32:36.505898 5978 tablet.cc:1722] T 267de6f0358a4e9f894a10a091cd8efc P ac714929b11c43d482b5920a2a5b9129: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250625 03:32:36.467082 5976 tablet.cc:1722] T bd204f74bbbf45218051c05c8d3a32c1 P ac714929b11c43d482b5920a2a5b9129: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250625 03:32:36.549499 5975 tablet.cc:1722] T bd204f74bbbf45218051c05c8d3a32c1 P 5a67f69245d14aa395dd7410912ee2d5: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250625 03:32:36.562091 5974 tablet.cc:1722] T 267de6f0358a4e9f894a10a091cd8efc P f0e7c9f6ec2c46eda889ff8f199bc969: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
W20250625 03:32:36.589563 5972 log.cc:927] Time spent T c7d0e4d719d3491199afddf8ff1204e0 P f0e7c9f6ec2c46eda889ff8f199bc969: Append to log took a long time: real 0.080s user 0.001s sys 0.000s
I20250625 03:32:36.665933 5975 tablet.cc:1722] T bbf810309eb949ff880839714444d55f P 5a67f69245d14aa395dd7410912ee2d5: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250625 03:32:36.695539 5976 tablet.cc:1722] T bbf810309eb949ff880839714444d55f P ac714929b11c43d482b5920a2a5b9129: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250625 03:32:36.697911 5978 tablet.cc:1722] T 70076edadb434d5a8d584361780928bc P ac714929b11c43d482b5920a2a5b9129: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250625 03:32:36.650662 5987 tablet.cc:1722] T bd204f74bbbf45218051c05c8d3a32c1 P f0e7c9f6ec2c46eda889ff8f199bc969: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
W20250625 03:32:36.741870 5587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.131:38277, user_credentials={real_user=slave}} blocked reactor thread for 74209.2us
I20250625 03:32:36.772723 5995 tablet.cc:1722] T 267de6f0358a4e9f894a10a091cd8efc P 5a67f69245d14aa395dd7410912ee2d5: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250625 03:32:36.777736 6001 tablet.cc:1722] T aaeeb3012a8c4a77a8359268c32d1abc P ac714929b11c43d482b5920a2a5b9129: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250625 03:32:36.793294 5975 tablet.cc:1722] T 70076edadb434d5a8d584361780928bc P 5a67f69245d14aa395dd7410912ee2d5: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250625 03:32:36.793624 6004 tablet.cc:1722] T 33bf1d07080f4096a5aa2b5daef743a6 P ac714929b11c43d482b5920a2a5b9129: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250625 03:32:36.749485 5978 tablet.cc:1722] T 786290ddcf094479800ece947612d482 P ac714929b11c43d482b5920a2a5b9129: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250625 03:32:36.803495 6003 tablet.cc:1722] T 786290ddcf094479800ece947612d482 P f0e7c9f6ec2c46eda889ff8f199bc969: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250625 03:32:36.860805 5976 tablet.cc:1722] T c7d0e4d719d3491199afddf8ff1204e0 P ac714929b11c43d482b5920a2a5b9129: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250625 03:32:36.870069 6012 tablet.cc:1722] T aaeeb3012a8c4a77a8359268c32d1abc P 5a67f69245d14aa395dd7410912ee2d5: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
W20250625 03:32:36.785248 5589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.106.129:44743, user_credentials={real_user=slave}} blocked reactor thread for 123656us
I20250625 03:32:36.865638 5974 tablet.cc:1722] T c7d0e4d719d3491199afddf8ff1204e0 P f0e7c9f6ec2c46eda889ff8f199bc969: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250625 03:32:36.923197 5975 tablet.cc:1722] T c7d0e4d719d3491199afddf8ff1204e0 P 5a67f69245d14aa395dd7410912ee2d5: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250625 03:32:36.889371 6013 tablet.cc:1722] T 33bf1d07080f4096a5aa2b5daef743a6 P 5a67f69245d14aa395dd7410912ee2d5: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250625 03:32:36.897329 6014 tablet.cc:1722] T 6026baaaf75a465aab3b95d3ada761c2 P f0e7c9f6ec2c46eda889ff8f199bc969: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250625 03:32:36.905727 6004 tablet.cc:1722] T 6026baaaf75a465aab3b95d3ada761c2 P ac714929b11c43d482b5920a2a5b9129: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250625 03:32:36.908151 5995 tablet.cc:1722] T 6026baaaf75a465aab3b95d3ada761c2 P 5a67f69245d14aa395dd7410912ee2d5: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250625 03:32:36.944854 6003 tablet.cc:1722] T aaeeb3012a8c4a77a8359268c32d1abc P f0e7c9f6ec2c46eda889ff8f199bc969: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250625 03:32:36.944871 6013 tablet.cc:1722] T 786290ddcf094479800ece947612d482 P 5a67f69245d14aa395dd7410912ee2d5: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250625 03:32:36.979683 5620 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "8014b6301211413cbbe6a34e60213b1f"
dest_uuid: "ac714929b11c43d482b5920a2a5b9129"
mode: GRACEFUL
new_leader_uuid: "5a67f69245d14aa395dd7410912ee2d5"
from {username='slave'} at 127.0.0.1:46616
I20250625 03:32:36.980362 5620 raft_consensus.cc:604] T 8014b6301211413cbbe6a34e60213b1f P ac714929b11c43d482b5920a2a5b9129 [term 2 LEADER]: Received request to transfer leadership to TS 5a67f69245d14aa395dd7410912ee2d5
I20250625 03:32:36.981599 5987 tablet.cc:1722] T 70076edadb434d5a8d584361780928bc P f0e7c9f6ec2c46eda889ff8f199bc969: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250625 03:32:36.994304 6014 tablet.cc:1722] T bbf810309eb949ff880839714444d55f P f0e7c9f6ec2c46eda889ff8f199bc969: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250625 03:32:36.994335 6003 tablet.cc:1722] T 33bf1d07080f4096a5aa2b5daef743a6 P f0e7c9f6ec2c46eda889ff8f199bc969: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250625 03:32:37.045534 5547 tablet_service.cc:1968] Received LeaderStepDown RPC: tablet_id: "b01160bf577842c485d19170bfcb2946"
dest_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969"
mode: GRACEFUL
new_leader_uuid: "5a67f69245d14aa395dd7410912ee2d5"
from {username='slave'} at 127.0.0.1:57164
I20250625 03:32:37.046379 5547 raft_consensus.cc:604] T b01160bf577842c485d19170bfcb2946 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 2 LEADER]: Received request to transfer leadership to TS 5a67f69245d14aa395dd7410912ee2d5
I20250625 03:32:37.047664 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20250625 03:32:37.048316 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:32:37.048460 5444 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 789cd038419c47e9882fb6ffdbae958a: soft_deleted_table [id=86492e2cc9db4924a45643c097013b3e] alter complete (version 1)
I20250625 03:32:37.075210 5992 raft_consensus.cc:991] T b01160bf577842c485d19170bfcb2946 P f0e7c9f6ec2c46eda889ff8f199bc969: : Instructing follower 5a67f69245d14aa395dd7410912ee2d5 to start an election
I20250625 03:32:37.075734 5990 raft_consensus.cc:1079] T b01160bf577842c485d19170bfcb2946 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 2 LEADER]: Signalling peer 5a67f69245d14aa395dd7410912ee2d5 to start an election
I20250625 03:32:37.077212 5695 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "b01160bf577842c485d19170bfcb2946"
dest_uuid: "5a67f69245d14aa395dd7410912ee2d5"
from {username='slave'} at 127.0.0.1:52258
I20250625 03:32:37.077670 5695 raft_consensus.cc:491] T b01160bf577842c485d19170bfcb2946 P 5a67f69245d14aa395dd7410912ee2d5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:32:37.077951 5695 raft_consensus.cc:3058] T b01160bf577842c485d19170bfcb2946 P 5a67f69245d14aa395dd7410912ee2d5 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:32:37.083488 5695 raft_consensus.cc:513] T b01160bf577842c485d19170bfcb2946 P 5a67f69245d14aa395dd7410912ee2d5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:37.085167 5695 leader_election.cc:290] T b01160bf577842c485d19170bfcb2946 P 5a67f69245d14aa395dd7410912ee2d5 [CANDIDATE]: Term 3 election: Requested vote from peers f0e7c9f6ec2c46eda889ff8f199bc969 (127.0.106.129:44743), ac714929b11c43d482b5920a2a5b9129 (127.0.106.130:39845)
I20250625 03:32:37.086021 5547 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b01160bf577842c485d19170bfcb2946" candidate_uuid: "5a67f69245d14aa395dd7410912ee2d5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969"
I20250625 03:32:37.086374 5620 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b01160bf577842c485d19170bfcb2946" candidate_uuid: "5a67f69245d14aa395dd7410912ee2d5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ac714929b11c43d482b5920a2a5b9129"
I20250625 03:32:37.086758 5547 raft_consensus.cc:3053] T b01160bf577842c485d19170bfcb2946 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 2 LEADER]: Stepping down as leader of term 2
I20250625 03:32:37.087095 5620 raft_consensus.cc:3058] T b01160bf577842c485d19170bfcb2946 P ac714929b11c43d482b5920a2a5b9129 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:32:37.087095 5547 raft_consensus.cc:738] T b01160bf577842c485d19170bfcb2946 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f0e7c9f6ec2c46eda889ff8f199bc969, State: Running, Role: LEADER
I20250625 03:32:37.088218 5547 consensus_queue.cc:260] T b01160bf577842c485d19170bfcb2946 P f0e7c9f6ec2c46eda889ff8f199bc969 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:37.089614 5547 raft_consensus.cc:3058] T b01160bf577842c485d19170bfcb2946 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:32:37.095742 5547 raft_consensus.cc:2466] T b01160bf577842c485d19170bfcb2946 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a67f69245d14aa395dd7410912ee2d5 in term 3.
I20250625 03:32:37.095746 5620 raft_consensus.cc:2466] T b01160bf577842c485d19170bfcb2946 P ac714929b11c43d482b5920a2a5b9129 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a67f69245d14aa395dd7410912ee2d5 in term 3.
I20250625 03:32:37.096948 5663 leader_election.cc:304] T b01160bf577842c485d19170bfcb2946 P 5a67f69245d14aa395dd7410912ee2d5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a67f69245d14aa395dd7410912ee2d5, f0e7c9f6ec2c46eda889ff8f199bc969; no voters:
I20250625 03:32:37.097852 5971 raft_consensus.cc:2802] T b01160bf577842c485d19170bfcb2946 P 5a67f69245d14aa395dd7410912ee2d5 [term 3 FOLLOWER]: Leader election won for term 3
I20250625 03:32:37.098877 5971 raft_consensus.cc:695] T b01160bf577842c485d19170bfcb2946 P 5a67f69245d14aa395dd7410912ee2d5 [term 3 LEADER]: Becoming Leader. State: Replica: 5a67f69245d14aa395dd7410912ee2d5, State: Running, Role: LEADER
I20250625 03:32:37.099818 5971 consensus_queue.cc:237] T b01160bf577842c485d19170bfcb2946 P 5a67f69245d14aa395dd7410912ee2d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:37.111403 5446 catalog_manager.cc:5582] T b01160bf577842c485d19170bfcb2946 P 5a67f69245d14aa395dd7410912ee2d5 reported cstate change: term changed from 2 to 3, leader changed from f0e7c9f6ec2c46eda889ff8f199bc969 (127.0.106.129) to 5a67f69245d14aa395dd7410912ee2d5 (127.0.106.131). New cstate: current_term: 3 leader_uuid: "5a67f69245d14aa395dd7410912ee2d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } health_report { overall_health: HEALTHY } } }
I20250625 03:32:37.492798 6009 raft_consensus.cc:991] T 8014b6301211413cbbe6a34e60213b1f P ac714929b11c43d482b5920a2a5b9129: : Instructing follower 5a67f69245d14aa395dd7410912ee2d5 to start an election
I20250625 03:32:37.493239 6009 raft_consensus.cc:1079] T 8014b6301211413cbbe6a34e60213b1f P ac714929b11c43d482b5920a2a5b9129 [term 2 LEADER]: Signalling peer 5a67f69245d14aa395dd7410912ee2d5 to start an election
I20250625 03:32:37.494493 5695 tablet_service.cc:1940] Received Run Leader Election RPC: tablet_id: "8014b6301211413cbbe6a34e60213b1f"
dest_uuid: "5a67f69245d14aa395dd7410912ee2d5"
from {username='slave'} at 127.0.0.1:52262
I20250625 03:32:37.494963 5695 raft_consensus.cc:491] T 8014b6301211413cbbe6a34e60213b1f P 5a67f69245d14aa395dd7410912ee2d5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20250625 03:32:37.495232 5695 raft_consensus.cc:3058] T 8014b6301211413cbbe6a34e60213b1f P 5a67f69245d14aa395dd7410912ee2d5 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:32:37.500368 5695 raft_consensus.cc:513] T 8014b6301211413cbbe6a34e60213b1f P 5a67f69245d14aa395dd7410912ee2d5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:37.501955 5695 leader_election.cc:290] T 8014b6301211413cbbe6a34e60213b1f P 5a67f69245d14aa395dd7410912ee2d5 [CANDIDATE]: Term 3 election: Requested vote from peers f0e7c9f6ec2c46eda889ff8f199bc969 (127.0.106.129:44743), ac714929b11c43d482b5920a2a5b9129 (127.0.106.130:39845)
I20250625 03:32:37.502751 5547 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8014b6301211413cbbe6a34e60213b1f" candidate_uuid: "5a67f69245d14aa395dd7410912ee2d5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969"
I20250625 03:32:37.503059 5620 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8014b6301211413cbbe6a34e60213b1f" candidate_uuid: "5a67f69245d14aa395dd7410912ee2d5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ac714929b11c43d482b5920a2a5b9129"
I20250625 03:32:37.503420 5547 raft_consensus.cc:3058] T 8014b6301211413cbbe6a34e60213b1f P f0e7c9f6ec2c46eda889ff8f199bc969 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:32:37.503628 5620 raft_consensus.cc:3053] T 8014b6301211413cbbe6a34e60213b1f P ac714929b11c43d482b5920a2a5b9129 [term 2 LEADER]: Stepping down as leader of term 2
I20250625 03:32:37.503983 5620 raft_consensus.cc:738] T 8014b6301211413cbbe6a34e60213b1f P ac714929b11c43d482b5920a2a5b9129 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ac714929b11c43d482b5920a2a5b9129, State: Running, Role: LEADER
I20250625 03:32:37.504776 5620 consensus_queue.cc:260] T 8014b6301211413cbbe6a34e60213b1f P ac714929b11c43d482b5920a2a5b9129 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:37.506155 5620 raft_consensus.cc:3058] T 8014b6301211413cbbe6a34e60213b1f P ac714929b11c43d482b5920a2a5b9129 [term 2 FOLLOWER]: Advancing to term 3
I20250625 03:32:37.510762 5547 raft_consensus.cc:2466] T 8014b6301211413cbbe6a34e60213b1f P f0e7c9f6ec2c46eda889ff8f199bc969 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a67f69245d14aa395dd7410912ee2d5 in term 3.
I20250625 03:32:37.512094 5663 leader_election.cc:304] T 8014b6301211413cbbe6a34e60213b1f P 5a67f69245d14aa395dd7410912ee2d5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a67f69245d14aa395dd7410912ee2d5, f0e7c9f6ec2c46eda889ff8f199bc969; no voters:
I20250625 03:32:37.512723 5971 raft_consensus.cc:2802] T 8014b6301211413cbbe6a34e60213b1f P 5a67f69245d14aa395dd7410912ee2d5 [term 3 FOLLOWER]: Leader election won for term 3
I20250625 03:32:37.513069 5620 raft_consensus.cc:2466] T 8014b6301211413cbbe6a34e60213b1f P ac714929b11c43d482b5920a2a5b9129 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a67f69245d14aa395dd7410912ee2d5 in term 3.
I20250625 03:32:37.513236 5971 raft_consensus.cc:695] T 8014b6301211413cbbe6a34e60213b1f P 5a67f69245d14aa395dd7410912ee2d5 [term 3 LEADER]: Becoming Leader. State: Replica: 5a67f69245d14aa395dd7410912ee2d5, State: Running, Role: LEADER
I20250625 03:32:37.514320 5971 consensus_queue.cc:237] T 8014b6301211413cbbe6a34e60213b1f P 5a67f69245d14aa395dd7410912ee2d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } }
I20250625 03:32:37.517741 5620 raft_consensus.cc:1273] T b01160bf577842c485d19170bfcb2946 P ac714929b11c43d482b5920a2a5b9129 [term 3 FOLLOWER]: Refusing update from remote peer 5a67f69245d14aa395dd7410912ee2d5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250625 03:32:37.519284 5971 consensus_queue.cc:1035] T b01160bf577842c485d19170bfcb2946 P 5a67f69245d14aa395dd7410912ee2d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:32:37.523207 5446 catalog_manager.cc:5582] T 8014b6301211413cbbe6a34e60213b1f P 5a67f69245d14aa395dd7410912ee2d5 reported cstate change: term changed from 2 to 3, leader changed from ac714929b11c43d482b5920a2a5b9129 (127.0.106.130) to 5a67f69245d14aa395dd7410912ee2d5 (127.0.106.131). New cstate: current_term: 3 leader_uuid: "5a67f69245d14aa395dd7410912ee2d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a67f69245d14aa395dd7410912ee2d5" member_type: VOTER last_known_addr { host: "127.0.106.131" port: 38277 } health_report { overall_health: HEALTHY } } }
I20250625 03:32:37.540258 5547 raft_consensus.cc:1273] T b01160bf577842c485d19170bfcb2946 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 3 FOLLOWER]: Refusing update from remote peer 5a67f69245d14aa395dd7410912ee2d5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250625 03:32:37.542384 5971 consensus_queue.cc:1035] T b01160bf577842c485d19170bfcb2946 P 5a67f69245d14aa395dd7410912ee2d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:32:37.940804 5620 raft_consensus.cc:1273] T 8014b6301211413cbbe6a34e60213b1f P ac714929b11c43d482b5920a2a5b9129 [term 3 FOLLOWER]: Refusing update from remote peer 5a67f69245d14aa395dd7410912ee2d5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250625 03:32:37.941962 5971 consensus_queue.cc:1035] T 8014b6301211413cbbe6a34e60213b1f P 5a67f69245d14aa395dd7410912ee2d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac714929b11c43d482b5920a2a5b9129" member_type: VOTER last_known_addr { host: "127.0.106.130" port: 39845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:32:37.950536 5547 raft_consensus.cc:1273] T 8014b6301211413cbbe6a34e60213b1f P f0e7c9f6ec2c46eda889ff8f199bc969 [term 3 FOLLOWER]: Refusing update from remote peer 5a67f69245d14aa395dd7410912ee2d5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250625 03:32:37.952209 6020 consensus_queue.cc:1035] T 8014b6301211413cbbe6a34e60213b1f P 5a67f69245d14aa395dd7410912ee2d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0e7c9f6ec2c46eda889ff8f199bc969" member_type: VOTER last_known_addr { host: "127.0.106.129" port: 44743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250625 03:32:38.049275 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:32:38.055605 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250625 03:32:38.056100 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:32:39.057755 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:32:39.070613 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250625 03:32:39.071121 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:32:40.140141 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:32:40.145056 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250625 03:32:40.145531 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
W20250625 03:32:40.612192 5718 debug-util.cc:398] Leaking SignalData structure 0x7b08001f74c0 after lost signal to thread 429
W20250625 03:32:40.613343 5718 debug-util.cc:398] Leaking SignalData structure 0x7b08002eb180 after lost signal to thread 5480
W20250625 03:32:40.614406 5718 debug-util.cc:398] Leaking SignalData structure 0x7b08001bd2e0 after lost signal to thread 5572
W20250625 03:32:40.615309 5718 debug-util.cc:398] Leaking SignalData structure 0x7b0800286e60 after lost signal to thread 5647
W20250625 03:32:40.616212 5718 debug-util.cc:398] Leaking SignalData structure 0x7b08001b9ee0 after lost signal to thread 5721
I20250625 03:32:41.146605 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:32:41.154831 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250625 03:32:41.155441 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:32:42.156698 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:32:42.164745 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250625 03:32:42.165355 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:32:43.166491 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:32:43.172621 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250625 03:32:43.173031 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:32:44.173971 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:32:44.181218 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250625 03:32:44.181763 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:32:45.182741 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:32:45.190030 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250625 03:32:45.190698 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:32:46.191759 426 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250625 03:32:46.197386 426 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250625 03:32:46.197835 426 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20250625 03:32:47.257323 426 tablet_server.cc:178] TabletServer@127.0.106.129:0 shutting down...
I20250625 03:32:47.291942 426 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250625 03:32:47.292920 426 tablet_replica.cc:331] T bd204f74bbbf45218051c05c8d3a32c1 P f0e7c9f6ec2c46eda889ff8f199bc969: stopping tablet replica
I20250625 03:32:47.294072 426 raft_consensus.cc:2241] T bd204f74bbbf45218051c05c8d3a32c1 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:47.294919 426 raft_consensus.cc:2270] T bd204f74bbbf45218051c05c8d3a32c1 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:47.298254 426 tablet_replica.cc:331] T 70076edadb434d5a8d584361780928bc P f0e7c9f6ec2c46eda889ff8f199bc969: stopping tablet replica
I20250625 03:32:47.299217 426 raft_consensus.cc:2241] T 70076edadb434d5a8d584361780928bc P f0e7c9f6ec2c46eda889ff8f199bc969 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:47.299767 426 raft_consensus.cc:2270] T 70076edadb434d5a8d584361780928bc P f0e7c9f6ec2c46eda889ff8f199bc969 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:47.302234 426 tablet_replica.cc:331] T bbf810309eb949ff880839714444d55f P f0e7c9f6ec2c46eda889ff8f199bc969: stopping tablet replica
I20250625 03:32:47.302843 426 raft_consensus.cc:2241] T bbf810309eb949ff880839714444d55f P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:47.303407 426 raft_consensus.cc:2270] T bbf810309eb949ff880839714444d55f P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:47.305891 426 tablet_replica.cc:331] T 267de6f0358a4e9f894a10a091cd8efc P f0e7c9f6ec2c46eda889ff8f199bc969: stopping tablet replica
I20250625 03:32:47.306510 426 raft_consensus.cc:2241] T 267de6f0358a4e9f894a10a091cd8efc P f0e7c9f6ec2c46eda889ff8f199bc969 [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:32:47.307387 426 raft_consensus.cc:2270] T 267de6f0358a4e9f894a10a091cd8efc P f0e7c9f6ec2c46eda889ff8f199bc969 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:47.309787 426 tablet_replica.cc:331] T 786290ddcf094479800ece947612d482 P f0e7c9f6ec2c46eda889ff8f199bc969: stopping tablet replica
I20250625 03:32:47.310322 426 raft_consensus.cc:2241] T 786290ddcf094479800ece947612d482 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:32:47.311147 426 raft_consensus.cc:2270] T 786290ddcf094479800ece947612d482 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:47.313561 426 tablet_replica.cc:331] T 6026baaaf75a465aab3b95d3ada761c2 P f0e7c9f6ec2c46eda889ff8f199bc969: stopping tablet replica
I20250625 03:32:47.314112 426 raft_consensus.cc:2241] T 6026baaaf75a465aab3b95d3ada761c2 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:32:47.315155 426 raft_consensus.cc:2270] T 6026baaaf75a465aab3b95d3ada761c2 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250625 03:32:47.317191 5663 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 13 similar messages]
I20250625 03:32:47.318526 426 tablet_replica.cc:331] T c7d0e4d719d3491199afddf8ff1204e0 P f0e7c9f6ec2c46eda889ff8f199bc969: stopping tablet replica
I20250625 03:32:47.319339 426 raft_consensus.cc:2241] T c7d0e4d719d3491199afddf8ff1204e0 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:32:47.320425 426 raft_consensus.cc:2270] T c7d0e4d719d3491199afddf8ff1204e0 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 2 FOLLOWER]: Raft consensus is shut down!
W20250625 03:32:47.320487 5663 consensus_peers.cc:487] T b01160bf577842c485d19170bfcb2946 P 5a67f69245d14aa395dd7410912ee2d5 -> Peer f0e7c9f6ec2c46eda889ff8f199bc969 (127.0.106.129:44743): Couldn't send request to peer f0e7c9f6ec2c46eda889ff8f199bc969. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:32:47.323132 426 tablet_replica.cc:331] T 09262e1d4d2346d1b9610e857b693324 P f0e7c9f6ec2c46eda889ff8f199bc969: stopping tablet replica
I20250625 03:32:47.323851 426 raft_consensus.cc:2241] T 09262e1d4d2346d1b9610e857b693324 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:47.324373 426 raft_consensus.cc:2270] T 09262e1d4d2346d1b9610e857b693324 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:47.326753 426 tablet_replica.cc:331] T 95a70da0935d43aba7bf794c38763425 P f0e7c9f6ec2c46eda889ff8f199bc969: stopping tablet replica
I20250625 03:32:47.327330 426 raft_consensus.cc:2241] T 95a70da0935d43aba7bf794c38763425 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:32:47.328364 426 raft_consensus.cc:2270] T 95a70da0935d43aba7bf794c38763425 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:47.330706 426 tablet_replica.cc:331] T b01160bf577842c485d19170bfcb2946 P f0e7c9f6ec2c46eda889ff8f199bc969: stopping tablet replica
I20250625 03:32:47.331279 426 raft_consensus.cc:2241] T b01160bf577842c485d19170bfcb2946 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:47.331725 426 raft_consensus.cc:2270] T b01160bf577842c485d19170bfcb2946 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:47.334167 426 tablet_replica.cc:331] T ec327833dcb74b6b8679315df6d60ac5 P f0e7c9f6ec2c46eda889ff8f199bc969: stopping tablet replica
I20250625 03:32:47.334719 426 raft_consensus.cc:2241] T ec327833dcb74b6b8679315df6d60ac5 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:47.335191 426 raft_consensus.cc:2270] T ec327833dcb74b6b8679315df6d60ac5 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:47.337431 426 tablet_replica.cc:331] T 9d744327c3714ed99169ee010b3a1eb7 P f0e7c9f6ec2c46eda889ff8f199bc969: stopping tablet replica
I20250625 03:32:47.337970 426 raft_consensus.cc:2241] T 9d744327c3714ed99169ee010b3a1eb7 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:47.338431 426 raft_consensus.cc:2270] T 9d744327c3714ed99169ee010b3a1eb7 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:47.341325 426 tablet_replica.cc:331] T aaeeb3012a8c4a77a8359268c32d1abc P f0e7c9f6ec2c46eda889ff8f199bc969: stopping tablet replica
I20250625 03:32:47.342111 426 raft_consensus.cc:2241] T aaeeb3012a8c4a77a8359268c32d1abc P f0e7c9f6ec2c46eda889ff8f199bc969 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:47.342736 426 raft_consensus.cc:2270] T aaeeb3012a8c4a77a8359268c32d1abc P f0e7c9f6ec2c46eda889ff8f199bc969 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:47.345028 426 tablet_replica.cc:331] T f586c1c904ee41f785ba350b68057810 P f0e7c9f6ec2c46eda889ff8f199bc969: stopping tablet replica
I20250625 03:32:47.345518 426 raft_consensus.cc:2241] T f586c1c904ee41f785ba350b68057810 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:32:47.346360 426 raft_consensus.cc:2270] T f586c1c904ee41f785ba350b68057810 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:47.348774 426 tablet_replica.cc:331] T 8014b6301211413cbbe6a34e60213b1f P f0e7c9f6ec2c46eda889ff8f199bc969: stopping tablet replica
I20250625 03:32:47.349434 426 raft_consensus.cc:2241] T 8014b6301211413cbbe6a34e60213b1f P f0e7c9f6ec2c46eda889ff8f199bc969 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:47.350045 426 raft_consensus.cc:2270] T 8014b6301211413cbbe6a34e60213b1f P f0e7c9f6ec2c46eda889ff8f199bc969 [term 3 FOLLOWER]: Raft consensus is shut down!
W20250625 03:32:47.352475 5589 consensus_peers.cc:487] T 70076edadb434d5a8d584361780928bc P ac714929b11c43d482b5920a2a5b9129 -> Peer f0e7c9f6ec2c46eda889ff8f199bc969 (127.0.106.129:44743): Couldn't send request to peer f0e7c9f6ec2c46eda889ff8f199bc969. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:32:47.352696 426 tablet_replica.cc:331] T 3857bc0f026242499856f49c07bccf36 P f0e7c9f6ec2c46eda889ff8f199bc969: stopping tablet replica
I20250625 03:32:47.353332 426 raft_consensus.cc:2241] T 3857bc0f026242499856f49c07bccf36 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:32:47.354144 426 raft_consensus.cc:2270] T 3857bc0f026242499856f49c07bccf36 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:47.356323 426 tablet_replica.cc:331] T 33bf1d07080f4096a5aa2b5daef743a6 P f0e7c9f6ec2c46eda889ff8f199bc969: stopping tablet replica
I20250625 03:32:47.356840 426 raft_consensus.cc:2241] T 33bf1d07080f4096a5aa2b5daef743a6 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:47.357358 426 raft_consensus.cc:2270] T 33bf1d07080f4096a5aa2b5daef743a6 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:47.359727 426 tablet_replica.cc:331] T dd40af6d9f9b4ae2ab31241b28f3b002 P f0e7c9f6ec2c46eda889ff8f199bc969: stopping tablet replica
I20250625 03:32:47.360275 426 raft_consensus.cc:2241] T dd40af6d9f9b4ae2ab31241b28f3b002 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:47.360739 426 raft_consensus.cc:2270] T dd40af6d9f9b4ae2ab31241b28f3b002 P f0e7c9f6ec2c46eda889ff8f199bc969 [term 2 FOLLOWER]: Raft consensus is shut down!
W20250625 03:32:47.376682 5589 consensus_peers.cc:487] T 33bf1d07080f4096a5aa2b5daef743a6 P ac714929b11c43d482b5920a2a5b9129 -> Peer f0e7c9f6ec2c46eda889ff8f199bc969 (127.0.106.129:44743): Couldn't send request to peer f0e7c9f6ec2c46eda889ff8f199bc969. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250625 03:32:47.428468 5589 consensus_peers.cc:487] T 09262e1d4d2346d1b9610e857b693324 P ac714929b11c43d482b5920a2a5b9129 -> Peer f0e7c9f6ec2c46eda889ff8f199bc969 (127.0.106.129:44743): Couldn't send request to peer f0e7c9f6ec2c46eda889ff8f199bc969. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:44743: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250625 03:32:47.432621 426 tablet_server.cc:195] TabletServer@127.0.106.129:0 shutdown complete.
W20250625 03:32:47.450130 5589 consensus_peers.cc:487] T aaeeb3012a8c4a77a8359268c32d1abc P ac714929b11c43d482b5920a2a5b9129 -> Peer f0e7c9f6ec2c46eda889ff8f199bc969 (127.0.106.129:44743): Couldn't send request to peer f0e7c9f6ec2c46eda889ff8f199bc969. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:44743: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250625 03:32:47.474606 426 tablet_server.cc:178] TabletServer@127.0.106.130:0 shutting down...
W20250625 03:32:47.478816 5663 consensus_peers.cc:487] T 8014b6301211413cbbe6a34e60213b1f P 5a67f69245d14aa395dd7410912ee2d5 -> Peer f0e7c9f6ec2c46eda889ff8f199bc969 (127.0.106.129:44743): Couldn't send request to peer f0e7c9f6ec2c46eda889ff8f199bc969. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:44743: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250625 03:32:47.506649 426 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250625 03:32:47.507349 426 tablet_replica.cc:331] T bd204f74bbbf45218051c05c8d3a32c1 P ac714929b11c43d482b5920a2a5b9129: stopping tablet replica
I20250625 03:32:47.508106 426 raft_consensus.cc:2241] T bd204f74bbbf45218051c05c8d3a32c1 P ac714929b11c43d482b5920a2a5b9129 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:47.508715 426 raft_consensus.cc:2270] T bd204f74bbbf45218051c05c8d3a32c1 P ac714929b11c43d482b5920a2a5b9129 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:47.511013 426 tablet_replica.cc:331] T 70076edadb434d5a8d584361780928bc P ac714929b11c43d482b5920a2a5b9129: stopping tablet replica
I20250625 03:32:47.511662 426 raft_consensus.cc:2241] T 70076edadb434d5a8d584361780928bc P ac714929b11c43d482b5920a2a5b9129 [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:32:47.512516 426 raft_consensus.cc:2270] T 70076edadb434d5a8d584361780928bc P ac714929b11c43d482b5920a2a5b9129 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:47.514600 426 tablet_replica.cc:331] T bbf810309eb949ff880839714444d55f P ac714929b11c43d482b5920a2a5b9129: stopping tablet replica
I20250625 03:32:47.515182 426 raft_consensus.cc:2241] T bbf810309eb949ff880839714444d55f P ac714929b11c43d482b5920a2a5b9129 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:32:47.515949 426 raft_consensus.cc:2270] T bbf810309eb949ff880839714444d55f P ac714929b11c43d482b5920a2a5b9129 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:47.518362 426 tablet_replica.cc:331] T 786290ddcf094479800ece947612d482 P ac714929b11c43d482b5920a2a5b9129: stopping tablet replica
I20250625 03:32:47.518929 426 raft_consensus.cc:2241] T 786290ddcf094479800ece947612d482 P ac714929b11c43d482b5920a2a5b9129 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:47.519402 426 raft_consensus.cc:2270] T 786290ddcf094479800ece947612d482 P ac714929b11c43d482b5920a2a5b9129 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:47.521530 426 tablet_replica.cc:331] T 267de6f0358a4e9f894a10a091cd8efc P ac714929b11c43d482b5920a2a5b9129: stopping tablet replica
I20250625 03:32:47.522105 426 raft_consensus.cc:2241] T 267de6f0358a4e9f894a10a091cd8efc P ac714929b11c43d482b5920a2a5b9129 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:47.522547 426 raft_consensus.cc:2270] T 267de6f0358a4e9f894a10a091cd8efc P ac714929b11c43d482b5920a2a5b9129 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:47.524725 426 tablet_replica.cc:331] T 6026baaaf75a465aab3b95d3ada761c2 P ac714929b11c43d482b5920a2a5b9129: stopping tablet replica
I20250625 03:32:47.525282 426 raft_consensus.cc:2241] T 6026baaaf75a465aab3b95d3ada761c2 P ac714929b11c43d482b5920a2a5b9129 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:47.525785 426 raft_consensus.cc:2270] T 6026baaaf75a465aab3b95d3ada761c2 P ac714929b11c43d482b5920a2a5b9129 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:47.527833 426 tablet_replica.cc:331] T c7d0e4d719d3491199afddf8ff1204e0 P ac714929b11c43d482b5920a2a5b9129: stopping tablet replica
I20250625 03:32:47.528730 426 raft_consensus.cc:2241] T c7d0e4d719d3491199afddf8ff1204e0 P ac714929b11c43d482b5920a2a5b9129 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:47.529218 426 raft_consensus.cc:2270] T c7d0e4d719d3491199afddf8ff1204e0 P ac714929b11c43d482b5920a2a5b9129 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:47.531272 426 tablet_replica.cc:331] T b01160bf577842c485d19170bfcb2946 P ac714929b11c43d482b5920a2a5b9129: stopping tablet replica
I20250625 03:32:47.532053 426 raft_consensus.cc:2241] T b01160bf577842c485d19170bfcb2946 P ac714929b11c43d482b5920a2a5b9129 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:47.532613 426 raft_consensus.cc:2270] T b01160bf577842c485d19170bfcb2946 P ac714929b11c43d482b5920a2a5b9129 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:47.534899 426 tablet_replica.cc:331] T ec327833dcb74b6b8679315df6d60ac5 P ac714929b11c43d482b5920a2a5b9129: stopping tablet replica
W20250625 03:32:47.535521 5662 consensus_peers.cc:487] T b01160bf577842c485d19170bfcb2946 P 5a67f69245d14aa395dd7410912ee2d5 -> Peer ac714929b11c43d482b5920a2a5b9129 (127.0.106.130:39845): Couldn't send request to peer ac714929b11c43d482b5920a2a5b9129. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:32:47.535629 426 raft_consensus.cc:2241] T ec327833dcb74b6b8679315df6d60ac5 P ac714929b11c43d482b5920a2a5b9129 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:47.536517 426 raft_consensus.cc:2270] T ec327833dcb74b6b8679315df6d60ac5 P ac714929b11c43d482b5920a2a5b9129 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:47.539485 426 tablet_replica.cc:331] T 09262e1d4d2346d1b9610e857b693324 P ac714929b11c43d482b5920a2a5b9129: stopping tablet replica
I20250625 03:32:47.540108 426 raft_consensus.cc:2241] T 09262e1d4d2346d1b9610e857b693324 P ac714929b11c43d482b5920a2a5b9129 [term 1 LEADER]: Raft consensus shutting down.
W20250625 03:32:47.540264 5663 consensus_peers.cc:487] T bd204f74bbbf45218051c05c8d3a32c1 P 5a67f69245d14aa395dd7410912ee2d5 -> Peer f0e7c9f6ec2c46eda889ff8f199bc969 (127.0.106.129:44743): Couldn't send request to peer f0e7c9f6ec2c46eda889ff8f199bc969. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.129:44743: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250625 03:32:47.541155 426 raft_consensus.cc:2270] T 09262e1d4d2346d1b9610e857b693324 P ac714929b11c43d482b5920a2a5b9129 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:47.543391 426 tablet_replica.cc:331] T 3857bc0f026242499856f49c07bccf36 P ac714929b11c43d482b5920a2a5b9129: stopping tablet replica
I20250625 03:32:47.543901 426 raft_consensus.cc:2241] T 3857bc0f026242499856f49c07bccf36 P ac714929b11c43d482b5920a2a5b9129 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:47.544409 426 raft_consensus.cc:2270] T 3857bc0f026242499856f49c07bccf36 P ac714929b11c43d482b5920a2a5b9129 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:47.546495 426 tablet_replica.cc:331] T 33bf1d07080f4096a5aa2b5daef743a6 P ac714929b11c43d482b5920a2a5b9129: stopping tablet replica
I20250625 03:32:47.546995 426 raft_consensus.cc:2241] T 33bf1d07080f4096a5aa2b5daef743a6 P ac714929b11c43d482b5920a2a5b9129 [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:32:47.547853 426 raft_consensus.cc:2270] T 33bf1d07080f4096a5aa2b5daef743a6 P ac714929b11c43d482b5920a2a5b9129 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:47.549957 426 tablet_replica.cc:331] T dd40af6d9f9b4ae2ab31241b28f3b002 P ac714929b11c43d482b5920a2a5b9129: stopping tablet replica
I20250625 03:32:47.550478 426 raft_consensus.cc:2241] T dd40af6d9f9b4ae2ab31241b28f3b002 P ac714929b11c43d482b5920a2a5b9129 [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:32:47.551273 426 raft_consensus.cc:2270] T dd40af6d9f9b4ae2ab31241b28f3b002 P ac714929b11c43d482b5920a2a5b9129 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:47.553272 426 tablet_replica.cc:331] T 95a70da0935d43aba7bf794c38763425 P ac714929b11c43d482b5920a2a5b9129: stopping tablet replica
I20250625 03:32:47.553752 426 raft_consensus.cc:2241] T 95a70da0935d43aba7bf794c38763425 P ac714929b11c43d482b5920a2a5b9129 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:47.554145 426 raft_consensus.cc:2270] T 95a70da0935d43aba7bf794c38763425 P ac714929b11c43d482b5920a2a5b9129 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:47.556164 426 tablet_replica.cc:331] T 9d744327c3714ed99169ee010b3a1eb7 P ac714929b11c43d482b5920a2a5b9129: stopping tablet replica
I20250625 03:32:47.556629 426 raft_consensus.cc:2241] T 9d744327c3714ed99169ee010b3a1eb7 P ac714929b11c43d482b5920a2a5b9129 [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:32:47.557379 426 raft_consensus.cc:2270] T 9d744327c3714ed99169ee010b3a1eb7 P ac714929b11c43d482b5920a2a5b9129 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:47.559417 426 tablet_replica.cc:331] T aaeeb3012a8c4a77a8359268c32d1abc P ac714929b11c43d482b5920a2a5b9129: stopping tablet replica
I20250625 03:32:47.559906 426 raft_consensus.cc:2241] T aaeeb3012a8c4a77a8359268c32d1abc P ac714929b11c43d482b5920a2a5b9129 [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:32:47.560742 426 raft_consensus.cc:2270] T aaeeb3012a8c4a77a8359268c32d1abc P ac714929b11c43d482b5920a2a5b9129 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:47.562793 426 tablet_replica.cc:331] T f586c1c904ee41f785ba350b68057810 P ac714929b11c43d482b5920a2a5b9129: stopping tablet replica
I20250625 03:32:47.563259 426 raft_consensus.cc:2241] T f586c1c904ee41f785ba350b68057810 P ac714929b11c43d482b5920a2a5b9129 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:47.563650 426 raft_consensus.cc:2270] T f586c1c904ee41f785ba350b68057810 P ac714929b11c43d482b5920a2a5b9129 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:47.565917 426 tablet_replica.cc:331] T 8014b6301211413cbbe6a34e60213b1f P ac714929b11c43d482b5920a2a5b9129: stopping tablet replica
I20250625 03:32:47.566416 426 raft_consensus.cc:2241] T 8014b6301211413cbbe6a34e60213b1f P ac714929b11c43d482b5920a2a5b9129 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:47.566813 426 raft_consensus.cc:2270] T 8014b6301211413cbbe6a34e60213b1f P ac714929b11c43d482b5920a2a5b9129 [term 3 FOLLOWER]: Raft consensus is shut down!
W20250625 03:32:47.580062 5662 consensus_peers.cc:487] T ec327833dcb74b6b8679315df6d60ac5 P 5a67f69245d14aa395dd7410912ee2d5 -> Peer ac714929b11c43d482b5920a2a5b9129 (127.0.106.130:39845): Couldn't send request to peer ac714929b11c43d482b5920a2a5b9129. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250625 03:32:47.609694 426 tablet_server.cc:195] TabletServer@127.0.106.130:0 shutdown complete.
W20250625 03:32:47.624853 5662 consensus_peers.cc:487] T bd204f74bbbf45218051c05c8d3a32c1 P 5a67f69245d14aa395dd7410912ee2d5 -> Peer ac714929b11c43d482b5920a2a5b9129 (127.0.106.130:39845): Couldn't send request to peer ac714929b11c43d482b5920a2a5b9129. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.130:39845: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250625 03:32:47.643712 5662 consensus_peers.cc:487] T 8014b6301211413cbbe6a34e60213b1f P 5a67f69245d14aa395dd7410912ee2d5 -> Peer ac714929b11c43d482b5920a2a5b9129 (127.0.106.130:39845): Couldn't send request to peer ac714929b11c43d482b5920a2a5b9129. Status: Network error: Client connection negotiation failed: client connection to 127.0.106.130:39845: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250625 03:32:47.649904 426 tablet_server.cc:178] TabletServer@127.0.106.131:0 shutting down...
I20250625 03:32:47.681062 426 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250625 03:32:47.681799 426 tablet_replica.cc:331] T 70076edadb434d5a8d584361780928bc P 5a67f69245d14aa395dd7410912ee2d5: stopping tablet replica
I20250625 03:32:47.683007 426 raft_consensus.cc:2241] T 70076edadb434d5a8d584361780928bc P 5a67f69245d14aa395dd7410912ee2d5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:47.683835 426 raft_consensus.cc:2270] T 70076edadb434d5a8d584361780928bc P 5a67f69245d14aa395dd7410912ee2d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:47.686091 426 tablet_replica.cc:331] T bd204f74bbbf45218051c05c8d3a32c1 P 5a67f69245d14aa395dd7410912ee2d5: stopping tablet replica
I20250625 03:32:47.686674 426 raft_consensus.cc:2241] T bd204f74bbbf45218051c05c8d3a32c1 P 5a67f69245d14aa395dd7410912ee2d5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:32:47.687469 426 raft_consensus.cc:2270] T bd204f74bbbf45218051c05c8d3a32c1 P 5a67f69245d14aa395dd7410912ee2d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:47.689603 426 tablet_replica.cc:331] T bbf810309eb949ff880839714444d55f P 5a67f69245d14aa395dd7410912ee2d5: stopping tablet replica
I20250625 03:32:47.690168 426 raft_consensus.cc:2241] T bbf810309eb949ff880839714444d55f P 5a67f69245d14aa395dd7410912ee2d5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:47.690639 426 raft_consensus.cc:2270] T bbf810309eb949ff880839714444d55f P 5a67f69245d14aa395dd7410912ee2d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:47.692813 426 tablet_replica.cc:331] T 267de6f0358a4e9f894a10a091cd8efc P 5a67f69245d14aa395dd7410912ee2d5: stopping tablet replica
I20250625 03:32:47.693285 426 raft_consensus.cc:2241] T 267de6f0358a4e9f894a10a091cd8efc P 5a67f69245d14aa395dd7410912ee2d5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:47.693719 426 raft_consensus.cc:2270] T 267de6f0358a4e9f894a10a091cd8efc P 5a67f69245d14aa395dd7410912ee2d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:47.695785 426 tablet_replica.cc:331] T 6026baaaf75a465aab3b95d3ada761c2 P 5a67f69245d14aa395dd7410912ee2d5: stopping tablet replica
I20250625 03:32:47.696372 426 raft_consensus.cc:2241] T 6026baaaf75a465aab3b95d3ada761c2 P 5a67f69245d14aa395dd7410912ee2d5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:47.696805 426 raft_consensus.cc:2270] T 6026baaaf75a465aab3b95d3ada761c2 P 5a67f69245d14aa395dd7410912ee2d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:47.698859 426 tablet_replica.cc:331] T c7d0e4d719d3491199afddf8ff1204e0 P 5a67f69245d14aa395dd7410912ee2d5: stopping tablet replica
I20250625 03:32:47.699422 426 raft_consensus.cc:2241] T c7d0e4d719d3491199afddf8ff1204e0 P 5a67f69245d14aa395dd7410912ee2d5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:47.699841 426 raft_consensus.cc:2270] T c7d0e4d719d3491199afddf8ff1204e0 P 5a67f69245d14aa395dd7410912ee2d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:47.701853 426 tablet_replica.cc:331] T 786290ddcf094479800ece947612d482 P 5a67f69245d14aa395dd7410912ee2d5: stopping tablet replica
I20250625 03:32:47.702322 426 raft_consensus.cc:2241] T 786290ddcf094479800ece947612d482 P 5a67f69245d14aa395dd7410912ee2d5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:47.702754 426 raft_consensus.cc:2270] T 786290ddcf094479800ece947612d482 P 5a67f69245d14aa395dd7410912ee2d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:47.704802 426 tablet_replica.cc:331] T 8014b6301211413cbbe6a34e60213b1f P 5a67f69245d14aa395dd7410912ee2d5: stopping tablet replica
I20250625 03:32:47.705303 426 raft_consensus.cc:2241] T 8014b6301211413cbbe6a34e60213b1f P 5a67f69245d14aa395dd7410912ee2d5 [term 3 LEADER]: Raft consensus shutting down.
I20250625 03:32:47.706089 426 raft_consensus.cc:2270] T 8014b6301211413cbbe6a34e60213b1f P 5a67f69245d14aa395dd7410912ee2d5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:47.708195 426 tablet_replica.cc:331] T 95a70da0935d43aba7bf794c38763425 P 5a67f69245d14aa395dd7410912ee2d5: stopping tablet replica
I20250625 03:32:47.708717 426 raft_consensus.cc:2241] T 95a70da0935d43aba7bf794c38763425 P 5a67f69245d14aa395dd7410912ee2d5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:47.709097 426 raft_consensus.cc:2270] T 95a70da0935d43aba7bf794c38763425 P 5a67f69245d14aa395dd7410912ee2d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:47.710978 426 tablet_replica.cc:331] T 33bf1d07080f4096a5aa2b5daef743a6 P 5a67f69245d14aa395dd7410912ee2d5: stopping tablet replica
I20250625 03:32:47.711486 426 raft_consensus.cc:2241] T 33bf1d07080f4096a5aa2b5daef743a6 P 5a67f69245d14aa395dd7410912ee2d5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:47.711897 426 raft_consensus.cc:2270] T 33bf1d07080f4096a5aa2b5daef743a6 P 5a67f69245d14aa395dd7410912ee2d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:47.713812 426 tablet_replica.cc:331] T dd40af6d9f9b4ae2ab31241b28f3b002 P 5a67f69245d14aa395dd7410912ee2d5: stopping tablet replica
I20250625 03:32:47.714290 426 raft_consensus.cc:2241] T dd40af6d9f9b4ae2ab31241b28f3b002 P 5a67f69245d14aa395dd7410912ee2d5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:47.714717 426 raft_consensus.cc:2270] T dd40af6d9f9b4ae2ab31241b28f3b002 P 5a67f69245d14aa395dd7410912ee2d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:47.716671 426 tablet_replica.cc:331] T 3857bc0f026242499856f49c07bccf36 P 5a67f69245d14aa395dd7410912ee2d5: stopping tablet replica
I20250625 03:32:47.717131 426 raft_consensus.cc:2241] T 3857bc0f026242499856f49c07bccf36 P 5a67f69245d14aa395dd7410912ee2d5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:47.717509 426 raft_consensus.cc:2270] T 3857bc0f026242499856f49c07bccf36 P 5a67f69245d14aa395dd7410912ee2d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:47.719437 426 tablet_replica.cc:331] T ec327833dcb74b6b8679315df6d60ac5 P 5a67f69245d14aa395dd7410912ee2d5: stopping tablet replica
I20250625 03:32:47.719895 426 raft_consensus.cc:2241] T ec327833dcb74b6b8679315df6d60ac5 P 5a67f69245d14aa395dd7410912ee2d5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 03:32:47.720718 426 raft_consensus.cc:2270] T ec327833dcb74b6b8679315df6d60ac5 P 5a67f69245d14aa395dd7410912ee2d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:47.722762 426 tablet_replica.cc:331] T b01160bf577842c485d19170bfcb2946 P 5a67f69245d14aa395dd7410912ee2d5: stopping tablet replica
I20250625 03:32:47.723312 426 raft_consensus.cc:2241] T b01160bf577842c485d19170bfcb2946 P 5a67f69245d14aa395dd7410912ee2d5 [term 3 LEADER]: Raft consensus shutting down.
I20250625 03:32:47.724195 426 raft_consensus.cc:2270] T b01160bf577842c485d19170bfcb2946 P 5a67f69245d14aa395dd7410912ee2d5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:47.726181 426 tablet_replica.cc:331] T aaeeb3012a8c4a77a8359268c32d1abc P 5a67f69245d14aa395dd7410912ee2d5: stopping tablet replica
I20250625 03:32:47.726644 426 raft_consensus.cc:2241] T aaeeb3012a8c4a77a8359268c32d1abc P 5a67f69245d14aa395dd7410912ee2d5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:47.727065 426 raft_consensus.cc:2270] T aaeeb3012a8c4a77a8359268c32d1abc P 5a67f69245d14aa395dd7410912ee2d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:47.729079 426 tablet_replica.cc:331] T f586c1c904ee41f785ba350b68057810 P 5a67f69245d14aa395dd7410912ee2d5: stopping tablet replica
I20250625 03:32:47.729519 426 raft_consensus.cc:2241] T f586c1c904ee41f785ba350b68057810 P 5a67f69245d14aa395dd7410912ee2d5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:47.729918 426 raft_consensus.cc:2270] T f586c1c904ee41f785ba350b68057810 P 5a67f69245d14aa395dd7410912ee2d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:47.731568 426 tablet_replica.cc:331] T 9d744327c3714ed99169ee010b3a1eb7 P 5a67f69245d14aa395dd7410912ee2d5: stopping tablet replica
I20250625 03:32:47.731985 426 raft_consensus.cc:2241] T 9d744327c3714ed99169ee010b3a1eb7 P 5a67f69245d14aa395dd7410912ee2d5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:47.732404 426 raft_consensus.cc:2270] T 9d744327c3714ed99169ee010b3a1eb7 P 5a67f69245d14aa395dd7410912ee2d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:47.734146 426 tablet_replica.cc:331] T 09262e1d4d2346d1b9610e857b693324 P 5a67f69245d14aa395dd7410912ee2d5: stopping tablet replica
I20250625 03:32:47.734560 426 raft_consensus.cc:2241] T 09262e1d4d2346d1b9610e857b693324 P 5a67f69245d14aa395dd7410912ee2d5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 03:32:47.735008 426 raft_consensus.cc:2270] T 09262e1d4d2346d1b9610e857b693324 P 5a67f69245d14aa395dd7410912ee2d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:47.789561 426 tablet_server.cc:195] TabletServer@127.0.106.131:0 shutdown complete.
I20250625 03:32:47.823829 426 master.cc:561] Master@127.0.106.190:39897 shutting down...
I20250625 03:32:47.850371 426 raft_consensus.cc:2241] T 00000000000000000000000000000000 P 789cd038419c47e9882fb6ffdbae958a [term 2 LEADER]: Raft consensus shutting down.
I20250625 03:32:47.850993 426 raft_consensus.cc:2270] T 00000000000000000000000000000000 P 789cd038419c47e9882fb6ffdbae958a [term 2 FOLLOWER]: Raft consensus is shut down!
I20250625 03:32:47.851329 426 tablet_replica.cc:331] T 00000000000000000000000000000000 P 789cd038419c47e9882fb6ffdbae958a: stopping tablet replica
I20250625 03:32:47.872596 426 master.cc:583] Master@127.0.106.190:39897 shutdown complete.
[ OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (21973 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (42763 ms total)
[----------] Global test environment tear-down
[==========] 7 tests from 2 test suites ran. (201046 ms total)
[ PASSED ] 5 tests.
[ SKIPPED ] 1 test, listed below:
[ SKIPPED ] LeaderRebalancerTest.TestMaintenanceMode
[ FAILED ] 1 test, listed below:
[ FAILED ] LeaderRebalancerTest.RestartTserver
1 FAILED TEST
I20250625 03:32:47.930119 426 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 2238 messages since previous log ~365 seconds ago
I20250625 03:32:47.930354 426 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 2238 messages since previous log ~365 seconds ago
I20250625 03:32:47.930529 426 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 2233 messages since previous log ~365 seconds ago
I20250625 03:32:47.930714 426 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/tserver/ts_tablet_manager.cc:594: suppressed but not reported on 44 messages since previous log ~63 seconds ago
I20250625 03:32:47.930886 426 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/tserver/ts_tablet_manager.cc:542: suppressed but not reported on 44 messages since previous log ~64 seconds ago
I20250625 03:32:47.931103 426 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 10 messages since previous log ~0 seconds ago
I20250625 03:32:47.931403 426 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/tablet/tablet.cc:2378: suppressed but not reported on 106 messages since previous log ~41 seconds ago